2023-12-22T08:57:06.203 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T08:57:06.204 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi --owner scheduled_rishabh@teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --verbose --archive /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499376 -- /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499376/orig.config.yaml 2023-12-22T08:57:06.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:57:06.337 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499376 branch: rishabh-mdscap-reef description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: null first_in_suite: false job_id: '7499376' kernel: client: branch: testing flavor: default kdb: true sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mdscap-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mdscap-reef sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 9974 sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c sleep_before_teardown: 0 subset: 301/512 suite: fs suite_branch: rishabh-mdscap-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCa+j7yH7UB9Md7fE8VZAmvOc29D7+9np8OKX/Mgca+AlseXlhI20SPzrYPZS68b9s+gNYdxk3drot6bOHy+H78= smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh8rvQ6Xhm/F5i+tlVJEymePkA4otQSgJf/2x3Sa3o3O94SZNHATy/kXQBMI9k7ZVkms3TtlZmb2yhR0b8qc18= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9680d2aba1e76f64ade295c81599c97907457848 timestamp: 2023-12-22_08:10:43 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-22T08:57:06.337 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa; will attempt to use it 2023-12-22T08:57:06.338 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks 2023-12-22T08:57:06.338 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-22T08:57:06.340 INFO:teuthology.task.internal:Checking packages... 2023-12-22T08:57:06.363 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '24e2e32ab893c11f7e31ee84381b2f961d1b317c' 2023-12-22T08:57:06.363 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-22T08:57:06.363 INFO:teuthology.packaging:ref: None 2023-12-22T08:57:06.363 INFO:teuthology.packaging:tag: None 2023-12-22T08:57:06.363 INFO:teuthology.packaging:branch: rishabh-mdscap-reef 2023-12-22T08:57:06.363 INFO:teuthology.packaging:sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:57:06.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mdscap-reef 2023-12-22T08:57:06.585 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1377.g24e2e32a 2023-12-22T08:57:06.586 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-22T08:57:06.593 INFO:teuthology.task.internal:no buildpackages task found 2023-12-22T08:57:06.593 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-22T08:57:06.608 INFO:teuthology.task.internal:Saving configuration 2023-12-22T08:57:06.624 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-22T08:57:06.630 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:57:06.653 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499376', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:52:12.540274', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCa+j7yH7UB9Md7fE8VZAmvOc29D7+9np8OKX/Mgca+AlseXlhI20SPzrYPZS68b9s+gNYdxk3drot6bOHy+H78='} 2023-12-22T08:57:06.676 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499376', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:52:12.538204', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh8rvQ6Xhm/F5i+tlVJEymePkA4otQSgJf/2x3Sa3o3O94SZNHATy/kXQBMI9k7ZVkms3TtlZmb2yhR0b8qc18='} 2023-12-22T08:57:06.676 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-22T08:57:06.682 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-22T08:57:06.682 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-12-22T08:57:06.682 INFO:teuthology.run_tasks:Running task console_log... 2023-12-22T08:57:06.796 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f84335c7dc0>, signals=[15]) 2023-12-22T08:57:06.796 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-22T08:57:06.802 INFO:teuthology.task.internal:Opening connections... 2023-12-22T08:57:06.802 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2023-12-22T08:57:06.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:57:06.893 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T08:57:06.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:57:06.978 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-22T08:57:06.984 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2023-12-22T08:57:07.002 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2023-12-22T08:57:07.002 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2023-12-22T08:57:07.061 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T08:57:07.062 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:57:07.063 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2023-12-22T08:57:07.087 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-12-22T08:57:07.104 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-12-22T08:57:07.104 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-12-22T08:57:07.160 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T08:57:07.161 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:57:07.162 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-12-22T08:57:07.186 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-22T08:57:07.195 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-22T08:57:07.200 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-22T08:57:07.200 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2023-12-22T08:57:07.203 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2023-12-22T08:57:07.219 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-22T08:57:07.225 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-22T08:57:07.225 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2023-12-22T08:57:07.264 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2023-12-22T08:57:07.374 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-22T08:57:07.428 INFO:teuthology.run_tasks:Running task kernel... 2023-12-22T08:57:07.442 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'} 2023-12-22T08:57:07.442 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-12-22T08:57:07.442 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-22T08:57:07.443 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-22T08:57:07.443 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-22T08:57:07.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:57:07.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-22T08:57:07.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:57:07.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-22T08:57:07.654 DEBUG:teuthology.task.kernel:sha1 for client.1 is 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:57:07.654 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "623393c9d50c04c7ea1d88824b8e92712e3e5611"... 2023-12-22T08:57:07.655 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-12-22T08:57:07.665 DEBUG:teuthology.task.kernel:sha1 for client.0 is 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:57:07.665 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "623393c9d50c04c7ea1d88824b8e92712e3e5611"... 2023-12-22T08:57:07.665 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2023-12-22T08:57:07.671 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-361.el9.x86_64 2023-12-22T08:57:07.671 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:57:07.672 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-22T08:57:07.672 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum upgrade -y linux-firmware 2023-12-22T08:57:07.682 INFO:teuthology.orchestra.run.smithi106.stdout:5.14.0-361.el9.x86_64 2023-12-22T08:57:07.682 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:57:07.682 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-22T08:57:07.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum upgrade -y linux-firmware 2023-12-22T08:57:09.903 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-22T08:57:09.922 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-22T08:57:11.295 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2023-12-22T08:57:11.538 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2023-12-22T08:57:12.604 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-12-22T08:57:13.069 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 7.9 MB 00:01 2023-12-22T08:57:14.538 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 21 MB/s | 18 MB 00:00 2023-12-22T08:57:15.937 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-12-22T08:57:18.389 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-12-22T08:57:19.898 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 15 kB 00:00 2023-12-22T08:57:20.579 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 5.8 MB 00:01 2023-12-22T08:57:21.710 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-22T08:57:22.105 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2023-12-22T08:57:23.556 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2023-12-22T08:57:26.632 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2023-12-22T08:57:28.631 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 5.1 kB/s | 1.7 kB 00:00 2023-12-22T08:57:28.994 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2023-12-22T08:57:29.005 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2023-12-22T08:57:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2023-12-22T08:57:29.005 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2023-12-22T08:57:29.005 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2023-12-22T08:57:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-22T08:57:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T08:57:29.006 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2023-12-22T08:57:29.006 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2023-12-22T08:57:29.006 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 1 Package 2023-12-22T08:57:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T08:57:29.006 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 328 M 2023-12-22T08:57:29.006 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2023-12-22T08:57:31.012 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-12-22T08:57:31.026 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-12-22T08:57:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2023-12-22T08:57:31.026 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-12-22T08:57:31.026 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2023-12-22T08:57:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-22T08:57:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T08:57:31.027 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2023-12-22T08:57:31.027 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-12-22T08:57:31.027 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 1 Package 2023-12-22T08:57:31.027 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T08:57:31.027 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 328 M 2023-12-22T08:57:31.027 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2023-12-22T08:57:37.932 INFO:teuthology.orchestra.run.smithi132.stdout:linux-firmware-20231030-141.el9.noarch.rpm 48 MB/s | 328 MB 00:06 2023-12-22T08:57:37.933 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:57:37.933 INFO:teuthology.orchestra.run.smithi132.stdout:Total 48 MB/s | 328 MB 00:06 2023-12-22T08:57:37.933 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2023-12-22T08:57:38.017 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2023-12-22T08:57:38.017 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2023-12-22T08:57:38.283 INFO:teuthology.orchestra.run.smithi106.stdout:linux-firmware-20231030-141.el9.noarch.rpm 35 MB/s | 328 MB 00:09 2023-12-22T08:57:38.284 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:57:38.284 INFO:teuthology.orchestra.run.smithi106.stdout:Total 35 MB/s | 328 MB 00:09 2023-12-22T08:57:38.285 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2023-12-22T08:57:38.373 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2023-12-22T08:57:38.373 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2023-12-22T08:57:40.151 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2023-12-22T08:57:40.151 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2023-12-22T08:57:40.497 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2023-12-22T08:57:40.497 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2023-12-22T08:57:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2023-12-22T08:57:46.326 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:57:46.421 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:57:46.523 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2023-12-22T08:57:46.964 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:57:47.065 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:57:47.463 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:57:47.463 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:57:47.875 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:57:47.875 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T08:57:47.875 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2023-12-22T08:57:47.875 INFO:teuthology.orchestra.run.smithi132.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-22T08:57:47.875 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T08:57:47.875 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-12-22T08:57:48.055 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:57:48.055 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:57:48.153 INFO:teuthology.task.kernel:Downloading kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.1... 2023-12-22T08:57:48.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:57:48.374 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ 2023-12-22T08:57:48.374 DEBUG:teuthology.orchestra.run.smithi132:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g623393c9d50c-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-22T08:57:48.377 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi132.front.sepia.ceph.com to complete... 2023-12-22T08:57:48.479 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:57:48.480 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T08:57:48.480 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2023-12-22T08:57:48.480 INFO:teuthology.orchestra.run.smithi106.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-22T08:57:48.480 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T08:57:48.480 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2023-12-22T08:57:48.773 INFO:teuthology.task.kernel:Downloading kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.0... 2023-12-22T08:57:48.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:57:48.908 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ 2023-12-22T08:57:48.909 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g623393c9d50c-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-22T08:57:48.911 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi106.front.sepia.ceph.com to complete... 2023-12-22T08:58:05.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22 08:58:05 URL:https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/kernel-6.6.0_g623393c9d50c-1.x86_64.rpm [320178570/320178570] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-22T08:58:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:FINISHED --2023-12-22 08:58:05-- 2023-12-22T08:58:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:Total wall clock time: 17s 2023-12-22T08:58:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:Downloaded: 1 files, 305M in 17s (18.1 MB/s) 2023-12-22T08:58:05.672 INFO:teuthology.task.kernel:Installing kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.1... 2023-12-22T08:58:05.672 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-22T08:58:07.512 INFO:teuthology.orchestra.run.smithi132.stdout:Verifying... ######################################## 2023-12-22T08:58:07.594 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing... ######################################## 2023-12-22T08:58:07.673 INFO:teuthology.orchestra.run.smithi132.stdout:Updating / installing... 2023-12-22T08:58:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22 08:58:10 URL:https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/kernel-6.6.0_g623393c9d50c-1.x86_64.rpm [320178570/320178570] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-22T08:58:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:FINISHED --2023-12-22 08:58:10-- 2023-12-22T08:58:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:Total wall clock time: 21s 2023-12-22T08:58:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:Downloaded: 1 files, 305M in 21s (14.6 MB/s) 2023-12-22T08:58:10.242 INFO:teuthology.task.kernel:Installing kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.0... 2023-12-22T08:58:10.242 DEBUG:teuthology.orchestra.run.smithi106:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-22T08:58:12.083 INFO:teuthology.orchestra.run.smithi106.stdout:Verifying... ######################################## 2023-12-22T08:58:12.131 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing... ######################################## 2023-12-22T08:58:12.209 INFO:teuthology.orchestra.run.smithi106.stdout:Updating / installing... 2023-12-22T08:58:14.739 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-6.6.0_g623393c9d50c-1 ######################################## 2023-12-22T08:58:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-6.6.0_g623393c9d50c-1 ######################################## 2023-12-22T08:58:30.429 INFO:teuthology.orchestra.run.smithi132.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-22T08:58:34.352 INFO:teuthology.orchestra.run.smithi106.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-22T08:58:51.682 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-22T08:58:51.683 DEBUG:teuthology.orchestra.run.smithi132:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-22T08:58:51.760 INFO:teuthology.orchestra.run.smithi132.stdout:/boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:58:51.761 INFO:teuthology.orchestra.run.smithi132.stdout:/boot/config-6.6.0-g623393c9d50c 2023-12-22T08:58:51.761 INFO:teuthology.orchestra.run.smithi132.stdout:/boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T08:58:51.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c 2023-12-22T08:58:51.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel 2023-12-22T08:58:51.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch 2023-12-22T08:58:51.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86 2023-12-22T08:58:51.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto 2023-12-22T08:58:51.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-22T08:58:51.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-22T08:58:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm 2023-12-22T08:58:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ansi_cprng.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/anubis.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/arc4.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_memcpy.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_pq.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_tx.ko 2023-12-22T08:58:51.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_xor.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/raid6test.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authenc.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authencesn.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blake2b_generic.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_common.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_generic.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/camellia_generic.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast5_generic.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast6_generic.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast_common.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ccm.ko 2023-12-22T08:58:51.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cmac.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crc32_generic.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_engine.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_user.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cts.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/des_generic.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/dh_generic.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/echainiv.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/essiv.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/fcrypt.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/khazad.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4.ko 2023-12-22T08:58:51.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4hc.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/md4.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/michael_mic.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcbc.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcrypt.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/rmd160.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/seed.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/serpent_generic.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tcrypt.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tea.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_common.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_generic.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/vmac.ko 2023-12-22T08:58:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/wp512.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xcbc.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xor.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xxhash_generic.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_pad.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/custom_method.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ec_sys.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/platform_profile.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbs.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbshc.ko 2023-12-22T08:58:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/video.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/acard-ahci.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci_platform.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ata_generic.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci_platform.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_acpi.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ali.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_amd.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_artop.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atiixp.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atp867x.ko 2023-12-22T08:58:51.769 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd640.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd64x.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cypress.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_efar.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt366.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt37x.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it8213.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it821x.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_jmicron.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_marvell.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_mpiix.ko 2023-12-22T08:58:51.770 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_netcell.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ninja32.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87410.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87415.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_oldpiix.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_opti.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_optidma.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pcmcia.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_piccolo.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rdc.ko 2023-12-22T08:58:51.771 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sch.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_serverworks.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sil680.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sis.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sl82c105.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_triflex.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_via.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pdc_adma.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_inic162x.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_mv.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_nv.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_promise.ko 2023-12-22T08:58:51.772 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_qstor.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil24.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sis.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_svw.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sx4.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_uli.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_via.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_vsc.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ks0108.ko 2023-12-22T08:58:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/bcma.ko 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/aoe.ko 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/brd.ko 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/drbd.ko 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/floppy.ko 2023-12-22T08:58:51.774 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/loop.ko 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/nbd.ko 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/null_blk.ko 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/pktcdvd.ko 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/rbd.ko 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/virtio_blk.ko 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkfront.ko 2023-12-22T08:58:51.775 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/zram.ko 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hangcheck-timer.ko 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/via-rng.ko 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-22T08:58:51.776 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/lp.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/mwave.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ppdev.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tlclk.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-22T08:58:51.777 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/uv_mmtimer.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/virtio_console.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto 2023-12-22T08:58:51.778 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp.ko 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-aes.ko 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-sha.ko 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio 2023-12-22T08:58:51.779 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/dca.ko 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/amd64_edac.ko 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/e752x_edac.ko 2023-12-22T08:58:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/edac_mce_amd.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3000_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3200_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5100_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5400_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7300_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7core_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i82975x_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ie31200_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/sb_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/x38_edac.ko 2023-12-22T08:58:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/edd.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ich.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-appleir.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-aureal.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-axff.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-dr.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elecom.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elo.ko 2023-12-22T08:58:51.782 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-emsff.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gaff.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gt683r.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gyration.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtekff.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-hyperv.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-icade.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-keytouch.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kye.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lcpower.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-led.ko 2023-12-22T08:58:51.783 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lenovo.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-multitouch.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ortek.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-penmount.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-petalynx.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-picolcd.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-pl.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-plantronics.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-primax.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-rmi.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-22T08:58:51.784 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-common.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-saitek.ko 2023-12-22T08:58:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-samsung.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sjoy.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sony.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-speedlink.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-steelseries.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sunplus.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tivo.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tmff.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-topseed.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-twinhan.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-uclogic.ko 2023-12-22T08:58:51.786 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-waltop.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-wiimote.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-xinmo.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zpff.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zydacron.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/uhid.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/wacom.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_balloon.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_utils.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_vmbus.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru.ko 2023-12-22T08:58:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru3.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7414.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7418.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adc128d818.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1025.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1026.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1029.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1031.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm9240.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ads7828.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7410.ko 2023-12-22T08:58:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7411.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7462.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7470.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7475.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7x10.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/amc6821.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/applesmc.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asb100.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asc7621.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/atxp1.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/coretemp.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-22T08:58:51.789 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dme1737.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds1621.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds620.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc1403.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc6w201.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71805f.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71882fg.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f75375s.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fam15h_power.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fschmd.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g760a.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g762.ko 2023-12-22T08:58:51.790 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl518sm.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl520sm.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5500_temp.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5k_amb.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmaem.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmpex.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina209.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina2xx.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/it87.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k10temp.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k8temp.ko 2023-12-22T08:58:51.791 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lineage-pem.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm63.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm73.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm75.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm77.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm78.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm80.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm83.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm85.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm87.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm90.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm92.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm93.ko 2023-12-22T08:58:51.792 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95234.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95241.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95245.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc2945.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4151.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4215.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4222.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4245.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4260.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4261.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max16065.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1619.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1668.ko 2023-12-22T08:58:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max197.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6639.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6650.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6697.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mcp3021.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6683.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775-core.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct7802.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87360.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87427.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pcf8591.ko 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus 2023-12-22T08:58:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-22T08:58:51.795 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/powr1220.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5627.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5636.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht15.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht21.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/shtc1.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sis5595.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47b397.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m1.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m192.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/thmc50.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp102.ko 2023-12-22T08:58:51.796 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp103.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp401.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp421.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via-cputemp.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via686a.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt1211.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt8231.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627ehf.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627hf.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83781d.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83791d.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83792d.ko 2023-12-22T08:58:51.797 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83793.ko 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83795.ko 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l785ts.ko 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l786ng.ko 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-22T08:58:51.798 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-22T08:58:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-dev.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-mux.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-smbus.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-stub.ko 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband 2023-12-22T08:58:51.800 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_core.ko 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4 2023-12-22T08:58:51.801 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp 2023-12-22T08:58:51.802 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/gameport.ko 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/joydev.ko 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/appletouch.ko 2023-12-22T08:58:51.803 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/bcm5974.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/cyapatp.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/sermouse.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/altera_ps2.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/arc_ps2.ko 2023-12-22T08:58:51.804 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serio_raw.ko 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/sparse-keymap.ko 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-blinkm.ko 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3530.ko 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp3944.ko 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-ss4200.ko 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger 2023-12-22T08:58:51.805 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/bcache.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bio-prison.ko 2023-12-22T08:58:51.806 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache-smq.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-crypt.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-delay.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-flakey.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log-userspace.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-multipath.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-queue-length.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-raid.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-round-robin.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-service-time.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-switch.ko 2023-12-22T08:58:51.807 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-thin-pool.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-verity.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/faulty.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/linear.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/multipath.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid0.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid1.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid10.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid456.ko 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion 2023-12-22T08:58:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptbase.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptctl.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptfc.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptlan.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptsas.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptscsih.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptspi.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_ich.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_sch.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mfd-core.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/sm501.ko 2023-12-22T08:58:51.809 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/viperboard.ko 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/vx855.ko 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wl1273-core.ko 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds9802als.ko 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds990x.ko 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/bh1770glc.ko 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/cb710.ko 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom 2023-12-22T08:58:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/at24.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/max6875.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/enclosure.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hpilo.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29003.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29020.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-me.ko 2023-12-22T08:58:51.811 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-txe.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_7xx1.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_core.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tsl2550.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_balloon.ko 2023-12-22T08:58:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/bonding.ko 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx 2023-12-22T08:58:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dummy.ko 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/eql.ko 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-22T08:58:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-22T08:58:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom 2023-12-22T08:58:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio 2023-12-22T08:58:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic 2023-12-22T08:58:51.818 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-22T08:58:51.819 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dnet.ko 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ethoc.ko 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fealnx.ko 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k 2023-12-22T08:58:51.820 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-22T08:58:51.821 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e 2023-12-22T08:58:51.821 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-22T08:58:51.821 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf 2023-12-22T08:58:51.821 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-22T08:58:51.821 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb 2023-12-22T08:58:51.821 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-22T08:58:51.821 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/jme.ko 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-22T08:58:51.822 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-22T08:58:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc 2023-12-22T08:58:51.824 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan 2023-12-22T08:58:51.825 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-22T08:58:51.826 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-22T08:58:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/geneve.ko 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ifb.ko 2023-12-22T08:58:51.828 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvlan.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvtap.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mii.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/net_failover.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/netconsole.ko 2023-12-22T08:58:51.829 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/nlmon.ko 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/amd.ko 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm87xx.ko 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/broadcom.ko 2023-12-22T08:58:51.830 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/cicada.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/davicom.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/dp83640.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/et1011c.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/icplus.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/lxt.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/marvell.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/micrel.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/national.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/phylink.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/qsemi.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/realtek.ko 2023-12-22T08:58:51.831 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/smsc.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ste10Xp.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/vitesse.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_async.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppoe.ko 2023-12-22T08:58:51.832 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppox.ko 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pptp.ko 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slhc.ko 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slip.ko 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sungem_phy.ko 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tap.ko 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team.ko 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-22T08:58:51.833 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_random.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tun.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/veth.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/virtio_net.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/vxlan.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netfront.ko 2023-12-22T08:58:51.834 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ntb.ko 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme-core.ko 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme.ko 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport.ko 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_cs.ko 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_pc.ko 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_serial.ko 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug 2023-12-22T08:58:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/xen-pcifront.ko 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/i82092.ko 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pd6729.ko 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform 2023-12-22T08:58:51.836 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acerhdf.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-22T08:58:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/hdaps.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel_ips.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-22T08:58:51.838 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi.ko 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps_parport.ko 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/pps_core.ko 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp 2023-12-22T08:58:51.839 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp_kvm.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-em3027.ko 2023-12-22T08:58:51.840 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max6900.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-22T08:58:51.841 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-x1205.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-9xxx.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-sas.ko 2023-12-22T08:58:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-xxxx.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/BusLogic.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/a100u2w.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/advansys.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/am53c974.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/atp870u.ko 2023-12-22T08:58:51.843 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/bfa.ko 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ch.ko 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-22T08:58:51.844 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dc395x.ko 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dmx3191d.ko 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r 2023-12-22T08:58:51.845 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esp_scsi.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/fnic.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hpsa.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hptiop.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hv_storvsc.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/initio.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ipr.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ips.ko 2023-12-22T08:58:51.846 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/isci.ko 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/libfc.ko 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi.ko 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/libsas.ko 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-22T08:58:51.847 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid.ko 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvumi.ko 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pmcraid.ko 2023-12-22T08:58:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla1280.ko 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/raid_class.ko 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_debug.ko 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-22T08:58:51.849 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ses.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/st.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/stex.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/virtio_scsi.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/wd719x.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ssb.ko 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target 2023-12-22T08:58:51.850 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_file.ko 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_iblock.ko 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_mod.ko 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_pscsi.ko 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_user.ko 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel 2023-12-22T08:58:51.851 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-22T08:58:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_gsm.ko 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_hdlc.ko 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/nozomi.ko 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250 2023-12-22T08:58:51.853 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/arc_uart.ko 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio.ko 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_aec.ko 2023-12-22T08:58:51.854 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_cif.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pci_generic.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_sercos3.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-acm.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usblp.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usbtmc.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/mdc800.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/microtek.ko 2023-12-22T08:58:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/adutux.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/appledisplay.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi26.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi62.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ezusb.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/idmouse.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/iowarrior.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ldusb.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/legousbtower.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-22T08:58:51.856 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usb3503.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usblcd.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/uss720.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/yurex.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-generic.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/aircable.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ark3116.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-22T08:58:51.857 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ch341.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cp210x.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cyberjack.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/empeg.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_ti.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipaq.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipw.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ir-usb.ko 2023-12-22T08:58:51.858 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mct_u232.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7720.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7840.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/navman.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/omninet.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/opticon.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/option.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/oti6858.ko 2023-12-22T08:58:51.859 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/pl2303.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcaux.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcserial.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/quatech2.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/safe_serial.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/sierra.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ssu100.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/symbolserial.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_debug.ko 2023-12-22T08:58:51.860 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/visor.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/whiteheat.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/uas.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-22T08:58:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-karma.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/usb-storage.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci 2023-12-22T08:58:51.862 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_net.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_scsi.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/apple_bl.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lcd.ko 2023-12-22T08:58:51.863 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio.ko 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_balloon.ko 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_mmio.ko 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci.ko 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_ring.ko 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2482.ko 2023-12-22T08:58:51.864 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2490.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-22T08:58:51.865 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/wire.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/hpwdt.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/i6300esb.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ib700wdt.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ibmasr.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-22T08:58:51.866 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it87_wdt.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/machzwd.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/nv_tco.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/softdog.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/via_wdt.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-22T08:58:51.867 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wdt_pci.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/xen_wdt.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-evtchn.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntalloc.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntdev.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-privcmd.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-22T08:58:51.868 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/9p.ko 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/affs.ko 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/befs.ko 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/binfmt_misc.ko 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/btrfs.ko 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/cachefiles.ko 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph 2023-12-22T08:58:51.869 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ceph.ko 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/coda.ko 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/cramfs.ko 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/dlm.ko 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/f2fs.ko 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/fat.ko 2023-12-22T08:58:51.870 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/msdos.ko 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/vfat.ko 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/fscache.ko 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/cuse.ko 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/fuse.ko 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/gfs2.ko 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/hfs.ko 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus 2023-12-22T08:58:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/hfsplus.ko 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/isofs.ko 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/jfs.ko 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/lockd.ko 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/minix.ko 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/netfs.ko 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout 2023-12-22T08:58:51.872 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfs.ko 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv3.ko 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv4.ko 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/grace.ko 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/nfs_acl.ko 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd 2023-12-22T08:58:51.873 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/nfsd.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/nilfs2.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-celtic.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-centeuro.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-croatian.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-cyrillic.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-gaelic.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-greek.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-iceland.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-inuit.ko 2023-12-22T08:58:51.874 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-roman.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-romanian.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-turkish.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1250.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1251.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1255.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp737.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp775.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp850.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp852.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp855.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp857.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp860.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp861.ko 2023-12-22T08:58:51.875 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp862.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp863.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp864.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp865.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp866.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp869.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp874.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp932.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp936.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp949.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp950.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_euc-jp.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-1.ko 2023-12-22T08:58:51.876 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-13.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-14.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-15.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-2.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-3.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-4.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-5.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-6.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-7.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-9.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-r.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-ru.ko 2023-12-22T08:58:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-u.ko 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_utf8.ko 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2.ko 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-22T08:58:51.878 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/overlay.ko 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ramoops.ko 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/reiserfs.ko 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/romfs.ko 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/cifs.ko 2023-12-22T08:58:51.879 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_arc4.ko 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_md4.ko 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/squashfs.ko 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/sysv.ko 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/udf.ko 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ufs.ko 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/xfs.ko 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel 2023-12-22T08:58:51.880 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu/rcutorture.ko 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/torture.ko 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/asn1_encoder.ko 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc-itu-t.ko 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc8.ko 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libarc4.ko 2023-12-22T08:58:51.881 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libdes.ko 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/libcrc32c.ko 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lru_cache.ko 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4_compress.ko 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4hc_compress.ko 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/cordic.ko 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/raid6_pq.ko 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_bm.ko 2023-12-22T08:58:51.882 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_fsm.ko 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_kmp.ko 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd/zstd_compress.ko 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm/hwpoison-inject.ko 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/6lowpan.ko 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_dest.ko 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_fragment.ko 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_hop.ko 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-22T08:58:51.883 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_mobility.ko 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_routing.ko 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_udp.ko 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/garp.ko 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/mrp.ko 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/p8022.ko 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/psnap.ko 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/stp.ko 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/8021q.ko 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p 2023-12-22T08:58:51.884 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_fd.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_rdma.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_virtio.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/batman-adv.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/br_netfilter.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/bridge.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-22T08:58:51.885 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-22T08:58:51.886 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtables.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/libceph.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/failover.ko 2023-12-22T08:58:51.887 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/pktgen.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_diag.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv4.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv6.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver/dns_resolver.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/dsa_core.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_brcm.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_dsa.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_none.ko 2023-12-22T08:58:51.888 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_trailer.ko 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154.ko 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ah4.ko 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/esp4.ko 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/fou.ko 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/gre.ko 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/inet_diag.ko 2023-12-22T08:58:51.889 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_gre.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_tunnel.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_vti.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipcomp.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipip.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-22T08:58:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-22T08:58:51.891 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_bic.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_dctcp.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_diag.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_highspeed.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_htcp.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_hybla.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_illinois.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_lp.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_scalable.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_vegas.ko 2023-12-22T08:58:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_veno.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_westwood.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_yeah.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tunnel4.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_diag.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_tunnel.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ah6.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/esp6.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/fou6.ko 2023-12-22T08:58:51.893 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_tunnel.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_vti.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ipcomp6.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-22T08:58:51.894 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-22T08:58:51.895 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/sit.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/tunnel6.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key/af_key.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_core.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-22T08:58:51.896 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_eth.ko 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip.ko 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip6.ko 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_netlink.ko 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ppp.ko 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc.ko 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/mac802154.ko 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/mpls_gso.ko 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter 2023-12-22T08:58:51.897 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-22T08:58:51.898 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-22T08:58:51.899 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conncount.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-22T08:58:51.900 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-22T08:58:51.901 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_log_syslog.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_irc.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_sip.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_tables.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_log.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-22T08:58:51.902 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_chain_nat.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_compat.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_ct.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fib.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_hash.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_limit.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_log.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_masq.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_nat.ko 2023-12-22T08:58:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_numgen.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_queue.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_quota.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_redir.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject_inet.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_socket.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_tunnel.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_AUDIT.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CT.ko 2023-12-22T08:58:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_DSCP.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HL.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HMARK.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LED.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LOG.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NETMAP.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFLOG.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_RATEEST.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-22T08:58:51.905 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_SECMARK.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TEE.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TPROXY.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TRACE.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_addrtype.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_bpf.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cgroup.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cluster.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_comment.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connbytes.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlabel.ko 2023-12-22T08:58:51.906 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlimit.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connmark.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_conntrack.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cpu.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dccp.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_devgroup.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dscp.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ecn.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_esp.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hashlimit.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_helper.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hl.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipcomp.ko 2023-12-22T08:58:51.907 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_iprange.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipvs.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_l2tp.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_length.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_limit.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mac.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mark.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_multiport.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nat.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nfacct.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_osf.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_owner.ko 2023-12-22T08:58:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_physdev.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_pkttype.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_policy.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_quota.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_rateest.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_realm.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_recent.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_sctp.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_set.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_socket.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_state.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_statistic.ko 2023-12-22T08:58:51.909 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_string.ko 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpmss.ko 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_time.ko 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_u32.ko 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/netlink_diag.ko 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/nsh.ko 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/openvswitch.ko 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-geneve.ko 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-gre.ko 2023-12-22T08:58:51.910 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-vxlan.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/af_packet_diag.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_rdma.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_tcp.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_csum.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_gact.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_ipt.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_mirred.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_nat.ko 2023-12-22T08:58:51.911 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_pedit.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_police.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_simple.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_skbedit.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_vlan.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_basic.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_bpf.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_flow.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_fw.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_route.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_u32.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_cmp.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_ipset.ko 2023-12-22T08:58:51.912 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_meta.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_nbyte.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_text.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_u32.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_choke.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_codel.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_drr.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_gred.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hfsc.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hhf.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_htb.ko 2023-12-22T08:58:51.913 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_ingress.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio_lib.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_multiq.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_netem.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_pie.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_plug.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_prio.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_qfq.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_red.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfb.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfq.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_tbf.ko 2023-12-22T08:58:51.914 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_teql.ko 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp.ko 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp_diag.ko 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/sunrpc.ko 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc 2023-12-22T08:58:51.915 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/diag.ko 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/tipc.ko 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/unix_diag.ko 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock.ko 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-22T08:58:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys/trusted.ko 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/irqbypass.ko 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias.bin 2023-12-22T08:58:51.917 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.alias.bin 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.bin 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.modinfo 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep.bin 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.devname 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.order 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.softdep 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols 2023-12-22T08:58:51.918 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols.bin 2023-12-22T08:58:51.919 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g623393c9d50c 2023-12-22T08:58:51.919 DEBUG:teuthology.orchestra.run.smithi132:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:postinstall scriptlet (using /bin/sh): 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g623393c9d50c -a -r /boot/System.map-6.6.0-g623393c9d50c ]; then 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:cp /boot/vmlinuz-6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:cp /boot/System.map-6.6.0-g623393c9d50c /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:rm -f /boot/vmlinuz-6.6.0-g623393c9d50c /boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:/sbin/installkernel 6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:rm -f /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:fi 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-22T08:58:51.942 INFO:teuthology.orchestra.run.smithi132.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-22T08:58:51.943 INFO:teuthology.orchestra.run.smithi132.stdout:new-kernel-pkg --remove 6.6.0-g623393c9d50c --rminitrd --initrdfile=/boot/initramfs-6.6.0-g623393c9d50c.img 2023-12-22T08:58:51.943 INFO:teuthology.orchestra.run.smithi132.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-22T08:58:51.943 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-install remove 6.6.0-g623393c9d50c 2023-12-22T08:58:51.943 INFO:teuthology.orchestra.run.smithi132.stdout:fi 2023-12-22T08:58:51.943 INFO:teuthology.orchestra.run.smithi132.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-22T08:58:51.943 INFO:teuthology.orchestra.run.smithi132.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-22T08:58:51.943 INFO:teuthology.orchestra.run.smithi132.stdout:/sbin/update-bootloader --remove 6.6.0-g623393c9d50c 2023-12-22T08:58:51.943 INFO:teuthology.orchestra.run.smithi132.stdout:fi 2023-12-22T08:58:51.944 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2-tools 2023-12-22T08:58:52.019 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2-tools 2023-12-22T08:58:52.019 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2023-12-22T08:58:52.019 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.06 2023-12-22T08:58:52.019 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 68.el9 2023-12-22T08:58:52.019 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2023-12-22T08:58:52.019 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-22T08:58:52.019 INFO:teuthology.orchestra.run.smithi132.stdout:Group : Unspecified 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 8264254 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : builder@centos.org 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : CentOS 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Support tools for GRUB. 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T08:58:52.020 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-22T08:58:52.021 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-22T08:58:52.021 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-22T08:58:52.021 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2023-12-22T08:58:52.021 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T08:58:52.021 INFO:teuthology.orchestra.run.smithi132.stdout:This subpackage provides tools for support of all platforms. 2023-12-22T08:58:52.022 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-22T08:58:52.022 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 6.6.0-g623393c9d50c 2023-12-22T08:58:52.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-22T08:58:52.675 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2023-12-22T08:58:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-22T08:58:54.023 INFO:teuthology.orchestra.run.smithi132.stderr:done 2023-12-22T08:58:54.026 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-12-22T08:58:54.040 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.Chh2yt1AaE 2023-12-22T08:58:54.040 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Chh2yt1AaE 2023-12-22T08:58:54.109 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.Chh2yt1AaE 2023-12-22T08:58:54.250 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.Chh2yt1AaE is 6KB 2023-12-22T08:58:54.269 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.Chh2yt1AaE 2023-12-22T08:58:54.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo /bin/ls /boot/loader/entries || true 2023-12-22T08:58:54.348 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-22T08:58:54.348 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-22T08:58:54.349 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-22T08:58:54.349 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c.conf 2023-12-22T08:58:54.350 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c 2023-12-22T08:58:54.515 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2023-12-22T08:58:55.529 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-22T08:58:55.529 DEBUG:teuthology.orchestra.run.smithi106:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/boot/config-6.6.0-g623393c9d50c 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-22T08:58:55.610 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-22T08:58:55.611 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm.ko 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ansi_cprng.ko 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/anubis.ko 2023-12-22T08:58:55.612 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/arc4.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_memcpy.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_pq.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_tx.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_xor.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/raid6test.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authenc.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authencesn.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blake2b_generic.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_common.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_generic.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/camellia_generic.ko 2023-12-22T08:58:55.613 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast5_generic.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast6_generic.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast_common.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ccm.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cmac.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crc32_generic.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_engine.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_user.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cts.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/des_generic.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/dh_generic.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/echainiv.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/essiv.ko 2023-12-22T08:58:55.614 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/fcrypt.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/khazad.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4hc.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/md4.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/michael_mic.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcbc.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcrypt.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/rmd160.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/seed.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/serpent_generic.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tcrypt.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tea.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_common.ko 2023-12-22T08:58:55.615 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_generic.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/vmac.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/wp512.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xcbc.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xor.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xxhash_generic.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_pad.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/custom_method.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ec_sys.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/platform_profile.ko 2023-12-22T08:58:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbs.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbshc.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/video.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/acard-ahci.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci_platform.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ata_generic.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci_platform.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_acpi.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ali.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_amd.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_artop.ko 2023-12-22T08:58:55.617 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atiixp.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atp867x.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd640.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd64x.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cypress.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_efar.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt366.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt37x.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it8213.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it821x.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_jmicron.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_marvell.ko 2023-12-22T08:58:55.618 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_mpiix.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_netcell.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ninja32.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87410.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87415.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_oldpiix.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_opti.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_optidma.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pcmcia.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_piccolo.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rdc.ko 2023-12-22T08:58:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sch.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_serverworks.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sil680.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sis.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sl82c105.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_triflex.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_via.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pdc_adma.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_inic162x.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_mv.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_nv.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_promise.ko 2023-12-22T08:58:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_qstor.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil24.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sis.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_svw.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sx4.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_uli.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_via.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_vsc.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ks0108.ko 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap 2023-12-22T08:58:55.621 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/bcma.ko 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/aoe.ko 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/brd.ko 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/drbd.ko 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/floppy.ko 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/loop.ko 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-22T08:58:55.622 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/nbd.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/null_blk.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/pktcdvd.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/rbd.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/virtio_blk.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkfront.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/zram.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hangcheck-timer.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-22T08:58:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/via-rng.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/lp.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/mwave.ko 2023-12-22T08:58:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ppdev.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tlclk.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/uv_mmtimer.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/virtio_console.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-22T08:58:55.625 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp.ko 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-aes.ko 2023-12-22T08:58:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-sha.ko 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/dca.ko 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/amd64_edac.ko 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/e752x_edac.ko 2023-12-22T08:58:55.627 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/edac_mce_amd.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3000_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3200_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5100_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5400_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7300_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7core_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i82975x_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ie31200_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/sb_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/x38_edac.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/edd.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio 2023-12-22T08:58:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ich.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-appleir.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-aureal.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-axff.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-dr.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elecom.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elo.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-emsff.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gaff.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gt683r.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gyration.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-22T08:58:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtekff.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-hyperv.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-icade.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-keytouch.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kye.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lcpower.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-led.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lenovo.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-multitouch.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ortek.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-penmount.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-petalynx.ko 2023-12-22T08:58:55.630 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-picolcd.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-pl.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-plantronics.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-primax.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-rmi.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-common.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-22T08:58:55.631 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-saitek.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-samsung.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sjoy.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sony.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-speedlink.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-steelseries.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sunplus.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tivo.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tmff.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-topseed.ko 2023-12-22T08:58:55.632 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-twinhan.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-uclogic.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-waltop.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-wiimote.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-xinmo.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zpff.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zydacron.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/uhid.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/wacom.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_balloon.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_utils.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_vmbus.ko 2023-12-22T08:58:55.633 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru3.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7414.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7418.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adc128d818.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1025.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1026.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1029.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1031.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm9240.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ads7828.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7410.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7411.ko 2023-12-22T08:58:55.634 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7462.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7470.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7475.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7x10.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/amc6821.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/applesmc.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asb100.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asc7621.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/atxp1.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/coretemp.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dme1737.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds1621.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds620.ko 2023-12-22T08:58:55.635 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc1403.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc6w201.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71805f.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71882fg.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f75375s.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fam15h_power.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fschmd.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g760a.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g762.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl518sm.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl520sm.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5500_temp.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5k_amb.ko 2023-12-22T08:58:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmaem.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmpex.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina209.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina2xx.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/it87.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k10temp.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k8temp.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lineage-pem.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm63.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm73.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm75.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm77.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm78.ko 2023-12-22T08:58:55.637 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm80.ko 2023-12-22T08:58:55.638 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm83.ko 2023-12-22T08:58:55.641 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm85.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm87.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm90.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm92.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm93.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95234.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95241.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95245.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc2945.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4151.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4215.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4222.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4245.ko 2023-12-22T08:58:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4260.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4261.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max16065.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1619.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1668.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max197.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6639.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6650.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6697.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mcp3021.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6683.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775-core.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct7802.ko 2023-12-22T08:58:55.643 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87360.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87427.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pcf8591.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-22T08:58:55.644 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/powr1220.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5627.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5636.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht15.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht21.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/shtc1.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sis5595.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47b397.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m1.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m192.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/thmc50.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp102.ko 2023-12-22T08:58:55.645 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp103.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp401.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp421.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via-cputemp.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via686a.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt1211.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt8231.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627ehf.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627hf.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83781d.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83791d.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83792d.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83793.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83795.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l785ts.ko 2023-12-22T08:58:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l786ng.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-22T08:58:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-dev.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-mux.ko 2023-12-22T08:58:55.648 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-smbus.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-stub.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_core.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw 2023-12-22T08:58:55.649 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp 2023-12-22T08:58:55.650 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/gameport.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/joydev.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/appletouch.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/bcm5974.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/cyapatp.ko 2023-12-22T08:58:55.651 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/sermouse.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/altera_ps2.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/arc_ps2.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serio_raw.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/sparse-keymap.ko 2023-12-22T08:58:55.652 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-blinkm.ko 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3530.ko 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp3944.ko 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-ss4200.ko 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-22T08:58:55.653 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/bcache.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bio-prison.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache-smq.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-crypt.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-delay.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-flakey.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log-userspace.ko 2023-12-22T08:58:55.654 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-multipath.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-queue-length.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-raid.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-round-robin.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-service-time.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-switch.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-thin-pool.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-verity.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/faulty.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/linear.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/multipath.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-22T08:58:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid0.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid1.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid10.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid456.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptbase.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptctl.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptfc.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptlan.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptsas.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptscsih.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptspi.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_ich.ko 2023-12-22T08:58:55.656 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_sch.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mfd-core.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/sm501.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/viperboard.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/vx855.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wl1273-core.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds9802als.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds990x.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/bh1770glc.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/cb710.ko 2023-12-22T08:58:55.657 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/at24.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/max6875.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/enclosure.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hpilo.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29003.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29020.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-22T08:58:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-me.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-txe.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_7xx1.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_core.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tsl2550.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_balloon.ko 2023-12-22T08:58:55.659 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/bonding.ko 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dummy.ko 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/eql.ko 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet 2023-12-22T08:58:55.660 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon 2023-12-22T08:58:55.661 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-22T08:58:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna 2023-12-22T08:58:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec 2023-12-22T08:58:55.664 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dnet.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-22T08:58:55.665 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ethoc.ko 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fealnx.ko 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-22T08:58:55.666 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/jme.ko 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-22T08:58:55.667 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia 2023-12-22T08:58:55.668 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek 2023-12-22T08:58:55.669 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-22T08:58:55.670 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-22T08:58:55.671 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/geneve.ko 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ifb.ko 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan 2023-12-22T08:58:55.672 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvlan.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvtap.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mii.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/net_failover.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/netconsole.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/nlmon.ko 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs 2023-12-22T08:58:55.673 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/amd.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm87xx.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/broadcom.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/cicada.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/davicom.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/dp83640.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/et1011c.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/icplus.ko 2023-12-22T08:58:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/lxt.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/marvell.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/micrel.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/national.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/phylink.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/qsemi.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/realtek.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/smsc.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ste10Xp.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/vitesse.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_async.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-22T08:58:55.675 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppoe.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppox.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pptp.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slhc.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slip.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sungem_phy.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tap.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_random.ko 2023-12-22T08:58:55.676 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tun.ko 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/veth.ko 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/virtio_net.ko 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/vxlan.ko 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netfront.ko 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ntb.ko 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host 2023-12-22T08:58:55.677 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme-core.ko 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme.ko 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport.ko 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_cs.ko 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_pc.ko 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_serial.ko 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/xen-pcifront.ko 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia 2023-12-22T08:58:55.678 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/i82092.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pd6729.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acerhdf.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-22T08:58:55.679 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/hdaps.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel_ips.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-22T08:58:55.680 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps_parport.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/pps_core.ko 2023-12-22T08:58:55.681 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp_kvm.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-22T08:58:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-em3027.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max6900.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-22T08:58:55.683 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-x1205.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-9xxx.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-sas.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-xxxx.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/BusLogic.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/a100u2w.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-22T08:58:55.684 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/advansys.ko 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/am53c974.ko 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/atp870u.ko 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/bfa.ko 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-22T08:58:55.685 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ch.ko 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dc395x.ko 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-22T08:58:55.686 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dmx3191d.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esp_scsi.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/fnic.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hpsa.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hptiop.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hv_storvsc.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/initio.ko 2023-12-22T08:58:55.687 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ipr.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ips.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/isci.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/libfc.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/libsas.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid 2023-12-22T08:58:55.688 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvumi.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pmcraid.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla1280.ko 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx 2023-12-22T08:58:55.689 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/raid_class.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_debug.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ses.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/st.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/stex.ko 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2 2023-12-22T08:58:55.690 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/virtio_scsi.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/wd719x.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ssb.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_file.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_iblock.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_mod.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_pscsi.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_user.ko 2023-12-22T08:58:55.691 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-22T08:58:55.692 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_gsm.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_hdlc.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/nozomi.ko 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial 2023-12-22T08:58:55.693 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/arc_uart.ko 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio.ko 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_aec.ko 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_cif.ko 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pci_generic.ko 2023-12-22T08:58:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_sercos3.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-acm.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usblp.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usbtmc.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/mdc800.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/microtek.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/adutux.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/appledisplay.ko 2023-12-22T08:58:55.695 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi26.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi62.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ezusb.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/idmouse.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/iowarrior.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ldusb.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/legousbtower.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usb3503.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usblcd.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/uss720.ko 2023-12-22T08:58:55.696 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/yurex.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-generic.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/aircable.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ark3116.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ch341.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cp210x.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cyberjack.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/empeg.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-22T08:58:55.697 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_ti.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipaq.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipw.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ir-usb.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mct_u232.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7720.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7840.ko 2023-12-22T08:58:55.698 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/navman.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/omninet.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/opticon.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/option.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/oti6858.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/pl2303.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcaux.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcserial.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/quatech2.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/safe_serial.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/sierra.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ssu100.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/symbolserial.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-22T08:58:55.699 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_debug.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/visor.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/whiteheat.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/uas.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-22T08:58:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-karma.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/usb-storage.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio 2023-12-22T08:58:55.701 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_net.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_scsi.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/apple_bl.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lcd.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-22T08:58:55.702 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_balloon.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_mmio.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_ring.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2482.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2490.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-22T08:58:55.703 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/wire.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/hpwdt.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/i6300esb.ko 2023-12-22T08:58:55.704 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ib700wdt.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ibmasr.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it87_wdt.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/machzwd.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/nv_tco.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/softdog.ko 2023-12-22T08:58:55.705 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/via_wdt.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wdt_pci.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/xen_wdt.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-evtchn.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntalloc.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntdev.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-privcmd.ko 2023-12-22T08:58:55.706 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/9p.ko 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/affs.ko 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/befs.ko 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/binfmt_misc.ko 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/btrfs.ko 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/cachefiles.ko 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph 2023-12-22T08:58:55.707 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ceph.ko 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/coda.ko 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/cramfs.ko 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/dlm.ko 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/f2fs.ko 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/fat.ko 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/msdos.ko 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/vfat.ko 2023-12-22T08:58:55.708 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/fscache.ko 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/cuse.ko 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/fuse.ko 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/gfs2.ko 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/hfs.ko 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/hfsplus.ko 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/isofs.ko 2023-12-22T08:58:55.709 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/jfs.ko 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/lockd.ko 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/minix.ko 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/netfs.ko 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout 2023-12-22T08:58:55.710 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfs.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv3.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv4.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/grace.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/nfs_acl.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/nfsd.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/nilfs2.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-celtic.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-centeuro.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-croatian.ko 2023-12-22T08:58:55.711 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-cyrillic.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-gaelic.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-greek.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-iceland.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-inuit.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-roman.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-romanian.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-turkish.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1250.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1251.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1255.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp737.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp775.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp850.ko 2023-12-22T08:58:55.712 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp852.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp855.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp857.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp860.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp861.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp862.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp863.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp864.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp865.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp866.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp869.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp874.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp932.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp936.ko 2023-12-22T08:58:55.713 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp949.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp950.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_euc-jp.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-1.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-13.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-14.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-15.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-2.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-3.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-4.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-5.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-6.ko 2023-12-22T08:58:55.714 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-7.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-9.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-r.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-ru.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-u.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_utf8.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2.ko 2023-12-22T08:58:55.715 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/overlay.ko 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ramoops.ko 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/reiserfs.ko 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/romfs.ko 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/cifs.ko 2023-12-22T08:58:55.716 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_arc4.ko 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_md4.ko 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/squashfs.ko 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/sysv.ko 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/udf.ko 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ufs.ko 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs 2023-12-22T08:58:55.717 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/xfs.ko 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu/rcutorture.ko 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/torture.ko 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/asn1_encoder.ko 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc-itu-t.ko 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc8.ko 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libarc4.ko 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libdes.ko 2023-12-22T08:58:55.718 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/libcrc32c.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lru_cache.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4_compress.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4hc_compress.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/cordic.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/raid6_pq.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_bm.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_fsm.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_kmp.ko 2023-12-22T08:58:55.719 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd/zstd_compress.ko 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm/hwpoison-inject.ko 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/6lowpan.ko 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_dest.ko 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_fragment.ko 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_hop.ko 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_mobility.ko 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_routing.ko 2023-12-22T08:58:55.720 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_udp.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/garp.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/mrp.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/p8022.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/psnap.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/stp.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/8021q.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_fd.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_rdma.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_virtio.ko 2023-12-22T08:58:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/batman-adv.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/br_netfilter.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/bridge.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-22T08:58:55.722 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtables.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-22T08:58:55.723 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/libceph.ko 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/failover.ko 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/pktgen.ko 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp.ko 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_diag.ko 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv4.ko 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv6.ko 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver/dns_resolver.ko 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa 2023-12-22T08:58:55.724 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/dsa_core.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_brcm.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_dsa.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_none.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_trailer.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ah4.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/esp4.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/fou.ko 2023-12-22T08:58:55.725 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/gre.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/inet_diag.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_gre.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_tunnel.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_vti.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipcomp.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipip.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-22T08:58:55.726 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-22T08:58:55.727 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_bic.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_dctcp.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_diag.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_highspeed.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_htcp.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_hybla.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_illinois.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_lp.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_scalable.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_vegas.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_veno.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_westwood.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_yeah.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tunnel4.ko 2023-12-22T08:58:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_diag.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_tunnel.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ah6.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/esp6.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/fou6.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_tunnel.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_vti.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ipcomp6.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-22T08:58:55.729 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-22T08:58:55.730 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/sit.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/tunnel6.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key/af_key.ko 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp 2023-12-22T08:58:55.731 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_core.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_eth.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip6.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_netlink.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ppp.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/mac802154.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/mpls_gso.ko 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter 2023-12-22T08:58:55.732 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-22T08:58:55.733 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-22T08:58:55.734 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conncount.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-22T08:58:55.735 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_log_syslog.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_irc.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_sip.ko 2023-12-22T08:58:55.736 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_tables.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_log.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_chain_nat.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_compat.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_ct.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fib.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_hash.ko 2023-12-22T08:58:55.737 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_limit.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_log.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_masq.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_nat.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_numgen.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_queue.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_quota.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_redir.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject_inet.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_socket.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_tunnel.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_AUDIT.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-22T08:58:55.738 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CT.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_DSCP.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HL.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HMARK.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LED.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LOG.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NETMAP.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFLOG.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_RATEEST.ko 2023-12-22T08:58:55.739 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_SECMARK.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TEE.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TPROXY.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TRACE.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_addrtype.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_bpf.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cgroup.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cluster.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_comment.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connbytes.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlabel.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlimit.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connmark.ko 2023-12-22T08:58:55.740 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_conntrack.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cpu.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dccp.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_devgroup.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dscp.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ecn.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_esp.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hashlimit.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_helper.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hl.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipcomp.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_iprange.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipvs.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_l2tp.ko 2023-12-22T08:58:55.741 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_length.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_limit.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mac.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mark.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_multiport.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nat.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nfacct.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_osf.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_owner.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_physdev.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_pkttype.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_policy.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_quota.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_rateest.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_realm.ko 2023-12-22T08:58:55.742 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_recent.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_sctp.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_set.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_socket.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_state.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_statistic.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_string.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpmss.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_time.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_u32.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/netlink_diag.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/nsh.ko 2023-12-22T08:58:55.743 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/openvswitch.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-geneve.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-gre.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-vxlan.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/af_packet_diag.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_rdma.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_tcp.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_csum.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_gact.ko 2023-12-22T08:58:55.744 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_ipt.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_mirred.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_nat.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_pedit.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_police.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_simple.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_skbedit.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_vlan.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_basic.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_bpf.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_flow.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_fw.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_route.ko 2023-12-22T08:58:55.745 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_u32.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_cmp.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_ipset.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_meta.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_nbyte.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_text.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_u32.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_choke.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_codel.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_drr.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_gred.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hfsc.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hhf.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_htb.ko 2023-12-22T08:58:55.746 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_ingress.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio_lib.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_multiq.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_netem.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_pie.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_plug.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_prio.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_qfq.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_red.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfb.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfq.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_tbf.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_teql.ko 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp 2023-12-22T08:58:55.747 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp.ko 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp_diag.ko 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/sunrpc.ko 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/diag.ko 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/tipc.ko 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/unix_diag.ko 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock 2023-12-22T08:58:55.748 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock.ko 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys/trusted.ko 2023-12-22T08:58:55.749 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/irqbypass.ko 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias.bin 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.alias.bin 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.bin 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.modinfo 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep.bin 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.devname 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.order 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.softdep 2023-12-22T08:58:55.750 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols 2023-12-22T08:58:55.751 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols.bin 2023-12-22T08:58:55.751 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g623393c9d50c 2023-12-22T08:58:55.751 DEBUG:teuthology.orchestra.run.smithi106:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:postinstall scriptlet (using /bin/sh): 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g623393c9d50c -a -r /boot/System.map-6.6.0-g623393c9d50c ]; then 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:cp /boot/vmlinuz-6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:cp /boot/System.map-6.6.0-g623393c9d50c /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:rm -f /boot/vmlinuz-6.6.0-g623393c9d50c /boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:/sbin/installkernel 6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:rm -f /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-22T08:58:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:new-kernel-pkg --remove 6.6.0-g623393c9d50c --rminitrd --initrdfile=/boot/initramfs-6.6.0-g623393c9d50c.img 2023-12-22T08:58:55.776 INFO:teuthology.orchestra.run.smithi106.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-22T08:58:55.776 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-install remove 6.6.0-g623393c9d50c 2023-12-22T08:58:55.776 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2023-12-22T08:58:55.776 INFO:teuthology.orchestra.run.smithi106.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-22T08:58:55.776 INFO:teuthology.orchestra.run.smithi106.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-22T08:58:55.776 INFO:teuthology.orchestra.run.smithi106.stdout:/sbin/update-bootloader --remove 6.6.0-g623393c9d50c 2023-12-22T08:58:55.776 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2023-12-22T08:58:55.777 DEBUG:teuthology.orchestra.run.smithi106:> sudo rpm -qi grub2-tools 2023-12-22T08:58:55.854 INFO:teuthology.orchestra.run.smithi106.stdout:Name : grub2-tools 2023-12-22T08:58:55.854 INFO:teuthology.orchestra.run.smithi106.stdout:Epoch : 1 2023-12-22T08:58:55.854 INFO:teuthology.orchestra.run.smithi106.stdout:Version : 2.06 2023-12-22T08:58:55.854 INFO:teuthology.orchestra.run.smithi106.stdout:Release : 68.el9 2023-12-22T08:58:55.854 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: x86_64 2023-12-22T08:58:55.854 INFO:teuthology.orchestra.run.smithi106.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-22T08:58:55.854 INFO:teuthology.orchestra.run.smithi106.stdout:Group : Unspecified 2023-12-22T08:58:55.854 INFO:teuthology.orchestra.run.smithi106.stdout:Size : 8264254 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:License : GPLv3+ 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:Packager : builder@centos.org 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:Vendor : CentOS 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:Summary : Support tools for GRUB. 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:Description : 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout:hardware devices. 2023-12-22T08:58:55.855 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T08:58:55.856 INFO:teuthology.orchestra.run.smithi106.stdout:This subpackage provides tools for support of all platforms. 2023-12-22T08:58:55.856 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-22T08:58:55.857 INFO:teuthology.task.kernel:Updating grub on smithi106 to boot 6.6.0-g623393c9d50c 2023-12-22T08:58:55.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-22T08:58:56.351 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2023-12-22T08:58:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-22T08:58:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:done 2023-12-22T08:58:57.803 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2023-12-22T08:58:57.818 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.vdkddL28Mx 2023-12-22T08:58:57.818 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vdkddL28Mx 2023-12-22T08:58:57.887 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.vdkddL28Mx 2023-12-22T08:58:58.033 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.vdkddL28Mx is 6KB 2023-12-22T08:58:58.082 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.vdkddL28Mx 2023-12-22T08:58:58.096 DEBUG:teuthology.orchestra.run.smithi106:> sudo /bin/ls /boot/loader/entries || true 2023-12-22T08:58:58.168 INFO:teuthology.orchestra.run.smithi106.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-22T08:58:58.169 INFO:teuthology.orchestra.run.smithi106.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-22T08:58:58.169 INFO:teuthology.orchestra.run.smithi106.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-22T08:58:58.169 INFO:teuthology.orchestra.run.smithi106.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c.conf 2023-12-22T08:58:58.170 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c 2023-12-22T08:58:58.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2023-12-22T08:59:24.541 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-22T08:59:24.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-22T08:59:24.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:59:28.337 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-22T08:59:28.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-12-22T08:59:28.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:59:42.993 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-12-22T08:59:46.833 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-12-22T08:59:52.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-22T08:59:52.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:59:55.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-12-22T08:59:55.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:59:58.897 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-12-22T09:00:10.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-12-22T09:00:10.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:00:29.330 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2023-12-22T09:00:44.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-12-22T09:00:44.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:00:44.758 DEBUG:teuthology.orchestra.run.smithi106:> true 2023-12-22T09:00:45.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-12-22T09:00:45.365 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g623393c9d50c"... 2023-12-22T09:00:45.365 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2023-12-22T09:00:45.410 INFO:teuthology.orchestra.run.smithi106.stdout:6.6.0-g623393c9d50c 2023-12-22T09:00:45.411 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g623393c9d50c vs 6.6.0-g623393c9d50c 2023-12-22T09:00:45.411 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-22T09:00:45.411 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-22T09:00:46.412 DEBUG:teuthology.parallel:result is None 2023-12-22T09:00:52.003 DEBUG:teuthology.orchestra.remote:timed out 2023-12-22T09:01:04.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-22T09:01:04.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:01:04.427 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-12-22T09:01:05.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-22T09:01:05.092 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g623393c9d50c"... 2023-12-22T09:01:05.093 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-12-22T09:01:05.148 INFO:teuthology.orchestra.run.smithi132.stdout:6.6.0-g623393c9d50c 2023-12-22T09:01:05.149 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g623393c9d50c vs 6.6.0-g623393c9d50c 2023-12-22T09:01:05.149 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-22T09:01:05.149 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-22T09:01:06.150 DEBUG:teuthology.parallel:result is None 2023-12-22T09:01:06.150 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-22T09:01:06.158 INFO:teuthology.task.internal:Creating test directory... 2023-12-22T09:01:06.158 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-22T09:01:06.169 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-22T09:01:06.227 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-22T09:01:06.246 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-22T09:01:06.257 INFO:teuthology.task.internal:Creating archive directory... 2023-12-22T09:01:06.257 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-22T09:01:06.266 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-22T09:01:06.416 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-22T09:01:06.426 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-22T09:01:06.427 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-22T09:01:06.436 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-22T09:01:06.574 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T09:01:06.591 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T09:01:06.639 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T09:01:06.666 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T09:01:06.670 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-22T09:01:06.681 INFO:teuthology.task.internal:Configuring sudo... 2023-12-22T09:01:06.681 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-22T09:01:06.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-22T09:01:06.783 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-22T09:01:06.795 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-22T09:01:06.795 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-22T09:01:06.804 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-22T09:01:06.859 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T09:01:06.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T09:01:07.064 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T09:01:07.152 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T09:01:07.249 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:01:07.249 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-22T09:01:07.331 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T09:01:07.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T09:01:07.522 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T09:01:07.605 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T09:01:07.702 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:01:07.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-22T09:01:07.800 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2023-12-22T09:01:07.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2023-12-22T09:01:07.936 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T09:01:07.967 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T09:01:08.369 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-22T09:01:08.377 INFO:teuthology.task.internal:Starting timer... 2023-12-22T09:01:08.377 INFO:teuthology.run_tasks:Running task pcp... 2023-12-22T09:01:08.564 INFO:teuthology.run_tasks:Running task selinux... 2023-12-22T09:01:08.633 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2023-12-22T09:01:08.767 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: 2023-12-22T09:01:08.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2023-12-22T09:01:08.933 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2023-12-22T09:01:08.939 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-22T09:01:08.939 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2023-12-22T09:01:08.997 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2023-12-22T09:01:08.997 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2023-12-22T09:01:09.076 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2023-12-22T09:01:09.077 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi106.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi132.front.sepia.ceph.com': 'permissive'} 2023-12-22T09:01:09.077 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T09:01:09.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:01:09.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T09:01:09.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:01:09.273 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-22T09:01:09.274 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2023-12-22T09:01:09.387 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2023-12-22T09:01:09.532 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-22T09:01:09.543 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-22T09:01:09.564 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-22T09:01:09.565 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi106.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-22T09:11:05.090 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2023-12-22T09:11:05.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-12-22T09:11:05.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:11:05.234 DEBUG:teuthology.orchestra.run.smithi106:> true 2023-12-22T09:11:05.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-12-22T09:11:05.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-22T09:11:05.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:11:05.517 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-12-22T09:11:05.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-22T09:11:05.676 INFO:teuthology.run_tasks:Running task clock... 2023-12-22T09:11:05.685 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-22T09:11:05.686 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-22T09:11:05.686 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T09:11:05.695 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-22T09:11:05.695 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T09:11:05.796 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-22T09:11:05.799 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-22T09:11:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-22T09:11:05.849 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-22T09:11:05.940 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2023-12-22T09:11:05.943 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2023-12-22T09:11:05.978 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2023-12-22T09:11:05.986 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2023-12-22T09:11:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-22T09:11:06.035 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-22T09:11:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-22T09:11:06.088 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-22T09:11:06.196 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: ntpq: command not found 2023-12-22T09:11:06.205 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T09:11:06.205 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2023-12-22T09:11:06.205 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T09:11:06.205 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T09:11:06.205 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T09:11:06.205 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T09:11:06.213 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2023-12-22T09:11:06.220 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T09:11:06.220 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2023-12-22T09:11:06.221 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T09:11:06.221 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T09:11:06.221 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T09:11:06.221 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T09:11:06.222 INFO:teuthology.run_tasks:Running task install... 2023-12-22T09:11:06.230 DEBUG:teuthology.task.install:project ceph 2023-12-22T09:11:06.230 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}} 2023-12-22T09:11:06.230 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'} 2023-12-22T09:11:06.230 INFO:teuthology.task.install:Using flavor: default 2023-12-22T09:11:06.236 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-22T09:11:06.236 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-22T09:11:06.236 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-22T09:11:06.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T09:11:06.239 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-22T09:11:06.239 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T09:11:06.386 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-22T09:11:06.386 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-22T09:11:06.458 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-22T09:11:06.458 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-22T09:11:06.566 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-22T09:11:06.566 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:11:06.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-22T09:11:06.569 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-22T09:11:06.569 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:11:06.569 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-22T09:11:06.670 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-22T09:11:06.670 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-22T09:11:06.674 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-22T09:11:06.674 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-22T09:11:06.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-22T09:11:06.815 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-22T09:11:06.944 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-22T09:11:06.945 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-22T09:11:07.035 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2023-12-22T09:11:07.038 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2023-12-22T09:11:07.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2023-12-22T09:11:07.042 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2023-12-22T09:11:07.392 INFO:teuthology.orchestra.run.smithi132.stdout:73 files removed 2023-12-22T09:11:07.402 INFO:teuthology.orchestra.run.smithi106.stdout:73 files removed 2023-12-22T09:11:07.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-22T09:11:07.441 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-22T09:11:08.407 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 169 kB/s | 77 kB 00:00 2023-12-22T09:11:08.482 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 143 kB/s | 77 kB 00:00 2023-12-22T09:11:08.965 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-12-22T09:11:08.999 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 22 kB/s | 9.5 kB 00:00 2023-12-22T09:11:09.416 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-12-22T09:11:09.450 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-12-22T09:11:10.278 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 8.5 MB/s | 6.4 MB 00:00 2023-12-22T09:11:10.294 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-9 - AppStream 8.0 MB/s | 6.4 MB 00:00 2023-12-22T09:11:11.954 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2023-12-22T09:11:12.005 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2023-12-22T09:11:13.813 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 7.9 MB 00:01 2023-12-22T09:11:15.133 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 7.9 MB 00:02 2023-12-22T09:11:17.160 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-12-22T09:11:22.279 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 5.8 MB 00:01 2023-12-22T09:11:23.996 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2023-12-22T09:11:26.425 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 20 MB 00:02 2023-12-22T09:11:32.056 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2023-12-22T09:11:33.833 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 995 kB/s | 18 MB 00:18 2023-12-22T09:11:34.903 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T09:11:34.904 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T09:11:34.928 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-22T09:11:34.929 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-22T09:11:34.931 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-22T09:11:34.933 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-22T09:11:34.935 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-22T09:11:34.939 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-22T09:11:34.940 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-22T09:11:35.023 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-12-22T09:11:35.039 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2023-12-22T09:11:35.039 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2023-12-22T09:11:35.039 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2023-12-22T09:11:35.039 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2023-12-22T09:11:35.039 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-22T09:11:35.039 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-22T09:11:35.039 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-22T09:11:35.039 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-22T09:11:35.039 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-22T09:11:35.040 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-22T09:11:35.041 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager x86_64 1:1.45.9-1.el9 CentOS-BaseOS 2.2 M 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm x86_64 1:1.45.9-1.el9 CentOS-BaseOS 1.8 M 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team x86_64 1:1.45.9-1.el9 CentOS-BaseOS 42 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui x86_64 1:1.45.9-1.el9 CentOS-BaseOS 246 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2023-12-22T09:11:35.042 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T09:11:35.043 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-22T09:11:35.044 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-22T09:11:35.045 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-22T09:11:35.046 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-22T09:11:35.046 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2023-12-22T09:11:35.046 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-22T09:11:35.046 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-22T09:11:35.046 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-22T09:11:35.046 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-22T09:11:35.046 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-22T09:11:35.047 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.25.2-1.el9 epel 199 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-22T09:11:35.048 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-22T09:11:35.049 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-22T09:11:35.050 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-22T09:11:35.050 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-22T09:11:35.050 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-22T09:11:35.050 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-22T09:11:35.050 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-22T09:11:35.050 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-22T09:11:35.050 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-22T09:11:35.050 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-22T09:11:35.050 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-22T09:11:35.051 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-22T09:11:35.052 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2023-12-22T09:11:35.052 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-22T09:11:35.052 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:11:35.052 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2023-12-22T09:11:35.052 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2023-12-22T09:11:35.052 INFO:teuthology.orchestra.run.smithi132.stdout:Install 139 Packages 2023-12-22T09:11:35.052 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 16 Packages 2023-12-22T09:11:35.052 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:11:35.053 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 200 M 2023-12-22T09:11:35.053 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2023-12-22T09:11:35.726 INFO:teuthology.orchestra.run.smithi132.stdout:(1/155): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 16 kB/s | 6.5 kB 00:00 2023-12-22T09:11:36.793 INFO:teuthology.orchestra.run.smithi132.stdout:(2/155): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 788 kB/s | 839 kB 00:01 2023-12-22T09:11:36.977 INFO:teuthology.orchestra.run.smithi132.stdout:(3/155): ceph-immutable-object-cache-18.2.0-137 782 kB/s | 142 kB 00:00 2023-12-22T09:11:37.835 INFO:teuthology.orchestra.run.smithi132.stdout:(4/155): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 2.1 MB/s | 5.2 MB 00:02 2023-12-22T09:11:38.157 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 5.8 MB 00:00 2023-12-22T09:11:38.260 INFO:teuthology.orchestra.run.smithi132.stdout:(5/155): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 3.4 MB/s | 1.4 MB 00:00 2023-12-22T09:11:39.086 INFO:teuthology.orchestra.run.smithi132.stdout:(6/155): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 1.0 MB/s | 2.1 MB 00:02 2023-12-22T09:11:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:(7/155): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 4.7 MB/s | 4.4 MB 00:00 2023-12-22T09:11:39.445 INFO:teuthology.orchestra.run.smithi132.stdout:(8/155): ceph-common-18.2.0-1377.g24e2e32a.el9. 4.4 MB/s | 18 MB 00:04 2023-12-22T09:11:39.520 INFO:teuthology.orchestra.run.smithi132.stdout:(9/155): ceph-selinux-18.2.0-1377.g24e2e32a.el9 326 kB/s | 24 kB 00:00 2023-12-22T09:11:40.043 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2023-12-22T09:11:40.812 INFO:teuthology.orchestra.run.smithi132.stdout:(10/155): ceph-radosgw-18.2.0-1377.g24e2e32a.el 4.8 MB/s | 7.7 MB 00:01 2023-12-22T09:11:40.920 INFO:teuthology.orchestra.run.smithi132.stdout:(11/155): cephfs-mirror-18.2.0-1377.g24e2e32a.e 2.0 MB/s | 219 kB 00:00 2023-12-22T09:11:41.012 INFO:teuthology.orchestra.run.smithi132.stdout:(12/155): cephfs-shell-18.2.0-1377.g24e2e32a.el 298 kB/s | 27 kB 00:00 2023-12-22T09:11:41.104 INFO:teuthology.orchestra.run.smithi132.stdout:(13/155): libcephfs-devel-18.2.0-1377.g24e2e32a 342 kB/s | 31 kB 00:00 2023-12-22T09:11:41.329 INFO:teuthology.orchestra.run.smithi132.stdout:(14/155): libcephfs2-18.2.0-1377.g24e2e32a.el9. 2.9 MB/s | 658 kB 00:00 2023-12-22T09:11:41.446 INFO:teuthology.orchestra.run.smithi132.stdout:(15/155): libcephsqlite-18.2.0-1377.g24e2e32a.e 1.4 MB/s | 166 kB 00:00 2023-12-22T09:11:41.546 INFO:teuthology.orchestra.run.smithi132.stdout:(16/155): librados-devel-18.2.0-1377.g24e2e32a. 1.2 MB/s | 127 kB 00:00 2023-12-22T09:11:41.680 INFO:teuthology.orchestra.run.smithi132.stdout:(17/155): libradosstriper1-18.2.0-1377.g24e2e32 3.5 MB/s | 474 kB 00:00 2023-12-22T09:11:42.706 INFO:teuthology.orchestra.run.smithi132.stdout:(18/155): librgw2-18.2.0-1377.g24e2e32a.el9.x86 4.3 MB/s | 4.5 MB 00:01 2023-12-22T09:11:42.709 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 20 MB 00:02 2023-12-22T09:11:42.789 INFO:teuthology.orchestra.run.smithi132.stdout:(19/155): python3-ceph-argparse-18.2.0-1377.g24 548 kB/s | 45 kB 00:00 2023-12-22T09:11:42.889 INFO:teuthology.orchestra.run.smithi132.stdout:(20/155): python3-ceph-common-18.2.0-1377.g24e2 1.2 MB/s | 124 kB 00:00 2023-12-22T09:11:42.990 INFO:teuthology.orchestra.run.smithi132.stdout:(21/155): python3-cephfs-18.2.0-1377.g24e2e32a. 1.6 MB/s | 162 kB 00:00 2023-12-22T09:11:43.098 INFO:teuthology.orchestra.run.smithi132.stdout:(22/155): python3-rados-18.2.0-1377.g24e2e32a.e 2.9 MB/s | 319 kB 00:00 2023-12-22T09:11:43.207 INFO:teuthology.orchestra.run.smithi132.stdout:(23/155): python3-rbd-18.2.0-1377.g24e2e32a.el9 2.7 MB/s | 297 kB 00:00 2023-12-22T09:11:43.291 INFO:teuthology.orchestra.run.smithi132.stdout:(24/155): python3-rgw-18.2.0-1377.g24e2e32a.el9 1.2 MB/s | 99 kB 00:00 2023-12-22T09:11:43.383 INFO:teuthology.orchestra.run.smithi132.stdout:(25/155): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 952 kB/s | 87 kB 00:00 2023-12-22T09:11:43.950 INFO:teuthology.orchestra.run.smithi132.stdout:(26/155): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 5.3 MB/s | 3.0 MB 00:00 2023-12-22T09:11:44.059 INFO:teuthology.orchestra.run.smithi132.stdout:(27/155): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.6 MB/s | 171 kB 00:00 2023-12-22T09:11:44.150 INFO:teuthology.orchestra.run.smithi132.stdout:(28/155): ceph-grafana-dashboards-18.2.0-1377.g 255 kB/s | 23 kB 00:00 2023-12-22T09:11:44.242 INFO:teuthology.orchestra.run.smithi132.stdout:(29/155): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.4 MB/s | 132 kB 00:00 2023-12-22T09:11:44.618 INFO:teuthology.orchestra.run.smithi132.stdout:(30/155): ceph-mgr-dashboard-18.2.0-1377.g24e2e 4.7 MB/s | 1.8 MB 00:00 2023-12-22T09:11:45.951 INFO:teuthology.orchestra.run.smithi132.stdout:(31/155): ceph-mgr-diskprediction-local-18.2.0- 5.5 MB/s | 7.4 MB 00:01 2023-12-22T09:11:46.051 INFO:teuthology.orchestra.run.smithi132.stdout:(32/155): ceph-mgr-modules-core-18.2.0-1377.g24 2.4 MB/s | 242 kB 00:00 2023-12-22T09:11:46.143 INFO:teuthology.orchestra.run.smithi132.stdout:(33/155): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 552 kB/s | 50 kB 00:00 2023-12-22T09:11:46.235 INFO:teuthology.orchestra.run.smithi132.stdout:(34/155): ceph-prometheus-alerts-18.2.0-1377.g2 161 kB/s | 15 kB 00:00 2023-12-22T09:11:46.344 INFO:teuthology.orchestra.run.smithi132.stdout:(35/155): ceph-volume-18.2.0-1377.g24e2e32a.el9 2.4 MB/s | 262 kB 00:00 2023-12-22T09:11:46.452 INFO:teuthology.orchestra.run.smithi132.stdout:(36/155): cephadm-18.2.0-1377.g24e2e32a.el9.noa 2.0 MB/s | 221 kB 00:00 2023-12-22T09:11:46.553 INFO:teuthology.orchestra.run.smithi132.stdout:(37/155): cephfs-top-18.2.0-1377.g24e2e32a.el9. 182 kB/s | 18 kB 00:00 2023-12-22T09:11:46.754 INFO:teuthology.orchestra.run.smithi132.stdout:(38/155): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 662 kB 00:00 2023-12-22T09:11:46.812 INFO:teuthology.orchestra.run.smithi132.stdout:(39/155): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2023-12-22T09:11:46.854 INFO:teuthology.orchestra.run.smithi132.stdout:(40/155): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2023-12-22T09:11:46.887 INFO:teuthology.orchestra.run.smithi132.stdout:(41/155): elfutils-libelf-devel-0.190-2.el9.x86 628 kB/s | 20 kB 00:00 2023-12-22T09:11:46.929 INFO:teuthology.orchestra.run.smithi132.stdout:(42/155): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 307 kB 00:00 2023-12-22T09:11:46.963 INFO:teuthology.orchestra.run.smithi132.stdout:(43/155): flexiblas-3.0.4-8.el9.x86_64.rpm 978 kB/s | 32 kB 00:00 2023-12-22T09:11:47.088 INFO:teuthology.orchestra.run.smithi132.stdout:(44/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-12-22T09:11:47.122 INFO:teuthology.orchestra.run.smithi132.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 532 kB/s | 17 kB 00:00 2023-12-22T09:11:47.622 INFO:teuthology.orchestra.run.smithi132.stdout:(46/155): ceph-test-18.2.0-1377.g24e2e32a.el9.x 4.9 MB/s | 40 MB 00:08 2023-12-22T09:11:47.648 INFO:teuthology.orchestra.run.smithi132.stdout:(47/155): libaio-devel-0.3.111-13.el9.x86_64.rp 19 kB/s | 10 kB 00:00 2023-12-22T09:11:47.673 INFO:teuthology.orchestra.run.smithi132.stdout:(48/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-22T09:11:47.723 INFO:teuthology.orchestra.run.smithi132.stdout:(49/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 44 kB 00:00 2023-12-22T09:11:47.774 INFO:teuthology.orchestra.run.smithi132.stdout:(50/155): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 661 kB 00:00 2023-12-22T09:11:47.816 INFO:teuthology.orchestra.run.smithi132.stdout:(51/155): libtool-2.4.6-45.el9.x86_64.rpm 6.6 MB/s | 578 kB 00:00 2023-12-22T09:11:47.858 INFO:teuthology.orchestra.run.smithi132.stdout:(52/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 313 kB/s | 24 kB 00:00 2023-12-22T09:11:47.900 INFO:teuthology.orchestra.run.smithi132.stdout:(53/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 562 kB/s | 46 kB 00:00 2023-12-22T09:11:47.934 INFO:teuthology.orchestra.run.smithi132.stdout:(54/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-12-22T09:11:47.976 INFO:teuthology.orchestra.run.smithi132.stdout:(55/155): openblas-0.3.21-2.el9.x86_64.rpm 474 kB/s | 34 kB 00:00 2023-12-22T09:11:48.109 INFO:teuthology.orchestra.run.smithi132.stdout:(56/155): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2023-12-22T09:11:48.209 INFO:teuthology.orchestra.run.smithi132.stdout:(57/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2023-12-22T09:11:48.260 INFO:teuthology.orchestra.run.smithi132.stdout:(58/155): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2023-12-22T09:11:48.302 INFO:teuthology.orchestra.run.smithi132.stdout:(59/155): postgresql-contrib-13.11-1.el9.x86_64 9.0 MB/s | 811 kB 00:00 2023-12-22T09:11:48.346 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-12-22T09:11:48.360 INFO:teuthology.orchestra.run.smithi132.stdout:(60/155): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 134 kB 00:00 2023-12-22T09:11:48.511 INFO:teuthology.orchestra.run.smithi132.stdout:(61/155): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2023-12-22T09:11:48.536 INFO:teuthology.orchestra.run.smithi132.stdout:(62/155): python3-attrs-20.3.0-7.el9.noarch.rpm 485 kB/s | 78 kB 00:00 2023-12-22T09:11:48.588 INFO:teuthology.orchestra.run.smithi132.stdout:(63/155): python3-jinja2-2.11.3-4.el9.noarch.rp 4.6 MB/s | 228 kB 00:00 2023-12-22T09:11:48.728 INFO:teuthology.orchestra.run.smithi132.stdout:(64/155): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2023-12-22T09:11:48.753 INFO:teuthology.orchestra.run.smithi132.stdout:(65/155): python3-jsonpatch-1.21-16.el9.noarch. 161 kB/s | 24 kB 00:00 2023-12-22T09:11:48.795 INFO:teuthology.orchestra.run.smithi132.stdout:(66/155): python3-jsonpointer-2.0-4.el9.noarch. 448 kB/s | 18 kB 00:00 2023-12-22T09:11:48.820 INFO:teuthology.orchestra.run.smithi132.stdout:(67/155): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-12-22T09:11:48.846 INFO:teuthology.orchestra.run.smithi132.stdout:(68/155): python3-markupsafe-1.1.1-12.el9.x86_6 651 kB/s | 32 kB 00:00 2023-12-22T09:11:48.971 INFO:teuthology.orchestra.run.smithi132.stdout:(69/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-12-22T09:11:48.996 INFO:teuthology.orchestra.run.smithi132.stdout:(70/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-12-22T09:11:49.038 INFO:teuthology.orchestra.run.smithi132.stdout:(71/155): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2023-12-22T09:11:49.080 INFO:teuthology.orchestra.run.smithi132.stdout:(72/155): python3-prettytable-0.7.2-27.el9.noar 501 kB/s | 41 kB 00:00 2023-12-22T09:11:49.130 INFO:teuthology.orchestra.run.smithi132.stdout:(73/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 132 kB 00:00 2023-12-22T09:11:49.164 INFO:teuthology.orchestra.run.smithi132.stdout:(74/155): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-12-22T09:11:49.189 INFO:teuthology.orchestra.run.smithi132.stdout:(75/155): python3-pytz-2021.1-5.el9.noarch.rpm 843 kB/s | 47 kB 00:00 2023-12-22T09:11:49.215 INFO:teuthology.orchestra.run.smithi132.stdout:(76/155): python3-requests-oauthlib-1.3.0-12.el 872 kB/s | 43 kB 00:00 2023-12-22T09:11:49.490 INFO:teuthology.orchestra.run.smithi132.stdout:(77/155): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 1.7 MB/s | 18 MB 00:10 2023-12-22T09:11:49.724 INFO:teuthology.orchestra.run.smithi132.stdout:(78/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2023-12-22T09:11:49.749 INFO:teuthology.orchestra.run.smithi132.stdout:(79/155): python3-toml-0.10.2-6.el9.noarch.rpm 74 kB/s | 39 kB 00:00 2023-12-22T09:11:49.774 INFO:teuthology.orchestra.run.smithi132.stdout:(80/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 152 kB/s | 41 kB 00:00 2023-12-22T09:11:49.800 INFO:teuthology.orchestra.run.smithi132.stdout:(81/155): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-12-22T09:11:49.833 INFO:teuthology.orchestra.run.smithi132.stdout:(82/155): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 300 kB 00:00 2023-12-22T09:11:49.884 INFO:teuthology.orchestra.run.smithi132.stdout:(83/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 806 kB/s | 87 kB 00:00 2023-12-22T09:11:49.917 INFO:teuthology.orchestra.run.smithi132.stdout:(84/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 553 kB/s | 63 kB 00:00 2023-12-22T09:11:49.942 INFO:teuthology.orchestra.run.smithi132.stdout:(85/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 777 kB/s | 44 kB 00:00 2023-12-22T09:11:49.968 INFO:teuthology.orchestra.run.smithi132.stdout:(86/155): fuse-2.9.9-15.el9.x86_64.rpm 964 kB/s | 79 kB 00:00 2023-12-22T09:11:50.001 INFO:teuthology.orchestra.run.smithi132.stdout:(87/155): jq-1.6-16.el9.x86_64.rpm 2.2 MB/s | 186 kB 00:00 2023-12-22T09:11:50.035 INFO:teuthology.orchestra.run.smithi132.stdout:(88/155): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.0 MB/s | 195 kB 00:00 2023-12-22T09:11:50.077 INFO:teuthology.orchestra.run.smithi132.stdout:(89/155): libgfortran-11.4.1-2.3.el9.x86_64.rpm 7.4 MB/s | 803 kB 00:00 2023-12-22T09:11:50.102 INFO:teuthology.orchestra.run.smithi132.stdout:(90/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.2 MB/s | 217 kB 00:00 2023-12-22T09:11:50.135 INFO:teuthology.orchestra.run.smithi132.stdout:(91/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 241 kB 00:00 2023-12-22T09:11:50.161 INFO:teuthology.orchestra.run.smithi132.stdout:(92/155): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-22T09:11:50.211 INFO:teuthology.orchestra.run.smithi132.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-12-22T09:11:50.236 INFO:teuthology.orchestra.run.smithi132.stdout:(94/155): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2023-12-22T09:11:50.262 INFO:teuthology.orchestra.run.smithi132.stdout:(95/155): python3-requests-2.25.1-7.el9.noarch. 1.2 MB/s | 113 kB 00:00 2023-12-22T09:11:50.295 INFO:teuthology.orchestra.run.smithi132.stdout:(96/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-22T09:11:50.446 INFO:teuthology.orchestra.run.smithi132.stdout:(97/155): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2023-12-22T09:11:50.504 INFO:teuthology.orchestra.run.smithi132.stdout:(98/155): fmt-8.1.1-5.el9.x86_64.rpm 462 kB/s | 111 kB 00:00 2023-12-22T09:11:50.538 INFO:teuthology.orchestra.run.smithi132.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.2 MB/s | 309 kB 00:00 2023-12-22T09:11:50.580 INFO:teuthology.orchestra.run.smithi132.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 348 kB/s | 26 kB 00:00 2023-12-22T09:11:50.605 INFO:teuthology.orchestra.run.smithi132.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 731 kB/s | 49 kB 00:00 2023-12-22T09:11:50.655 INFO:teuthology.orchestra.run.smithi132.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 905 kB/s | 67 kB 00:00 2023-12-22T09:11:50.714 INFO:teuthology.orchestra.run.smithi132.stdout:(103/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 838 kB 00:00 2023-12-22T09:11:50.781 INFO:teuthology.orchestra.run.smithi132.stdout:(104/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 664 kB/s | 43 kB 00:00 2023-12-22T09:11:50.814 INFO:teuthology.orchestra.run.smithi132.stdout:(105/155): python3-asyncssh-2.13.2-3.el9.noarch 3.4 MB/s | 548 kB 00:00 2023-12-22T09:11:50.857 INFO:teuthology.orchestra.run.smithi132.stdout:(106/155): python3-cachetools-4.2.4-1.el9.noarc 434 kB/s | 32 kB 00:00 2023-12-22T09:11:50.899 INFO:teuthology.orchestra.run.smithi132.stdout:(107/155): python3-certifi-2021.10.8-2.el9.noar 180 kB/s | 15 kB 00:00 2023-12-22T09:11:50.949 INFO:teuthology.orchestra.run.smithi132.stdout:(108/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2023-12-22T09:11:51.049 INFO:teuthology.orchestra.run.smithi132.stdout:(109/155): libarrow-9.0.0-10.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2023-12-22T09:11:51.083 INFO:teuthology.orchestra.run.smithi132.stdout:(110/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2023-12-22T09:11:51.117 INFO:teuthology.orchestra.run.smithi132.stdout:(111/155): python3-cherrypy-18.6.1-2.el9.noarch 1.6 MB/s | 358 kB 00:00 2023-12-22T09:11:51.123 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T09:11:51.124 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T09:11:51.142 INFO:teuthology.orchestra.run.smithi132.stdout:(112/155): python3-colorama-0.4.4-12.el9.noarch 385 kB/s | 35 kB 00:00 2023-12-22T09:11:51.145 INFO:teuthology.orchestra.run.smithi106.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-22T09:11:51.147 INFO:teuthology.orchestra.run.smithi106.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-22T09:11:51.148 INFO:teuthology.orchestra.run.smithi106.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-22T09:11:51.150 INFO:teuthology.orchestra.run.smithi106.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-22T09:11:51.152 INFO:teuthology.orchestra.run.smithi106.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-22T09:11:51.156 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-22T09:11:51.157 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-22T09:11:51.175 INFO:teuthology.orchestra.run.smithi132.stdout:(113/155): python3-google-auth-2.25.2-1.el9.noa 2.1 MB/s | 199 kB 00:00 2023-12-22T09:11:51.201 INFO:teuthology.orchestra.run.smithi132.stdout:(114/155): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2023-12-22T09:11:51.226 INFO:teuthology.orchestra.run.smithi132.stdout:(115/155): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2023-12-22T09:11:51.238 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2023-12-22T09:11:51.251 INFO:teuthology.orchestra.run.smithi132.stdout:(116/155): python3-jaraco-collections-3.0.0-8.e 310 kB/s | 23 kB 00:00 2023-12-22T09:11:51.253 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================================ 2023-12-22T09:11:51.256 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2023-12-22T09:11:51.256 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================================ 2023-12-22T09:11:51.256 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2023-12-22T09:11:51.256 INFO:teuthology.orchestra.run.smithi106.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-22T09:11:51.257 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-22T09:11:51.258 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager x86_64 1:1.45.9-1.el9 CentOS-BaseOS 2.2 M 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-libnm x86_64 1:1.45.9-1.el9 CentOS-BaseOS 1.8 M 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-team x86_64 1:1.45.9-1.el9 CentOS-BaseOS 42 k 2023-12-22T09:11:51.259 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-tui x86_64 1:1.45.9-1.el9 CentOS-BaseOS 246 k 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2023-12-22T09:11:51.260 INFO:teuthology.orchestra.run.smithi106.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-22T09:11:51.261 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-22T09:11:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-22T09:11:51.263 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:2.25.2-1.el9 epel 199 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-22T09:11:51.264 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-22T09:11:51.265 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-22T09:11:51.266 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-22T09:11:51.267 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout:Installing weak dependencies: 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================================ 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout:Install 139 Packages 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 16 Packages 2023-12-22T09:11:51.268 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:11:51.269 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 200 M 2023-12-22T09:11:51.269 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2023-12-22T09:11:51.276 INFO:teuthology.orchestra.run.smithi132.stdout:(117/155): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2023-12-22T09:11:51.293 INFO:teuthology.orchestra.run.smithi132.stdout:(118/155): python3-jaraco-text-3.2.0-6.el9.noar 296 kB/s | 20 kB 00:00 2023-12-22T09:11:51.319 INFO:teuthology.orchestra.run.smithi132.stdout:(119/155): python3-jwt+crypto-2.4.0-1.el9.noarc 136 kB/s | 9.0 kB 00:00 2023-12-22T09:11:51.344 INFO:teuthology.orchestra.run.smithi132.stdout:(120/155): python3-jwt-2.4.0-1.el9.noarch.rpm 616 kB/s | 41 kB 00:00 2023-12-22T09:11:51.415 INFO:teuthology.orchestra.run.smithi132.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 483 kB/s | 46 kB 00:00 2023-12-22T09:11:51.445 INFO:teuthology.orchestra.run.smithi132.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 790 kB/s | 79 kB 00:00 2023-12-22T09:11:51.470 INFO:teuthology.orchestra.run.smithi132.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-12-22T09:11:51.520 INFO:teuthology.orchestra.run.smithi132.stdout:(124/155): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2023-12-22T09:11:51.537 INFO:teuthology.orchestra.run.smithi132.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 248 kB/s | 16 kB 00:00 2023-12-22T09:11:51.588 INFO:teuthology.orchestra.run.smithi132.stdout:(126/155): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2023-12-22T09:11:51.613 INFO:teuthology.orchestra.run.smithi132.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 378 kB/s | 28 kB 00:00 2023-12-22T09:11:51.638 INFO:teuthology.orchestra.run.smithi132.stdout:(128/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 772 kB/s | 90 kB 00:00 2023-12-22T09:11:51.663 INFO:teuthology.orchestra.run.smithi132.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 412 kB/s | 31 kB 00:00 2023-12-22T09:11:51.697 INFO:teuthology.orchestra.run.smithi132.stdout:(130/155): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-12-22T09:11:51.716 INFO:teuthology.orchestra.run.smithi106.stdout:(1/155): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 21 kB/s | 6.5 kB 00:00 2023-12-22T09:11:51.722 INFO:teuthology.orchestra.run.smithi132.stdout:(131/155): python3-rsa-4.9-2.el9.noarch.rpm 711 kB/s | 59 kB 00:00 2023-12-22T09:11:51.747 INFO:teuthology.orchestra.run.smithi132.stdout:(132/155): python3-tempora-5.0.0-2.el9.noarch.r 430 kB/s | 36 kB 00:00 2023-12-22T09:11:51.773 INFO:teuthology.orchestra.run.smithi132.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 682 kB/s | 51 kB 00:00 2023-12-22T09:11:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2023-12-22T09:11:51.848 INFO:teuthology.orchestra.run.smithi132.stdout:(135/155): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-12-22T09:11:51.890 INFO:teuthology.orchestra.run.smithi132.stdout:(136/155): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-12-22T09:11:51.916 INFO:teuthology.orchestra.run.smithi132.stdout:(137/155): python3-zc-lockfile-2.0-10.el9.noarc 218 kB/s | 20 kB 00:00 2023-12-22T09:11:51.949 INFO:teuthology.orchestra.run.smithi132.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2023-12-22T09:11:52.050 INFO:teuthology.orchestra.run.smithi132.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2023-12-22T09:11:52.092 INFO:teuthology.orchestra.run.smithi132.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-22T09:11:52.217 INFO:teuthology.orchestra.run.smithi132.stdout:(141/155): NetworkManager-1.45.9-1.el9.x86_64.r 18 MB/s | 2.2 MB 00:00 2023-12-22T09:11:52.309 INFO:teuthology.orchestra.run.smithi132.stdout:(142/155): NetworkManager-libnm-1.45.9-1.el9.x8 20 MB/s | 1.8 MB 00:00 2023-12-22T09:11:52.359 INFO:teuthology.orchestra.run.smithi132.stdout:(143/155): NetworkManager-team-1.45.9-1.el9.x86 862 kB/s | 42 kB 00:00 2023-12-22T09:11:52.366 INFO:teuthology.orchestra.run.smithi106.stdout:(2/155): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.3 MB/s | 839 kB 00:00 2023-12-22T09:11:52.401 INFO:teuthology.orchestra.run.smithi132.stdout:(144/155): NetworkManager-tui-1.45.9-1.el9.x86_ 5.9 MB/s | 246 kB 00:00 2023-12-22T09:11:52.443 INFO:teuthology.orchestra.run.smithi132.stdout:(145/155): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-22T09:11:52.493 INFO:teuthology.orchestra.run.smithi132.stdout:(146/155): elfutils-debuginfod-client-0.190-2.e 717 kB/s | 35 kB 00:00 2023-12-22T09:11:52.535 INFO:teuthology.orchestra.run.smithi132.stdout:(147/155): elfutils-libelf-0.190-2.el9.x86_64.r 4.6 MB/s | 191 kB 00:00 2023-12-22T09:11:52.577 INFO:teuthology.orchestra.run.smithi132.stdout:(148/155): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 254 kB 00:00 2023-12-22T09:11:52.636 INFO:teuthology.orchestra.run.smithi132.stdout:(149/155): libacl-2.3.1-4.el9.x86_64.rpm 379 kB/s | 22 kB 00:00 2023-12-22T09:11:52.693 INFO:teuthology.orchestra.run.smithi106.stdout:(3/155): ceph-immutable-object-cache-18.2.0-137 440 kB/s | 142 kB 00:00 2023-12-22T09:11:52.845 INFO:teuthology.orchestra.run.smithi132.stdout:(150/155): openssl-3.0.7-25.el9.x86_64.rpm 5.6 MB/s | 1.2 MB 00:00 2023-12-22T09:11:52.964 INFO:teuthology.orchestra.run.smithi132.stdout:(151/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 18 MB/s | 2.1 MB 00:00 2023-12-22T09:11:53.012 INFO:teuthology.orchestra.run.smithi132.stdout:(152/155): xfsdump-3.1.12-4.el9.x86_64.rpm 6.7 MB/s | 321 kB 00:00 2023-12-22T09:11:53.104 INFO:teuthology.orchestra.run.smithi132.stdout:(153/155): librbd1-18.2.0-1377.g24e2e32a.el9.x8 2.6 MB/s | 3.0 MB 00:01 2023-12-22T09:11:53.145 INFO:teuthology.orchestra.run.smithi132.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 8.0 MB/s | 1.1 MB 00:00 2023-12-22T09:11:53.388 INFO:teuthology.orchestra.run.smithi132.stdout:(155/155): librados2-18.2.0-1377.g24e2e32a.el9. 2.2 MB/s | 3.3 MB 00:01 2023-12-22T09:11:53.396 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2023-12-22T09:11:53.396 INFO:teuthology.orchestra.run.smithi132.stdout:Total 11 MB/s | 200 MB 00:18 2023-12-22T09:11:53.449 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2023-12-22T09:11:53.787 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2023-12-22T09:11:53.787 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2023-12-22T09:11:53.800 INFO:teuthology.orchestra.run.smithi106.stdout:(4/155): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 1.9 MB/s | 2.1 MB 00:01 2023-12-22T09:11:53.900 INFO:teuthology.orchestra.run.smithi106.stdout:(5/155): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 2.1 MB/s | 5.2 MB 00:02 2023-12-22T09:11:54.550 INFO:teuthology.orchestra.run.smithi106.stdout:(6/155): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 1.9 MB/s | 1.4 MB 00:00 2023-12-22T09:11:55.446 INFO:teuthology.orchestra.run.smithi106.stdout:(7/155): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 2.9 MB/s | 4.4 MB 00:01 2023-12-22T09:11:55.878 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2023-12-22T09:11:55.878 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2023-12-22T09:11:58.142 INFO:teuthology.orchestra.run.smithi106.stdout:(8/155): ceph-radosgw-18.2.0-1377.g24e2e32a.el9 2.9 MB/s | 7.7 MB 00:02 2023-12-22T09:11:58.234 INFO:teuthology.orchestra.run.smithi106.stdout:(9/155): ceph-selinux-18.2.0-1377.g24e2e32a.el9 265 kB/s | 24 kB 00:00 2023-12-22T09:11:59.301 INFO:teuthology.orchestra.run.smithi106.stdout:(10/155): ceph-common-18.2.0-1377.g24e2e32a.el9 2.3 MB/s | 18 MB 00:07 2023-12-22T09:11:59.459 INFO:teuthology.orchestra.run.smithi106.stdout:(11/155): cephfs-mirror-18.2.0-1377.g24e2e32a.e 1.4 MB/s | 219 kB 00:00 2023-12-22T09:11:59.551 INFO:teuthology.orchestra.run.smithi106.stdout:(12/155): cephfs-shell-18.2.0-1377.g24e2e32a.el 298 kB/s | 27 kB 00:00 2023-12-22T09:11:59.643 INFO:teuthology.orchestra.run.smithi106.stdout:(13/155): libcephfs-devel-18.2.0-1377.g24e2e32a 342 kB/s | 31 kB 00:00 2023-12-22T09:11:59.952 INFO:teuthology.orchestra.run.smithi106.stdout:(14/155): libcephfs2-18.2.0-1377.g24e2e32a.el9. 2.1 MB/s | 658 kB 00:00 2023-12-22T09:12:00.069 INFO:teuthology.orchestra.run.smithi106.stdout:(15/155): libcephsqlite-18.2.0-1377.g24e2e32a.e 1.4 MB/s | 166 kB 00:00 2023-12-22T09:12:00.161 INFO:teuthology.orchestra.run.smithi106.stdout:(16/155): librados-devel-18.2.0-1377.g24e2e32a. 1.4 MB/s | 127 kB 00:00 2023-12-22T09:12:00.386 INFO:teuthology.orchestra.run.smithi106.stdout:(17/155): libradosstriper1-18.2.0-1377.g24e2e32 2.1 MB/s | 474 kB 00:00 2023-12-22T09:12:01.978 INFO:teuthology.orchestra.run.smithi106.stdout:(18/155): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 2.4 MB/s | 18 MB 00:07 2023-12-22T09:12:02.086 INFO:teuthology.orchestra.run.smithi106.stdout:(19/155): librgw2-18.2.0-1377.g24e2e32a.el9.x86 2.6 MB/s | 4.5 MB 00:01 2023-12-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi106.stdout:(20/155): python3-ceph-argparse-18.2.0-1377.g24 340 kB/s | 45 kB 00:00 2023-12-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi106.stdout:(21/155): python3-ceph-common-18.2.0-1377.g24e2 1.5 MB/s | 124 kB 00:00 2023-12-22T09:12:02.270 INFO:teuthology.orchestra.run.smithi106.stdout:(22/155): python3-cephfs-18.2.0-1377.g24e2e32a. 1.0 MB/s | 162 kB 00:00 2023-12-22T09:12:02.345 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2023-12-22T09:12:02.353 INFO:teuthology.orchestra.run.smithi106.stdout:(23/155): python3-rados-18.2.0-1377.g24e2e32a.e 1.7 MB/s | 319 kB 00:00 2023-12-22T09:12:02.446 INFO:teuthology.orchestra.run.smithi106.stdout:(24/155): python3-rbd-18.2.0-1377.g24e2e32a.el9 1.7 MB/s | 297 kB 00:00 2023-12-22T09:12:02.471 INFO:teuthology.orchestra.run.smithi106.stdout:(25/155): python3-rgw-18.2.0-1377.g24e2e32a.el9 853 kB/s | 99 kB 00:00 2023-12-22T09:12:02.476 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2023-12-22T09:12:02.512 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/171 2023-12-22T09:12:02.530 INFO:teuthology.orchestra.run.smithi106.stdout:(26/155): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.0 MB/s | 87 kB 00:00 2023-12-22T09:12:02.579 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/171 2023-12-22T09:12:02.630 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/171 2023-12-22T09:12:02.639 INFO:teuthology.orchestra.run.smithi106.stdout:(27/155): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.6 MB/s | 171 kB 00:00 2023-12-22T09:12:02.662 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2023-12-22T09:12:02.722 INFO:teuthology.orchestra.run.smithi106.stdout:(28/155): ceph-grafana-dashboards-18.2.0-1377.g 281 kB/s | 23 kB 00:00 2023-12-22T09:12:02.753 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2023-12-22T09:12:02.814 INFO:teuthology.orchestra.run.smithi106.stdout:(29/155): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.4 MB/s | 132 kB 00:00 2023-12-22T09:12:03.147 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2023-12-22T09:12:03.194 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T09:12:03.386 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T09:12:03.412 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T09:12:03.523 INFO:teuthology.orchestra.run.smithi106.stdout:(30/155): ceph-mgr-dashboard-18.2.0-1377.g24e2e 2.5 MB/s | 1.8 MB 00:00 2023-12-22T09:12:03.524 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T09:12:03.568 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T09:12:03.607 INFO:teuthology.orchestra.run.smithi106.stdout:(31/155): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 2.6 MB/s | 3.0 MB 00:01 2023-12-22T09:12:03.711 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2023-12-22T09:12:03.831 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2023-12-22T09:12:03.965 INFO:teuthology.orchestra.run.smithi106.stdout:(32/155): ceph-mgr-modules-core-18.2.0-1377.g24 677 kB/s | 242 kB 00:00 2023-12-22T09:12:04.049 INFO:teuthology.orchestra.run.smithi106.stdout:(33/155): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 610 kB/s | 50 kB 00:00 2023-12-22T09:12:04.132 INFO:teuthology.orchestra.run.smithi106.stdout:(34/155): ceph-prometheus-alerts-18.2.0-1377.g2 178 kB/s | 15 kB 00:00 2023-12-22T09:12:04.195 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2023-12-22T09:12:04.262 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2023-12-22T09:12:04.286 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T09:12:04.292 INFO:teuthology.orchestra.run.smithi106.stdout:(35/155): ceph-volume-18.2.0-1377.g24e2e32a.el9 1.6 MB/s | 262 kB 00:00 2023-12-22T09:12:04.440 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T09:12:04.450 INFO:teuthology.orchestra.run.smithi106.stdout:(36/155): cephadm-18.2.0-1377.g24e2e32a.el9.noa 1.4 MB/s | 221 kB 00:00 2023-12-22T09:12:04.487 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T09:12:04.525 INFO:teuthology.orchestra.run.smithi106.stdout:(37/155): cephfs-top-18.2.0-1377.g24e2e32a.el9. 244 kB/s | 18 kB 00:00 2023-12-22T09:12:04.595 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T09:12:04.759 INFO:teuthology.orchestra.run.smithi106.stdout:(38/155): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 662 kB 00:00 2023-12-22T09:12:04.825 INFO:teuthology.orchestra.run.smithi106.stdout:(39/155): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2023-12-22T09:12:04.867 INFO:teuthology.orchestra.run.smithi106.stdout:(40/155): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2023-12-22T09:12:04.901 INFO:teuthology.orchestra.run.smithi106.stdout:(41/155): elfutils-libelf-devel-0.190-2.el9.x86 628 kB/s | 20 kB 00:00 2023-12-22T09:12:04.936 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2023-12-22T09:12:04.943 INFO:teuthology.orchestra.run.smithi106.stdout:(42/155): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 307 kB 00:00 2023-12-22T09:12:04.977 INFO:teuthology.orchestra.run.smithi106.stdout:(43/155): flexiblas-3.0.4-8.el9.x86_64.rpm 978 kB/s | 32 kB 00:00 2023-12-22T09:12:05.104 INFO:teuthology.orchestra.run.smithi106.stdout:(44/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-12-22T09:12:05.109 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T09:12:05.136 INFO:teuthology.orchestra.run.smithi106.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 539 kB/s | 17 kB 00:00 2023-12-22T09:12:05.169 INFO:teuthology.orchestra.run.smithi106.stdout:(46/155): libaio-devel-0.3.111-13.el9.x86_64.rp 308 kB/s | 10 kB 00:00 2023-12-22T09:12:05.213 INFO:teuthology.orchestra.run.smithi106.stdout:(47/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-12-22T09:12:05.253 INFO:teuthology.orchestra.run.smithi106.stdout:(48/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2023-12-22T09:12:05.255 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T09:12:05.304 INFO:teuthology.orchestra.run.smithi106.stdout:(49/155): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-22T09:12:05.354 INFO:teuthology.orchestra.run.smithi106.stdout:(50/155): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2023-12-22T09:12:05.387 INFO:teuthology.orchestra.run.smithi106.stdout:(51/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 756 kB/s | 24 kB 00:00 2023-12-22T09:12:05.421 INFO:teuthology.orchestra.run.smithi106.stdout:(52/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-22T09:12:05.469 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T09:12:05.480 INFO:teuthology.orchestra.run.smithi106.stdout:(53/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-22T09:12:05.514 INFO:teuthology.orchestra.run.smithi106.stdout:(54/155): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-22T09:12:05.546 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T09:12:05.664 INFO:teuthology.orchestra.run.smithi106.stdout:(55/155): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2023-12-22T09:12:05.764 INFO:teuthology.orchestra.run.smithi106.stdout:(56/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 30 MB/s | 3.0 MB 00:00 2023-12-22T09:12:05.848 INFO:teuthology.orchestra.run.smithi106.stdout:(57/155): postgresql-13.11-1.el9.x86_64.rpm 18 MB/s | 1.5 MB 00:00 2023-12-22T09:12:05.907 INFO:teuthology.orchestra.run.smithi106.stdout:(58/155): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2023-12-22T09:12:05.948 INFO:teuthology.orchestra.run.smithi106.stdout:(59/155): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2023-12-22T09:12:05.982 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T09:12:06.042 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2023-12-22T09:12:06.090 INFO:teuthology.orchestra.run.smithi106.stdout:(60/155): ceph-mgr-diskprediction-local-18.2.0- 2.9 MB/s | 7.4 MB 00:02 2023-12-22T09:12:06.155 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2023-12-22T09:12:06.224 INFO:teuthology.orchestra.run.smithi106.stdout:(61/155): postgresql-server-13.11-1.el9.x86_64. 21 MB/s | 5.7 MB 00:00 2023-12-22T09:12:06.233 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2023-12-22T09:12:06.249 INFO:teuthology.orchestra.run.smithi106.stdout:(62/155): python3-attrs-20.3.0-7.el9.noarch.rpm 536 kB/s | 78 kB 00:00 2023-12-22T09:12:06.280 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2023-12-22T09:12:06.324 INFO:teuthology.orchestra.run.smithi106.stdout:(63/155): python3-jinja2-2.11.3-4.el9.noarch.rp 3.0 MB/s | 228 kB 00:00 2023-12-22T09:12:06.337 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/171 2023-12-22T09:12:06.394 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/171 2023-12-22T09:12:06.500 INFO:teuthology.orchestra.run.smithi106.stdout:(64/155): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-12-22T09:12:06.505 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2023-12-22T09:12:06.525 INFO:teuthology.orchestra.run.smithi106.stdout:(65/155): python3-jsonpatch-1.21-16.el9.noarch. 130 kB/s | 24 kB 00:00 2023-12-22T09:12:06.548 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2023-12-22T09:12:06.550 INFO:teuthology.orchestra.run.smithi106.stdout:(66/155): python3-jsonpointer-2.0-4.el9.noarch. 365 kB/s | 18 kB 00:00 2023-12-22T09:12:06.574 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2023-12-22T09:12:06.584 INFO:teuthology.orchestra.run.smithi106.stdout:(67/155): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2023-12-22T09:12:06.601 INFO:teuthology.orchestra.run.smithi106.stdout:(68/155): python3-markupsafe-1.1.1-12.el9.x86_6 638 kB/s | 32 kB 00:00 2023-12-22T09:12:06.671 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/171 2023-12-22T09:12:06.706 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 30/171 2023-12-22T09:12:06.742 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 31/171 2023-12-22T09:12:06.874 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 32/171 2023-12-22T09:12:07.048 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/171 2023-12-22T09:12:07.068 INFO:teuthology.orchestra.run.smithi106.stdout:(69/155): ceph-test-18.2.0-1377.g24e2e32a.el9.x 4.5 MB/s | 40 MB 00:08 2023-12-22T09:12:07.102 INFO:teuthology.orchestra.run.smithi106.stdout:(70/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 435 kB/s | 217 kB 00:00 2023-12-22T09:12:07.117 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/171 2023-12-22T09:12:07.218 INFO:teuthology.orchestra.run.smithi106.stdout:(71/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.6 MB/s | 4.8 MB 00:00 2023-12-22T09:12:07.244 INFO:teuthology.orchestra.run.smithi106.stdout:(72/155): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2023-12-22T09:12:07.269 INFO:teuthology.orchestra.run.smithi106.stdout:(73/155): python3-prettytable-0.7.2-27.el9.noar 267 kB/s | 41 kB 00:00 2023-12-22T09:12:07.302 INFO:teuthology.orchestra.run.smithi106.stdout:(74/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2023-12-22T09:12:07.328 INFO:teuthology.orchestra.run.smithi106.stdout:(75/155): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-12-22T09:12:07.353 INFO:teuthology.orchestra.run.smithi106.stdout:(76/155): python3-pytz-2021.1-5.el9.noarch.rpm 592 kB/s | 47 kB 00:00 2023-12-22T09:12:07.395 INFO:teuthology.orchestra.run.smithi106.stdout:(77/155): python3-requests-oauthlib-1.3.0-12.el 654 kB/s | 43 kB 00:00 2023-12-22T09:12:07.579 INFO:teuthology.orchestra.run.smithi106.stdout:(78/155): python3-toml-0.10.2-6.el9.noarch.rpm 184 kB/s | 39 kB 00:00 2023-12-22T09:12:07.788 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/171 2023-12-22T09:12:07.812 INFO:teuthology.orchestra.run.smithi106.stdout:(79/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2023-12-22T09:12:07.838 INFO:teuthology.orchestra.run.smithi106.stdout:(80/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 96 kB/s | 41 kB 00:00 2023-12-22T09:12:07.862 INFO:teuthology.orchestra.run.smithi106.stdout:(81/155): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2023-12-22T09:12:07.880 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/171 2023-12-22T09:12:07.904 INFO:teuthology.orchestra.run.smithi106.stdout:(82/155): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 56 kB 00:00 2023-12-22T09:12:07.921 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/171 2023-12-22T09:12:07.929 INFO:teuthology.orchestra.run.smithi106.stdout:(83/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 961 kB/s | 63 kB 00:00 2023-12-22T09:12:07.946 INFO:teuthology.orchestra.run.smithi106.stdout:(84/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2023-12-22T09:12:07.972 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 38/171 2023-12-22T09:12:07.972 INFO:teuthology.orchestra.run.smithi106.stdout:(85/155): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2023-12-22T09:12:07.997 INFO:teuthology.orchestra.run.smithi106.stdout:(86/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 670 kB/s | 44 kB 00:00 2023-12-22T09:12:08.011 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 39/171 2023-12-22T09:12:08.022 INFO:teuthology.orchestra.run.smithi106.stdout:(87/155): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2023-12-22T09:12:08.064 INFO:teuthology.orchestra.run.smithi106.stdout:(88/155): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.8 MB/s | 803 kB 00:00 2023-12-22T09:12:08.073 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/171 2023-12-22T09:12:08.190 INFO:teuthology.orchestra.run.smithi106.stdout:(89/155): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2023-12-22T09:12:08.261 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/171 2023-12-22T09:12:08.273 INFO:teuthology.orchestra.run.smithi106.stdout:(90/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 894 kB/s | 217 kB 00:00 2023-12-22T09:12:08.307 INFO:teuthology.orchestra.run.smithi106.stdout:(91/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 241 kB 00:00 2023-12-22T09:12:08.321 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/171 2023-12-22T09:12:08.332 INFO:teuthology.orchestra.run.smithi106.stdout:(92/155): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-22T09:12:08.391 INFO:teuthology.orchestra.run.smithi106.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2023-12-22T09:12:08.416 INFO:teuthology.orchestra.run.smithi106.stdout:(94/155): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 124 kB 00:00 2023-12-22T09:12:08.441 INFO:teuthology.orchestra.run.smithi106.stdout:(95/155): python3-requests-2.25.1-7.el9.noarch. 1.1 MB/s | 113 kB 00:00 2023-12-22T09:12:08.468 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/171 2023-12-22T09:12:08.475 INFO:teuthology.orchestra.run.smithi106.stdout:(96/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-22T09:12:08.511 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/171 2023-12-22T09:12:08.586 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/171 2023-12-22T09:12:08.804 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/171 2023-12-22T09:12:08.847 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/171 2023-12-22T09:12:08.875 INFO:teuthology.orchestra.run.smithi106.stdout:(97/155): fmt-8.1.1-5.el9.x86_64.rpm 257 kB/s | 111 kB 00:00 2023-12-22T09:12:08.887 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/171 2023-12-22T09:12:08.947 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/171 2023-12-22T09:12:08.985 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/171 2023-12-22T09:12:09.016 INFO:teuthology.orchestra.run.smithi106.stdout:(98/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 598 kB/s | 309 kB 00:00 2023-12-22T09:12:09.049 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/171 2023-12-22T09:12:09.109 INFO:teuthology.orchestra.run.smithi106.stdout:(99/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2023-12-22T09:12:09.125 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/171 2023-12-22T09:12:09.201 INFO:teuthology.orchestra.run.smithi106.stdout:(100/155): liboath-2.6.7-2.el9.x86_64.rpm 534 kB/s | 49 kB 00:00 2023-12-22T09:12:09.314 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/171 2023-12-22T09:12:09.335 INFO:teuthology.orchestra.run.smithi106.stdout:(101/155): libarrow-9.0.0-10.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2023-12-22T09:12:09.360 INFO:teuthology.orchestra.run.smithi106.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 426 kB/s | 67 kB 00:00 2023-12-22T09:12:09.367 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/171 2023-12-22T09:12:09.404 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/171 2023-12-22T09:12:09.443 INFO:teuthology.orchestra.run.smithi106.stdout:(103/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 838 kB 00:00 2023-12-22T09:12:09.451 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/171 2023-12-22T09:12:09.527 INFO:teuthology.orchestra.run.smithi106.stdout:(104/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 526 kB/s | 43 kB 00:00 2023-12-22T09:12:09.560 INFO:teuthology.orchestra.run.smithi106.stdout:(105/155): python3-asyncssh-2.13.2-3.el9.noarch 2.7 MB/s | 548 kB 00:00 2023-12-22T09:12:09.577 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/171 2023-12-22T09:12:09.602 INFO:teuthology.orchestra.run.smithi106.stdout:(106/155): python3-cachetools-4.2.4-1.el9.noarc 432 kB/s | 32 kB 00:00 2023-12-22T09:12:09.636 INFO:teuthology.orchestra.run.smithi106.stdout:(107/155): python3-certifi-2021.10.8-2.el9.noar 201 kB/s | 15 kB 00:00 2023-12-22T09:12:09.637 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.25.2-1.el9.noarch 58/171 2023-12-22T09:12:09.678 INFO:teuthology.orchestra.run.smithi106.stdout:(108/155): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2023-12-22T09:12:09.712 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/171 2023-12-22T09:12:09.745 INFO:teuthology.orchestra.run.smithi106.stdout:(109/155): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2023-12-22T09:12:09.755 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/171 2023-12-22T09:12:09.778 INFO:teuthology.orchestra.run.smithi106.stdout:(110/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2023-12-22T09:12:09.796 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/171 2023-12-22T09:12:09.812 INFO:teuthology.orchestra.run.smithi106.stdout:(111/155): python3-colorama-0.4.4-12.el9.noarch 533 kB/s | 35 kB 00:00 2023-12-22T09:12:09.854 INFO:teuthology.orchestra.run.smithi106.stdout:(112/155): python3-google-auth-2.25.2-1.el9.noa 2.6 MB/s | 199 kB 00:00 2023-12-22T09:12:09.879 INFO:teuthology.orchestra.run.smithi106.stdout:(113/155): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2023-12-22T09:12:09.921 INFO:teuthology.orchestra.run.smithi106.stdout:(114/155): python3-jaraco-classes-3.2.1-5.el9.n 266 kB/s | 18 kB 00:00 2023-12-22T09:12:09.949 INFO:teuthology.orchestra.run.smithi106.stdout:(115/155): python3-jaraco-collections-3.0.0-8.e 350 kB/s | 23 kB 00:00 2023-12-22T09:12:09.988 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fmt-8.1.1-5.el9.x86_64 62/171 2023-12-22T09:12:10.006 INFO:teuthology.orchestra.run.smithi106.stdout:(116/155): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2023-12-22T09:12:10.031 INFO:teuthology.orchestra.run.smithi106.stdout:(117/155): python3-jaraco-text-3.2.0-6.el9.noar 236 kB/s | 20 kB 00:00 2023-12-22T09:12:10.041 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/171 2023-12-22T09:12:10.081 INFO:teuthology.orchestra.run.smithi106.stdout:(118/155): python3-jwt+crypto-2.4.0-1.el9.noarc 122 kB/s | 9.0 kB 00:00 2023-12-22T09:12:10.106 INFO:teuthology.orchestra.run.smithi106.stdout:(119/155): python3-jwt-2.4.0-1.el9.noarch.rpm 547 kB/s | 41 kB 00:00 2023-12-22T09:12:10.112 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/171 2023-12-22T09:12:10.190 INFO:teuthology.orchestra.run.smithi106.stdout:(120/155): python3-kubernetes-26.1.0-2.el9.noar 9.5 MB/s | 1.0 MB 00:00 2023-12-22T09:12:10.193 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/171 2023-12-22T09:12:10.215 INFO:teuthology.orchestra.run.smithi106.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 428 kB/s | 46 kB 00:00 2023-12-22T09:12:10.265 INFO:teuthology.orchestra.run.smithi106.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2023-12-22T09:12:10.299 INFO:teuthology.orchestra.run.smithi106.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 695 kB/s | 58 kB 00:00 2023-12-22T09:12:10.349 INFO:teuthology.orchestra.run.smithi106.stdout:(124/155): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2023-12-22T09:12:10.375 INFO:teuthology.orchestra.run.smithi106.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 220 kB/s | 16 kB 00:00 2023-12-22T09:12:10.425 INFO:teuthology.orchestra.run.smithi106.stdout:(126/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-12-22T09:12:10.450 INFO:teuthology.orchestra.run.smithi106.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 378 kB/s | 28 kB 00:00 2023-12-22T09:12:10.465 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/171 2023-12-22T09:12:10.500 INFO:teuthology.orchestra.run.smithi106.stdout:(128/155): python3-repoze-lru-0.7-16.el9.noarch 413 kB/s | 31 kB 00:00 2023-12-22T09:12:10.529 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/171 2023-12-22T09:12:10.559 INFO:teuthology.orchestra.run.smithi106.stdout:(129/155): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-12-22T09:12:10.584 INFO:teuthology.orchestra.run.smithi106.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 714 kB/s | 59 kB 00:00 2023-12-22T09:12:10.634 INFO:teuthology.orchestra.run.smithi106.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 481 kB/s | 36 kB 00:00 2023-12-22T09:12:10.660 INFO:teuthology.orchestra.run.smithi106.stdout:(132/155): python3-typing-extensions-4.4.0-2.el 684 kB/s | 51 kB 00:00 2023-12-22T09:12:10.697 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/171 2023-12-22T09:12:10.727 INFO:teuthology.orchestra.run.smithi106.stdout:(133/155): python3-webob-1.8.7-6.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2023-12-22T09:12:10.752 INFO:teuthology.orchestra.run.smithi106.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 981 kB/s | 90 kB 00:00 2023-12-22T09:12:10.757 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/171 2023-12-22T09:12:10.781 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 70/171 2023-12-22T09:12:10.802 INFO:teuthology.orchestra.run.smithi106.stdout:(135/155): python3-devel-3.9.17-2.el9.x86_64.rp 103 kB/s | 245 kB 00:02 2023-12-22T09:12:10.820 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 71/171 2023-12-22T09:12:10.827 INFO:teuthology.orchestra.run.smithi106.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 267 kB/s | 20 kB 00:00 2023-12-22T09:12:10.861 INFO:teuthology.orchestra.run.smithi106.stdout:(137/155): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2023-12-22T09:12:10.866 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2023-12-22T09:12:10.896 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2023-12-22T09:12:10.945 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2023-12-22T09:12:10.987 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2023-12-22T09:12:10.987 INFO:teuthology.orchestra.run.smithi106.stdout:(138/155): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2023-12-22T09:12:11.038 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2023-12-22T09:12:11.099 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2023-12-22T09:12:11.178 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2023-12-22T09:12:11.241 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2023-12-22T09:12:11.254 INFO:teuthology.orchestra.run.smithi106.stdout:(139/155): re2-20211101-3.el9.x86_64.rpm 426 kB/s | 192 kB 00:00 2023-12-22T09:12:11.288 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2023-12-22T09:12:11.320 INFO:teuthology.orchestra.run.smithi106.stdout:(140/155): librbd1-18.2.0-1377.g24e2e32a.el9.x8 9.1 MB/s | 3.0 MB 00:00 2023-12-22T09:12:11.346 INFO:teuthology.orchestra.run.smithi106.stdout:(141/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 744 kB/s | 68 kB 00:00 2023-12-22T09:12:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2023-12-22T09:12:11.464 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2023-12-22T09:12:11.500 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2023-12-22T09:12:11.504 INFO:teuthology.orchestra.run.smithi106.stdout:(142/155): librados2-18.2.0-1377.g24e2e32a.el9. 5.7 MB/s | 3.3 MB 00:00 2023-12-22T09:12:11.564 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2023-12-22T09:12:11.603 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2023-12-22T09:12:11.745 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2023-12-22T09:12:11.800 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2023-12-22T09:12:11.888 INFO:teuthology.orchestra.run.smithi106.stdout:(143/155): NetworkManager-1.45.9-1.el9.x86_64.r 4.0 MB/s | 2.2 MB 00:00 2023-12-22T09:12:11.944 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2023-12-22T09:12:11.980 INFO:teuthology.orchestra.run.smithi106.stdout:(144/155): NetworkManager-libnm-1.45.9-1.el9.x8 2.8 MB/s | 1.8 MB 00:00 2023-12-22T09:12:12.006 INFO:teuthology.orchestra.run.smithi106.stdout:(145/155): NetworkManager-team-1.45.9-1.el9.x86 85 kB/s | 42 kB 00:00 2023-12-22T09:12:12.006 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2023-12-22T09:12:12.030 INFO:teuthology.orchestra.run.smithi106.stdout:(146/155): NetworkManager-tui-1.45.9-1.el9.x86_ 1.8 MB/s | 246 kB 00:00 2023-12-22T09:12:12.056 INFO:teuthology.orchestra.run.smithi106.stdout:(147/155): acl-2.3.1-4.el9.x86_64.rpm 952 kB/s | 69 kB 00:00 2023-12-22T09:12:12.081 INFO:teuthology.orchestra.run.smithi106.stdout:(148/155): elfutils-debuginfod-client-0.190-2.e 729 kB/s | 35 kB 00:00 2023-12-22T09:12:12.106 INFO:teuthology.orchestra.run.smithi106.stdout:(149/155): elfutils-libelf-0.190-2.el9.x86_64.r 2.5 MB/s | 191 kB 00:00 2023-12-22T09:12:12.140 INFO:teuthology.orchestra.run.smithi106.stdout:(150/155): elfutils-libs-0.190-2.el9.x86_64.rpm 3.1 MB/s | 254 kB 00:00 2023-12-22T09:12:12.173 INFO:teuthology.orchestra.run.smithi106.stdout:(151/155): libacl-2.3.1-4.el9.x86_64.rpm 345 kB/s | 22 kB 00:00 2023-12-22T09:12:12.223 INFO:teuthology.orchestra.run.smithi106.stdout:(152/155): openssl-3.0.7-25.el9.x86_64.rpm 10 MB/s | 1.2 MB 00:00 2023-12-22T09:12:12.307 INFO:teuthology.orchestra.run.smithi106.stdout:(153/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 13 MB/s | 2.1 MB 00:00 2023-12-22T09:12:12.349 INFO:teuthology.orchestra.run.smithi106.stdout:(154/155): xfsdump-3.1.12-4.el9.x86_64.rpm 1.9 MB/s | 321 kB 00:00 2023-12-22T09:12:12.391 INFO:teuthology.orchestra.run.smithi106.stdout:(155/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.9 MB/s | 1.1 MB 00:00 2023-12-22T09:12:12.406 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2023-12-22T09:12:12.406 INFO:teuthology.orchestra.run.smithi106.stdout:Total 9.5 MB/s | 200 MB 00:21 2023-12-22T09:12:12.460 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2023-12-22T09:12:12.807 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2023-12-22T09:12:12.807 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2023-12-22T09:12:12.944 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2023-12-22T09:12:12.998 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2023-12-22T09:12:13.031 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2023-12-22T09:12:13.087 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2023-12-22T09:12:13.199 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2023-12-22T09:12:13.249 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2023-12-22T09:12:13.487 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2023-12-22T09:12:13.521 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2023-12-22T09:12:13.616 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2023-12-22T09:12:14.405 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2023-12-22T09:12:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2023-12-22T09:12:14.861 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2023-12-22T09:12:14.862 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2023-12-22T09:12:16.084 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2023-12-22T09:12:16.178 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2023-12-22T09:12:16.214 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2023-12-22T09:12:16.249 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2023-12-22T09:12:16.600 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2023-12-22T09:12:16.632 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T09:12:16.753 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T09:12:16.788 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 107/171 2023-12-22T09:12:16.835 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2023-12-22T09:12:17.280 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2023-12-22T09:12:17.310 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T09:12:17.385 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T09:12:17.412 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/171 2023-12-22T09:12:19.840 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T09:12:19.884 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T09:12:20.504 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T09:12:20.546 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T09:12:20.723 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T09:12:20.723 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-22T09:12:20.723 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-22T09:12:20.723 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:20.756 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T09:12:21.249 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2023-12-22T09:12:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2023-12-22T09:12:21.414 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/171 2023-12-22T09:12:21.486 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/171 2023-12-22T09:12:21.541 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/171 2023-12-22T09:12:21.574 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2023-12-22T09:12:21.673 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2023-12-22T09:12:22.069 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2023-12-22T09:12:22.122 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T09:12:22.272 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T09:12:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T09:12:22.429 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T09:12:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T09:12:22.635 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2023-12-22T09:12:22.742 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2023-12-22T09:12:23.054 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2023-12-22T09:12:23.105 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2023-12-22T09:12:23.130 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T09:12:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T09:12:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T09:12:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T09:12:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2023-12-22T09:12:23.885 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T09:12:23.983 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T09:12:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T09:12:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T09:12:24.738 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T09:12:24.776 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2023-12-22T09:12:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2023-12-22T09:12:24.948 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2023-12-22T09:12:24.980 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2023-12-22T09:12:25.033 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/171 2023-12-22T09:12:25.081 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/171 2023-12-22T09:12:25.183 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2023-12-22T09:12:25.224 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2023-12-22T09:12:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2023-12-22T09:12:25.366 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/171 2023-12-22T09:12:25.404 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 30/171 2023-12-22T09:12:25.453 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 31/171 2023-12-22T09:12:25.557 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 32/171 2023-12-22T09:12:25.732 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/171 2023-12-22T09:12:25.798 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/171 2023-12-22T09:12:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/171 2023-12-22T09:12:26.596 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/171 2023-12-22T09:12:26.644 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/171 2023-12-22T09:12:26.713 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 38/171 2023-12-22T09:12:26.762 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 39/171 2023-12-22T09:12:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/171 2023-12-22T09:12:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/171 2023-12-22T09:12:27.071 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/171 2023-12-22T09:12:27.204 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/171 2023-12-22T09:12:27.257 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/171 2023-12-22T09:12:27.323 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/171 2023-12-22T09:12:27.407 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/171 2023-12-22T09:12:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/171 2023-12-22T09:12:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/171 2023-12-22T09:12:27.547 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/171 2023-12-22T09:12:27.588 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/171 2023-12-22T09:12:27.650 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/171 2023-12-22T09:12:27.710 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/171 2023-12-22T09:12:27.888 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/171 2023-12-22T09:12:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/171 2023-12-22T09:12:27.974 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/171 2023-12-22T09:12:28.021 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/171 2023-12-22T09:12:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/171 2023-12-22T09:12:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:2.25.2-1.el9.noarch 58/171 2023-12-22T09:12:28.230 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/171 2023-12-22T09:12:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/171 2023-12-22T09:12:28.303 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/171 2023-12-22T09:12:28.466 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fmt-8.1.1-5.el9.x86_64 62/171 2023-12-22T09:12:28.530 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/171 2023-12-22T09:12:28.604 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/171 2023-12-22T09:12:28.679 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/171 2023-12-22T09:12:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/171 2023-12-22T09:12:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/171 2023-12-22T09:12:29.193 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/171 2023-12-22T09:12:29.244 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/171 2023-12-22T09:12:29.268 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 70/171 2023-12-22T09:12:29.307 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 71/171 2023-12-22T09:12:29.351 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2023-12-22T09:12:29.392 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2023-12-22T09:12:29.440 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2023-12-22T09:12:29.481 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2023-12-22T09:12:29.524 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2023-12-22T09:12:29.585 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2023-12-22T09:12:29.663 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2023-12-22T09:12:29.719 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2023-12-22T09:12:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2023-12-22T09:12:29.881 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2023-12-22T09:12:29.918 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2023-12-22T09:12:29.953 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2023-12-22T09:12:30.006 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2023-12-22T09:12:30.047 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2023-12-22T09:12:30.186 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2023-12-22T09:12:30.229 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2023-12-22T09:12:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2023-12-22T09:12:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2023-12-22T09:12:31.354 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2023-12-22T09:12:31.401 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2023-12-22T09:12:31.434 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2023-12-22T09:12:31.489 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2023-12-22T09:12:31.600 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2023-12-22T09:12:31.653 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2023-12-22T09:12:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2023-12-22T09:12:31.890 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2023-12-22T09:12:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2023-12-22T09:12:32.772 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2023-12-22T09:12:32.918 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2023-12-22T09:12:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T09:12:33.491 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2023-12-22T09:12:33.491 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2023-12-22T09:12:33.491 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2023-12-22T09:12:33.491 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2023-12-22T09:12:33.491 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2023-12-22T09:12:33.492 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2023-12-22T09:12:33.492 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2023-12-22T09:12:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T09:12:33.762 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T09:12:33.762 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:33.762 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-22T09:12:33.762 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2023-12-22T09:12:34.598 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2023-12-22T09:12:34.744 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2023-12-22T09:12:34.744 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2023-12-22T09:12:35.036 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2023-12-22T09:12:35.067 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T09:12:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T09:12:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 107/171 2023-12-22T09:12:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2023-12-22T09:12:35.449 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T09:12:35.529 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T09:12:35.530 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:35.530 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-22T09:12:35.530 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T09:12:35.530 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T09:12:35.530 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:35.712 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2023-12-22T09:12:35.744 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T09:12:35.780 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T09:12:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T09:12:35.853 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T09:12:35.853 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:35.853 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-22T09:12:35.853 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T09:12:35.854 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T09:12:35.854 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/171 2023-12-22T09:12:36.344 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T09:12:36.412 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T09:12:36.412 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:36.412 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-22T09:12:36.412 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T09:12:36.412 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T09:12:36.412 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:36.553 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2023-12-22T09:12:37.155 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T09:12:37.189 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T09:12:37.239 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 121/171 2023-12-22T09:12:37.350 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 122/171 2023-12-22T09:12:37.382 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T09:12:37.708 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T09:12:37.758 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T09:12:38.311 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T09:12:38.343 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T09:12:38.886 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T09:12:38.917 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T09:12:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T09:12:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T09:12:39.059 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T09:12:39.192 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T09:12:39.192 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-22T09:12:39.192 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-22T09:12:39.192 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:39.239 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T09:12:39.240 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 126/171 2023-12-22T09:12:39.286 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T09:12:39.355 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T09:12:39.355 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:39.355 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-22T09:12:39.355 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T09:12:39.355 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T09:12:39.355 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:39.412 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T09:12:39.451 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T09:12:39.540 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 129/171 2023-12-22T09:12:40.339 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2023-12-22T09:12:40.397 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T09:12:40.469 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T09:12:40.469 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:40.469 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-22T09:12:40.469 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T09:12:40.469 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T09:12:40.469 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:40.514 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T09:12:40.591 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T09:12:40.591 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:40.591 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-22T09:12:40.591 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:40.657 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T09:12:40.759 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T09:12:40.759 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:40.759 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-22T09:12:40.759 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T09:12:40.759 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T09:12:40.759 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:41.161 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T09:12:41.255 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T09:12:41.255 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:41.255 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-22T09:12:41.255 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T09:12:41.255 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T09:12:41.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:45.288 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/171 2023-12-22T09:12:45.339 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/171 2023-12-22T09:12:45.394 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 137/171 2023-12-22T09:12:45.427 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2023-12-22T09:12:45.465 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2023-12-22T09:12:45.730 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T09:12:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2023-12-22T09:12:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T09:12:45.925 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 143/171 2023-12-22T09:12:45.965 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2023-12-22T09:12:46.013 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-team-1:1.45.9-1.el9.x86_64 145/171 2023-12-22T09:12:46.126 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-tui-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T09:12:46.191 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2023-12-22T09:12:46.227 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2023-12-22T09:12:47.303 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T09:12:47.343 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T09:12:47.432 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T09:12:47.524 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2023-12-22T09:12:48.871 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 151/171 2023-12-22T09:12:48.949 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2023-12-22T09:12:48.995 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2023-12-22T09:12:49.107 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2023-12-22T09:12:49.142 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2023-12-22T09:12:49.159 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2023-12-22T09:12:49.185 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T09:12:49.224 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2023-12-22T09:12:49.225 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T09:12:49.385 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T09:12:49.436 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2023-12-22T09:12:49.483 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2023-12-22T09:12:49.524 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2023-12-22T09:12:49.557 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2023-12-22T09:12:49.557 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T09:12:49.694 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T09:12:49.725 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2023-12-22T09:12:49.765 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T09:12:49.766 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T09:12:50.108 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T09:12:50.108 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T09:12:50.233 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T09:12:50.269 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2023-12-22T09:12:50.311 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2023-12-22T09:12:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2023-12-22T09:12:50.507 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T09:12:50.764 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T09:12:50.764 INFO:teuthology.orchestra.run.smithi132.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-22T09:12:50.765 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:51.937 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T09:12:51.937 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2023-12-22T09:12:51.937 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2023-12-22T09:12:51.937 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2023-12-22T09:12:51.937 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2023-12-22T09:12:51.938 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2023-12-22T09:12:51.938 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /root 2023-12-22T09:12:51.938 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2023-12-22T09:12:51.938 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:52.160 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T09:12:52.209 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T09:12:52.209 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:52.209 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-22T09:12:52.209 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:53.939 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T09:12:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T09:12:54.021 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:54.021 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-22T09:12:54.021 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T09:12:54.021 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T09:12:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:54.247 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T09:12:54.322 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T09:12:54.322 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:54.322 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-22T09:12:54.322 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T09:12:54.322 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T09:12:54.322 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:54.823 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T09:12:54.899 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T09:12:54.899 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:54.899 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-22T09:12:54.899 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T09:12:54.899 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T09:12:54.899 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:55.016 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2023-12-22T09:12:55.449 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/171 2023-12-22T09:12:55.449 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/171 2023-12-22T09:12:55.449 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/171 2023-12-22T09:12:55.449 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/171 2023-12-22T09:12:55.449 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/171 2023-12-22T09:12:55.449 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/171 2023-12-22T09:12:55.449 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/171 2023-12-22T09:12:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/171 2023-12-22T09:12:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2023-12-22T09:12:55.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/171 2023-12-22T09:12:55.453 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/171 2023-12-22T09:12:55.454 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 80/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 81/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 82/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 83/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/171 2023-12-22T09:12:55.455 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.6-16.el9.x86_64 87/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 90/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 91/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 92/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 93/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 94/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 95/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 96/171 2023-12-22T09:12:55.456 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/171 2023-12-22T09:12:55.457 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.25.2-1.el9.noarch 113/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2023-12-22T09:12:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2023-12-22T09:12:55.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 148/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.45.9-1.el9.x86_64 150/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2023-12-22T09:12:55.460 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.45.9-1.el9.x86_64 152/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2023-12-22T09:12:55.461 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2023-12-22T09:12:55.462 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2023-12-22T09:12:55.462 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2023-12-22T09:12:55.462 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2023-12-22T09:12:55.462 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2023-12-22T09:12:55.462 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2023-12-22T09:12:55.626 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T09:12:55.661 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T09:12:55.707 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 121/171 2023-12-22T09:12:55.821 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 122/171 2023-12-22T09:12:55.855 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T09:12:56.166 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T09:12:56.197 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T09:12:57.294 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T09:12:57.322 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T09:12:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T09:12:57.628 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 126/171 2023-12-22T09:12:57.666 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T09:12:57.667 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-1:1.45.9-1.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team-1:1.45.9-1.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui-1:1.45.9-1.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: acl-2.3.1-4.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-0.190-2.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs-0.190-2.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-6.3.0-1.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.2-8.el9.noarch 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.7.4-5.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.669 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.4-9.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: jq-1.6-16.el9.x86_64 2023-12-22T09:12:57.671 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.672 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-13.11-1.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-22T09:12:57.673 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-22T09:12:57.674 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.25.2-1.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-22T09:12:57.675 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-22T09:12:57.676 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-22T09:12:57.676 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-22T09:12:57.676 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-22T09:12:57.676 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-22T09:12:57.676 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-22T09:12:57.676 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-22T09:12:57.676 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-22T09:12:57.676 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.677 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-5.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-22T09:12:57.678 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-22T09:12:57.679 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-22T09:12:57.680 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:12:57.680 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-12-22T09:12:57.767 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T09:12:57.767 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:57.767 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-22T09:12:57.767 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T09:12:57.767 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T09:12:57.768 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T09:12:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T09:12:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 129/171 2023-12-22T09:12:58.238 DEBUG:teuthology.parallel:result is None 2023-12-22T09:12:58.744 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2023-12-22T09:12:58.778 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T09:12:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T09:12:58.850 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:58.850 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-22T09:12:58.850 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T09:12:58.850 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T09:12:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:58.903 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T09:12:58.979 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T09:12:58.979 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:58.979 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-22T09:12:58.979 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T09:12:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T09:12:59.130 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:59.130 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-22T09:12:59.130 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T09:12:59.130 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T09:12:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:12:59.496 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T09:12:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T09:12:59.568 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T09:12:59.568 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-22T09:12:59.568 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T09:12:59.568 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T09:12:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:03.560 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/171 2023-12-22T09:13:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/171 2023-12-22T09:13:03.668 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 137/171 2023-12-22T09:13:03.709 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2023-12-22T09:13:03.746 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2023-12-22T09:13:04.009 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T09:13:04.134 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2023-12-22T09:13:04.162 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T09:13:04.196 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 143/171 2023-12-22T09:13:04.236 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2023-12-22T09:13:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-team-1:1.45.9-1.el9.x86_64 145/171 2023-12-22T09:13:04.386 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-tui-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T09:13:04.460 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2023-12-22T09:13:04.498 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2023-12-22T09:13:05.466 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T09:13:05.521 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T09:13:05.625 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T09:13:05.699 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2023-12-22T09:13:07.056 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 151/171 2023-12-22T09:13:07.143 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2023-12-22T09:13:07.187 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2023-12-22T09:13:07.304 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2023-12-22T09:13:07.337 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2023-12-22T09:13:07.371 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2023-12-22T09:13:07.405 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T09:13:07.462 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2023-12-22T09:13:07.462 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T09:13:07.579 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T09:13:07.630 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2023-12-22T09:13:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2023-12-22T09:13:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2023-12-22T09:13:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2023-12-22T09:13:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T09:13:07.880 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T09:13:07.910 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2023-12-22T09:13:07.951 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T09:13:07.951 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T09:13:08.269 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T09:13:08.269 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T09:13:08.418 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T09:13:08.454 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2023-12-22T09:13:08.499 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2023-12-22T09:13:08.556 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2023-12-22T09:13:08.703 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T09:13:08.969 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T09:13:08.969 INFO:teuthology.orchestra.run.smithi106.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-22T09:13:08.969 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:13.484 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/171 2023-12-22T09:13:13.484 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/171 2023-12-22T09:13:13.484 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/171 2023-12-22T09:13:13.484 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/171 2023-12-22T09:13:13.484 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/171 2023-12-22T09:13:13.484 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/171 2023-12-22T09:13:13.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/171 2023-12-22T09:13:13.486 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/171 2023-12-22T09:13:13.486 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/171 2023-12-22T09:13:13.486 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/171 2023-12-22T09:13:13.486 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/171 2023-12-22T09:13:13.486 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/171 2023-12-22T09:13:13.486 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/171 2023-12-22T09:13:13.486 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/171 2023-12-22T09:13:13.487 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/171 2023-12-22T09:13:13.487 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/171 2023-12-22T09:13:13.487 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/171 2023-12-22T09:13:13.487 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/171 2023-12-22T09:13:13.500 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/171 2023-12-22T09:13:13.500 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/171 2023-12-22T09:13:13.500 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/171 2023-12-22T09:13:13.500 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/171 2023-12-22T09:13:13.500 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/171 2023-12-22T09:13:13.500 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/171 2023-12-22T09:13:13.500 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/171 2023-12-22T09:13:13.500 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/171 2023-12-22T09:13:13.500 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2023-12-22T09:13:13.501 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/171 2023-12-22T09:13:13.502 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/171 2023-12-22T09:13:13.503 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 80/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 81/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 82/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 83/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : jq-1.6-16.el9.x86_64 87/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 90/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 91/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 92/171 2023-12-22T09:13:13.504 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ply-3.11-14.el9.noarch 93/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 94/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 95/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 96/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/171 2023-12-22T09:13:13.505 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:2.25.2-1.el9.noarch 113/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/171 2023-12-22T09:13:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/171 2023-12-22T09:13:13.507 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2023-12-22T09:13:13.507 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2023-12-22T09:13:13.507 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2023-12-22T09:13:13.507 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2023-12-22T09:13:13.507 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2023-12-22T09:13:13.507 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2023-12-22T09:13:13.507 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2023-12-22T09:13:13.507 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2023-12-22T09:13:13.508 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 148/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-team-1:1.45.9-1.el9.x86_64 150/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-tui-1:1.45.9-1.el9.x86_64 152/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2023-12-22T09:13:13.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2023-12-22T09:13:13.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2023-12-22T09:13:15.724 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2023-12-22T09:13:15.724 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-1:1.45.9-1.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-team-1:1.45.9-1.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-tui-1:1.45.9-1.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: acl-2.3.1-4.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-0.190-2.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs-0.190-2.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.725 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-6.3.0-1.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: automake-1.16.2-8.el9.noarch 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: bison-3.7.4-5.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.726 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.727 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: flex-2.6.4-9.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: jq-1.6-16.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-22T09:13:15.728 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.729 INFO:teuthology.orchestra.run.smithi106.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-13.11-1.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-22T09:13:15.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-22T09:13:15.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:2.25.2-1.el9.noarch 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-22T09:13:15.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-22T09:13:15.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-22T09:13:15.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-22T09:13:15.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-22T09:13:15.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-22T09:13:15.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-22T09:13:15.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-22T09:13:15.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-22T09:13:15.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-22T09:13:15.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-22T09:13:15.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-22T09:13:15.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply-3.11-14.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-22T09:13:15.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3-1.26.5-5.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.736 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.737 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T09:13:15.737 INFO:teuthology.orchestra.run.smithi106.stdout: re2-1:20211101-3.el9.x86_64 2023-12-22T09:13:15.737 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-22T09:13:15.737 INFO:teuthology.orchestra.run.smithi106.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-22T09:13:15.737 INFO:teuthology.orchestra.run.smithi106.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-22T09:13:15.737 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2023-12-22T09:13:15.737 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-22T09:13:15.737 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-22T09:13:15.737 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:15.738 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2023-12-22T09:13:16.304 DEBUG:teuthology.parallel:result is None 2023-12-22T09:13:16.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T09:13:16.452 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-22T09:13:16.508 INFO:teuthology.orchestra.run.smithi106.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-22T09:13:16.509 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-22T09:13:16.509 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-22T09:13:16.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T09:13:16.659 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-22T09:13:16.736 INFO:teuthology.orchestra.run.smithi132.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-22T09:13:16.737 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-22T09:13:16.737 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-22T09:13:16.738 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-22T09:13:16.739 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:16.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-22T09:13:16.825 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:16.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-22T09:13:16.929 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-22T09:13:16.929 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:16.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2023-12-22T09:13:17.007 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-22T09:13:17.127 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:17.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2023-12-22T09:13:17.229 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-22T09:13:17.369 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-22T09:13:17.369 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:17.369 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-22T09:13:17.450 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-22T09:13:17.565 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:17.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-22T09:13:17.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-22T09:13:17.808 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-22T09:13:17.808 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:17.808 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2023-12-22T09:13:17.885 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-22T09:13:18.010 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:18.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2023-12-22T09:13:18.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-22T09:13:18.205 INFO:teuthology.run_tasks:Running task ceph... 2023-12-22T09:13:18.279 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-22T09:13:18.279 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2023-12-22T09:13:18.288 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2023-12-22T09:13:18.383 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-22T09:13:18.384 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-22T09:13:18.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-22T09:13:18.481 INFO:tasks.ceph:Creating extra log directories... 2023-12-22T09:13:18.481 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-22T09:13:18.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-22T09:13:18.589 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-22T09:13:18.589 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-22T09:13:18.589 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-22T09:13:18.590 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:18.590 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-22T09:13:18.631 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-22T09:13:18.852 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-22T09:13:18.928 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:18.928 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-22T09:13:18.987 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-22T09:13:19.272 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-22T09:13:19.379 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-22T09:13:19.379 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-22T09:13:19.380 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499376', 'branch': 'rishabh-mdscap-reef', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': None, 'first_in_suite': False, 'job_id': '7499376', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mdscap-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mdscap-reef', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 9974, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'sleep_before_teardown': 0, 'subset': '301/512', 'suite': 'fs', 'suite_branch': 'rishabh-mdscap-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCa+j7yH7UB9Md7fE8VZAmvOc29D7+9np8OKX/Mgca+AlseXlhI20SPzrYPZS68b9s+gNYdxk3drot6bOHy+H78=', 'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh8rvQ6Xhm/F5i+tlVJEymePkA4otQSgJf/2x3Sa3o3O94SZNHATy/kXQBMI9k7ZVkms3TtlZmb2yhR0b8qc18='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9680d2aba1e76f64ade295c81599c97907457848', 'timestamp': '2023-12-22_08:10:43', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-22T09:13:19.381 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-22T09:13:19.387 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-22T09:13:19.443 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2023-12-22T09:13:19.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2023-12-22T09:13:19.576 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:19.576 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2023-12-22T09:13:19.619 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-22T09:13:19.619 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2023-12-22T09:13:19.707 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-22T09:13:19.707 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:13:19.707 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 631 Links: 1 2023-12-22T09:13:19.707 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:13:19.707 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T09:13:19.707 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-12-22 09:13:09.442036603 +0000 2023-12-22T09:13:19.707 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-12-22 09:10:16.735589487 +0000 2023-12-22T09:13:19.708 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-12-22 09:10:16.735589487 +0000 2023-12-22T09:13:19.708 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2023-12-22 09:10:16.735589487 +0000 2023-12-22T09:13:19.708 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-22T09:13:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-12-22T09:13:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-12-22T09:13:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000428561 s, 1.2 MB/s 2023-12-22T09:13:19.829 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-22T09:13:19.874 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2023-12-22T09:13:19.958 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-22T09:13:19.958 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:13:19.958 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-12-22T09:13:19.958 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:13:19.958 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T09:13:19.958 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-12-22 09:13:09.443036579 +0000 2023-12-22T09:13:19.958 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-12-22 09:10:17.795563668 +0000 2023-12-22T09:13:19.958 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-12-22 09:10:17.795563668 +0000 2023-12-22T09:13:19.958 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2023-12-22 09:10:17.795563668 +0000 2023-12-22T09:13:19.959 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-22T09:13:20.078 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-12-22T09:13:20.078 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-12-22T09:13:20.078 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000317078 s, 1.6 MB/s 2023-12-22T09:13:20.080 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-22T09:13:20.123 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2023-12-22T09:13:20.210 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-22T09:13:20.210 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:13:20.210 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-12-22T09:13:20.210 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:13:20.211 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T09:13:20.211 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-12-22 09:13:09.443036579 +0000 2023-12-22T09:13:20.211 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-12-22 09:10:18.831538432 +0000 2023-12-22T09:13:20.211 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-12-22 09:10:18.831538432 +0000 2023-12-22T09:13:20.211 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2023-12-22 09:10:18.831538432 +0000 2023-12-22T09:13:20.211 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-22T09:13:20.324 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-12-22T09:13:20.324 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-12-22T09:13:20.324 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000315473 s, 1.6 MB/s 2023-12-22T09:13:20.327 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-22T09:13:20.370 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2023-12-22T09:13:20.466 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-22T09:13:20.466 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:13:20.467 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-12-22T09:13:20.467 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:13:20.467 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T09:13:20.467 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-12-22 09:13:09.445036530 +0000 2023-12-22T09:13:20.467 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-12-22 09:10:19.833514025 +0000 2023-12-22T09:13:20.467 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-12-22 09:10:19.833514025 +0000 2023-12-22T09:13:20.467 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2023-12-22 09:10:19.833514025 +0000 2023-12-22T09:13:20.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-22T09:13:20.548 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-12-22T09:13:20.548 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-12-22T09:13:20.548 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000346563 s, 1.5 MB/s 2023-12-22T09:13:20.551 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-22T09:13:20.595 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:20.595 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:20.595 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2023-12-22T09:13:20.656 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-22T09:13:20.656 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2023-12-22T09:13:20.711 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-22T09:13:20.712 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:13:20.712 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-12-22T09:13:20.712 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:13:20.712 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T09:13:20.712 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-12-22 09:12:51.254007566 +0000 2023-12-22T09:13:20.712 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-12-22 09:10:16.771178249 +0000 2023-12-22T09:13:20.712 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-12-22 09:10:16.771178249 +0000 2023-12-22T09:13:20.712 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-12-22 09:10:16.771178249 +0000 2023-12-22T09:13:20.712 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-22T09:13:20.804 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-12-22T09:13:20.804 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-12-22T09:13:20.804 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.00035527 s, 1.4 MB/s 2023-12-22T09:13:20.807 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-22T09:13:20.864 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2023-12-22T09:13:20.915 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-22T09:13:20.915 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:13:20.915 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-12-22T09:13:20.916 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:13:20.916 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T09:13:20.916 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-12-22 09:12:51.255007540 +0000 2023-12-22T09:13:20.916 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-12-22 09:10:17.792151509 +0000 2023-12-22T09:13:20.916 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-12-22 09:10:17.793151482 +0000 2023-12-22T09:13:20.916 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-12-22 09:10:17.792151509 +0000 2023-12-22T09:13:20.916 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-22T09:13:21.003 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-12-22T09:13:21.003 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-12-22T09:13:21.003 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000331442 s, 1.5 MB/s 2023-12-22T09:13:21.007 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-22T09:13:21.062 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2023-12-22T09:13:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-22T09:13:21.115 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:13:21.115 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-12-22T09:13:21.115 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:13:21.115 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T09:13:21.115 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-12-22 09:12:51.256007514 +0000 2023-12-22T09:13:21.115 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-12-22 09:10:18.787125450 +0000 2023-12-22T09:13:21.116 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-12-22 09:10:18.787125450 +0000 2023-12-22T09:13:21.116 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-12-22 09:10:18.787125450 +0000 2023-12-22T09:13:21.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-22T09:13:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-12-22T09:13:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-12-22T09:13:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.00035155 s, 1.5 MB/s 2023-12-22T09:13:21.211 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-22T09:13:21.266 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2023-12-22T09:13:21.316 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-22T09:13:21.316 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:13:21.316 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-12-22T09:13:21.316 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:13:21.316 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T09:13:21.316 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-12-22 09:12:51.257007488 +0000 2023-12-22T09:13:21.316 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-12-22 09:10:19.797098998 +0000 2023-12-22T09:13:21.317 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-12-22 09:10:19.797098998 +0000 2023-12-22T09:13:21.317 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-12-22 09:10:19.797098998 +0000 2023-12-22T09:13:21.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-22T09:13:21.407 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-12-22T09:13:21.407 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-12-22T09:13:21.407 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000366243 s, 1.4 MB/s 2023-12-22T09:13:21.411 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-22T09:13:21.469 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:21.469 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-22T09:13:21.469 INFO:tasks.ceph:Generating config... 2023-12-22T09:13:21.470 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-22T09:13:21.470 INFO:tasks.ceph:[client] debug client = 20 2023-12-22T09:13:21.470 INFO:tasks.ceph:[client] debug ms = 1 2023-12-22T09:13:21.470 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-22T09:13:21.470 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-22T09:13:21.471 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-22T09:13:21.471 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-22T09:13:21.472 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-22T09:13:21.472 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-22T09:13:21.472 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-22T09:13:21.473 INFO:tasks.ceph:Setting up mon.a... 2023-12-22T09:13:21.473 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-22T09:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.keyring 2023-12-22T09:13:21.635 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-22T09:13:21.761 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T09:13:21.847 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.106'), ('mon.b', '172.21.15.132'), ('mon.c', '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]')] 2023-12-22T09:13:21.847 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.106,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-22T09:13:21.848 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:21.848 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-22T09:13:21.901 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.106 --add b 172.21.15.132 --addv c '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:22.055 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:22.055 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: generated fsid c9422aac-a1e3-428b-87d0-2dbf321c6b46 2023-12-22T09:13:22.055 INFO:teuthology.orchestra.run.smithi106.stdout:setting min_mon_release = pacific 2023-12-22T09:13:22.055 INFO:teuthology.orchestra.run.smithi106.stdout:epoch 0 2023-12-22T09:13:22.055 INFO:teuthology.orchestra.run.smithi106.stdout:fsid c9422aac-a1e3-428b-87d0-2dbf321c6b46 2023-12-22T09:13:22.056 INFO:teuthology.orchestra.run.smithi106.stdout:last_changed 2023-12-22T09:13:22.055838+0000 2023-12-22T09:13:22.056 INFO:teuthology.orchestra.run.smithi106.stdout:created 2023-12-22T09:13:22.055838+0000 2023-12-22T09:13:22.056 INFO:teuthology.orchestra.run.smithi106.stdout:min_mon_release 16 (pacific) 2023-12-22T09:13:22.056 INFO:teuthology.orchestra.run.smithi106.stdout:election_strategy: 1 2023-12-22T09:13:22.056 INFO:teuthology.orchestra.run.smithi106.stdout:0: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.a 2023-12-22T09:13:22.056 INFO:teuthology.orchestra.run.smithi106.stdout:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2023-12-22T09:13:22.056 INFO:teuthology.orchestra.run.smithi106.stdout:2: [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] mon.c 2023-12-22T09:13:22.056 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-22T09:13:22.058 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-22T09:13:22.108 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c9422aac-a1e3-428b-87d0-2dbf321c6b46... 2023-12-22T09:13:22.109 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T09:13:22.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T09:13:22.272 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2023-12-22T09:13:22.272 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2023-12-22T09:13:22.272 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.273 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2023-12-22T09:13:22.274 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.106,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on skipped message = False 2023-12-22T09:13:22.275 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = c9422aac-a1e3-428b-87d0-2dbf321c6b46 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2023-12-22T09:13:22.276 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.277 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2023-12-22T09:13:22.277 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2023-12-22T09:13:22.277 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.277 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2023-12-22T09:13:22.277 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.277 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2023-12-22T09:13:22.277 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.277 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2023-12-22T09:13:22.277 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2023-12-22T09:13:22.278 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2023-12-22T09:13:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2023-12-22T09:13:22.280 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2023-12-22T09:13:22.281 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2023-12-22T09:13:22.282 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2023-12-22T09:13:22.283 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2023-12-22T09:13:22.294 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2023-12-22T09:13:22.295 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2023-12-22T09:13:22.296 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2023-12-22T09:13:22.297 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.106,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on skipped message = False 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = c9422aac-a1e3-428b-87d0-2dbf321c6b46 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.298 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2023-12-22T09:13:22.299 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 20 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 20 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 10 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2023-12-22T09:13:22.300 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-12-22T09:13:22.301 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T09:13:22.302 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2023-12-22T09:13:22.303 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-12-22T09:13:22.304 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-12-22T09:13:22.305 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-12-22T09:13:22.341 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-22T09:13:22.342 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-22T09:13:22.492 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-22T09:13:22.492 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:22.492 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-22T09:13:22.541 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:22.541 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-22T09:13:22.636 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2023-12-22T09:13:22.636 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:22.636 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-22T09:13:22.636 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T09:13:22.787 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:22.787 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:22.888 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T09:13:22.888 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:22.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-22T09:13:22.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T09:13:23.047 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:23.048 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:23.148 INFO:tasks.ceph:Setting up mon nodes... 2023-12-22T09:13:23.148 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-22T09:13:23.148 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-22T09:13:23.333 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-22T09:13:23.345 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-22T09:13:23.586 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-22T09:13:23.598 INFO:tasks.ceph:Setting up mds nodes... 2023-12-22T09:13:23.599 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-22T09:13:23.790 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-22T09:13:23.799 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-22T09:13:23.894 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-22T09:13:24.065 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-22T09:13:24.075 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-22T09:13:24.172 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-22T09:13:24.357 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-22T09:13:24.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-22T09:13:24.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-22T09:13:24.637 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-22T09:13:24.647 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-22T09:13:24.732 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-22T09:13:24.733 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-22T09:13:24.871 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-22T09:13:24.928 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-22T09:13:25.061 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-22T09:13:25.116 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-22T09:13:25.117 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-22T09:13:25.117 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-22T09:13:25.222 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:25.222 INFO:tasks.ceph:role: osd.0 2023-12-22T09:13:25.222 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2023-12-22T09:13:25.222 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-22T09:13:25.327 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:13:25.327 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:13:25.327 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:13:25.327 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T09:13:25.328 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:13:25.328 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:13:25.328 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:13:25.328 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T09:13:25.328 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:13:25.328 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:13:25.854 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-12-22T09:13:25.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-12-22T09:13:25.860 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-22T09:13:26.046 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-22T09:13:26.150 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-22T09:13:26.246 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:26.246 INFO:tasks.ceph:role: osd.1 2023-12-22T09:13:26.246 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2023-12-22T09:13:26.246 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-22T09:13:26.347 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:13:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:13:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:13:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T09:13:26.347 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:13:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:13:26.347 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:13:26.348 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T09:13:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:13:26.348 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:13:26.841 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-12-22T09:13:26.847 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-12-22T09:13:26.847 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-22T09:13:26.978 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-22T09:13:27.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-22T09:13:27.162 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:27.163 INFO:tasks.ceph:role: osd.2 2023-12-22T09:13:27.163 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2023-12-22T09:13:27.163 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-22T09:13:27.262 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:13:27.262 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:13:27.262 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:13:27.262 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T09:13:27.262 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:13:27.263 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:13:27.263 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:13:27.263 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T09:13:27.263 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:13:27.263 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:13:27.779 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-12-22T09:13:27.786 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-12-22T09:13:27.786 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-22T09:13:27.985 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-22T09:13:28.096 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-22T09:13:28.193 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:28.193 INFO:tasks.ceph:role: osd.3 2023-12-22T09:13:28.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2023-12-22T09:13:28.193 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-22T09:13:28.291 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:13:28.292 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:13:28.292 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:13:28.292 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T09:13:28.292 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:13:28.293 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:13:28.293 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:13:28.293 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T09:13:28.293 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:13:28.293 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:13:28.752 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-12-22T09:13:28.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-12-22T09:13:28.760 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-22T09:13:28.912 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-22T09:13:29.018 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:29.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:29.178+0000 7f6eb5739500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-22T09:13:29.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:29.182+0000 7f6eb5739500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-22T09:13:29.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:29.182+0000 7f6eb5739500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-22T09:13:29.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:29.182+0000 7f6eb5739500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-22T09:13:29.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:29.182+0000 7f6eb5739500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-22T09:13:29.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:29.191+0000 7f6eb5739500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-22T09:13:32.128 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-22T09:13:32.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:32.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:32.366+0000 7fbac2014500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-22T09:13:32.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:32.367+0000 7fbac2014500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-22T09:13:32.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:32.367+0000 7fbac2014500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-22T09:13:32.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:32.367+0000 7fbac2014500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-22T09:13:32.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:32.367+0000 7fbac2014500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-22T09:13:32.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:32.369+0000 7fbac2014500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-22T09:13:35.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-22T09:13:35.646 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:35.787+0000 7fe2c6ec9500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-22T09:13:35.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:35.787+0000 7fe2c6ec9500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-22T09:13:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:35.788+0000 7fe2c6ec9500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-22T09:13:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:35.788+0000 7fe2c6ec9500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-22T09:13:35.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:35.788+0000 7fe2c6ec9500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-22T09:13:35.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:35.791+0000 7fe2c6ec9500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-22T09:13:38.723 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-22T09:13:38.822 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:38.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:38.962+0000 7f9ffe5fe500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-22T09:13:38.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:38.962+0000 7f9ffe5fe500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-22T09:13:38.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:38.962+0000 7f9ffe5fe500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-22T09:13:38.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:38.962+0000 7f9ffe5fe500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-22T09:13:38.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:38.962+0000 7f9ffe5fe500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-22T09:13:38.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:13:38.965+0000 7f9ffe5fe500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-22T09:13:42.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-22T09:13:42.223 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-22T09:13:42.328 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:42.328 INFO:tasks.ceph:role: osd.4 2023-12-22T09:13:42.328 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T09:13:42.328 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:13:42.429 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:13:42.952 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-12-22T09:13:42.958 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-12-22T09:13:42.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-22T09:13:43.142 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-22T09:13:43.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-22T09:13:43.327 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:43.327 INFO:tasks.ceph:role: osd.5 2023-12-22T09:13:43.327 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T09:13:43.327 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-22T09:13:43.410 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:13:43.410 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:13:43.410 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:13:43.411 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T09:13:43.411 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:13:43.411 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:13:43.411 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:13:43.411 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T09:13:43.411 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:13:43.411 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:13:43.883 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-12-22T09:13:43.888 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-12-22T09:13:43.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-22T09:13:44.020 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-22T09:13:44.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-22T09:13:44.193 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:44.193 INFO:tasks.ceph:role: osd.6 2023-12-22T09:13:44.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T09:13:44.193 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-22T09:13:44.278 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:13:44.278 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:13:44.278 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:13:44.278 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T09:13:44.278 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:13:44.279 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:13:44.279 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:13:44.279 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T09:13:44.279 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:13:44.279 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:13:44.796 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-12-22T09:13:44.801 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-12-22T09:13:44.802 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-22T09:13:44.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-22T09:13:45.095 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-22T09:13:45.191 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:13:45.191 INFO:tasks.ceph:role: osd.7 2023-12-22T09:13:45.192 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T09:13:45.192 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-22T09:13:45.298 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:13:45.298 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:13:45.298 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:13:45.298 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T09:13:45.298 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:13:45.298 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:13:45.299 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:13:45.299 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T09:13:45.299 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:13:45.299 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:13:45.749 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-12-22T09:13:45.754 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-12-22T09:13:45.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-22T09:13:45.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-22T09:13:45.967 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:46.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:46.116+0000 7fe7aff6c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-22T09:13:46.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:46.122+0000 7fe7aff6c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-22T09:13:46.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:46.122+0000 7fe7aff6c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-22T09:13:46.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:46.122+0000 7fe7aff6c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-22T09:13:46.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:46.122+0000 7fe7aff6c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-22T09:13:46.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:46.129+0000 7fe7aff6c500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-22T09:13:49.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-22T09:13:49.154 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:49.294+0000 7fab51424500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-22T09:13:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:49.295+0000 7fab51424500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-22T09:13:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:49.295+0000 7fab51424500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-22T09:13:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:49.295+0000 7fab51424500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-22T09:13:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:49.295+0000 7fab51424500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-22T09:13:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:49.297+0000 7fab51424500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-22T09:13:49.382 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:13:49.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:13:52.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-22T09:13:52.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:52.456+0000 7faf81e11500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-22T09:13:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:52.456+0000 7faf81e11500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-22T09:13:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:52.456+0000 7faf81e11500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-22T09:13:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:52.456+0000 7faf81e11500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-22T09:13:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:52.456+0000 7faf81e11500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-22T09:13:52.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:52.459+0000 7faf81e11500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-22T09:13:55.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-22T09:13:55.465 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:13:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:55.604+0000 7fd6bfd6c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-22T09:13:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:55.604+0000 7fd6bfd6c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-22T09:13:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:55.604+0000 7fd6bfd6c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-22T09:13:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:55.604+0000 7fd6bfd6c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-22T09:13:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:55.604+0000 7fd6bfd6c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-22T09:13:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:13:55.606+0000 7fd6bfd6c500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-22T09:13:58.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-22T09:13:58.625 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-22T09:13:58.625 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:58.625 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-22T09:13:58.729 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:58.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-22T09:13:58.823 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:58.823 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-22T09:13:58.920 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:58.920 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-22T09:13:59.007 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:59.008 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-22T09:13:59.105 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:59.105 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-22T09:13:59.203 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:59.203 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-22T09:13:59.300 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:59.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-22T09:13:59.406 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:59.406 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-22T09:13:59.499 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:59.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-22T09:13:59.601 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:59.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-22T09:13:59.704 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:59.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-22T09:13:59.800 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:59.800 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-22T09:13:59.897 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:13:59.897 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-22T09:13:59.985 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:13:59.985 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-22T09:14:00.046 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:14:00.046 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-22T09:14:00.105 INFO:tasks.ceph:Adding keys to all mons... 2023-12-22T09:14:00.105 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-22T09:14:00.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-22T09:14:00.202 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAzU4VlNjb0ExAAVGE9vTIVcmlv6k9ayU0aWA== 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAzU4VlwWkqLxAApz1giF6+ha0K7ztx/4TxuA== 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA0U4VlNW78AxAAtjjvQMtyKLXjO553rvgbzg== 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA5U4VlZj6+ChAAgUGYECmhf7VMz7jptVK6kg== 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA8U4VlC5/yFRAAOCUCyRLUmz+2agqeuZvQmQ== 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA/U4Vln1YGLxAA8/8yn/FrMvPmQjohk/Yuag== 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBCU4Vl0m1gORAA4j0GIYcQmoWPOiWeDXme+w== 2023-12-22T09:14:00.203 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAzU4Vl9kj8IhAA0uOah8x3KUQ+6skT+MpbwQ== 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA0U4VlZGlkFRAAlhOp8GuimPn+NUbxP7ZllQ== 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA0U4VlUtEPJhAA3bcdbWblGawtQSyE26PH9A== 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBKU4VlC/kABxAAXafE0YIVbfH0+PwzNYZ6cA== 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBNU4VlrO2bERAAvVCV9iET01m3JXQ71+IO+w== 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBQU4Vl1qE9GxAANLGc1YGoglBh6qkE6vCFCA== 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBTU4Vl5YYMJBAAoxMjGGh5W1Ov5y4ZkvmoGg== 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA0U4Vl+O39MxAAKadHlnvSTbHMtmqYe65N8w== 2023-12-22T09:14:00.204 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2023-12-22T09:14:00.205 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA1U4VlrsGyAxAAMbxdEGSzUNtfZVI5FP8Llw== 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAzU4VlNjb0ExAAVGE9vTIVcmlv6k9ayU0aWA== 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAzU4VlwWkqLxAApz1giF6+ha0K7ztx/4TxuA== 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQA0U4VlNW78AxAAtjjvQMtyKLXjO553rvgbzg== 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQA5U4VlZj6+ChAAgUGYECmhf7VMz7jptVK6kg== 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2023-12-22T09:14:00.206 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQA8U4VlC5/yFRAAOCUCyRLUmz+2agqeuZvQmQ== 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQA/U4Vln1YGLxAA8/8yn/FrMvPmQjohk/Yuag== 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBCU4Vl0m1gORAA4j0GIYcQmoWPOiWeDXme+w== 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAzU4Vl9kj8IhAA0uOah8x3KUQ+6skT+MpbwQ== 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQA0U4VlZGlkFRAAlhOp8GuimPn+NUbxP7ZllQ== 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQA0U4VlUtEPJhAA3bcdbWblGawtQSyE26PH9A== 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBKU4VlC/kABxAAXafE0YIVbfH0+PwzNYZ6cA== 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBNU4VlrO2bERAAvVCV9iET01m3JXQ71+IO+w== 2023-12-22T09:14:00.207 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2023-12-22T09:14:00.208 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBQU4Vl1qE9GxAANLGc1YGoglBh6qkE6vCFCA== 2023-12-22T09:14:00.208 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2023-12-22T09:14:00.208 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBTU4Vl5YYMJBAAoxMjGGh5W1Ov5y4ZkvmoGg== 2023-12-22T09:14:00.208 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-12-22T09:14:00.208 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQA0U4Vl+O39MxAAKadHlnvSTbHMtmqYe65N8w== 2023-12-22T09:14:00.208 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-12-22T09:14:00.208 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQA1U4VlrsGyAxAAMbxdEGSzUNtfZVI5FP8Llw== 2023-12-22T09:14:00.210 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T09:14:00.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T09:14:00.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T09:14:00.373 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T09:14:00.522 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T09:14:00.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T09:14:00.682 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:00.690 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:00.833 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:00.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:00.980 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:00.989 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:01.129 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:01.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:01.279 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T09:14:01.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T09:14:01.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T09:14:01.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T09:14:01.576 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T09:14:01.582 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T09:14:01.730 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:01.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:01.871 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:01.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:02.013 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:02.019 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:02.166 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:02.174 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T09:14:02.310 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T09:14:02.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T09:14:02.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T09:14:02.469 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T09:14:02.616 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-22T09:14:02.616 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-22T09:14:02.712 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T09:14:02.866 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-22T09:14:02.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-22T09:14:03.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T09:14:03.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-22T09:14:03.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-22T09:14:03.374 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T09:14:03.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-22T09:14:03.602 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:14:03.611 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:14:03.662 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-22T09:14:03.663 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-22T09:14:03.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-22T09:14:03.668 INFO:tasks.ceph.mon.a:Started 2023-12-22T09:14:03.669 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-22T09:14:03.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-22T09:14:03.673 INFO:tasks.ceph.mon.b:Started 2023-12-22T09:14:03.674 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-22T09:14:03.674 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-22T09:14:03.679 INFO:tasks.ceph.mon.c:Started 2023-12-22T09:14:03.679 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-22T09:14:03.679 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-22T09:14:03.679 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-22T09:14:03.684 INFO:tasks.ceph.mgr.y:Started 2023-12-22T09:14:03.684 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-22T09:14:03.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-22T09:14:03.690 INFO:tasks.ceph.mgr.x:Started 2023-12-22T09:14:03.690 INFO:tasks.ceph:Setting crush tunables to default 2023-12-22T09:14:03.690 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd crush tunables default 2023-12-22T09:14:03.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.874+0000 7fd4b0da2640 1 Processor -- start 2023-12-22T09:14:03.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.874+0000 7fd4b0da2640 1 -- start start 2023-12-22T09:14:03.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4b0da2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 0x7fd4ac0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:03.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4b0da2640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd4ac154790 0x7fd4ac0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:03.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4b0da2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac06f6f0 con 0x7fd4ac0c1d10 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4b0da2640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac0c3bc0 con 0x7fd4ac154790 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4b0da2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac154c70 con 0x7fd4ac0c3da0 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4ab7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 0x7fd4ac0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4ab7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 0x7fd4ac0c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:54008/0 (socket says 172.21.15.106:54008) 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4ab7fe640 1 -- 172.21.15.106:0/3488644144 learned_addr learned my addr 172.21.15.106:0/3488644144 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4abfff640 1 --1- 172.21.15.106:0/3488644144 >> v1:172.21.15.132:6789/0 conn(0x7fd4ac0c1d10 0x7fd4ac155180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:45920/0 (socket says 172.21.15.106:45920) 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.875+0000 7fd4a3fff640 1 --2- 172.21.15.106:0/3488644144 >> v2:172.21.15.106:3300/0 conn(0x7fd4ac154790 0x7fd4ac0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.876+0000 7fd4ab7fe640 1 -- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 msgr2=0x7fd4ac0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.876+0000 7fd4ab7fe640 1 -- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 msgr2=0x7fd4ac0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T09:14:03.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.876+0000 7fd4ab7fe640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 0x7fd4ac0c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-22T09:14:03.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.876+0000 7fd4ab7fe640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 0x7fd4ac0c4180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-22T09:14:03.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.876+0000 7fd4a3fff640 1 -- 172.21.15.106:0/3488644144 >> v2:172.21.15.106:3300/0 conn(0x7fd4ac154790 msgr2=0x7fd4ac0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-22T09:14:03.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.876+0000 7fd4a3fff640 1 -- 172.21.15.106:0/3488644144 >> v2:172.21.15.106:3300/0 conn(0x7fd4ac154790 msgr2=0x7fd4ac0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T09:14:03.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.876+0000 7fd4a3fff640 1 --2- 172.21.15.106:0/3488644144 >> v2:172.21.15.106:3300/0 conn(0x7fd4ac154790 0x7fd4ac0c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-22T09:14:03.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.876+0000 7fd4a3fff640 1 --2- 172.21.15.106:0/3488644144 >> v2:172.21.15.106:3300/0 conn(0x7fd4ac154790 0x7fd4ac0c46c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-22T09:14:03.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784064644 0 0) 0x7fd4ac06f6f0 con 0x7fd4ac0c1d10 2023-12-22T09:14:03.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd498003520 con 0x7fd4ac0c1d10 2023-12-22T09:14:03.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3508721398 0 0) 0x7fd498003520 con 0x7fd4ac0c1d10 2023-12-22T09:14:03.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 msgr2=0x7fd4ac0c4180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 0x7fd4ac0c4180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 >> v2:172.21.15.106:3300/0 conn(0x7fd4ac154790 msgr2=0x7fd4ac0c46c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 --2- 172.21.15.106:0/3488644144 >> v2:172.21.15.106:3300/0 conn(0x7fd4ac154790 0x7fd4ac0c46c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac06fb80 con 0x7fd4ac0c1d10 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fd4a40019f0 con 0x7fd4ac0c1d10 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 >> v1:172.21.15.132:6789/0 conn(0x7fd4ac0c1d10 legacy=0x7fd4ac155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd498003970 0x7fd498003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4980047c0 0x7fd498004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.878+0000 7fd4aaffd640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 0x7fd4980051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4a3fff640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4980047c0 0x7fd498004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0c3bc0 con 0x7fd498003970 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac154c70 con 0x7fd4980047c0 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49800bb10 con 0x7fd4ac0c3da0 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4ab7fe640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd498003970 0x7fd498003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:03.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4a3fff640 1 -- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 msgr2=0x7fd4980051a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-22T09:14:03.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4a3fff640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0c3da0 0x7fd4980051a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4a3fff640 1 -- 172.21.15.106:0/3488644144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd498003970 msgr2=0x7fd498003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:03.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4a3fff640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd498003970 0x7fd498003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4a3fff640 1 -- 172.21.15.106:0/3488644144 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498003520 con 0x7fd4980047c0 2023-12-22T09:14:03.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.879+0000 7fd4ab7fe640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd498003970 0x7fd498003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:03.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.881+0000 7fd4a3fff640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4980047c0 0x7fd498004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd49400b9e0 tx=0x7fd4980057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b34f6ceef9b68f34 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:03.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.881+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494032620 con 0x7fd4980047c0 2023-12-22T09:14:03.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.881+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494032780 con 0x7fd4980047c0 2023-12-22T09:14:03.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.881+0000 7fd4aaffd640 1 -- 172.21.15.106:0/3488644144 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494032b30 con 0x7fd4980047c0 2023-12-22T09:14:03.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.882+0000 7fd4b0da2640 1 -- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4980047c0 msgr2=0x7fd498004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:03.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.882+0000 7fd4b0da2640 1 --2- 172.21.15.106:0/3488644144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4980047c0 0x7fd498004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd49400b9e0 tx=0x7fd4980057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.882+0000 7fd4abfff640 1 -- 172.21.15.106:0/3488644144 reap_dead start 2023-12-22T09:14:03.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.882+0000 7fd4b0da2640 1 -- 172.21.15.106:0/3488644144 shutdown_connections 2023-12-22T09:14:03.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.882+0000 7fd4b0da2640 1 -- 172.21.15.106:0/3488644144 >> 172.21.15.106:0/3488644144 conn(0x7fd4ac069bf0 msgr2=0x7fd4ac069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.882+0000 7fd4b0da2640 1 -- 172.21.15.106:0/3488644144 shutdown_connections 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.883+0000 7fd4b0da2640 1 -- 172.21.15.106:0/3488644144 wait complete. 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.884+0000 7fd4b0da2640 1 Processor -- start 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.884+0000 7fd4b0da2640 1 -- start start 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.885+0000 7fd4b0da2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4980047c0 0x7fd4ac0c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.885+0000 7fd4b0da2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac0c0e30 0x7fd4ac0bc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.885+0000 7fd4b0da2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0bcd50 0x7fd4ac151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.885+0000 7fd4b0da2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac1ed8c0 con 0x7fd4980047c0 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.885+0000 7fd4b0da2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0c12b0 con 0x7fd4ac0c0e30 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.885+0000 7fd4b0da2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0bd800 con 0x7fd4ac0bcd50 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4ab7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4980047c0 0x7fd4ac0c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4ab7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4980047c0 0x7fd4ac0c08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48536/0 (socket says 172.21.15.106:48536) 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4ab7fe640 1 -- 172.21.15.106:0/299095844 learned_addr learned my addr 172.21.15.106:0/299095844 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:03.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4a3fff640 1 --2- 172.21.15.106:0/299095844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac0c0e30 0x7fd4ac0bc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4abfff640 1 --2- 172.21.15.106:0/299095844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0bcd50 0x7fd4ac151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4ab7fe640 1 -- 172.21.15.106:0/299095844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0bcd50 msgr2=0x7fd4ac151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4ab7fe640 1 --2- 172.21.15.106:0/299095844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0bcd50 0x7fd4ac151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4ab7fe640 1 -- 172.21.15.106:0/299095844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac0c0e30 msgr2=0x7fd4ac0bc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4ab7fe640 1 --2- 172.21.15.106:0/299095844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac0c0e30 0x7fd4ac0bc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4ab7fe640 1 -- 172.21.15.106:0/299095844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac1ed300 con 0x7fd4980047c0 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.886+0000 7fd4ab7fe640 1 --2- 172.21.15.106:0/299095844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4980047c0 0x7fd4ac0c08f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd49c010890 tx=0x7fd49c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.887+0000 7fd4a8ff9640 1 -- 172.21.15.106:0/299095844 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c004020 con 0x7fd4980047c0 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.887+0000 7fd4a8ff9640 1 -- 172.21.15.106:0/299095844 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c004180 con 0x7fd4980047c0 2023-12-22T09:14:03.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.887+0000 7fd4b0da2640 1 -- 172.21.15.106:0/299095844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac1ed5e0 con 0x7fd4980047c0 2023-12-22T09:14:03.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.887+0000 7fd4a8ff9640 1 -- 172.21.15.106:0/299095844 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00e9c0 con 0x7fd4980047c0 2023-12-22T09:14:03.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.887+0000 7fd4b0da2640 1 -- 172.21.15.106:0/299095844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac0bd1d0 con 0x7fd4980047c0 2023-12-22T09:14:03.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.887+0000 7fd4a8ff9640 1 -- 172.21.15.106:0/299095844 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd49c00eb20 con 0x7fd4980047c0 2023-12-22T09:14:03.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.888+0000 7fd4a8ff9640 1 -- 172.21.15.106:0/299095844 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd49c015470 con 0x7fd4980047c0 2023-12-22T09:14:03.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.888+0000 7fd4b0da2640 1 -- 172.21.15.106:0/299095844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac151db0 con 0x7fd4980047c0 2023-12-22T09:14:03.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.892+0000 7fd4a8ff9640 1 -- 172.21.15.106:0/299095844 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fd49c01a030 con 0x7fd4980047c0 2023-12-22T09:14:03.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.963+0000 7fd4b0da2640 1 -- 172.21.15.106:0/299095844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd4ac0bd660 con 0x7fd4980047c0 2023-12-22T09:14:03.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.968+0000 7fd4a8ff9640 1 -- 172.21.15.106:0/299095844 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd4ac0bd660 con 0x7fd4980047c0 2023-12-22T09:14:03.968 INFO:teuthology.orchestra.run.smithi106.stderr:adjusted tunables profile to default 2023-12-22T09:14:03.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.969+0000 7fd4b0da2640 1 -- 172.21.15.106:0/299095844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4980047c0 msgr2=0x7fd4ac0c08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:03.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.969+0000 7fd4b0da2640 1 --2- 172.21.15.106:0/299095844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4980047c0 0x7fd4ac0c08f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd49c010890 tx=0x7fd49c010d50 comp rx=0 tx=0).stop 2023-12-22T09:14:03.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.969+0000 7fd4b0da2640 1 -- 172.21.15.106:0/299095844 shutdown_connections 2023-12-22T09:14:03.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.969+0000 7fd4b0da2640 1 --2- 172.21.15.106:0/299095844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4ac0bcd50 0x7fd4ac151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.969+0000 7fd4b0da2640 1 --2- 172.21.15.106:0/299095844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4ac0c0e30 0x7fd4ac0bc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.969+0000 7fd4b0da2640 1 --2- 172.21.15.106:0/299095844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4980047c0 0x7fd4ac0c08f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:03.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.969+0000 7fd4b0da2640 1 -- 172.21.15.106:0/299095844 >> 172.21.15.106:0/299095844 conn(0x7fd4ac069bf0 msgr2=0x7fd4ac0c7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:03.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.969+0000 7fd4b0da2640 1 -- 172.21.15.106:0/299095844 shutdown_connections 2023-12-22T09:14:03.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:03.969+0000 7fd4b0da2640 1 -- 172.21.15.106:0/299095844 wait complete. 2023-12-22T09:14:03.988 INFO:tasks.ceph:check_enable_crimson: False 2023-12-22T09:14:03.988 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-22T09:14:03.989 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:14:03.989 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-22T09:14:04.061 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:14:04.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-22T09:14:04.192 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:14:04.192 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-22T09:14:04.272 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:14:04.273 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-22T09:14:04.401 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:14:04.401 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-22T09:14:04.429 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:04.429+0000 7f82b6656040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-22T09:14:04.488 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:04.488+0000 7f82b6656040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-22T09:14:04.491 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:14:04.492 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-22T09:14:04.568 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:14:04.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-22T09:14:04.605 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:04.605+0000 7f1e7f24c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-22T09:14:04.671 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:04.671+0000 7f1e7f24c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-22T09:14:04.697 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:14:04.698 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-22T09:14:04.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new cfdeeba0-d07e-4bf9-bba1-2a8275dccf15 0 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.987+0000 7f773edac640 1 Processor -- start 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.987+0000 7f773edac640 1 -- start start 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773edac640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773edac640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f773806f890 0x7f77380c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773edac640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77380c7220 con 0x7f77380c7e30 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773edac640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77380bad20 con 0x7f773806f890 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773edac640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7738152900 con 0x7f773814efb0 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773ddaa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773d5a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f773806f890 0x7f77380c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773ddaa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:34052/0 (socket says 172.21.15.132:34052) 2023-12-22T09:14:04.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773ddaa640 1 -- 172.21.15.132:0/3594291979 learned_addr learned my addr 172.21.15.132:0/3594291979 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:04.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.989+0000 7f773ddaa640 1 -- 172.21.15.132:0/3594291979 >> v2:172.21.15.132:3300/0 conn(0x7f773806f890 msgr2=0x7f77380c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:04.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.990+0000 7f773ddaa640 1 --2- 172.21.15.132:0/3594291979 >> v2:172.21.15.132:3300/0 conn(0x7f773806f890 0x7f77380c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:04.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.990+0000 7f773ddaa640 1 -- 172.21.15.132:0/3594291979 >> v1:172.21.15.132:6789/0 conn(0x7f77380c7e30 legacy=0x7f77380c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:04.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.990+0000 7f773ddaa640 1 -- 172.21.15.132:0/3594291979 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7738152380 con 0x7f773814efb0 2023-12-22T09:14:04.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.990+0000 7f773d5a9640 1 --2- 172.21.15.132:0/3594291979 >> v2:172.21.15.132:3300/0 conn(0x7f773806f890 0x7f77380c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.991+0000 7f773ddaa640 1 --2- 172.21.15.132:0/3594291979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380c78f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7728009e50 tx=0x7f772802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e9b05054c62fdca server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.991+0000 7f773cda8640 1 -- 172.21.15.132:0/3594291979 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772802ca80 con 0x7f773814efb0 2023-12-22T09:14:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.991+0000 7f773cda8640 1 -- 172.21.15.132:0/3594291979 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772802cbe0 con 0x7f773814efb0 2023-12-22T09:14:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.991+0000 7f773cda8640 1 -- 172.21.15.132:0/3594291979 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280343f0 con 0x7f773814efb0 2023-12-22T09:14:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.992+0000 7f773edac640 1 -- 172.21.15.132:0/3594291979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 msgr2=0x7f77380c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:04.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.992+0000 7f773edac640 1 --2- 172.21.15.132:0/3594291979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380c78f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7728009e50 tx=0x7f772802bee0 comp rx=0 tx=0).stop 2023-12-22T09:14:04.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.992+0000 7f773edac640 1 -- 172.21.15.132:0/3594291979 shutdown_connections 2023-12-22T09:14:04.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.992+0000 7f773edac640 1 --2- 172.21.15.132:0/3594291979 >> v2:172.21.15.132:3300/0 conn(0x7f773806f890 0x7f77380c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:04.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.992+0000 7f773edac640 1 --2- 172.21.15.132:0/3594291979 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380c78f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:04.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.992+0000 7f773edac640 1 -- 172.21.15.132:0/3594291979 >> 172.21.15.132:0/3594291979 conn(0x7f7738069fe0 msgr2=0x7f773806a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:04.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.992+0000 7f773edac640 1 -- 172.21.15.132:0/3594291979 shutdown_connections 2023-12-22T09:14:04.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.992+0000 7f773edac640 1 -- 172.21.15.132:0/3594291979 wait complete. 2023-12-22T09:14:04.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.994+0000 7f773edac640 1 Processor -- start 2023-12-22T09:14:04.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.994+0000 7f773edac640 1 -- start start 2023-12-22T09:14:04.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773edac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773806f890 0x7f77380c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:04.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773edac640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77380c7e30 0x7f77380ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773edac640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773edac640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77380bf5b0 con 0x7f77380c7e30 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773edac640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77380bf890 con 0x7f773806f890 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773edac640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77380bfb70 con 0x7f773814efb0 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773ddaa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773806f890 0x7f77380c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773e5ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773ddaa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773806f890 0x7f77380c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51484/0 (socket says 172.21.15.132:51484) 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.995+0000 7f773ddaa640 1 -- 172.21.15.132:0/1692334663 learned_addr learned my addr 172.21.15.132:0/1692334663 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773d5a9640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77380c7e30 0x7f77380ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773e5ab640 1 -- 172.21.15.132:0/1692334663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773806f890 msgr2=0x7f77380c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773e5ab640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773806f890 0x7f77380c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773e5ab640 1 -- 172.21.15.132:0/1692334663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77380c7e30 msgr2=0x7f77380ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:04.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773e5ab640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77380c7e30 0x7f77380ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773e5ab640 1 -- 172.21.15.132:0/1692334663 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c009400 con 0x7f773814efb0 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773ddaa640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773806f890 0x7f77380c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773d5a9640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77380c7e30 0x7f77380ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773e5ab640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380abc50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f773000c310 tx=0x7f773000c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f77367fc640 1 -- 172.21.15.132:0/1692334663 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300052d0 con 0x7f773814efb0 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f77367fc640 1 -- 172.21.15.132:0/1692334663 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730005430 con 0x7f773814efb0 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f77367fc640 1 -- 172.21.15.132:0/1692334663 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730003830 con 0x7f773814efb0 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.996+0000 7f773edac640 1 -- 172.21.15.132:0/1692334663 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7728009b30 con 0x7f773814efb0 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.997+0000 7f773edac640 1 -- 172.21.15.132:0/1692334663 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77380c0130 con 0x7f773814efb0 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.997+0000 7f77367fc640 1 -- 172.21.15.132:0/1692334663 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7730003c90 con 0x7f773814efb0 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.997+0000 7f77367fc640 1 -- 172.21.15.132:0/1692334663 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f773001c850 con 0x7f773814efb0 2023-12-22T09:14:04.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:04.998+0000 7f773edac640 1 -- 172.21.15.132:0/1692334663 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773804e8d0 con 0x7f773814efb0 2023-12-22T09:14:05.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.001+0000 7f77367fc640 1 -- 172.21.15.132:0/1692334663 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f7730017070 con 0x7f773814efb0 2023-12-22T09:14:05.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.092+0000 7f773edac640 1 -- 172.21.15.132:0/1692334663 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cfdeeba0-d07e-4bf9-bba1-2a8275dccf15", "id": 0} v 0) v1 -- 0x7f773806ef60 con 0x7f773814efb0 2023-12-22T09:14:05.096 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.095+0000 7f82b6656040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-22T09:14:05.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.099+0000 7f77367fc640 1 -- 172.21.15.132:0/1692334663 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfdeeba0-d07e-4bf9-bba1-2a8275dccf15", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f773001ca10 con 0x7f773814efb0 2023-12-22T09:14:05.099 INFO:teuthology.orchestra.run.smithi132.stdout:0 2023-12-22T09:14:05.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.100+0000 7f773edac640 1 -- 172.21.15.132:0/1692334663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 msgr2=0x7f77380abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.100+0000 7f773edac640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380abc50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f773000c310 tx=0x7f773000c7d0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.101+0000 7f773edac640 1 -- 172.21.15.132:0/1692334663 shutdown_connections 2023-12-22T09:14:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.101+0000 7f773edac640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f773814efb0 0x7f77380abc50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.101+0000 7f773edac640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77380c7e30 0x7f77380ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.101+0000 7f773edac640 1 --2- 172.21.15.132:0/1692334663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f773806f890 0x7f77380c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.101+0000 7f773edac640 1 -- 172.21.15.132:0/1692334663 >> 172.21.15.132:0/1692334663 conn(0x7f7738069fe0 msgr2=0x7f77380c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.101+0000 7f773edac640 1 -- 172.21.15.132:0/1692334663 shutdown_connections 2023-12-22T09:14:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.101+0000 7f773edac640 1 -- 172.21.15.132:0/1692334663 wait complete. 2023-12-22T09:14:05.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 7c87401d-2d1c-4ab0-a241-1a265ec971ad 1 2023-12-22T09:14:05.158 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.158+0000 7f82b6656040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-22T09:14:05.209 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.209+0000 7f82b6656040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-22T09:14:05.272 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.272+0000 7f82b6656040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-22T09:14:05.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.304+0000 7fd2d033e640 1 Processor -- start 2023-12-22T09:14:05.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.305+0000 7fd2d033e640 1 -- start start 2023-12-22T09:14:05.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.306+0000 7fd2d033e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2c806acc0 0x7fd2c8153d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.306+0000 7fd2d033e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2c806b540 0x7fd2c80c4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.306+0000 7fd2d033e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c80c7aa0 con 0x7fd2c80c4560 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.306+0000 7fd2d033e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c80c7d80 con 0x7fd2c806b540 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.306+0000 7fd2d033e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c80c8060 con 0x7fd2c806acc0 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.306+0000 7fd2ce0da640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2c806acc0 0x7fd2c8153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.306+0000 7fd2ce0da640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2c806acc0 0x7fd2c8153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51490/0 (socket says 172.21.15.132:51490) 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.306+0000 7fd2ce0da640 1 -- 172.21.15.132:0/1832180568 learned_addr learned my addr 172.21.15.132:0/1832180568 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.306+0000 7fd2ce8db640 1 --1- 172.21.15.132:0/1832180568 >> v1:172.21.15.132:6789/0 conn(0x7fd2c80c4560 0x7fd2c8151110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46730/0 (socket says 172.21.15.132:46730) 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.307+0000 7fd2cd8d9640 1 --2- 172.21.15.132:0/1832180568 >> v2:172.21.15.106:3300/0 conn(0x7fd2c806b540 0x7fd2c80c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.307+0000 7fd2ce0da640 1 -- 172.21.15.132:0/1832180568 >> v2:172.21.15.106:3300/0 conn(0x7fd2c806b540 msgr2=0x7fd2c80c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.307+0000 7fd2ce0da640 1 --2- 172.21.15.132:0/1832180568 >> v2:172.21.15.106:3300/0 conn(0x7fd2c806b540 0x7fd2c80c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.307+0000 7fd2ce0da640 1 -- 172.21.15.132:0/1832180568 >> v1:172.21.15.132:6789/0 conn(0x7fd2c80c4560 legacy=0x7fd2c8151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.307+0000 7fd2cd0d8640 1 -- 172.21.15.132:0/1832180568 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493552825 0 0) 0x7fd2c80c7aa0 con 0x7fd2c80c4560 2023-12-22T09:14:05.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.307+0000 7fd2ce0da640 1 -- 172.21.15.132:0/1832180568 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c80c8340 con 0x7fd2c806acc0 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.308+0000 7fd2ce0da640 1 --2- 172.21.15.132:0/1832180568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c806acc0 0x7fd2c8153d50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80c7220 tx=0x7fd2c402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e738c199e17d422e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.308+0000 7fd2cd0d8640 1 -- 172.21.15.132:0/1832180568 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4030860 con 0x7fd2c806acc0 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.308+0000 7fd2cd0d8640 1 -- 172.21.15.132:0/1832180568 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c40309c0 con 0x7fd2c806acc0 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.308+0000 7fd2cd0d8640 1 -- 172.21.15.132:0/1832180568 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4030d50 con 0x7fd2c806acc0 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.309+0000 7fd2d033e640 1 -- 172.21.15.132:0/1832180568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c806acc0 msgr2=0x7fd2c8153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.309+0000 7fd2d033e640 1 --2- 172.21.15.132:0/1832180568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c806acc0 0x7fd2c8153d50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80c7220 tx=0x7fd2c402b9a0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.309+0000 7fd2d033e640 1 -- 172.21.15.132:0/1832180568 shutdown_connections 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.309+0000 7fd2d033e640 1 --2- 172.21.15.132:0/1832180568 >> v2:172.21.15.106:3300/0 conn(0x7fd2c806b540 0x7fd2c80c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.309+0000 7fd2d033e640 1 --2- 172.21.15.132:0/1832180568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c806acc0 0x7fd2c8153d50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.309+0000 7fd2d033e640 1 -- 172.21.15.132:0/1832180568 >> 172.21.15.132:0/1832180568 conn(0x7fd2c80c96a0 msgr2=0x7fd2c80c9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.309+0000 7fd2d033e640 1 -- 172.21.15.132:0/1832180568 shutdown_connections 2023-12-22T09:14:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.309+0000 7fd2d033e640 1 -- 172.21.15.132:0/1832180568 wait complete. 2023-12-22T09:14:05.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.311+0000 7fd2d033e640 1 Processor -- start 2023-12-22T09:14:05.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.311+0000 7fd2d033e640 1 -- start start 2023-12-22T09:14:05.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2d033e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2c806acc0 0x7fd2c81e9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2d033e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c806b540 0x7fd2c81ec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2d033e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80c4560 0x7fd2c80aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2d033e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c81ece10 con 0x7fd2c806b540 2023-12-22T09:14:05.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2d033e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c81e8f80 con 0x7fd2c80c4560 2023-12-22T09:14:05.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2d033e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c81e8950 con 0x7fd2c806acc0 2023-12-22T09:14:05.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2ce8db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80c4560 0x7fd2c80aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2ce8db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80c4560 0x7fd2c80aa840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51492/0 (socket says 172.21.15.132:51492) 2023-12-22T09:14:05.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2ce0da640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2c806acc0 0x7fd2c81e9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2ce8db640 1 -- 172.21.15.132:0/1770910533 learned_addr learned my addr 172.21.15.132:0/1770910533 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:05.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2ce8db640 1 -- 172.21.15.132:0/1770910533 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2c806acc0 msgr2=0x7fd2c81e9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2ce8db640 1 --2- 172.21.15.132:0/1770910533 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2c806acc0 0x7fd2c81e9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2ce8db640 1 -- 172.21.15.132:0/1770910533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c806b540 msgr2=0x7fd2c81ec8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2ce8db640 1 --2- 172.21.15.132:0/1770910533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c806b540 0x7fd2c81ec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.312+0000 7fd2ce8db640 1 -- 172.21.15.132:0/1770910533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40094d0 con 0x7fd2c80c4560 2023-12-22T09:14:05.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.313+0000 7fd2ce8db640 1 --2- 172.21.15.132:0/1770910533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80c4560 0x7fd2c80aa840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000c7e0 tx=0x7fd2c000cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:05.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.313+0000 7fd2beffd640 1 -- 172.21.15.132:0/1770910533 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c000a640 con 0x7fd2c80c4560 2023-12-22T09:14:05.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.313+0000 7fd2beffd640 1 -- 172.21.15.132:0/1770910533 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c000a7c0 con 0x7fd2c80c4560 2023-12-22T09:14:05.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.313+0000 7fd2beffd640 1 -- 172.21.15.132:0/1770910533 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c000ab70 con 0x7fd2c80c4560 2023-12-22T09:14:05.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.313+0000 7fd2d033e640 1 -- 172.21.15.132:0/1770910533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c8157220 con 0x7fd2c80c4560 2023-12-22T09:14:05.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.313+0000 7fd2d033e640 1 -- 172.21.15.132:0/1770910533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c81e8c10 con 0x7fd2c80c4560 2023-12-22T09:14:05.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.313+0000 7fd2beffd640 1 -- 172.21.15.132:0/1770910533 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd2c00070d0 con 0x7fd2c80c4560 2023-12-22T09:14:05.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.313+0000 7fd2beffd640 1 -- 172.21.15.132:0/1770910533 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fd2c00128f0 con 0x7fd2c80c4560 2023-12-22T09:14:05.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.314+0000 7fd2d033e640 1 -- 172.21.15.132:0/1770910533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c8073f10 con 0x7fd2c80c4560 2023-12-22T09:14:05.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.317+0000 7fd2beffd640 1 -- 172.21.15.132:0/1770910533 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fd2c0018070 con 0x7fd2c80c4560 2023-12-22T09:14:05.317 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.318+0000 7f1e7f24c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-22T09:14:05.322 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.322+0000 7f82b6656040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-22T09:14:05.382 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.382+0000 7f1e7f24c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-22T09:14:05.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.395+0000 7fd2d033e640 1 -- 172.21.15.132:0/1770910533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c87401d-2d1c-4ab0-a241-1a265ec971ad", "id": 1} v 0) v1 -- 0x7fd2c81e90c0 con 0x7fd2c80c4560 2023-12-22T09:14:05.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.404+0000 7fd2beffd640 1 -- 172.21.15.132:0/1770910533 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c87401d-2d1c-4ab0-a241-1a265ec971ad", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd2c0012b80 con 0x7fd2c80c4560 2023-12-22T09:14:05.405 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-22T09:14:05.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.405+0000 7fd2d033e640 1 -- 172.21.15.132:0/1770910533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80c4560 msgr2=0x7fd2c80aa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.405+0000 7fd2d033e640 1 --2- 172.21.15.132:0/1770910533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80c4560 0x7fd2c80aa840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000c7e0 tx=0x7fd2c000cca0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.405+0000 7fd2d033e640 1 -- 172.21.15.132:0/1770910533 shutdown_connections 2023-12-22T09:14:05.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.405+0000 7fd2d033e640 1 --2- 172.21.15.132:0/1770910533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80c4560 0x7fd2c80aa840 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.405+0000 7fd2d033e640 1 --2- 172.21.15.132:0/1770910533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c806b540 0x7fd2c81ec8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.405+0000 7fd2d033e640 1 --2- 172.21.15.132:0/1770910533 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2c806acc0 0x7fd2c81e9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.405+0000 7fd2d033e640 1 -- 172.21.15.132:0/1770910533 >> 172.21.15.132:0/1770910533 conn(0x7fd2c80c96a0 msgr2=0x7fd2c80c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:05.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.406+0000 7fd2d033e640 1 -- 172.21.15.132:0/1770910533 shutdown_connections 2023-12-22T09:14:05.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.406+0000 7fd2d033e640 1 -- 172.21.15.132:0/1770910533 wait complete. 2023-12-22T09:14:05.422 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new f437f571-c91a-4169-8911-7468d972e39c 2 2023-12-22T09:14:05.436 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.437+0000 7f1e7f24c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-22T09:14:05.437 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.436+0000 7f82b6656040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-22T09:14:05.503 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.503+0000 7f1e7f24c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-22T09:14:05.516 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.516+0000 7f82b6656040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-22T09:14:05.556 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.556+0000 7f1e7f24c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-22T09:14:05.569 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.568+0000 7f82b6656040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-22T09:14:05.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.607+0000 7f0d4db38640 1 Processor -- start 2023-12-22T09:14:05.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.607+0000 7f0d4db38640 1 -- start start 2023-12-22T09:14:05.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.608+0000 7f0d4db38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d480bcde0 0x7f0d48153d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.608+0000 7f0d4db38640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480c7610 con 0x7f0d48151550 2023-12-22T09:14:05.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d4db38640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480c41c0 con 0x7f0d4806c890 2023-12-22T09:14:05.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d4db38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480c7b40 con 0x7f0d480bcde0 2023-12-22T09:14:05.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d47fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0d4806c890 0x7f0d4815e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46746/0 (socket says 172.21.15.132:46746) 2023-12-22T09:14:05.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d47fff640 1 -- 172.21.15.132:0/3194531740 learned_addr learned my addr 172.21.15.132:0/3194531740 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-22T09:14:05.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d46ffd640 1 --2- 172.21.15.132:0/3194531740 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d480bcde0 0x7f0d48153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d467fc640 1 -- 172.21.15.132:0/3194531740 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964176461 0 0) 0x7f0d480c41c0 con 0x7f0d4806c890 2023-12-22T09:14:05.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d467fc640 1 -- 172.21.15.132:0/3194531740 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d30003520 con 0x7f0d4806c890 2023-12-22T09:14:05.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d46ffd640 1 -- 172.21.15.132:0/3194531740 >> v1:172.21.15.132:6789/0 conn(0x7f0d4806c890 legacy=0x7f0d4815e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d46ffd640 1 -- 172.21.15.132:0/3194531740 >> v1:172.21.15.106:6789/0 conn(0x7f0d48151550 legacy=0x7f0d480c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.609+0000 7f0d46ffd640 1 -- 172.21.15.132:0/3194531740 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480c7860 con 0x7f0d480bcde0 2023-12-22T09:14:05.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.611+0000 7f0d46ffd640 1 --2- 172.21.15.132:0/3194531740 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d480bcde0 0x7f0d48153d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0097c0 tx=0x7f0d3c02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6abfa262eb7f4f5c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:05.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.611+0000 7f0d467fc640 1 -- 172.21.15.132:0/3194531740 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c031760 con 0x7f0d480bcde0 2023-12-22T09:14:05.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.611+0000 7f0d467fc640 1 -- 172.21.15.132:0/3194531740 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0318c0 con 0x7f0d480bcde0 2023-12-22T09:14:05.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.611+0000 7f0d467fc640 1 -- 172.21.15.132:0/3194531740 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c031c50 con 0x7f0d480bcde0 2023-12-22T09:14:05.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.612+0000 7f0d4db38640 1 -- 172.21.15.132:0/3194531740 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d480bcde0 msgr2=0x7f0d48153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.612+0000 7f0d4db38640 1 --2- 172.21.15.132:0/3194531740 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d480bcde0 0x7f0d48153d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0097c0 tx=0x7f0d3c02b800 comp rx=0 tx=0).stop 2023-12-22T09:14:05.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.612+0000 7f0d4db38640 1 -- 172.21.15.132:0/3194531740 shutdown_connections 2023-12-22T09:14:05.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.612+0000 7f0d4db38640 1 --2- 172.21.15.132:0/3194531740 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d480bcde0 0x7f0d48153d30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.612+0000 7f0d4db38640 1 -- 172.21.15.132:0/3194531740 >> 172.21.15.132:0/3194531740 conn(0x7f0d480ab300 msgr2=0x7f0d480ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:05.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.612+0000 7f0d4db38640 1 -- 172.21.15.132:0/3194531740 shutdown_connections 2023-12-22T09:14:05.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.612+0000 7f0d4db38640 1 -- 172.21.15.132:0/3194531740 wait complete. 2023-12-22T09:14:05.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.615+0000 7f0d4db38640 1 Processor -- start 2023-12-22T09:14:05.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.615+0000 7f0d4db38640 1 -- start start 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.616+0000 7f0d4db38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d4806c890 0x7f0d481530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.616+0000 7f0d4db38640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d480bcde0 0x7f0d4814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.616+0000 7f0d4db38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d48151550 0x7f0d4814e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.616+0000 7f0d4db38640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480c08e0 con 0x7f0d480bcde0 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.616+0000 7f0d4db38640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48153b60 con 0x7f0d48151550 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.616+0000 7f0d4db38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4814e610 con 0x7f0d4806c890 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.616+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d48151550 0x7f0d4814e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.616+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d48151550 0x7f0d4814e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51502/0 (socket says 172.21.15.132:51502) 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d47fff640 1 -- 172.21.15.132:0/3527325275 learned_addr learned my addr 172.21.15.132:0/3527325275 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d477fe640 1 --2- 172.21.15.132:0/3527325275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d4806c890 0x7f0d481530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d46ffd640 1 --2- 172.21.15.132:0/3527325275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d480bcde0 0x7f0d4814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d47fff640 1 -- 172.21.15.132:0/3527325275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d4806c890 msgr2=0x7f0d481530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d47fff640 1 --2- 172.21.15.132:0/3527325275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d4806c890 0x7f0d481530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d47fff640 1 -- 172.21.15.132:0/3527325275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d480bcde0 msgr2=0x7f0d4814db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d47fff640 1 --2- 172.21.15.132:0/3527325275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d480bcde0 0x7f0d4814db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d47fff640 1 -- 172.21.15.132:0/3527325275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0093a0 con 0x7f0d48151550 2023-12-22T09:14:05.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d47fff640 1 --2- 172.21.15.132:0/3527325275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d48151550 0x7f0d4814e0d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000caa0 tx=0x7f0d4000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:05.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d2ffff640 1 -- 172.21.15.132:0/3527325275 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000aba0 con 0x7f0d48151550 2023-12-22T09:14:05.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d2ffff640 1 -- 172.21.15.132:0/3527325275 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000ad00 con 0x7f0d48151550 2023-12-22T09:14:05.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d4db38640 1 -- 172.21.15.132:0/3527325275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d48152280 con 0x7f0d48151550 2023-12-22T09:14:05.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.617+0000 7f0d2ffff640 1 -- 172.21.15.132:0/3527325275 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40012620 con 0x7f0d48151550 2023-12-22T09:14:05.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.618+0000 7f0d4db38640 1 -- 172.21.15.132:0/3527325275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d48152840 con 0x7f0d48151550 2023-12-22T09:14:05.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.618+0000 7f0d2ffff640 1 -- 172.21.15.132:0/3527325275 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0d40012a80 con 0x7f0d48151550 2023-12-22T09:14:05.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.618+0000 7f0d2ffff640 1 -- 172.21.15.132:0/3527325275 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0d40012d30 con 0x7f0d48151550 2023-12-22T09:14:05.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.619+0000 7f0d4db38640 1 -- 172.21.15.132:0/3527325275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d480c0a20 con 0x7f0d48151550 2023-12-22T09:14:05.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.621+0000 7f0d2ffff640 1 -- 172.21.15.132:0/3527325275 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f0d480c0a20 con 0x7f0d48151550 2023-12-22T09:14:05.629 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.628+0000 7f82b6656040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-22T09:14:05.676 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.676+0000 7f1e7f24c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-22T09:14:05.683 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:05.682+0000 7f82b6656040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-22T09:14:05.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.697+0000 7f0d4db38640 1 -- 172.21.15.132:0/3527325275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f437f571-c91a-4169-8911-7468d972e39c", "id": 2} v 0) v1 -- 0x7f0d480c3a20 con 0x7f0d48151550 2023-12-22T09:14:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.707+0000 7f0d2ffff640 1 -- 172.21.15.132:0/3527325275 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f437f571-c91a-4169-8911-7468d972e39c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d40021060 con 0x7f0d48151550 2023-12-22T09:14:05.707 INFO:teuthology.orchestra.run.smithi132.stdout:2 2023-12-22T09:14:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.708+0000 7f0d4db38640 1 -- 172.21.15.132:0/3527325275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d48151550 msgr2=0x7f0d4814e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.708+0000 7f0d4db38640 1 --2- 172.21.15.132:0/3527325275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d48151550 0x7f0d4814e0d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000caa0 tx=0x7f0d4000cf60 comp rx=0 tx=0).stop 2023-12-22T09:14:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.708+0000 7f0d4db38640 1 -- 172.21.15.132:0/3527325275 shutdown_connections 2023-12-22T09:14:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.708+0000 7f0d4db38640 1 --2- 172.21.15.132:0/3527325275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d48151550 0x7f0d4814e0d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.708+0000 7f0d4db38640 1 --2- 172.21.15.132:0/3527325275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d480bcde0 0x7f0d4814db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.708+0000 7f0d4db38640 1 --2- 172.21.15.132:0/3527325275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d4806c890 0x7f0d481530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.708+0000 7f0d4db38640 1 -- 172.21.15.132:0/3527325275 >> 172.21.15.132:0/3527325275 conn(0x7f0d480ab300 msgr2=0x7f0d480c8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.708+0000 7f0d4db38640 1 -- 172.21.15.132:0/3527325275 shutdown_connections 2023-12-22T09:14:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.709+0000 7f0d4db38640 1 -- 172.21.15.132:0/3527325275 wait complete. 2023-12-22T09:14:05.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 4946e22f-789e-4326-a11b-f6e65f518dfb 3 2023-12-22T09:14:05.761 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.761+0000 7f1e7f24c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-22T09:14:05.818 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.818+0000 7f1e7f24c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-22T09:14:05.882 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.883+0000 7f1e7f24c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-22T09:14:05.940 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:05.940+0000 7f1e7f24c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-22T09:14:05.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.956+0000 7fcbc9994640 1 Processor -- start 2023-12-22T09:14:05.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.957+0000 7fcbc9994640 1 -- start start 2023-12-22T09:14:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc9994640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f890 0x7fcbc40c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc9994640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcbc406f180 0x7fcbc40c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc9994640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc40c7220 con 0x7fcbc414efb0 2023-12-22T09:14:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc9994640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc40bad20 con 0x7fcbc406f180 2023-12-22T09:14:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc9994640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4152900 con 0x7fcbc406f890 2023-12-22T09:14:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f890 0x7fcbc40c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc9193640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcbc406f180 0x7fcbc40c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc9193640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcbc406f180 0x7fcbc40c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51514/0 (socket says 172.21.15.132:51514) 2023-12-22T09:14:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc9193640 1 -- 172.21.15.132:0/3483072171 learned_addr learned my addr 172.21.15.132:0/3483072171 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f890 0x7fcbc40c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:34094/0 (socket says 172.21.15.132:34094) 2023-12-22T09:14:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc3fff640 1 -- 172.21.15.132:0/3483072171 >> v2:172.21.15.132:3300/0 conn(0x7fcbc406f180 msgr2=0x7fcbc40c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:05.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.958+0000 7fcbc3fff640 1 --2- 172.21.15.132:0/3483072171 >> v2:172.21.15.132:3300/0 conn(0x7fcbc406f180 0x7fcbc40c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.959+0000 7fcbc3fff640 1 -- 172.21.15.132:0/3483072171 >> v1:172.21.15.106:6789/0 conn(0x7fcbc414efb0 legacy=0x7fcbc40c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:05.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.959+0000 7fcbc3fff640 1 -- 172.21.15.132:0/3483072171 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4152380 con 0x7fcbc406f890 2023-12-22T09:14:05.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.959+0000 7fcbc9193640 1 --2- 172.21.15.132:0/3483072171 >> v2:172.21.15.132:3300/0 conn(0x7fcbc406f180 0x7fcbc40c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:05.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.960+0000 7fcbc3fff640 1 --2- 172.21.15.132:0/3483072171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f890 0x7fcbc40c55c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00097a0 tx=0x7fcbb002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85cb3c0b2c7b50f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:05.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.960+0000 7fcbc37fe640 1 -- 172.21.15.132:0/3483072171 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00316f0 con 0x7fcbc406f890 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.960+0000 7fcbc37fe640 1 -- 172.21.15.132:0/3483072171 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0031850 con 0x7fcbc406f890 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.960+0000 7fcbc37fe640 1 -- 172.21.15.132:0/3483072171 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0031be0 con 0x7fcbc406f890 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.960+0000 7fcbc9994640 1 -- 172.21.15.132:0/3483072171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f890 msgr2=0x7fcbc40c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.960+0000 7fcbc9994640 1 --2- 172.21.15.132:0/3483072171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f890 0x7fcbc40c55c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00097a0 tx=0x7fcbb002b790 comp rx=0 tx=0).stop 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.961+0000 7fcbc9994640 1 -- 172.21.15.132:0/3483072171 shutdown_connections 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.961+0000 7fcbc9994640 1 --2- 172.21.15.132:0/3483072171 >> v2:172.21.15.132:3300/0 conn(0x7fcbc406f180 0x7fcbc40c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.961+0000 7fcbc9994640 1 --2- 172.21.15.132:0/3483072171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f890 0x7fcbc40c55c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.961+0000 7fcbc9994640 1 -- 172.21.15.132:0/3483072171 >> 172.21.15.132:0/3483072171 conn(0x7fcbc4069fe0 msgr2=0x7fcbc406a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.961+0000 7fcbc9994640 1 -- 172.21.15.132:0/3483072171 shutdown_connections 2023-12-22T09:14:05.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.961+0000 7fcbc9994640 1 -- 172.21.15.132:0/3483072171 wait complete. 2023-12-22T09:14:05.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.962+0000 7fcbc9994640 1 Processor -- start 2023-12-22T09:14:05.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.962+0000 7fcbc9994640 1 -- start start 2023-12-22T09:14:05.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.963+0000 7fcbc9994640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f180 0x7fcbc41555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.963+0000 7fcbc9994640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc406f890 0x7fcbc40ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.963+0000 7fcbc9994640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbc414efb0 0x7fcbc40c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:05.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.963+0000 7fcbc9994640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40aa860 con 0x7fcbc414efb0 2023-12-22T09:14:05.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.963+0000 7fcbc9994640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40aa050 con 0x7fcbc406f890 2023-12-22T09:14:05.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.963+0000 7fcbc9994640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40acb30 con 0x7fcbc406f180 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc406f890 0x7fcbc40ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc8992640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f180 0x7fcbc41555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc406f890 0x7fcbc40ac5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51530/0 (socket says 172.21.15.132:51530) 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc3fff640 1 -- 172.21.15.132:0/2481836262 learned_addr learned my addr 172.21.15.132:0/2481836262 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc9193640 1 --2- 172.21.15.132:0/2481836262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbc414efb0 0x7fcbc40c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc3fff640 1 -- 172.21.15.132:0/2481836262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f180 msgr2=0x7fcbc41555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc3fff640 1 --2- 172.21.15.132:0/2481836262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f180 0x7fcbc41555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc3fff640 1 -- 172.21.15.132:0/2481836262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbc414efb0 msgr2=0x7fcbc40c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc3fff640 1 --2- 172.21.15.132:0/2481836262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbc414efb0 0x7fcbc40c00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc3fff640 1 -- 172.21.15.132:0/2481836262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc009b30 con 0x7fcbc406f890 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.964+0000 7fcbc3fff640 1 --2- 172.21.15.132:0/2481836262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc406f890 0x7fcbc40ac5f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0000c00 tx=0x7fcbb00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.965+0000 7fcbc17fa640 1 -- 172.21.15.132:0/2481836262 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0034680 con 0x7fcbc406f890 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.965+0000 7fcbc17fa640 1 -- 172.21.15.132:0/2481836262 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0034820 con 0x7fcbc406f890 2023-12-22T09:14:05.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.965+0000 7fcbc17fa640 1 -- 172.21.15.132:0/2481836262 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0034bd0 con 0x7fcbc406f890 2023-12-22T09:14:05.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.965+0000 7fcbc9994640 1 -- 172.21.15.132:0/2481836262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb0009400 con 0x7fcbc406f890 2023-12-22T09:14:05.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.965+0000 7fcbc9994640 1 -- 172.21.15.132:0/2481836262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc40aaab0 con 0x7fcbc406f890 2023-12-22T09:14:05.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.965+0000 7fcbc17fa640 1 -- 172.21.15.132:0/2481836262 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcbb003b040 con 0x7fcbc406f890 2023-12-22T09:14:05.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.965+0000 7fcbc17fa640 1 -- 172.21.15.132:0/2481836262 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fcbb0034d30 con 0x7fcbc406f890 2023-12-22T09:14:05.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.966+0000 7fcbc9994640 1 -- 172.21.15.132:0/2481836262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc404e8d0 con 0x7fcbc406f890 2023-12-22T09:14:05.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:05.970+0000 7fcbc17fa640 1 -- 172.21.15.132:0/2481836262 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fcbb004e060 con 0x7fcbc406f890 2023-12-22T09:14:06.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.047+0000 7fcbc9994640 1 -- 172.21.15.132:0/2481836262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4946e22f-789e-4326-a11b-f6e65f518dfb", "id": 3} v 0) v1 -- 0x7fcbc406c490 con 0x7fcbc406f890 2023-12-22T09:14:06.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.055+0000 7fcbc17fa640 1 -- 172.21.15.132:0/2481836262 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4946e22f-789e-4326-a11b-f6e65f518dfb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcbb0044070 con 0x7fcbc406f890 2023-12-22T09:14:06.055 INFO:teuthology.orchestra.run.smithi132.stdout:3 2023-12-22T09:14:06.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.056+0000 7fcbc9994640 1 -- 172.21.15.132:0/2481836262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc406f890 msgr2=0x7fcbc40ac5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.056+0000 7fcbc9994640 1 --2- 172.21.15.132:0/2481836262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc406f890 0x7fcbc40ac5f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0000c00 tx=0x7fcbb00046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.057+0000 7fcbc9994640 1 -- 172.21.15.132:0/2481836262 shutdown_connections 2023-12-22T09:14:06.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.057+0000 7fcbc9994640 1 --2- 172.21.15.132:0/2481836262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbc414efb0 0x7fcbc40c00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.057+0000 7fcbc9994640 1 --2- 172.21.15.132:0/2481836262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc406f890 0x7fcbc40ac5f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.057+0000 7fcbc9994640 1 --2- 172.21.15.132:0/2481836262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbc406f180 0x7fcbc41555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.057+0000 7fcbc9994640 1 -- 172.21.15.132:0/2481836262 >> 172.21.15.132:0/2481836262 conn(0x7fcbc4069fe0 msgr2=0x7fcbc414f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:06.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.057+0000 7fcbc9994640 1 -- 172.21.15.132:0/2481836262 shutdown_connections 2023-12-22T09:14:06.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.057+0000 7fcbc9994640 1 -- 172.21.15.132:0/2481836262 wait complete. 2023-12-22T09:14:06.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 8649cca0-8591-4ed5-bbaa-0e5209d8a53f 4 2023-12-22T09:14:06.135 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:06.134+0000 7f82b6656040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-22T09:14:06.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.260+0000 7f7a5cf3e640 1 Processor -- start 2023-12-22T09:14:06.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.260+0000 7f7a5cf3e640 1 -- start start 2023-12-22T09:14:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5cf3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a58070e30 0x7f7a580a8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5cf3e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a5814dea0 0x7f7a5814e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5cf3e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a581519a0 con 0x7f7a580a75f0 2023-12-22T09:14:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5cf3e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a58150ad0 con 0x7f7a58070e30 2023-12-22T09:14:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5cf3e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58150d90 con 0x7f7a5814dea0 2023-12-22T09:14:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a58070e30 0x7f7a580a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a4ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a5814dea0 0x7f7a5814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a58070e30 0x7f7a580a8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51546/0 (socket says 172.21.15.132:51546) 2023-12-22T09:14:06.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5659c640 1 -- 172.21.15.132:0/2356466901 learned_addr learned my addr 172.21.15.132:0/2356466901 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:06.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5659c640 1 -- 172.21.15.132:0/2356466901 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a5814dea0 msgr2=0x7f7a5814e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:06.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5659c640 1 --2- 172.21.15.132:0/2356466901 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a5814dea0 0x7f7a5814e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5659c640 1 -- 172.21.15.132:0/2356466901 >> v1:172.21.15.106:6789/0 conn(0x7f7a580a75f0 legacy=0x7f7a580a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:06.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.262+0000 7f7a5659c640 1 -- 172.21.15.132:0/2356466901 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58151070 con 0x7f7a58070e30 2023-12-22T09:14:06.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.263+0000 7f7a5659c640 1 --2- 172.21.15.132:0/2356466901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a58070e30 0x7f7a580a8670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009870 tx=0x7f7a4802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18565594b6c056b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:06.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.264+0000 7f7a55d9b640 1 -- 172.21.15.132:0/2356466901 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480317c0 con 0x7f7a58070e30 2023-12-22T09:14:06.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.264+0000 7f7a55d9b640 1 -- 172.21.15.132:0/2356466901 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48031920 con 0x7f7a58070e30 2023-12-22T09:14:06.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.264+0000 7f7a55d9b640 1 -- 172.21.15.132:0/2356466901 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48031cb0 con 0x7f7a58070e30 2023-12-22T09:14:06.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.264+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/2356466901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a58070e30 msgr2=0x7f7a580a8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.264+0000 7f7a5cf3e640 1 --2- 172.21.15.132:0/2356466901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a58070e30 0x7f7a580a8670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009870 tx=0x7f7a4802b860 comp rx=0 tx=0).stop 2023-12-22T09:14:06.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.265+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/2356466901 shutdown_connections 2023-12-22T09:14:06.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.265+0000 7f7a5cf3e640 1 --2- 172.21.15.132:0/2356466901 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a5814dea0 0x7f7a5814e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.265+0000 7f7a5cf3e640 1 --2- 172.21.15.132:0/2356466901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a58070e30 0x7f7a580a8670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.265+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/2356466901 >> 172.21.15.132:0/2356466901 conn(0x7f7a5806b770 msgr2=0x7f7a580c63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:06.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.265+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/2356466901 shutdown_connections 2023-12-22T09:14:06.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.265+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/2356466901 wait complete. 2023-12-22T09:14:06.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.266+0000 7f7a5cf3e640 1 Processor -- start 2023-12-22T09:14:06.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.267+0000 7f7a5cf3e640 1 -- start start 2023-12-22T09:14:06.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.267+0000 7f7a5cf3e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a58070e30 0x7f7a580a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.267+0000 7f7a5cf3e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a580a75f0 0x7f7a5806a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.267+0000 7f7a5cf3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a5814dea0 0x7f7a58144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5cf3e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581ebdb0 con 0x7f7a580a75f0 2023-12-22T09:14:06.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5cf3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581ec930 con 0x7f7a5814dea0 2023-12-22T09:14:06.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5cf3e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581ecd50 con 0x7f7a58070e30 2023-12-22T09:14:06.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5659c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a58070e30 0x7f7a580a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5659c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a58070e30 0x7f7a580a9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:34118/0 (socket says 172.21.15.132:34118) 2023-12-22T09:14:06.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a56d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a5814dea0 0x7f7a58144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5659c640 1 -- 172.21.15.132:0/893317228 learned_addr learned my addr 172.21.15.132:0/893317228 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:06.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a4ffff640 1 --2- 172.21.15.132:0/893317228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a580a75f0 0x7f7a5806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5659c640 1 -- 172.21.15.132:0/893317228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a5814dea0 msgr2=0x7f7a58144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5659c640 1 --2- 172.21.15.132:0/893317228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a5814dea0 0x7f7a58144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5659c640 1 -- 172.21.15.132:0/893317228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a580a75f0 msgr2=0x7f7a5806a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5659c640 1 --2- 172.21.15.132:0/893317228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a580a75f0 0x7f7a5806a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a5659c640 1 -- 172.21.15.132:0/893317228 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480094d0 con 0x7f7a58070e30 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.268+0000 7f7a56d9d640 1 --2- 172.21.15.132:0/893317228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a5814dea0 0x7f7a58144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.269+0000 7f7a5659c640 1 --2- 172.21.15.132:0/893317228 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a58070e30 0x7f7a580a9880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7a48000c00 tx=0x7f7a480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.269+0000 7f7a4effd640 1 -- 172.21.15.132:0/893317228 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48032860 con 0x7f7a58070e30 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.269+0000 7f7a4effd640 1 -- 172.21.15.132:0/893317228 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480329e0 con 0x7f7a58070e30 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.269+0000 7f7a4effd640 1 -- 172.21.15.132:0/893317228 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48032d90 con 0x7f7a58070e30 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.269+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/893317228 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a581ebf90 con 0x7f7a58070e30 2023-12-22T09:14:06.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.269+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/893317228 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a581ec550 con 0x7f7a58070e30 2023-12-22T09:14:06.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.271+0000 7f7a4effd640 1 -- 172.21.15.132:0/893317228 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7a4804e750 con 0x7f7a58070e30 2023-12-22T09:14:06.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.271+0000 7f7a4effd640 1 -- 172.21.15.132:0/893317228 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7a480459f0 con 0x7f7a58070e30 2023-12-22T09:14:06.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.271+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/893317228 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a581ecba0 con 0x7f7a58070e30 2023-12-22T09:14:06.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.273+0000 7f7a4effd640 1 -- 172.21.15.132:0/893317228 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f7a48045c50 con 0x7f7a58070e30 2023-12-22T09:14:06.294 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:06.294+0000 7f82b6656040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-22T09:14:06.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.351+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/893317228 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8649cca0-8591-4ed5-bbaa-0e5209d8a53f", "id": 4} v 0) v1 -- 0x7f7a58073f10 con 0x7f7a58070e30 2023-12-22T09:14:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.359+0000 7f7a4effd640 1 -- 172.21.15.132:0/893317228 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8649cca0-8591-4ed5-bbaa-0e5209d8a53f", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a48045df0 con 0x7f7a58070e30 2023-12-22T09:14:06.361 INFO:teuthology.orchestra.run.smithi132.stdout:4 2023-12-22T09:14:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.361+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/893317228 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a58070e30 msgr2=0x7f7a580a9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.361+0000 7f7a5cf3e640 1 --2- 172.21.15.132:0/893317228 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a58070e30 0x7f7a580a9880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7a48000c00 tx=0x7f7a480046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.361+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/893317228 shutdown_connections 2023-12-22T09:14:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.361+0000 7f7a5cf3e640 1 --2- 172.21.15.132:0/893317228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a5814dea0 0x7f7a58144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.361+0000 7f7a5cf3e640 1 --2- 172.21.15.132:0/893317228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a580a75f0 0x7f7a5806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.361+0000 7f7a5cf3e640 1 --2- 172.21.15.132:0/893317228 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a58070e30 0x7f7a580a9880 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.361+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/893317228 >> 172.21.15.132:0/893317228 conn(0x7f7a5806b770 msgr2=0x7f7a580c63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.361+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/893317228 shutdown_connections 2023-12-22T09:14:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.361+0000 7f7a5cf3e640 1 -- 172.21.15.132:0/893317228 wait complete. 2023-12-22T09:14:06.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 52e2de6d-f709-4a50-9e16-f2f621898e96 5 2023-12-22T09:14:06.415 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:06.415+0000 7f1e7f24c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-22T09:14:06.420 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:06.419+0000 7f82b6656040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-22T09:14:06.473 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:06.472+0000 7f82b6656040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-22T09:14:06.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.565+0000 7f475b5d9640 1 Processor -- start 2023-12-22T09:14:06.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.565+0000 7f475b5d9640 1 -- start start 2023-12-22T09:14:06.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f475b5d9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4754151550 0x7f47540c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f475b5d9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47540bcde0 0x7f4754153d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f475b5d9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47540c7610 con 0x7f47540c6660 2023-12-22T09:14:06.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f475b5d9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47540c7b40 con 0x7f4754151550 2023-12-22T09:14:06.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f475b5d9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47540c41c0 con 0x7f47540bcde0 2023-12-22T09:14:06.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f4759375640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4754151550 0x7f47540c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f4758b74640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47540bcde0 0x7f4754153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f4759b76640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f47540c6660 0x7f475406b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46750/0 (socket says 172.21.15.132:46750) 2023-12-22T09:14:06.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f4759b76640 1 -- 172.21.15.132:0/2862550985 learned_addr learned my addr 172.21.15.132:0/2862550985 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-22T09:14:06.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f4758b74640 1 -- 172.21.15.132:0/2862550985 >> v2:172.21.15.132:3300/0 conn(0x7f4754151550 msgr2=0x7f47540c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:06.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f4758b74640 1 --2- 172.21.15.132:0/2862550985 >> v2:172.21.15.132:3300/0 conn(0x7f4754151550 0x7f47540c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.567+0000 7f4758b74640 1 -- 172.21.15.132:0/2862550985 >> v1:172.21.15.132:6789/0 conn(0x7f47540c6660 legacy=0x7f475406b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.568+0000 7f4758b74640 1 -- 172.21.15.132:0/2862550985 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47540c7860 con 0x7f47540bcde0 2023-12-22T09:14:06.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.568+0000 7f4759375640 1 --2- 172.21.15.132:0/2862550985 >> v2:172.21.15.132:3300/0 conn(0x7f4754151550 0x7f47540c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:06.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.568+0000 7f474bfff640 1 -- 172.21.15.132:0/2862550985 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240102821 0 0) 0x7f47540c7610 con 0x7f47540c6660 2023-12-22T09:14:06.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.569+0000 7f4758b74640 1 --2- 172.21.15.132:0/2862550985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47540bcde0 0x7f4754153d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4744009790 tx=0x7f474402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c1da84a0db24af2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.569+0000 7f474bfff640 1 -- 172.21.15.132:0/2862550985 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744031780 con 0x7f47540bcde0 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.569+0000 7f474bfff640 1 -- 172.21.15.132:0/2862550985 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47440318e0 con 0x7f47540bcde0 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.569+0000 7f474bfff640 1 -- 172.21.15.132:0/2862550985 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744031c70 con 0x7f47540bcde0 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.570+0000 7f475b5d9640 1 -- 172.21.15.132:0/2862550985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47540bcde0 msgr2=0x7f4754153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.570+0000 7f475b5d9640 1 --2- 172.21.15.132:0/2862550985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47540bcde0 0x7f4754153d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4744009790 tx=0x7f474402b820 comp rx=0 tx=0).stop 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.570+0000 7f475b5d9640 1 -- 172.21.15.132:0/2862550985 shutdown_connections 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.570+0000 7f475b5d9640 1 --2- 172.21.15.132:0/2862550985 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47540bcde0 0x7f4754153d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.570+0000 7f475b5d9640 1 --2- 172.21.15.132:0/2862550985 >> v2:172.21.15.132:3300/0 conn(0x7f4754151550 0x7f47540c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.570+0000 7f475b5d9640 1 -- 172.21.15.132:0/2862550985 >> 172.21.15.132:0/2862550985 conn(0x7f47540ab300 msgr2=0x7f47540ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.570+0000 7f475b5d9640 1 -- 172.21.15.132:0/2862550985 shutdown_connections 2023-12-22T09:14:06.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.570+0000 7f475b5d9640 1 -- 172.21.15.132:0/2862550985 wait complete. 2023-12-22T09:14:06.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.571+0000 7f475b5d9640 1 Processor -- start 2023-12-22T09:14:06.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.572+0000 7f475b5d9640 1 -- start start 2023-12-22T09:14:06.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.572+0000 7f475b5d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47540bcde0 0x7f47541e6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.572+0000 7f475b5d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47540c6660 0x7f4754153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.572+0000 7f475b5d9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4754151550 0x7f47541528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.572+0000 7f475b5d9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4754154f40 con 0x7f47540c6660 2023-12-22T09:14:06.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.572+0000 7f475b5d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47540bf620 con 0x7f47540bcde0 2023-12-22T09:14:06.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.572+0000 7f475b5d9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47541506d0 con 0x7f4754151550 2023-12-22T09:14:06.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759375640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47540bcde0 0x7f47541e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759b76640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4754151550 0x7f47541528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759375640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47540bcde0 0x7f47541e6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51580/0 (socket says 172.21.15.132:51580) 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759375640 1 -- 172.21.15.132:0/592259141 learned_addr learned my addr 172.21.15.132:0/592259141 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4758b74640 1 --2- 172.21.15.132:0/592259141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47540c6660 0x7f4754153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759b76640 1 -- 172.21.15.132:0/592259141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47540bcde0 msgr2=0x7f47541e6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759b76640 1 --2- 172.21.15.132:0/592259141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47540bcde0 0x7f47541e6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759b76640 1 -- 172.21.15.132:0/592259141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47540c6660 msgr2=0x7f4754153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759b76640 1 --2- 172.21.15.132:0/592259141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47540c6660 0x7f4754153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759b76640 1 -- 172.21.15.132:0/592259141 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750009400 con 0x7f4754151550 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759375640 1 --2- 172.21.15.132:0/592259141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47540bcde0 0x7f47541e6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:06.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.573+0000 7f4759b76640 1 --2- 172.21.15.132:0/592259141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4754151550 0x7f47541528b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f474c001560 tx=0x7f474c00cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:06.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.574+0000 7f4749ffb640 1 -- 172.21.15.132:0/592259141 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00ce30 con 0x7f4754151550 2023-12-22T09:14:06.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.574+0000 7f4749ffb640 1 -- 172.21.15.132:0/592259141 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c00a640 con 0x7f4754151550 2023-12-22T09:14:06.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.574+0000 7f4749ffb640 1 -- 172.21.15.132:0/592259141 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00aa10 con 0x7f4754151550 2023-12-22T09:14:06.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.574+0000 7f475b5d9640 1 -- 172.21.15.132:0/592259141 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47440093a0 con 0x7f4754151550 2023-12-22T09:14:06.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.574+0000 7f475b5d9640 1 -- 172.21.15.132:0/592259141 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47541ec780 con 0x7f4754151550 2023-12-22T09:14:06.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.574+0000 7f4749ffb640 1 -- 172.21.15.132:0/592259141 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f474c0070d0 con 0x7f4754151550 2023-12-22T09:14:06.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.574+0000 7f4749ffb640 1 -- 172.21.15.132:0/592259141 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f474c007900 con 0x7f4754151550 2023-12-22T09:14:06.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.575+0000 7f475b5d9640 1 -- 172.21.15.132:0/592259141 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47541ec5e0 con 0x7f4754151550 2023-12-22T09:14:06.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.577+0000 7f4749ffb640 1 -- 172.21.15.132:0/592259141 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f47541ec5e0 con 0x7f4754151550 2023-12-22T09:14:06.582 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:06.582+0000 7f82b6656040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-22T09:14:06.589 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:06.589+0000 7f1e7f24c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-22T09:14:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.655+0000 7f475b5d9640 1 -- 172.21.15.132:0/592259141 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "52e2de6d-f709-4a50-9e16-f2f621898e96", "id": 5} v 0) v1 -- 0x7f4754073f10 con 0x7f4754151550 2023-12-22T09:14:06.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.664+0000 7f4749ffb640 1 -- 172.21.15.132:0/592259141 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52e2de6d-f709-4a50-9e16-f2f621898e96", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f474c018070 con 0x7f4754151550 2023-12-22T09:14:06.664 INFO:teuthology.orchestra.run.smithi132.stdout:5 2023-12-22T09:14:06.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.666+0000 7f475b5d9640 1 -- 172.21.15.132:0/592259141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4754151550 msgr2=0x7f47541528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.666+0000 7f475b5d9640 1 --2- 172.21.15.132:0/592259141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4754151550 0x7f47541528b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f474c001560 tx=0x7f474c00cbe0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.666+0000 7f475b5d9640 1 -- 172.21.15.132:0/592259141 shutdown_connections 2023-12-22T09:14:06.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.666+0000 7f475b5d9640 1 --2- 172.21.15.132:0/592259141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4754151550 0x7f47541528b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.666+0000 7f475b5d9640 1 --2- 172.21.15.132:0/592259141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47540c6660 0x7f4754153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.666+0000 7f475b5d9640 1 --2- 172.21.15.132:0/592259141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47540bcde0 0x7f47541e6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.666+0000 7f475b5d9640 1 -- 172.21.15.132:0/592259141 >> 172.21.15.132:0/592259141 conn(0x7f47540ab300 msgr2=0x7f47540c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:06.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.666+0000 7f475b5d9640 1 -- 172.21.15.132:0/592259141 shutdown_connections 2023-12-22T09:14:06.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.666+0000 7f475b5d9640 1 -- 172.21.15.132:0/592259141 wait complete. 2023-12-22T09:14:06.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 71c167ac-2694-4ce4-babf-7c899e6945f7 6 2023-12-22T09:14:06.694 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:06.693+0000 7f82b6656040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-22T09:14:06.752 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:06.752+0000 7f1e7f24c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-22T09:14:06.808 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:06.808+0000 7f1e7f24c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-22T09:14:06.855 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:06.854+0000 7f82b6656040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-22T09:14:06.905 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:06.905+0000 7f82b6656040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-22T09:14:06.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.921+0000 7f787e8c0640 1 Processor -- start 2023-12-22T09:14:06.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.921+0000 7f787e8c0640 1 -- start start 2023-12-22T09:14:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.922+0000 7f787e8c0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7878151010 0x7f787806a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.922+0000 7f787e8c0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f787806a930 0x7f7878154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.922+0000 7f787e8c0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7878154b50 con 0x7f787806b340 2023-12-22T09:14:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.922+0000 7f787e8c0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78780c3ea0 con 0x7f787806a930 2023-12-22T09:14:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.922+0000 7f787e8c0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78780c4740 con 0x7f7878151010 2023-12-22T09:14:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.923+0000 7f787d8be640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7878151010 0x7f787806a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.923+0000 7f787e0bf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f787806a930 0x7f7878154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.923+0000 7f787d8be640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7878151010 0x7f787806a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:34140/0 (socket says 172.21.15.132:34140) 2023-12-22T09:14:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.923+0000 7f787d8be640 1 -- 172.21.15.132:0/4075741649 learned_addr learned my addr 172.21.15.132:0/4075741649 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.923+0000 7f787e0bf640 1 -- 172.21.15.132:0/4075741649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7878151010 msgr2=0x7f787806a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.923+0000 7f787e0bf640 1 --2- 172.21.15.132:0/4075741649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7878151010 0x7f787806a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.923+0000 7f787e0bf640 1 -- 172.21.15.132:0/4075741649 >> v1:172.21.15.106:6789/0 conn(0x7f787806b340 legacy=0x7f7878153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.923+0000 7f787e0bf640 1 -- 172.21.15.132:0/4075741649 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878157f00 con 0x7f787806a930 2023-12-22T09:14:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.923+0000 7f787d8be640 1 --2- 172.21.15.132:0/4075741649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7878151010 0x7f787806a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.924+0000 7f787e0bf640 1 --2- 172.21.15.132:0/4075741649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f787806a930 0x7f7878154610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78700097a0 tx=0x7f787002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e905c2dc4e64a8c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:06.924 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:06.924+0000 7f1e7f24c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-22T09:14:06.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.924+0000 7f787c8bc640 1 -- 172.21.15.132:0/4075741649 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78700316f0 con 0x7f787806a930 2023-12-22T09:14:06.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.924+0000 7f787c8bc640 1 -- 172.21.15.132:0/4075741649 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7870031850 con 0x7f787806a930 2023-12-22T09:14:06.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.924+0000 7f787c8bc640 1 -- 172.21.15.132:0/4075741649 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870031be0 con 0x7f787806a930 2023-12-22T09:14:06.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.925+0000 7f787e8c0640 1 -- 172.21.15.132:0/4075741649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f787806a930 msgr2=0x7f7878154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.925+0000 7f787e8c0640 1 --2- 172.21.15.132:0/4075741649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f787806a930 0x7f7878154610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78700097a0 tx=0x7f787002b790 comp rx=0 tx=0).stop 2023-12-22T09:14:06.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.925+0000 7f787e8c0640 1 -- 172.21.15.132:0/4075741649 shutdown_connections 2023-12-22T09:14:06.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.925+0000 7f787e8c0640 1 --2- 172.21.15.132:0/4075741649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f787806a930 0x7f7878154610 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.925+0000 7f787e8c0640 1 --2- 172.21.15.132:0/4075741649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7878151010 0x7f787806a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.925+0000 7f787e8c0640 1 -- 172.21.15.132:0/4075741649 >> 172.21.15.132:0/4075741649 conn(0x7f78780c5fa0 msgr2=0x7f78780c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:06.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.925+0000 7f787e8c0640 1 -- 172.21.15.132:0/4075741649 shutdown_connections 2023-12-22T09:14:06.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.925+0000 7f787e8c0640 1 -- 172.21.15.132:0/4075741649 wait complete. 2023-12-22T09:14:06.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.927+0000 7f787e8c0640 1 Processor -- start 2023-12-22T09:14:06.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.927+0000 7f787e8c0640 1 -- start start 2023-12-22T09:14:06.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787e8c0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f787806a930 0x7f78780ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787e8c0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f787806b340 0x7f7878156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787e8c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7878151010 0x7f78780c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787e8c0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78780a9750 con 0x7f787806b340 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787e8c0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78780c2450 con 0x7f7878151010 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787e8c0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78780a90d0 con 0x7f787806a930 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787d8be640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f787806a930 0x7f78780ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787e0bf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7878151010 0x7f78780c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787d8be640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f787806a930 0x7f78780ab9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:34148/0 (socket says 172.21.15.132:34148) 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787d8be640 1 -- 172.21.15.132:0/1164540002 learned_addr learned my addr 172.21.15.132:0/1164540002 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:06.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787d8be640 1 -- 172.21.15.132:0/1164540002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7878151010 msgr2=0x7f78780c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787d8be640 1 --2- 172.21.15.132:0/1164540002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7878151010 0x7f78780c2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787d0bd640 1 --2- 172.21.15.132:0/1164540002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f787806b340 0x7f7878156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:06.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787d8be640 1 -- 172.21.15.132:0/1164540002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f787806b340 msgr2=0x7f7878156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:06.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787d8be640 1 --2- 172.21.15.132:0/1164540002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f787806b340 0x7f7878156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:06.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.928+0000 7f787d8be640 1 -- 172.21.15.132:0/1164540002 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868009b30 con 0x7f787806a930 2023-12-22T09:14:06.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.929+0000 7f787d0bd640 1 --2- 172.21.15.132:0/1164540002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f787806b340 0x7f7878156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:06.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.929+0000 7f787d8be640 1 --2- 172.21.15.132:0/1164540002 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f787806a930 0x7f78780ab9c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f786800efc0 tx=0x7f786800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:06.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.929+0000 7f78767fc640 1 -- 172.21.15.132:0/1164540002 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868014480 con 0x7f787806a930 2023-12-22T09:14:06.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.929+0000 7f78767fc640 1 -- 172.21.15.132:0/1164540002 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786800f040 con 0x7f787806a930 2023-12-22T09:14:06.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.929+0000 7f78767fc640 1 -- 172.21.15.132:0/1164540002 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78680147e0 con 0x7f787806a930 2023-12-22T09:14:06.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.929+0000 7f787e8c0640 1 -- 172.21.15.132:0/1164540002 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7870009400 con 0x7f787806a930 2023-12-22T09:14:06.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.929+0000 7f787e8c0640 1 -- 172.21.15.132:0/1164540002 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78780a9370 con 0x7f787806a930 2023-12-22T09:14:06.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.929+0000 7f78767fc640 1 -- 172.21.15.132:0/1164540002 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7868014c40 con 0x7f787806a930 2023-12-22T09:14:06.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.929+0000 7f78767fc640 1 -- 172.21.15.132:0/1164540002 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f786801e460 con 0x7f787806a930 2023-12-22T09:14:06.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.930+0000 7f787e8c0640 1 -- 172.21.15.132:0/1164540002 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78780c40a0 con 0x7f787806a930 2023-12-22T09:14:06.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:06.932+0000 7f78767fc640 1 -- 172.21.15.132:0/1164540002 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f786801e6b0 con 0x7f787806a930 2023-12-22T09:14:07.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.005+0000 7f787e8c0640 1 -- 172.21.15.132:0/1164540002 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "71c167ac-2694-4ce4-babf-7c899e6945f7", "id": 6} v 0) v1 -- 0x7f787804e8d0 con 0x7f787806a930 2023-12-22T09:14:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.015+0000 7f78767fc640 1 -- 172.21.15.132:0/1164540002 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71c167ac-2694-4ce4-babf-7c899e6945f7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f786801eb90 con 0x7f787806a930 2023-12-22T09:14:07.015 INFO:teuthology.orchestra.run.smithi132.stdout:6 2023-12-22T09:14:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.016+0000 7f787e8c0640 1 -- 172.21.15.132:0/1164540002 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f787806a930 msgr2=0x7f78780ab9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.016+0000 7f787e8c0640 1 --2- 172.21.15.132:0/1164540002 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f787806a930 0x7f78780ab9c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f786800efc0 tx=0x7f786800c490 comp rx=0 tx=0).stop 2023-12-22T09:14:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.016+0000 7f787e8c0640 1 -- 172.21.15.132:0/1164540002 shutdown_connections 2023-12-22T09:14:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.016+0000 7f787e8c0640 1 --2- 172.21.15.132:0/1164540002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7878151010 0x7f78780c2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.016+0000 7f787e8c0640 1 --2- 172.21.15.132:0/1164540002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f787806b340 0x7f7878156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.016+0000 7f787e8c0640 1 --2- 172.21.15.132:0/1164540002 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f787806a930 0x7f78780ab9c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.016+0000 7f787e8c0640 1 -- 172.21.15.132:0/1164540002 >> 172.21.15.132:0/1164540002 conn(0x7f78780c5fa0 msgr2=0x7f7878153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.017+0000 7f787e8c0640 1 -- 172.21.15.132:0/1164540002 shutdown_connections 2023-12-22T09:14:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.017+0000 7f787e8c0640 1 -- 172.21.15.132:0/1164540002 wait complete. 2023-12-22T09:14:07.037 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 8a8e873b-9dc5-4e8a-ba64-c7fc14baef98 7 2023-12-22T09:14:07.040 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:07.040+0000 7f1e7f24c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-22T09:14:07.064 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:07.063+0000 7f82b6656040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-22T09:14:07.209 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:07.209+0000 7f1e7f24c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-22T09:14:07.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.228+0000 7fbe955c1640 1 Processor -- start 2023-12-22T09:14:07.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.228+0000 7fbe955c1640 1 -- start start 2023-12-22T09:14:07.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe955c1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbe90151380 0x7fbe900c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe955c1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbe900c76c0 0x7fbe900c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe955c1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe90153b50 con 0x7fbe901570e0 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe955c1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe90153e10 con 0x7fbe90151380 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe955c1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe901540f0 con 0x7fbe900c76c0 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe87fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbe900c76c0 0x7fbe900c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe87fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbe900c76c0 0x7fbe900c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51612/0 (socket says 172.21.15.132:51612) 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe87fff640 1 -- 172.21.15.132:0/2870415319 learned_addr learned my addr 172.21.15.132:0/2870415319 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe94dc0640 1 --1- 172.21.15.132:0/2870415319 >> v1:172.21.15.132:6789/0 conn(0x7fbe901570e0 0x7fbe90157550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46764/0 (socket says 172.21.15.132:46764) 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe8ffff640 1 --2- 172.21.15.132:0/2870415319 >> v2:172.21.15.106:3300/0 conn(0x7fbe90151380 0x7fbe900c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe87fff640 1 -- 172.21.15.132:0/2870415319 >> v2:172.21.15.106:3300/0 conn(0x7fbe90151380 msgr2=0x7fbe900c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe87fff640 1 --2- 172.21.15.132:0/2870415319 >> v2:172.21.15.106:3300/0 conn(0x7fbe90151380 0x7fbe900c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.230+0000 7fbe87fff640 1 -- 172.21.15.132:0/2870415319 >> v1:172.21.15.132:6789/0 conn(0x7fbe901570e0 legacy=0x7fbe90157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.231+0000 7fbe87fff640 1 -- 172.21.15.132:0/2870415319 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe901543d0 con 0x7fbe900c76c0 2023-12-22T09:14:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.231+0000 7fbe8f7fe640 1 -- 172.21.15.132:0/2870415319 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740608112 0 0) 0x7fbe90153b50 con 0x7fbe901570e0 2023-12-22T09:14:07.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.232+0000 7fbe87fff640 1 --2- 172.21.15.132:0/2870415319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe900c76c0 0x7fbe900c7b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbe90071b60 tx=0x7fbe7802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2e806d9b297753 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:07.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.232+0000 7fbe8f7fe640 1 -- 172.21.15.132:0/2870415319 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78031870 con 0x7fbe900c76c0 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.232+0000 7fbe8f7fe640 1 -- 172.21.15.132:0/2870415319 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe780319d0 con 0x7fbe900c76c0 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.232+0000 7fbe8f7fe640 1 -- 172.21.15.132:0/2870415319 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78031d60 con 0x7fbe900c76c0 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.233+0000 7fbe955c1640 1 -- 172.21.15.132:0/2870415319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe900c76c0 msgr2=0x7fbe900c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.233+0000 7fbe955c1640 1 --2- 172.21.15.132:0/2870415319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe900c76c0 0x7fbe900c7b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbe90071b60 tx=0x7fbe7802b910 comp rx=0 tx=0).stop 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.233+0000 7fbe955c1640 1 -- 172.21.15.132:0/2870415319 shutdown_connections 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.233+0000 7fbe955c1640 1 --2- 172.21.15.132:0/2870415319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe900c76c0 0x7fbe900c7b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.233+0000 7fbe955c1640 1 --2- 172.21.15.132:0/2870415319 >> v2:172.21.15.106:3300/0 conn(0x7fbe90151380 0x7fbe900c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.233+0000 7fbe955c1640 1 -- 172.21.15.132:0/2870415319 >> 172.21.15.132:0/2870415319 conn(0x7fbe90069dd0 msgr2=0x7fbe9006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.233+0000 7fbe955c1640 1 -- 172.21.15.132:0/2870415319 shutdown_connections 2023-12-22T09:14:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.233+0000 7fbe955c1640 1 -- 172.21.15.132:0/2870415319 wait complete. 2023-12-22T09:14:07.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.234+0000 7fbe955c1640 1 Processor -- start 2023-12-22T09:14:07.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.235+0000 7fbe955c1640 1 -- start start 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.235+0000 7fbe955c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe900c76c0 0x7fbe9014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.235+0000 7fbe955c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe90151380 0x7fbe900c00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.235+0000 7fbe955c1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe901570e0 0x7fbe900bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.235+0000 7fbe955c1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90153a80 con 0x7fbe901570e0 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.235+0000 7fbe955c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900c0a00 con 0x7fbe90151380 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.235+0000 7fbe955c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe901530e0 con 0x7fbe900c76c0 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe87fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe90151380 0x7fbe900c00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe8ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe900c76c0 0x7fbe9014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe87fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe90151380 0x7fbe900c00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51626/0 (socket says 172.21.15.132:51626) 2023-12-22T09:14:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe87fff640 1 -- 172.21.15.132:0/1411577141 learned_addr learned my addr 172.21.15.132:0/1411577141 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-22T09:14:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe94dc0640 1 --2- 172.21.15.132:0/1411577141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe901570e0 0x7fbe900bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe87fff640 1 -- 172.21.15.132:0/1411577141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe900c76c0 msgr2=0x7fbe9014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe87fff640 1 --2- 172.21.15.132:0/1411577141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe900c76c0 0x7fbe9014ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe87fff640 1 -- 172.21.15.132:0/1411577141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe901570e0 msgr2=0x7fbe900bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe87fff640 1 --2- 172.21.15.132:0/1411577141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe901570e0 0x7fbe900bc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe87fff640 1 -- 172.21.15.132:0/1411577141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe780094d0 con 0x7fbe90151380 2023-12-22T09:14:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe87fff640 1 --2- 172.21.15.132:0/1411577141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe90151380 0x7fbe900c00b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000c00 tx=0x7fbe780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:07.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.236+0000 7fbe8d7fa640 1 -- 172.21.15.132:0/1411577141 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7803ad30 con 0x7fbe90151380 2023-12-22T09:14:07.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.237+0000 7fbe8d7fa640 1 -- 172.21.15.132:0/1411577141 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe780443f0 con 0x7fbe90151380 2023-12-22T09:14:07.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.237+0000 7fbe8d7fa640 1 -- 172.21.15.132:0/1411577141 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe780447a0 con 0x7fbe90151380 2023-12-22T09:14:07.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.237+0000 7fbe955c1640 1 -- 172.21.15.132:0/1411577141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe901533c0 con 0x7fbe90151380 2023-12-22T09:14:07.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.237+0000 7fbe955c1640 1 -- 172.21.15.132:0/1411577141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe901504a0 con 0x7fbe90151380 2023-12-22T09:14:07.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.237+0000 7fbe8d7fa640 1 -- 172.21.15.132:0/1411577141 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbe78044c00 con 0x7fbe90151380 2023-12-22T09:14:07.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.237+0000 7fbe8d7fa640 1 -- 172.21.15.132:0/1411577141 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fbe7802d040 con 0x7fbe90151380 2023-12-22T09:14:07.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.238+0000 7fbe955c1640 1 -- 172.21.15.132:0/1411577141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9004e8d0 con 0x7fbe90151380 2023-12-22T09:14:07.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.242+0000 7fbe8d7fa640 1 -- 172.21.15.132:0/1411577141 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fbe78052060 con 0x7fbe90151380 2023-12-22T09:14:07.264 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:07.264+0000 7f1e7f24c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-22T09:14:07.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.320+0000 7fbe955c1640 1 -- 172.21.15.132:0/1411577141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8a8e873b-9dc5-4e8a-ba64-c7fc14baef98", "id": 7} v 0) v1 -- 0x7fbe9006f0d0 con 0x7fbe90151380 2023-12-22T09:14:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.329+0000 7fbe8d7fa640 1 -- 172.21.15.132:0/1411577141 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a8e873b-9dc5-4e8a-ba64-c7fc14baef98", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbe78035020 con 0x7fbe90151380 2023-12-22T09:14:07.330 INFO:teuthology.orchestra.run.smithi132.stdout:7 2023-12-22T09:14:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.331+0000 7fbe955c1640 1 -- 172.21.15.132:0/1411577141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe90151380 msgr2=0x7fbe900c00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.331+0000 7fbe955c1640 1 --2- 172.21.15.132:0/1411577141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe90151380 0x7fbe900c00b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000c00 tx=0x7fbe780046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.331+0000 7fbe955c1640 1 -- 172.21.15.132:0/1411577141 shutdown_connections 2023-12-22T09:14:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.331+0000 7fbe955c1640 1 --2- 172.21.15.132:0/1411577141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe901570e0 0x7fbe900bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.331+0000 7fbe955c1640 1 --2- 172.21.15.132:0/1411577141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe90151380 0x7fbe900c00b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.331+0000 7fbe955c1640 1 --2- 172.21.15.132:0/1411577141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe900c76c0 0x7fbe9014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.331+0000 7fbe955c1640 1 -- 172.21.15.132:0/1411577141 >> 172.21.15.132:0/1411577141 conn(0x7fbe90069dd0 msgr2=0x7fbe900acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.331+0000 7fbe955c1640 1 -- 172.21.15.132:0/1411577141 shutdown_connections 2023-12-22T09:14:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-22T09:14:07.331+0000 7fbe955c1640 1 -- 172.21.15.132:0/1411577141 wait complete. 2023-12-22T09:14:07.347 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-22T09:14:07.347 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-22T09:14:07.356 INFO:tasks.ceph.osd.0:Started 2023-12-22T09:14:07.356 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-22T09:14:07.356 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-22T09:14:07.364 INFO:tasks.ceph.osd.1:Started 2023-12-22T09:14:07.364 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-22T09:14:07.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-22T09:14:07.371 INFO:tasks.ceph.osd.2:Started 2023-12-22T09:14:07.371 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-22T09:14:07.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-22T09:14:07.376 INFO:tasks.ceph.osd.3:Started 2023-12-22T09:14:07.376 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-22T09:14:07.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-22T09:14:07.385 INFO:tasks.ceph.osd.4:Started 2023-12-22T09:14:07.385 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-22T09:14:07.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-22T09:14:07.393 INFO:tasks.ceph.osd.5:Started 2023-12-22T09:14:07.393 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-22T09:14:07.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-22T09:14:07.399 INFO:tasks.ceph.osd.6:Started 2023-12-22T09:14:07.399 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-22T09:14:07.399 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-22T09:14:07.405 INFO:tasks.ceph.osd.7:Started 2023-12-22T09:14:07.406 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:07.438 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:07.438+0000 7f1e7f24c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-22T09:14:07.629 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.628+0000 7f30b26db640 1 Processor -- start 2023-12-22T09:14:07.629 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.628+0000 7f30b26db640 1 -- start start 2023-12-22T09:14:07.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.629+0000 7f30b26db640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac1514b0 0x7f30ac0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.629+0000 7f30b26db640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30ac06aad0 0x7f30ac0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.629+0000 7f30b26db640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ac0c4660 con 0x7f30ac0c4130 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.629+0000 7f30b26db640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ac153d60 con 0x7f30ac06aad0 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.629+0000 7f30b26db640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac154c50 con 0x7f30ac1514b0 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.630+0000 7f30b0c78640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30ac06aad0 0x7f30ac0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.630+0000 7f30b0c78640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30ac06aad0 0x7f30ac0c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48576/0 (socket says 172.21.15.106:48576) 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.630+0000 7f30b0c78640 1 -- 172.21.15.106:0/3946942528 learned_addr learned my addr 172.21.15.106:0/3946942528 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.630+0000 7f30abfff640 1 --2- 172.21.15.106:0/3946942528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac1514b0 0x7f30ac0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.630+0000 7f30b0c78640 1 -- 172.21.15.106:0/3946942528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac1514b0 msgr2=0x7f30ac0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.630+0000 7f30b0c78640 1 --2- 172.21.15.106:0/3946942528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac1514b0 0x7f30ac0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.630+0000 7f30b0c78640 1 -- 172.21.15.106:0/3946942528 >> v1:172.21.15.132:6789/0 conn(0x7f30ac0c4130 legacy=0x7f30ac154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.630+0000 7f30b0c78640 1 -- 172.21.15.106:0/3946942528 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac06b250 con 0x7f30ac06aad0 2023-12-22T09:14:07.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.631+0000 7f30b0c78640 1 --2- 172.21.15.106:0/3946942528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac06aad0 0x7f30ac0c48e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009e50 tx=0x7f30a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d20a1fb1e53eb53 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.631+0000 7f30ab7fe640 1 -- 172.21.15.106:0/3946942528 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a402ca70 con 0x7f30ac06aad0 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.631+0000 7f30ab7fe640 1 -- 172.21.15.106:0/3946942528 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a402cbd0 con 0x7f30ac06aad0 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.631+0000 7f30ab7fe640 1 -- 172.21.15.106:0/3946942528 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40343f0 con 0x7f30ac06aad0 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.632+0000 7f30b26db640 1 -- 172.21.15.106:0/3946942528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac06aad0 msgr2=0x7f30ac0c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.632+0000 7f30b26db640 1 --2- 172.21.15.106:0/3946942528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac06aad0 0x7f30ac0c48e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009e50 tx=0x7f30a402bed0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.632+0000 7f30b26db640 1 -- 172.21.15.106:0/3946942528 shutdown_connections 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.632+0000 7f30b26db640 1 --2- 172.21.15.106:0/3946942528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac06aad0 0x7f30ac0c48e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.632+0000 7f30b26db640 1 --2- 172.21.15.106:0/3946942528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac1514b0 0x7f30ac0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.632+0000 7f30b26db640 1 -- 172.21.15.106:0/3946942528 >> 172.21.15.106:0/3946942528 conn(0x7f30ac0ab1a0 msgr2=0x7f30ac0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.632+0000 7f30b26db640 1 -- 172.21.15.106:0/3946942528 shutdown_connections 2023-12-22T09:14:07.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.632+0000 7f30b26db640 1 -- 172.21.15.106:0/3946942528 wait complete. 2023-12-22T09:14:07.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.634+0000 7f30b26db640 1 Processor -- start 2023-12-22T09:14:07.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.634+0000 7f30b26db640 1 -- start start 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.634+0000 7f30b26db640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac06aad0 0x7f30ac1dba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b26db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30ac0c4130 0x7f30ac0c2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b26db640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac1514b0 0x7f30ac0c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b26db640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0aaa60 con 0x7f30ac1514b0 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b26db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0ab030 con 0x7f30ac0c4130 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b26db640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0c1ba0 con 0x7f30ac06aad0 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b0c78640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac1514b0 0x7f30ac0c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b0c78640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac1514b0 0x7f30ac0c2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48586/0 (socket says 172.21.15.106:48586) 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b0c78640 1 -- 172.21.15.106:0/1046801836 learned_addr learned my addr 172.21.15.106:0/1046801836 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30a3fff640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30ac0c4130 0x7f30ac0c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30abfff640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac06aad0 0x7f30ac1dba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b0c78640 1 -- 172.21.15.106:0/1046801836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac06aad0 msgr2=0x7f30ac1dba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b0c78640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac06aad0 0x7f30ac1dba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b0c78640 1 -- 172.21.15.106:0/1046801836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30ac0c4130 msgr2=0x7f30ac0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b0c78640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30ac0c4130 0x7f30ac0c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b0c78640 1 -- 172.21.15.106:0/1046801836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a4009b30 con 0x7f30ac1514b0 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30abfff640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac06aad0 0x7f30ac1dba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.635+0000 7f30b0c78640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac1514b0 0x7f30ac0c2550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f30a4036040 tx=0x7f30a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.636+0000 7f30a97fa640 1 -- 172.21.15.106:0/1046801836 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a4009510 con 0x7f30ac1514b0 2023-12-22T09:14:07.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.636+0000 7f30a97fa640 1 -- 172.21.15.106:0/1046801836 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a403e450 con 0x7f30ac1514b0 2023-12-22T09:14:07.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.636+0000 7f30b26db640 1 -- 172.21.15.106:0/1046801836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac0a9ee0 con 0x7f30ac1514b0 2023-12-22T09:14:07.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.636+0000 7f30a97fa640 1 -- 172.21.15.106:0/1046801836 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a403e7e0 con 0x7f30ac1514b0 2023-12-22T09:14:07.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.636+0000 7f30b26db640 1 -- 172.21.15.106:0/1046801836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac0aa4a0 con 0x7f30ac1514b0 2023-12-22T09:14:07.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.636+0000 7f30a97fa640 1 -- 172.21.15.106:0/1046801836 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f30a403ec40 con 0x7f30ac1514b0 2023-12-22T09:14:07.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.636+0000 7f30a97fa640 1 -- 172.21.15.106:0/1046801836 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f30a4048b70 con 0x7f30ac1514b0 2023-12-22T09:14:07.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.637+0000 7f30b26db640 1 -- 172.21.15.106:0/1046801836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ac073f10 con 0x7f30ac1514b0 2023-12-22T09:14:07.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.640+0000 7f30a97fa640 1 -- 172.21.15.106:0/1046801836 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f30a4043020 con 0x7f30ac1514b0 2023-12-22T09:14:07.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.703+0000 7f30b26db640 1 -- 172.21.15.106:0/1046801836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30ac0c37b0 con 0x7f30ac1514b0 2023-12-22T09:14:07.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.703+0000 7f30a97fa640 1 -- 172.21.15.106:0/1046801836 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f30a4048400 con 0x7f30ac1514b0 2023-12-22T09:14:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:07.704 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":10,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:07.322286+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:07.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.704+0000 7f30b26db640 1 -- 172.21.15.106:0/1046801836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac1514b0 msgr2=0x7f30ac0c2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:07.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.704+0000 7f30b26db640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac1514b0 0x7f30ac0c2550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f30a4036040 tx=0x7f30a4004a40 comp rx=0 tx=0).stop 2023-12-22T09:14:07.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.705+0000 7f30b26db640 1 -- 172.21.15.106:0/1046801836 shutdown_connections 2023-12-22T09:14:07.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.705+0000 7f30b26db640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30ac1514b0 0x7f30ac0c2550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.705+0000 7f30b26db640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30ac0c4130 0x7f30ac0c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.705+0000 7f30b26db640 1 --2- 172.21.15.106:0/1046801836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30ac06aad0 0x7f30ac1dba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:07.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.705+0000 7f30b26db640 1 -- 172.21.15.106:0/1046801836 >> 172.21.15.106:0/1046801836 conn(0x7f30ac0ab1a0 msgr2=0x7f30ac0c5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:07.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.705+0000 7f30b26db640 1 -- 172.21.15.106:0/1046801836 shutdown_connections 2023-12-22T09:14:07.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:07.705+0000 7f30b26db640 1 -- 172.21.15.106:0/1046801836 wait complete. 2023-12-22T09:14:07.720 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-22T09:14:07.721 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-22T09:14:08.061 INFO:tasks.ceph.osd.0.smithi106.stderr:2023-12-22T09:14:08.059+0000 7f0b0c70e500 -1 Falling back to public interface 2023-12-22T09:14:08.071 INFO:tasks.ceph.osd.1.smithi106.stderr:2023-12-22T09:14:08.071+0000 7fdbdcecf500 -1 Falling back to public interface 2023-12-22T09:14:08.076 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-12-22T09:14:08.075+0000 7f179f8d2500 -1 Falling back to public interface 2023-12-22T09:14:08.096 INFO:tasks.ceph.osd.2.smithi106.stderr:2023-12-22T09:14:08.095+0000 7f438922a500 -1 Falling back to public interface 2023-12-22T09:14:08.099 INFO:tasks.ceph.osd.3.smithi106.stderr:2023-12-22T09:14:08.099+0000 7fae9c411500 -1 Falling back to public interface 2023-12-22T09:14:08.101 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-12-22T09:14:08.101+0000 7f916b00d500 -1 Falling back to public interface 2023-12-22T09:14:08.113 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-12-22T09:14:08.112+0000 7fbaeee20500 -1 Falling back to public interface 2023-12-22T09:14:08.113 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-12-22T09:14:08.112+0000 7f42d3f27500 -1 Falling back to public interface 2023-12-22T09:14:08.188 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:08.187+0000 7f82b6656040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-22T09:14:08.480 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:08.479+0000 7f1e7f24c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-22T09:14:08.497 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:08.497+0000 7f82b6656040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-22T09:14:08.527 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:08.558 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:08.557+0000 7f82b6656040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-22T09:14:08.678 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:08.675+0000 7f82b6656040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-22T09:14:08.690 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.690+0000 7fa2de754640 1 Processor -- start 2023-12-22T09:14:08.690 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.690+0000 7fa2de754640 1 -- start start 2023-12-22T09:14:08.692 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.691+0000 7fa2de754640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa2d80c4200 0x7fa2d814d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:08.692 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.691+0000 7fa2de754640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80bcca0 0x7fa2d81579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:08.692 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.691+0000 7fa2de754640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d8154030 con 0x7fa2d80c6020 2023-12-22T09:14:08.692 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.691+0000 7fa2de754640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d81549d0 con 0x7fa2d80c4200 2023-12-22T09:14:08.692 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.691+0000 7fa2de754640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8154310 con 0x7fa2d80bcca0 2023-12-22T09:14:08.693 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2d7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa2d80c4200 0x7fa2d814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:08.693 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2d7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa2d80c4200 0x7fa2d814d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48620/0 (socket says 172.21.15.106:48620) 2023-12-22T09:14:08.693 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2d7fff640 1 -- 172.21.15.106:0/1055979184 learned_addr learned my addr 172.21.15.106:0/1055979184 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:08.693 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2d77fe640 1 --1- 172.21.15.106:0/1055979184 >> v1:172.21.15.132:6789/0 conn(0x7fa2d80c6020 0x7fa2d81572d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:45964/0 (socket says 172.21.15.106:45964) 2023-12-22T09:14:08.693 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2dccf1640 1 --2- 172.21.15.106:0/1055979184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80bcca0 0x7fa2d81579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:08.693 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2d7fff640 1 -- 172.21.15.106:0/1055979184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80bcca0 msgr2=0x7fa2d81579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:08.694 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2d7fff640 1 --2- 172.21.15.106:0/1055979184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80bcca0 0x7fa2d81579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:08.694 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2d7fff640 1 -- 172.21.15.106:0/1055979184 >> v1:172.21.15.132:6789/0 conn(0x7fa2d80c6020 legacy=0x7fa2d81572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:08.694 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2d7fff640 1 -- 172.21.15.106:0/1055979184 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d81545f0 con 0x7fa2d80c4200 2023-12-22T09:14:08.694 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.692+0000 7fa2d6ffd640 1 -- 172.21.15.106:0/1055979184 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830206943 0 0) 0x7fa2d8154030 con 0x7fa2d80c6020 2023-12-22T09:14:08.695 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.693+0000 7fa2d7fff640 1 --2- 172.21.15.106:0/1055979184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80c4200 0x7fa2d814d960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009870 tx=0x7fa2c802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50f6b1fba491e2a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:08.695 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.694+0000 7fa2d6ffd640 1 -- 172.21.15.106:0/1055979184 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80317c0 con 0x7fa2d80c4200 2023-12-22T09:14:08.695 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.694+0000 7fa2d6ffd640 1 -- 172.21.15.106:0/1055979184 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8031920 con 0x7fa2d80c4200 2023-12-22T09:14:08.695 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.694+0000 7fa2d6ffd640 1 -- 172.21.15.106:0/1055979184 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8031cb0 con 0x7fa2d80c4200 2023-12-22T09:14:08.695 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.694+0000 7fa2de754640 1 -- 172.21.15.106:0/1055979184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80c4200 msgr2=0x7fa2d814d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:08.695 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.694+0000 7fa2de754640 1 --2- 172.21.15.106:0/1055979184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80c4200 0x7fa2d814d960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009870 tx=0x7fa2c802b860 comp rx=0 tx=0).stop 2023-12-22T09:14:08.696 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.695+0000 7fa2de754640 1 -- 172.21.15.106:0/1055979184 shutdown_connections 2023-12-22T09:14:08.696 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.695+0000 7fa2de754640 1 --2- 172.21.15.106:0/1055979184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80bcca0 0x7fa2d81579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:08.696 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.695+0000 7fa2de754640 1 --2- 172.21.15.106:0/1055979184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80c4200 0x7fa2d814d960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:08.696 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.695+0000 7fa2de754640 1 -- 172.21.15.106:0/1055979184 >> 172.21.15.106:0/1055979184 conn(0x7fa2d80ab1a0 msgr2=0x7fa2d80ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:08.696 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.695+0000 7fa2de754640 1 -- 172.21.15.106:0/1055979184 shutdown_connections 2023-12-22T09:14:08.696 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.695+0000 7fa2de754640 1 -- 172.21.15.106:0/1055979184 wait complete. 2023-12-22T09:14:08.697 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.696+0000 7fa2de754640 1 Processor -- start 2023-12-22T09:14:08.697 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.697+0000 7fa2de754640 1 -- start start 2023-12-22T09:14:08.700 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.697+0000 7fa2de754640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80bcca0 0x7fa2d80ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:08.700 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.697+0000 7fa2de754640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2d80c4200 0x7fa2d814c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:08.700 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.697+0000 7fa2de754640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80c6020 0x7fa2d8147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:08.707 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.697+0000 7fa2de754640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80ad6c0 con 0x7fa2d80bcca0 2023-12-22T09:14:08.708 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.697+0000 7fa2de754640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d814bc50 con 0x7fa2d80c4200 2023-12-22T09:14:08.708 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.697+0000 7fa2de754640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80bd340 con 0x7fa2d80c6020 2023-12-22T09:14:08.708 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80bcca0 0x7fa2d80ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:08.708 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80bcca0 0x7fa2d80ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48638/0 (socket says 172.21.15.106:48638) 2023-12-22T09:14:08.708 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2d7fff640 1 -- 172.21.15.106:0/3347717097 learned_addr learned my addr 172.21.15.106:0/3347717097 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:08.708 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2dccf1640 1 --2- 172.21.15.106:0/3347717097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80c6020 0x7fa2d8147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:08.709 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2d77fe640 1 --2- 172.21.15.106:0/3347717097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2d80c4200 0x7fa2d814c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:08.709 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2d7fff640 1 -- 172.21.15.106:0/3347717097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80c6020 msgr2=0x7fa2d8147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:08.709 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2d7fff640 1 --2- 172.21.15.106:0/3347717097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80c6020 0x7fa2d8147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:08.709 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2d7fff640 1 -- 172.21.15.106:0/3347717097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2d80c4200 msgr2=0x7fa2d814c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:08.709 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2d7fff640 1 --2- 172.21.15.106:0/3347717097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2d80c4200 0x7fa2d814c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:08.709 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.698+0000 7fa2d7fff640 1 -- 172.21.15.106:0/3347717097 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c80094d0 con 0x7fa2d80bcca0 2023-12-22T09:14:08.710 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.699+0000 7fa2d7fff640 1 --2- 172.21.15.106:0/3347717097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80bcca0 0x7fa2d80ad180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2c802b8a0 tx=0x7fa2c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:08.710 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.699+0000 7fa2d4ff9640 1 -- 172.21.15.106:0/3347717097 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8032860 con 0x7fa2d80bcca0 2023-12-22T09:14:08.710 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.699+0000 7fa2d4ff9640 1 -- 172.21.15.106:0/3347717097 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c80329c0 con 0x7fa2d80bcca0 2023-12-22T09:14:08.710 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.699+0000 7fa2d4ff9640 1 -- 172.21.15.106:0/3347717097 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8032d70 con 0x7fa2d80bcca0 2023-12-22T09:14:08.710 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.699+0000 7fa2de754640 1 -- 172.21.15.106:0/3347717097 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d80bd620 con 0x7fa2d80bcca0 2023-12-22T09:14:08.710 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.699+0000 7fa2de754640 1 -- 172.21.15.106:0/3347717097 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d814bef0 con 0x7fa2d80bcca0 2023-12-22T09:14:08.711 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.700+0000 7fa2de754640 1 -- 172.21.15.106:0/3347717097 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d814c0e0 con 0x7fa2d80bcca0 2023-12-22T09:14:08.711 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.700+0000 7fa2d4ff9640 1 -- 172.21.15.106:0/3347717097 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 2) v1 ==== 44255+0+0 (secure 0 0 0) 0x7fa2c804e450 con 0x7fa2d80bcca0 2023-12-22T09:14:08.711 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.701+0000 7fa2d4ff9640 1 -- 172.21.15.106:0/3347717097 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa2c806b0e0 con 0x7fa2d80bcca0 2023-12-22T09:14:08.711 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.703+0000 7fa2d4ff9640 1 -- 172.21.15.106:0/3347717097 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fa2c804e8e0 con 0x7fa2d80bcca0 2023-12-22T09:14:08.773 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.773+0000 7fa2de754640 1 -- 172.21.15.106:0/3347717097 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2d8073f50 con 0x7fa2d80bcca0 2023-12-22T09:14:08.774 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.773+0000 7fa2d4ff9640 1 -- 172.21.15.106:0/3347717097 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa2c804d3b0 con 0x7fa2d80bcca0 2023-12-22T09:14:08.774 INFO:teuthology.misc.health.smithi106.stdout: 2023-12-22T09:14:08.774 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":10,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:07.322286+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:08.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.774+0000 7fa2de754640 1 -- 172.21.15.106:0/3347717097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80bcca0 msgr2=0x7fa2d80ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:08.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.774+0000 7fa2de754640 1 --2- 172.21.15.106:0/3347717097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80bcca0 0x7fa2d80ad180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2c802b8a0 tx=0x7fa2c80046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:08.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.774+0000 7fa2de754640 1 -- 172.21.15.106:0/3347717097 shutdown_connections 2023-12-22T09:14:08.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.774+0000 7fa2de754640 1 --2- 172.21.15.106:0/3347717097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2d80c6020 0x7fa2d8147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:08.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.774+0000 7fa2de754640 1 --2- 172.21.15.106:0/3347717097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2d80c4200 0x7fa2d814c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:08.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.774+0000 7fa2de754640 1 --2- 172.21.15.106:0/3347717097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2d80bcca0 0x7fa2d80ad180 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:08.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.774+0000 7fa2de754640 1 -- 172.21.15.106:0/3347717097 >> 172.21.15.106:0/3347717097 conn(0x7fa2d80ab1a0 msgr2=0x7fa2d81531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:08.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.774+0000 7fa2de754640 1 -- 172.21.15.106:0/3347717097 shutdown_connections 2023-12-22T09:14:08.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:08.774+0000 7fa2de754640 1 -- 172.21.15.106:0/3347717097 wait complete. 2023-12-22T09:14:08.787 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-22T09:14:08.793 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:08.793+0000 7f1e7f24c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-22T09:14:08.854 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:08.853+0000 7f1e7f24c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-22T09:14:08.971 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-12-22T09:14:08.970+0000 7f1e7f24c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-22T09:14:09.715 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:09.714+0000 7f8257b55640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-22T09:14:09.716 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-12-22T09:14:09.716+0000 7f8257b55640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-22T09:14:11.193 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-12-22T09:14:11.192+0000 7f42d3f27500 -1 osd.7 0 log_to_monitors true 2023-12-22T09:14:11.379 INFO:tasks.ceph.osd.1.smithi106.stderr:2023-12-22T09:14:11.378+0000 7fdbdcecf500 -1 osd.1 0 log_to_monitors true 2023-12-22T09:14:11.631 INFO:tasks.ceph.osd.0.smithi106.stderr:2023-12-22T09:14:11.630+0000 7f0b0c70e500 -1 osd.0 0 log_to_monitors true 2023-12-22T09:14:11.654 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-12-22T09:14:11.653+0000 7fbaeee20500 -1 osd.4 0 log_to_monitors true 2023-12-22T09:14:11.669 INFO:tasks.ceph.osd.2.smithi106.stderr:2023-12-22T09:14:11.669+0000 7f438922a500 -1 osd.2 0 log_to_monitors true 2023-12-22T09:14:11.677 INFO:tasks.ceph.osd.3.smithi106.stderr:2023-12-22T09:14:11.677+0000 7fae9c411500 -1 osd.3 0 log_to_monitors true 2023-12-22T09:14:11.868 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-12-22T09:14:11.866+0000 7f179f8d2500 -1 osd.5 0 log_to_monitors true 2023-12-22T09:14:11.921 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-12-22T09:14:11.921+0000 7f916b00d500 -1 osd.6 0 log_to_monitors true 2023-12-22T09:14:14.973 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-12-22T09:14:14.972+0000 7fbaeaf79640 -1 osd.4 0 waiting for initial osdmap 2023-12-22T09:14:14.995 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-12-22T09:14:14.994+0000 7fbae2581640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T09:14:15.031 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-12-22T09:14:15.030+0000 7f42cfeb2640 -1 osd.7 0 waiting for initial osdmap 2023-12-22T09:14:15.050 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-12-22T09:14:15.049+0000 7f42c7cd1640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T09:14:15.111 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-12-22T09:14:15.110+0000 7f179b85d640 -1 osd.5 0 waiting for initial osdmap 2023-12-22T09:14:15.129 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-12-22T09:14:15.128+0000 7f179367c640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T09:14:15.343 INFO:tasks.ceph.osd.3.smithi106.stderr:2023-12-22T09:14:15.342+0000 7fae985f2640 -1 osd.3 0 waiting for initial osdmap 2023-12-22T09:14:15.356 INFO:tasks.ceph.osd.2.smithi106.stderr:2023-12-22T09:14:15.355+0000 7f43847fb640 -1 osd.2 0 waiting for initial osdmap 2023-12-22T09:14:15.363 INFO:tasks.ceph.osd.3.smithi106.stderr:2023-12-22T09:14:15.362+0000 7fae8fbfa640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T09:14:15.366 INFO:tasks.ceph.osd.1.smithi106.stderr:2023-12-22T09:14:15.366+0000 7fdbd8e5a640 -1 osd.1 0 waiting for initial osdmap 2023-12-22T09:14:15.368 INFO:tasks.ceph.osd.0.smithi106.stderr:2023-12-22T09:14:15.367+0000 7f0b08699640 -1 osd.0 0 waiting for initial osdmap 2023-12-22T09:14:15.371 INFO:tasks.ceph.osd.2.smithi106.stderr:2023-12-22T09:14:15.371+0000 7f437c61a640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T09:14:15.381 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-12-22T09:14:15.380+0000 7f91669c8640 -1 osd.6 0 waiting for initial osdmap 2023-12-22T09:14:15.381 INFO:tasks.ceph.osd.1.smithi106.stderr:2023-12-22T09:14:15.381+0000 7fdbd0c79640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T09:14:15.384 INFO:tasks.ceph.osd.0.smithi106.stderr:2023-12-22T09:14:15.384+0000 7f0b004b8640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T09:14:15.402 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-12-22T09:14:15.401+0000 7f915e7e7640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T09:14:15.593 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:15.772 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.772+0000 7f00cf403640 1 Processor -- start 2023-12-22T09:14:15.772 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.772+0000 7f00cf403640 1 -- start start 2023-12-22T09:14:15.774 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.773+0000 7f00cf403640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00c80bfca0 0x7f00c8069c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:15.774 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.773+0000 7f00cf403640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00c8155dc0 0x7f00c80a8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.773+0000 7f00cf403640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c8155930 con 0x7f00c813a580 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.773+0000 7f00cf403640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c8156250 con 0x7f00c80bfca0 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.773+0000 7f00cf403640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c813a960 con 0x7f00c8155dc0 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.774+0000 7f00cd19f640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f00c813a580 0x7f00c8151c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53122/0 (socket says 172.21.15.106:53122) 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.774+0000 7f00cd19f640 1 -- 172.21.15.106:0/1737104548 learned_addr learned my addr 172.21.15.106:0/1737104548 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.774+0000 7f00cc99e640 1 --2- 172.21.15.106:0/1737104548 >> v2:172.21.15.106:3300/0 conn(0x7f00c80bfca0 0x7f00c8069c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.774+0000 7f00bffff640 1 -- 172.21.15.106:0/1737104548 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099815443 0 0) 0x7f00c8155930 con 0x7f00c813a580 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.774+0000 7f00cd9a0640 1 --2- 172.21.15.106:0/1737104548 >> v2:172.21.15.132:3300/0 conn(0x7f00c8155dc0 0x7f00c80a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.774+0000 7f00cc99e640 1 -- 172.21.15.106:0/1737104548 >> v2:172.21.15.132:3300/0 conn(0x7f00c8155dc0 msgr2=0x7f00c80a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.774+0000 7f00cc99e640 1 --2- 172.21.15.106:0/1737104548 >> v2:172.21.15.132:3300/0 conn(0x7f00c8155dc0 0x7f00c80a8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.774+0000 7f00cc99e640 1 -- 172.21.15.106:0/1737104548 >> v1:172.21.15.106:6789/0 conn(0x7f00c813a580 legacy=0x7f00c8151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:15.775 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.774+0000 7f00cc99e640 1 -- 172.21.15.106:0/1737104548 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c806a4d0 con 0x7f00c80bfca0 2023-12-22T09:14:15.776 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.775+0000 7f00cc99e640 1 --2- 172.21.15.106:0/1737104548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 0x7f00c8069c10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f00c8071fa0 tx=0x7f00b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277dc20f44a87124 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.775+0000 7f00bffff640 1 -- 172.21.15.106:0/1737104548 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b802e070 con 0x7f00c80bfca0 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.775+0000 7f00bffff640 1 -- 172.21.15.106:0/1737104548 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b80315a0 con 0x7f00c80bfca0 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.775+0000 7f00bffff640 1 -- 172.21.15.106:0/1737104548 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8031930 con 0x7f00c80bfca0 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.776+0000 7f00cf403640 1 -- 172.21.15.106:0/1737104548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 msgr2=0x7f00c8069c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.776+0000 7f00cf403640 1 --2- 172.21.15.106:0/1737104548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 0x7f00c8069c10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f00c8071fa0 tx=0x7f00b802b840 comp rx=0 tx=0).stop 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.776+0000 7f00cf403640 1 -- 172.21.15.106:0/1737104548 shutdown_connections 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.776+0000 7f00cf403640 1 --2- 172.21.15.106:0/1737104548 >> v2:172.21.15.132:3300/0 conn(0x7f00c8155dc0 0x7f00c80a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.776+0000 7f00cf403640 1 --2- 172.21.15.106:0/1737104548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 0x7f00c8069c10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.776+0000 7f00cf403640 1 -- 172.21.15.106:0/1737104548 >> 172.21.15.106:0/1737104548 conn(0x7f00c80c5320 msgr2=0x7f00c80c5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.776+0000 7f00cf403640 1 -- 172.21.15.106:0/1737104548 shutdown_connections 2023-12-22T09:14:15.777 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.776+0000 7f00cf403640 1 -- 172.21.15.106:0/1737104548 wait complete. 2023-12-22T09:14:15.778 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.778+0000 7f00cf403640 1 Processor -- start 2023-12-22T09:14:15.778 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.778+0000 7f00cf403640 1 -- start start 2023-12-22T09:14:15.779 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cf403640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 0x7f00c8154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:15.779 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cf403640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00c813a580 0x7f00c81ec430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:15.779 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cf403640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00c8155dc0 0x7f00c8071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:15.780 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cf403640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c81337e0 con 0x7f00c80bfca0 2023-12-22T09:14:15.780 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cf403640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c814fda0 con 0x7f00c8155dc0 2023-12-22T09:14:15.780 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cf403640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c8154990 con 0x7f00c813a580 2023-12-22T09:14:15.780 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cd19f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 0x7f00c8154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:15.780 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cd19f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 0x7f00c8154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52480/0 (socket says 172.21.15.106:52480) 2023-12-22T09:14:15.780 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cd19f640 1 -- 172.21.15.106:0/834856410 learned_addr learned my addr 172.21.15.106:0/834856410 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:15.781 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cd19f640 1 -- 172.21.15.106:0/834856410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00c813a580 msgr2=0x7f00c81ec430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:15.781 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cd9a0640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00c8155dc0 0x7f00c8071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:15.781 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cd19f640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00c813a580 0x7f00c81ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.781 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cd19f640 1 -- 172.21.15.106:0/834856410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00c8155dc0 msgr2=0x7f00c8071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:15.781 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cd19f640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00c8155dc0 0x7f00c8071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.781 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.779+0000 7f00cd19f640 1 -- 172.21.15.106:0/834856410 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8009400 con 0x7f00c80bfca0 2023-12-22T09:14:15.781 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.780+0000 7f00cd19f640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 0x7f00c8154450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c430 tx=0x7f00c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:15.781 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.780+0000 7f00bdffb640 1 -- 172.21.15.106:0/834856410 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c40074e0 con 0x7f00c80bfca0 2023-12-22T09:14:15.782 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.780+0000 7f00bdffb640 1 -- 172.21.15.106:0/834856410 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c4007660 con 0x7f00c80bfca0 2023-12-22T09:14:15.782 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.780+0000 7f00bdffb640 1 -- 172.21.15.106:0/834856410 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4004a20 con 0x7f00c80bfca0 2023-12-22T09:14:15.782 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.780+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c814fa50 con 0x7f00c80bfca0 2023-12-22T09:14:15.782 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.780+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c81ecf60 con 0x7f00c80bfca0 2023-12-22T09:14:15.782 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.781+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c804e080 con 0x7f00c80bfca0 2023-12-22T09:14:15.782 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.782+0000 7f00bdffb640 1 -- 172.21.15.106:0/834856410 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 4) v1 ==== 88551+0+0 (secure 0 0 0) 0x7f00c4004b80 con 0x7f00c80bfca0 2023-12-22T09:14:15.783 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.783+0000 7f00bdffb640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f00ac06a3d0 0x7f00ac06c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:15.783 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.783+0000 7f00bdffb640 1 -- 172.21.15.106:0/834856410 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f00c4087860 con 0x7f00c80bfca0 2023-12-22T09:14:15.783 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.783+0000 7f00cc99e640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f00ac06a3d0 0x7f00ac06c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:15.784 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.784+0000 7f00cc99e640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f00ac06a3d0 0x7f00ac06c890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f00b8036000 tx=0x7f00b8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:15.788 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.788+0000 7f00bdffb640 1 -- 172.21.15.106:0/834856410 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f00c4053cb0 con 0x7f00c80bfca0 2023-12-22T09:14:15.967 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.966+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00c8073f50 con 0x7f00c80bfca0 2023-12-22T09:14:15.968 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.968+0000 7f00bdffb640 1 -- 172.21.15.106:0/834856410 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f00c40572d0 con 0x7f00c80bfca0 2023-12-22T09:14:15.968 INFO:teuthology.misc.health.smithi106.stdout: 2023-12-22T09:14:15.968 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":13,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:13.997832+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:15.971 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f00ac06a3d0 msgr2=0x7f00ac06c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:15.971 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f00ac06a3d0 0x7f00ac06c890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f00b8036000 tx=0x7f00b8030000 comp rx=0 tx=0).stop 2023-12-22T09:14:15.971 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 msgr2=0x7f00c8154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:15.971 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 0x7f00c8154450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c430 tx=0x7f00c400c8f0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.971 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 shutdown_connections 2023-12-22T09:14:15.971 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f00ac06a3d0 0x7f00ac06c890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.971 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00c8155dc0 0x7f00c8071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.972 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00c813a580 0x7f00c81ec430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.972 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 --2- 172.21.15.106:0/834856410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00c80bfca0 0x7f00c8154450 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:15.972 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.970+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 >> 172.21.15.106:0/834856410 conn(0x7f00c80c5320 msgr2=0x7f00c80c1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:15.972 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.971+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 shutdown_connections 2023-12-22T09:14:15.972 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:15.971+0000 7f00cf403640 1 -- 172.21.15.106:0/834856410 wait complete. 2023-12-22T09:14:15.985 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-22T09:14:19.532 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:14:19.542 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:14:22.793 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:22.975 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.976+0000 7f7c26d2e640 1 Processor -- start 2023-12-22T09:14:22.976 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.976+0000 7f7c26d2e640 1 -- start start 2023-12-22T09:14:22.977 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.977+0000 7f7c26d2e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c20069e80 0x7f7c2014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:22.977 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.977+0000 7f7c26d2e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c20154110 0x7f7c201522b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:22.977 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.977+0000 7f7c26d2e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c20150f00 con 0x7f7c2014e280 2023-12-22T09:14:22.977 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.977+0000 7f7c26d2e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c20071db0 con 0x7f7c20069e80 2023-12-22T09:14:22.977 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.977+0000 7f7c26d2e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201511e0 con 0x7f7c20154110 2023-12-22T09:14:22.977 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.978+0000 7f7c252cb640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7c2014e280 0x7f7c201527f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36172/0 (socket says 172.21.15.106:36172) 2023-12-22T09:14:22.977 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.978+0000 7f7c252cb640 1 -- 172.21.15.106:0/33938781 learned_addr learned my addr 172.21.15.106:0/33938781 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.978+0000 7f7c24aca640 1 --2- 172.21.15.106:0/33938781 >> v2:172.21.15.132:3300/0 conn(0x7f7c20069e80 0x7f7c2014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.978+0000 7f7c1ffff640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c20154110 0x7f7c201522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.978+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426596549 0 0) 0x7f7c20150f00 con 0x7f7c2014e280 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.978+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c10005730 con 0x7f7c2014e280 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3296163123 0 0) 0x7f7c10005730 con 0x7f7c2014e280 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c20154110 msgr2=0x7f7c201522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c20154110 0x7f7c201522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 >> v2:172.21.15.132:3300/0 conn(0x7f7c20069e80 msgr2=0x7f7c2014dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 --2- 172.21.15.106:0/33938781 >> v2:172.21.15.132:3300/0 conn(0x7f7c20069e80 0x7f7c2014dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:22.980 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c201514c0 con 0x7f7c2014e280 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f7c180019f0 con 0x7f7c2014e280 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 >> v1:172.21.15.106:6789/0 conn(0x7f7c2014e280 legacy=0x7f7c201527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c20154110 0x7f7c10005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c10006150 0x7f7c100069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006f10 0x7f7c10007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20071db0 con 0x7f7c10006150 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201511e0 con 0x7f7c10006f10 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1000dcc0 con 0x7f7c20154110 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c1ffff640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c10006150 0x7f7c100069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.979+0000 7f7c24aca640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c20154110 0x7f7c10005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.980+0000 7f7c252cb640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006f10 0x7f7c10007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.980+0000 7f7c1ffff640 1 -- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c20154110 msgr2=0x7f7c10005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:22.981 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.980+0000 7f7c1ffff640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c20154110 0x7f7c10005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:22.982 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.980+0000 7f7c1ffff640 1 -- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006f10 msgr2=0x7f7c10007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:22.982 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.980+0000 7f7c1ffff640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006f10 0x7f7c10007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:22.982 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.980+0000 7f7c1ffff640 1 -- 172.21.15.106:0/33938781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10005730 con 0x7f7c10006150 2023-12-22T09:14:22.982 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.980+0000 7f7c252cb640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006f10 0x7f7c10007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:22.985 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.981+0000 7f7c1ffff640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c10006150 0x7f7c100069d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009ac0 tx=0x7f7c10007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43afeb4e16443a93 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:22.985 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.981+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c02c6b0 con 0x7f7c10006150 2023-12-22T09:14:22.985 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.981+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c02c810 con 0x7f7c10006150 2023-12-22T09:14:22.985 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.981+0000 7f7c1f7fe640 1 -- 172.21.15.106:0/33938781 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c02cba0 con 0x7f7c10006150 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.982+0000 7f7c26d2e640 1 -- 172.21.15.106:0/33938781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c10006150 msgr2=0x7f7c100069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.982+0000 7f7c26d2e640 1 --2- 172.21.15.106:0/33938781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c10006150 0x7f7c100069d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009ac0 tx=0x7f7c10007a00 comp rx=0 tx=0).stop 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.982+0000 7f7c252cb640 1 -- 172.21.15.106:0/33938781 reap_dead start 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.982+0000 7f7c26d2e640 1 -- 172.21.15.106:0/33938781 shutdown_connections 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.982+0000 7f7c26d2e640 1 -- 172.21.15.106:0/33938781 >> 172.21.15.106:0/33938781 conn(0x7f7c200c5320 msgr2=0x7f7c200c5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.982+0000 7f7c26d2e640 1 -- 172.21.15.106:0/33938781 shutdown_connections 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.982+0000 7f7c26d2e640 1 -- 172.21.15.106:0/33938781 wait complete. 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.984+0000 7f7c26d2e640 1 Processor -- start 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.984+0000 7f7c26d2e640 1 -- start start 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.985+0000 7f7c26d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006150 0x7f7c200be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.985+0000 7f7c26d2e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c20071720 0x7f7c20145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.985+0000 7f7c26d2e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c201476c0 0x7f7c20146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.985+0000 7f7c26d2e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201e94c0 con 0x7f7c20071720 2023-12-22T09:14:22.986 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.985+0000 7f7c26d2e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20070a30 con 0x7f7c10006150 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.985+0000 7f7c26d2e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201e91e0 con 0x7f7c201476c0 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.985+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c20071720 0x7f7c20145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.985+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c20071720 0x7f7c20145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41988/0 (socket says 172.21.15.106:41988) 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.985+0000 7f7c1ffff640 1 -- 172.21.15.106:0/1614829918 learned_addr learned my addr 172.21.15.106:0/1614829918 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c24aca640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006150 0x7f7c200be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c252cb640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c201476c0 0x7f7c20146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c1ffff640 1 -- 172.21.15.106:0/1614829918 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c201476c0 msgr2=0x7f7c20146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c1ffff640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c201476c0 0x7f7c20146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c1ffff640 1 -- 172.21.15.106:0/1614829918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006150 msgr2=0x7f7c200be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c1ffff640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006150 0x7f7c200be8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c1ffff640 1 -- 172.21.15.106:0/1614829918 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20070c40 con 0x7f7c20071720 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c252cb640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c201476c0 0x7f7c20146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:22.987 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c1ffff640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c20071720 0x7f7c20145b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009ac0 tx=0x7f7c0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c1d7fa640 1 -- 172.21.15.106:0/1614829918 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c003810 con 0x7f7c20071720 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c1d7fa640 1 -- 172.21.15.106:0/1614829918 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c003970 con 0x7f7c20071720 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20070f20 con 0x7f7c20071720 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.986+0000 7f7c1d7fa640 1 -- 172.21.15.106:0/1614829918 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c003d00 con 0x7f7c20071720 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.987+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c200bee20 con 0x7f7c20071720 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.988+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c20073f50 con 0x7f7c20071720 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.988+0000 7f7c1d7fa640 1 -- 172.21.15.106:0/1614829918 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c0c040450 con 0x7f7c20071720 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.989+0000 7f7c1d7fa640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7c0406a460 0x7f7c0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.989+0000 7f7c1d7fa640 1 -- 172.21.15.106:0/1614829918 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c0c0aa3f0 con 0x7f7c20071720 2023-12-22T09:14:22.989 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.990+0000 7f7c24aca640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7c0406a460 0x7f7c0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:22.990 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.990+0000 7f7c24aca640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7c0406a460 0x7f7c0406c920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009a90 tx=0x7f7c14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:22.994 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:22.994+0000 7f7c1d7fa640 1 -- 172.21.15.106:0/1614829918 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c0c075dc0 con 0x7f7c20071720 2023-12-22T09:14:23.188 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.189+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c20151ed0 con 0x7f7c20071720 2023-12-22T09:14:23.190 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.190+0000 7f7c1d7fa640 1 -- 172.21.15.106:0/1614829918 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f7c0c003e60 con 0x7f7c20071720 2023-12-22T09:14:23.190 INFO:teuthology.misc.health.smithi106.stdout: 2023-12-22T09:14:23.190 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":17,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:19.074317+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:23.193 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.193+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7c0406a460 msgr2=0x7f7c0406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.193 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.193+0000 7f7c26d2e640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7c0406a460 0x7f7c0406c920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009a90 tx=0x7f7c14008040 comp rx=0 tx=0).stop 2023-12-22T09:14:23.193 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c20071720 msgr2=0x7f7c20145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.194 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c20071720 0x7f7c20145b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009ac0 tx=0x7f7c0c004730 comp rx=0 tx=0).stop 2023-12-22T09:14:23.194 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 shutdown_connections 2023-12-22T09:14:23.194 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7c0406a460 0x7f7c0406c920 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.194 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c201476c0 0x7f7c20146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.194 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c20071720 0x7f7c20145b30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.194 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 --2- 172.21.15.106:0/1614829918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c10006150 0x7f7c200be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.194 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 >> 172.21.15.106:0/1614829918 conn(0x7f7c200c5320 msgr2=0x7f7c201545d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:23.194 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 shutdown_connections 2023-12-22T09:14:23.194 INFO:teuthology.misc.health.smithi106.stderr:2023-12-22T09:14:23.194+0000 7f7c26d2e640 1 -- 172.21.15.106:0/1614829918 wait complete. 2023-12-22T09:14:23.207 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-22T09:14:23.208 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-22T09:14:23.208 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T09:14:23.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T09:14:23.214 INFO:tasks.ceph.mds.a:Started 2023-12-22T09:14:23.214 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T09:14:23.214 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T09:14:23.222 INFO:tasks.ceph.mds.c:Started 2023-12-22T09:14:23.222 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T09:14:23.223 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T09:14:23.232 INFO:tasks.ceph.mds.b:Started 2023-12-22T09:14:23.232 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T09:14:23.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T09:14:23.243 INFO:tasks.ceph.mds.d:Started 2023-12-22T09:14:23.243 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-22T09:14:23.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:23.367 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2023-12-22T09:14:23.370 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2023-12-22T09:14:23.397 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-12-22T09:14:23.397 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-12-22T09:14:23.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.427+0000 7f41fe992640 1 Processor -- start 2023-12-22T09:14:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.427+0000 7f41fe992640 1 -- start start 2023-12-22T09:14:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41fe992640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f8151b10 0x7f41f8152f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41fe992640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41f80c2250 0x7f41f8070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41fe992640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f8152a70 con 0x7f41f8151ef0 2023-12-22T09:14:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41fe992640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f806f4d0 con 0x7f41f80c2250 2023-12-22T09:14:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41fe992640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f806e940 con 0x7f41f8151b10 2023-12-22T09:14:23.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41f7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f8151b10 0x7f41f8152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41f7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f8151b10 0x7f41f8152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:41992/0 (socket says 172.21.15.106:41992) 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41f7fff640 1 -- 172.21.15.106:0/3914584572 learned_addr learned my addr 172.21.15.106:0/3914584572 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41f77fe640 1 --2- 172.21.15.106:0/3914584572 >> v2:172.21.15.132:3300/0 conn(0x7f41f80c2250 0x7f41f8070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41f7fff640 1 -- 172.21.15.106:0/3914584572 >> v2:172.21.15.132:3300/0 conn(0x7f41f80c2250 msgr2=0x7f41f8070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.428+0000 7f41f7fff640 1 --2- 172.21.15.106:0/3914584572 >> v2:172.21.15.132:3300/0 conn(0x7f41f80c2250 0x7f41f8070170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.429+0000 7f41f7fff640 1 -- 172.21.15.106:0/3914584572 >> v1:172.21.15.132:6789/0 conn(0x7f41f8151ef0 legacy=0x7f41f8155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.429+0000 7f41f7fff640 1 -- 172.21.15.106:0/3914584572 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f80c5fe0 con 0x7f41f8151b10 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.430+0000 7f41f7fff640 1 --2- 172.21.15.106:0/3914584572 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f8151b10 0x7f41f8152f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009870 tx=0x7f41e802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa30b2e1bda12e19 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.430+0000 7f41f6ffd640 1 -- 172.21.15.106:0/3914584572 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8031640 con 0x7f41f8151b10 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.430+0000 7f41f6ffd640 1 -- 172.21.15.106:0/3914584572 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e80317a0 con 0x7f41f8151b10 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.430+0000 7f41f6ffd640 1 -- 172.21.15.106:0/3914584572 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8031b30 con 0x7f41f8151b10 2023-12-22T09:14:23.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.430+0000 7f41fe992640 1 -- 172.21.15.106:0/3914584572 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f8151b10 msgr2=0x7f41f8152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.430+0000 7f41fe992640 1 --2- 172.21.15.106:0/3914584572 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f8151b10 0x7f41f8152f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009870 tx=0x7f41e802b8f0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.430+0000 7f41fe992640 1 -- 172.21.15.106:0/3914584572 shutdown_connections 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.430+0000 7f41fe992640 1 --2- 172.21.15.106:0/3914584572 >> v2:172.21.15.132:3300/0 conn(0x7f41f80c2250 0x7f41f8070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.430+0000 7f41fe992640 1 --2- 172.21.15.106:0/3914584572 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f8151b10 0x7f41f8152f30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.431+0000 7f41fe992640 1 -- 172.21.15.106:0/3914584572 >> 172.21.15.106:0/3914584572 conn(0x7f41f80a90a0 msgr2=0x7f41f80a9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.431+0000 7f41fe992640 1 -- 172.21.15.106:0/3914584572 shutdown_connections 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.431+0000 7f41fe992640 1 -- 172.21.15.106:0/3914584572 wait complete. 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.432+0000 7f41fe992640 1 Processor -- start 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.432+0000 7f41fe992640 1 -- start start 2023-12-22T09:14:23.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.433+0000 7f41fe992640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f80c2250 0x7f41f80bda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.433+0000 7f41fe992640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f8151b10 0x7f41f80bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.433+0000 7f41fe992640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f8151ef0 0x7f41f80a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.433+0000 7f41fe992640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80bf2e0 con 0x7f41f8151b10 2023-12-22T09:14:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.433+0000 7f41fe992640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80bb680 con 0x7f41f8151ef0 2023-12-22T09:14:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.433+0000 7f41fe992640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80bf530 con 0x7f41f80c2250 2023-12-22T09:14:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f8151b10 0x7f41f80bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f80c2250 0x7f41f80bda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41fcf2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f8151ef0 0x7f41f80a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f8151b10 0x7f41f80bdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42036/0 (socket says 172.21.15.106:42036) 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f80c2250 0x7f41f80bda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:42004/0 (socket says 172.21.15.106:42004) 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f77fe640 1 -- 172.21.15.106:0/1639270823 learned_addr learned my addr 172.21.15.106:0/1639270823 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f7fff640 1 -- 172.21.15.106:0/1639270823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f8151ef0 msgr2=0x7f41f80a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f7fff640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f8151ef0 0x7f41f80a82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f7fff640 1 -- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f8151b10 msgr2=0x7f41f80bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f7fff640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f8151b10 0x7f41f80bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f7fff640 1 -- 172.21.15.106:0/1639270823 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e80094d0 con 0x7f41f80c2250 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f77fe640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f8151b10 0x7f41f80bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.434+0000 7f41f7fff640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f80c2250 0x7f41f80bda00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f41e8033000 tx=0x7f41e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.435+0000 7f41f4ff9640 1 -- 172.21.15.106:0/1639270823 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e803ac60 con 0x7f41f80c2250 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.435+0000 7f41f4ff9640 1 -- 172.21.15.106:0/1639270823 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e803ade0 con 0x7f41f80c2250 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.435+0000 7f41f4ff9640 1 -- 172.21.15.106:0/1639270823 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8044630 con 0x7f41f80c2250 2023-12-22T09:14:23.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.435+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f80bf810 con 0x7f41f80c2250 2023-12-22T09:14:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.435+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f80bb3a0 con 0x7f41f80c2250 2023-12-22T09:14:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.436+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f8073f10 con 0x7f41f80c2250 2023-12-22T09:14:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.437+0000 7f41f4ff9640 1 -- 172.21.15.106:0/1639270823 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f41e802f050 con 0x7f41f80c2250 2023-12-22T09:14:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.438+0000 7f41f4ff9640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f41e406a430 0x7f41e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.438+0000 7f41f4ff9640 1 -- 172.21.15.106:0/1639270823 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f41e80aa210 con 0x7f41f80c2250 2023-12-22T09:14:23.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.438+0000 7f41f77fe640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f41e406a430 0x7f41e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.439+0000 7f41f77fe640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f41e406a430 0x7f41e406c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41f8150b30 tx=0x7f41ec009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.443+0000 7f41f4ff9640 1 -- 172.21.15.106:0/1639270823 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f41e8075bf0 con 0x7f41f80c2250 2023-12-22T09:14:23.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.626+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41f80c4750 con 0x7f41f80c2250 2023-12-22T09:14:23.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.628+0000 7f41f4ff9640 1 -- 172.21.15.106:0/1639270823 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f41e8079210 con 0x7f41f80c2250 2023-12-22T09:14:23.628 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:23.629 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":17,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:19.074317+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:23.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f41e406a430 msgr2=0x7f41e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f41e406a430 0x7f41e406c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41f8150b30 tx=0x7f41ec009190 comp rx=0 tx=0).stop 2023-12-22T09:14:23.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f80c2250 msgr2=0x7f41f80bda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f80c2250 0x7f41f80bda00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f41e8033000 tx=0x7f41e80046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 shutdown_connections 2023-12-22T09:14:23.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f41e406a430 0x7f41e406c8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41f8151ef0 0x7f41f80a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f8151b10 0x7f41f80bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 --2- 172.21.15.106:0/1639270823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f41f80c2250 0x7f41f80bda00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 >> 172.21.15.106:0/1639270823 conn(0x7f41f80a90a0 msgr2=0x7f41f80a9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:23.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 shutdown_connections 2023-12-22T09:14:23.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.631+0000 7f41fe992640 1 -- 172.21.15.106:0/1639270823 wait complete. 2023-12-22T09:14:23.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:14:23.649 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:14:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.851+0000 7fc2a15a4640 1 Processor -- start 2023-12-22T09:14:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.851+0000 7fc2a15a4640 1 -- start start 2023-12-22T09:14:23.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.852+0000 7fc2a15a4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc29c0c1910 0x7fc29c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.852+0000 7fc2a15a4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c06b960 0x7fc29c0c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.852+0000 7fc2a15a4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c155120 con 0x7fc29c14f090 2023-12-22T09:14:23.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.852+0000 7fc2a15a4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c06e080 con 0x7fc29c0c1910 2023-12-22T09:14:23.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.852+0000 7fc2a15a4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c155fa0 con 0x7fc29c06b960 2023-12-22T09:14:23.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.853+0000 7fc29b7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c06b960 0x7fc29c0c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.853+0000 7fc29a7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc29c0c1910 0x7fc29c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.853+0000 7fc29b7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c06b960 0x7fc29c0c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:42006/0 (socket says 172.21.15.106:42006) 2023-12-22T09:14:23.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.853+0000 7fc29b7fe640 1 -- 172.21.15.106:0/1166766272 learned_addr learned my addr 172.21.15.106:0/1166766272 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:23.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.853+0000 7fc29affd640 1 --1- 172.21.15.106:0/1166766272 >> v1:172.21.15.132:6789/0 conn(0x7fc29c14f090 0x7fc29c155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:41498/0 (socket says 172.21.15.106:41498) 2023-12-22T09:14:23.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.854+0000 7fc29a7fc640 1 -- 172.21.15.106:0/1166766272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c06b960 msgr2=0x7fc29c0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:23.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.854+0000 7fc29a7fc640 1 --2- 172.21.15.106:0/1166766272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c06b960 0x7fc29c0c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.854+0000 7fc29a7fc640 1 -- 172.21.15.106:0/1166766272 >> v1:172.21.15.132:6789/0 conn(0x7fc29c14f090 legacy=0x7fc29c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.854+0000 7fc29a7fc640 1 -- 172.21.15.106:0/1166766272 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0a8720 con 0x7fc29c0c1910 2023-12-22T09:14:23.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.855+0000 7fc29a7fc640 1 --2- 172.21.15.106:0/1166766272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c0c1910 0x7fc29c151b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097a0 tx=0x7fc28402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=216324b0e26f9210 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:23.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.856+0000 7fc299ffb640 1 -- 172.21.15.106:0/1166766272 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284031780 con 0x7fc29c0c1910 2023-12-22T09:14:23.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.856+0000 7fc299ffb640 1 -- 172.21.15.106:0/1166766272 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2840318e0 con 0x7fc29c0c1910 2023-12-22T09:14:23.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.856+0000 7fc299ffb640 1 -- 172.21.15.106:0/1166766272 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284031c70 con 0x7fc29c0c1910 2023-12-22T09:14:23.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.857+0000 7fc2a15a4640 1 -- 172.21.15.106:0/1166766272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c0c1910 msgr2=0x7fc29c151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.857+0000 7fc2a15a4640 1 --2- 172.21.15.106:0/1166766272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c0c1910 0x7fc29c151b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097a0 tx=0x7fc28402b820 comp rx=0 tx=0).stop 2023-12-22T09:14:23.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.857+0000 7fc2a15a4640 1 -- 172.21.15.106:0/1166766272 shutdown_connections 2023-12-22T09:14:23.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.857+0000 7fc2a15a4640 1 --2- 172.21.15.106:0/1166766272 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c06b960 0x7fc29c0c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.857+0000 7fc2a15a4640 1 --2- 172.21.15.106:0/1166766272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c0c1910 0x7fc29c151b30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.857+0000 7fc2a15a4640 1 -- 172.21.15.106:0/1166766272 >> 172.21.15.106:0/1166766272 conn(0x7fc29c069dd0 msgr2=0x7fc29c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:23.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.857+0000 7fc2a15a4640 1 -- 172.21.15.106:0/1166766272 shutdown_connections 2023-12-22T09:14:23.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.857+0000 7fc2a15a4640 1 -- 172.21.15.106:0/1166766272 wait complete. 2023-12-22T09:14:23.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.859+0000 7fc2a15a4640 1 Processor -- start 2023-12-22T09:14:23.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.859+0000 7fc2a15a4640 1 -- start start 2023-12-22T09:14:23.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc2a15a4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29c06b960 0x7fc29c150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc2a15a4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c0c1910 0x7fc29c1e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc2a15a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c14f090 0x7fc29c071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc2a15a4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c1ddf00 con 0x7fc29c06b960 2023-12-22T09:14:23.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc2a15a4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c151b00 con 0x7fc29c14f090 2023-12-22T09:14:23.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc2a15a4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c150190 con 0x7fc29c0c1910 2023-12-22T09:14:23.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29c06b960 0x7fc29c150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29c06b960 0x7fc29c150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42046/0 (socket says 172.21.15.106:42046) 2023-12-22T09:14:23.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29affd640 1 -- 172.21.15.106:0/745661831 learned_addr learned my addr 172.21.15.106:0/745661831 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:23.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29b7fe640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c14f090 0x7fc29c071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29a7fc640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c0c1910 0x7fc29c1e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29affd640 1 -- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c0c1910 msgr2=0x7fc29c1e97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29affd640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c0c1910 0x7fc29c1e97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29affd640 1 -- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c14f090 msgr2=0x7fc29c071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29affd640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c14f090 0x7fc29c071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29affd640 1 -- 172.21.15.106:0/745661831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284009400 con 0x7fc29c06b960 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29a7fc640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c0c1910 0x7fc29c1e97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.860+0000 7fc29b7fe640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c14f090 0x7fc29c071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.861+0000 7fc29affd640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29c06b960 0x7fc29c150620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00c410 tx=0x7fc28c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.861+0000 7fc2937fe640 1 -- 172.21.15.106:0/745661831 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0074e0 con 0x7fc29c06b960 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.861+0000 7fc2937fe640 1 -- 172.21.15.106:0/745661831 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c007640 con 0x7fc29c06b960 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.861+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c1e9cf0 con 0x7fc29c06b960 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.861+0000 7fc2937fe640 1 -- 172.21.15.106:0/745661831 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0049e0 con 0x7fc29c06b960 2023-12-22T09:14:23.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.861+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c14fb40 con 0x7fc29c06b960 2023-12-22T09:14:23.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.863+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c14f9a0 con 0x7fc29c06b960 2023-12-22T09:14:23.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.863+0000 7fc2937fe640 1 -- 172.21.15.106:0/745661831 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc28c004b40 con 0x7fc29c06b960 2023-12-22T09:14:23.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.864+0000 7fc2937fe640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc27c06a430 0x7fc27c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:23.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.864+0000 7fc2937fe640 1 -- 172.21.15.106:0/745661831 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc28c087f60 con 0x7fc29c06b960 2023-12-22T09:14:23.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.865+0000 7fc29a7fc640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc27c06a430 0x7fc27c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:23.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.865+0000 7fc29a7fc640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc27c06a430 0x7fc27c06c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc284036000 tx=0x7fc28403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:23.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:23.869+0000 7fc2937fe640 1 -- 172.21.15.106:0/745661831 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc29c14f9a0 con 0x7fc29c06b960 2023-12-22T09:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.058+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc29c14f9a0 con 0x7fc29c06b960 2023-12-22T09:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.059+0000 7fc2937fe640 1 -- 172.21.15.106:0/745661831 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc29c14f9a0 con 0x7fc29c06b960 2023-12-22T09:14:24.059 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:14:24.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.061+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc27c06a430 msgr2=0x7fc27c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc27c06a430 0x7fc27c06c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc284036000 tx=0x7fc28403d040 comp rx=0 tx=0).stop 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29c06b960 msgr2=0x7fc29c150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29c06b960 0x7fc29c150620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00c410 tx=0x7fc28c00c8d0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 shutdown_connections 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc27c06a430 0x7fc27c06c8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29c14f090 0x7fc29c071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29c0c1910 0x7fc29c1e97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 --2- 172.21.15.106:0/745661831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29c06b960 0x7fc29c150620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 >> 172.21.15.106:0/745661831 conn(0x7fc29c069dd0 msgr2=0x7fc29c153350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 shutdown_connections 2023-12-22T09:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.062+0000 7fc2a15a4640 1 -- 172.21.15.106:0/745661831 wait complete. 2023-12-22T09:14:24.079 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:14:24.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.282+0000 7f3176b6c640 1 Processor -- start 2023-12-22T09:14:24.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.283+0000 7f3176b6c640 1 -- start start 2023-12-22T09:14:24.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.284+0000 7f3176b6c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f31700a8150 0x7f3170070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.284+0000 7f3176b6c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31700c16f0 0x7f3170071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.284+0000 7f3176b6c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3170152300 con 0x7f317014f050 2023-12-22T09:14:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.284+0000 7f3176b6c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317014f430 con 0x7f31700a8150 2023-12-22T09:14:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.284+0000 7f3176b6c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31701519f0 con 0x7f31700c16f0 2023-12-22T09:14:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.284+0000 7f3175b6a640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f317014f050 0x7f31700c1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36192/0 (socket says 172.21.15.106:36192) 2023-12-22T09:14:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.284+0000 7f3175b6a640 1 -- 172.21.15.106:0/896414039 learned_addr learned my addr 172.21.15.106:0/896414039 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.284+0000 7f3175369640 1 --2- 172.21.15.106:0/896414039 >> v2:172.21.15.106:3300/0 conn(0x7f31700a8150 0x7f3170070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.285+0000 7f317636b640 1 --2- 172.21.15.106:0/896414039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31700c16f0 0x7f3170071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.285+0000 7f3174b68640 1 -- 172.21.15.106:0/896414039 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485654307 0 0) 0x7f3170152300 con 0x7f317014f050 2023-12-22T09:14:24.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.285+0000 7f3175369640 1 -- 172.21.15.106:0/896414039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31700c16f0 msgr2=0x7f3170071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:24.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.285+0000 7f3175369640 1 --2- 172.21.15.106:0/896414039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31700c16f0 0x7f3170071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.285+0000 7f3175369640 1 -- 172.21.15.106:0/896414039 >> v1:172.21.15.106:6789/0 conn(0x7f317014f050 legacy=0x7f31700c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.285+0000 7f3175369640 1 -- 172.21.15.106:0/896414039 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700c0860 con 0x7f31700a8150 2023-12-22T09:14:24.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.285+0000 7f317636b640 1 --2- 172.21.15.106:0/896414039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31700c16f0 0x7f3170071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:24.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.286+0000 7f3175369640 1 --2- 172.21.15.106:0/896414039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 0x7f3170070e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f31600097a0 tx=0x7f316002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8980eac8b94ade server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:24.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.286+0000 7f3174b68640 1 -- 172.21.15.106:0/896414039 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316002e070 con 0x7f31700a8150 2023-12-22T09:14:24.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.286+0000 7f3174b68640 1 -- 172.21.15.106:0/896414039 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31600315a0 con 0x7f31700a8150 2023-12-22T09:14:24.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.286+0000 7f3174b68640 1 -- 172.21.15.106:0/896414039 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160031930 con 0x7f31700a8150 2023-12-22T09:14:24.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.287+0000 7f3176b6c640 1 -- 172.21.15.106:0/896414039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 msgr2=0x7f3170070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.287+0000 7f3176b6c640 1 --2- 172.21.15.106:0/896414039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 0x7f3170070e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f31600097a0 tx=0x7f316002b840 comp rx=0 tx=0).stop 2023-12-22T09:14:24.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.287+0000 7f3176b6c640 1 -- 172.21.15.106:0/896414039 shutdown_connections 2023-12-22T09:14:24.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.287+0000 7f3176b6c640 1 --2- 172.21.15.106:0/896414039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f31700c16f0 0x7f3170071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.287+0000 7f3176b6c640 1 --2- 172.21.15.106:0/896414039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 0x7f3170070e00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.287+0000 7f3176b6c640 1 -- 172.21.15.106:0/896414039 >> 172.21.15.106:0/896414039 conn(0x7f3170069dd0 msgr2=0x7f317006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:24.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.287+0000 7f3176b6c640 1 -- 172.21.15.106:0/896414039 shutdown_connections 2023-12-22T09:14:24.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.287+0000 7f3176b6c640 1 -- 172.21.15.106:0/896414039 wait complete. 2023-12-22T09:14:24.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.289+0000 7f3176b6c640 1 Processor -- start 2023-12-22T09:14:24.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.289+0000 7f3176b6c640 1 -- start start 2023-12-22T09:14:24.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3176b6c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 0x7f31701494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3176b6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31700c16f0 0x7f3170149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3176b6c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f317014f050 0x7f31700c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3176b6c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31701ed2d0 con 0x7f31700a8150 2023-12-22T09:14:24.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3176b6c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31700c50f0 con 0x7f31700c16f0 2023-12-22T09:14:24.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3176b6c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31700c53d0 con 0x7f317014f050 2023-12-22T09:14:24.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3175b6a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 0x7f31701494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3175b6a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 0x7f31701494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42072/0 (socket says 172.21.15.106:42072) 2023-12-22T09:14:24.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3175b6a640 1 -- 172.21.15.106:0/2630912613 learned_addr learned my addr 172.21.15.106:0/2630912613 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:24.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3175b6a640 1 -- 172.21.15.106:0/2630912613 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f317014f050 msgr2=0x7f31700c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3175b6a640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f317014f050 0x7f31700c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3175b6a640 1 -- 172.21.15.106:0/2630912613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31700c16f0 msgr2=0x7f3170149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3175b6a640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31700c16f0 0x7f3170149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.290+0000 7f3175b6a640 1 -- 172.21.15.106:0/2630912613 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160009400 con 0x7f31700a8150 2023-12-22T09:14:24.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.291+0000 7f3175b6a640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 0x7f31701494d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c430 tx=0x7f316c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:24.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.291+0000 7f31667fc640 1 -- 172.21.15.106:0/2630912613 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c0074e0 con 0x7f31700a8150 2023-12-22T09:14:24.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.291+0000 7f31667fc640 1 -- 172.21.15.106:0/2630912613 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c007660 con 0x7f31700a8150 2023-12-22T09:14:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.291+0000 7f31667fc640 1 -- 172.21.15.106:0/2630912613 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c004a20 con 0x7f31700a8150 2023-12-22T09:14:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.291+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31700c56b0 con 0x7f31700a8150 2023-12-22T09:14:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.291+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3170150890 con 0x7f31700a8150 2023-12-22T09:14:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.292+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31700c3c50 con 0x7f31700a8150 2023-12-22T09:14:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.293+0000 7f31667fc640 1 -- 172.21.15.106:0/2630912613 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f316c004b80 con 0x7f31700a8150 2023-12-22T09:14:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.294+0000 7f31667fc640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f315406a430 0x7f315406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.294+0000 7f31667fc640 1 -- 172.21.15.106:0/2630912613 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f316c088350 con 0x7f31700a8150 2023-12-22T09:14:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.294+0000 7f3175369640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f315406a430 0x7f315406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.295+0000 7f3175369640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f315406a430 0x7f315406c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3160036000 tx=0x7f3160030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.299+0000 7f31667fc640 1 -- 172.21.15.106:0/2630912613 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f31700c3c50 con 0x7f31700a8150 2023-12-22T09:14:24.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.512+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31700c3c50 con 0x7f31700a8150 2023-12-22T09:14:24.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.513+0000 7f31667fc640 1 -- 172.21.15.106:0/2630912613 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f31700c3c50 con 0x7f31700a8150 2023-12-22T09:14:24.514 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:24.514 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-22T09:14:24.514 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 3 2023-12-22T09:14:24.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f315406a430 msgr2=0x7f315406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f315406a430 0x7f315406c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3160036000 tx=0x7f3160030000 comp rx=0 tx=0).stop 2023-12-22T09:14:24.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 msgr2=0x7f31701494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 0x7f31701494d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c430 tx=0x7f316c00c8f0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 shutdown_connections 2023-12-22T09:14:24.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f315406a430 0x7f315406c8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f317014f050 0x7f31700c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31700c16f0 0x7f3170149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 --2- 172.21.15.106:0/2630912613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31700a8150 0x7f31701494d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.516+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 >> 172.21.15.106:0/2630912613 conn(0x7f3170069dd0 msgr2=0x7f31700a9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:24.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.517+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 shutdown_connections 2023-12-22T09:14:24.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.517+0000 7f3176b6c640 1 -- 172.21.15.106:0/2630912613 wait complete. 2023-12-22T09:14:24.535 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.739+0000 7fa1a3755640 1 Processor -- start 2023-12-22T09:14:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.739+0000 7fa1a3755640 1 -- start start 2023-12-22T09:14:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.740+0000 7fa1a3755640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa19c150a80 0x7fa19c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.740+0000 7fa1a3755640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19c071ea0 0x7fa19c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.740+0000 7fa1a3755640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0bfce0 con 0x7fa19c069e60 2023-12-22T09:14:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.740+0000 7fa1a3755640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c0c0960 con 0x7fa19c150a80 2023-12-22T09:14:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.740+0000 7fa1a3755640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c06aba0 con 0x7fa19c071ea0 2023-12-22T09:14:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.740+0000 7fa1a14f1640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa19c069e60 0x7fa19c14a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36196/0 (socket says 172.21.15.106:36196) 2023-12-22T09:14:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.740+0000 7fa1a14f1640 1 -- 172.21.15.106:0/2024844040 learned_addr learned my addr 172.21.15.106:0/2024844040 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040038015 0 0) 0x7fa19c0bfce0 con 0x7fa19c069e60 2023-12-22T09:14:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa1a1cf2640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19c071ea0 0x7fa19c1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa1a0cf0640 1 --2- 172.21.15.106:0/2024844040 >> v2:172.21.15.132:3300/0 conn(0x7fa19c150a80 0x7fa19c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa188005730 con 0x7fa19c069e60 2023-12-22T09:14:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1718664058 0 0) 0x7fa188005730 con 0x7fa19c069e60 2023-12-22T09:14:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19c071ea0 msgr2=0x7fa19c1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19c071ea0 0x7fa19c1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 >> v2:172.21.15.132:3300/0 conn(0x7fa19c150a80 msgr2=0x7fa19c151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 --2- 172.21.15.106:0/2024844040 >> v2:172.21.15.132:3300/0 conn(0x7fa19c150a80 0x7fa19c151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c0bffc0 con 0x7fa19c069e60 2023-12-22T09:14:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fa1980017f0 con 0x7fa19c069e60 2023-12-22T09:14:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 >> v1:172.21.15.106:6789/0 conn(0x7fa19c069e60 legacy=0x7fa19c14a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19c071ea0 0x7fa188005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1880061b0 0x7fa1880069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa188006f10 0x7fa188007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0c0960 con 0x7fa188006f10 2023-12-22T09:14:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c06aba0 con 0x7fa1880061b0 2023-12-22T09:14:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.741+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18800de00 con 0x7fa19c071ea0 2023-12-22T09:14:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a1cf2640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa188006f10 0x7fa188007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a14f1640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19c071ea0 0x7fa188005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a0cf0640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1880061b0 0x7fa1880069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a1cf2640 1 -- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19c071ea0 msgr2=0x7fa188005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a1cf2640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19c071ea0 0x7fa188005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a1cf2640 1 -- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1880061b0 msgr2=0x7fa1880069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a1cf2640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1880061b0 0x7fa1880069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a1cf2640 1 -- 172.21.15.106:0/2024844040 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188005730 con 0x7fa188006f10 2023-12-22T09:14:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a14f1640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa19c071ea0 0x7fa188005b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.742+0000 7fa1a0cf0640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1880061b0 0x7fa1880069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.743+0000 7fa1a1cf2640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa188006f10 0x7fa188007390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa194007360 tx=0x7fa188007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7eddf1fc3fc15b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.743+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19402ccd0 con 0x7fa188006f10 2023-12-22T09:14:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.743+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19402ce30 con 0x7fa188006f10 2023-12-22T09:14:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.743+0000 7fa193fff640 1 -- 172.21.15.106:0/2024844040 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194034660 con 0x7fa188006f10 2023-12-22T09:14:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.744+0000 7fa1a3755640 1 -- 172.21.15.106:0/2024844040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa188006f10 msgr2=0x7fa188007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.744+0000 7fa1a3755640 1 --2- 172.21.15.106:0/2024844040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa188006f10 0x7fa188007390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa194007360 tx=0x7fa188007a00 comp rx=0 tx=0).stop 2023-12-22T09:14:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.744+0000 7fa1a1cf2640 1 -- 172.21.15.106:0/2024844040 reap_dead start 2023-12-22T09:14:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.744+0000 7fa1a3755640 1 -- 172.21.15.106:0/2024844040 shutdown_connections 2023-12-22T09:14:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.744+0000 7fa1a3755640 1 -- 172.21.15.106:0/2024844040 >> 172.21.15.106:0/2024844040 conn(0x7fa19c0c5360 msgr2=0x7fa19c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.744+0000 7fa1a3755640 1 -- 172.21.15.106:0/2024844040 shutdown_connections 2023-12-22T09:14:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.744+0000 7fa1a3755640 1 -- 172.21.15.106:0/2024844040 wait complete. 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.746+0000 7fa1a3755640 1 Processor -- start 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.746+0000 7fa1a3755640 1 -- start start 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a3755640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa188006f10 0x7fa19c140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a3755640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa19c1dda90 0x7fa19c1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a3755640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19c137de0 0x7fa19c138290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a3755640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c1dcb60 con 0x7fa19c1dda90 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a3755640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c1dcdb0 con 0x7fa19c137de0 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a3755640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c071450 con 0x7fa188006f10 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a0cf0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa19c1dda90 0x7fa19c1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a0cf0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa19c1dda90 0x7fa19c1412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42098/0 (socket says 172.21.15.106:42098) 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a0cf0640 1 -- 172.21.15.106:0/3613870369 learned_addr learned my addr 172.21.15.106:0/3613870369 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.747+0000 7fa1a14f1640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa188006f10 0x7fa19c140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a1cf2640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19c137de0 0x7fa19c138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a0cf0640 1 -- 172.21.15.106:0/3613870369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa188006f10 msgr2=0x7fa19c140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a0cf0640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa188006f10 0x7fa19c140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a0cf0640 1 -- 172.21.15.106:0/3613870369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19c137de0 msgr2=0x7fa19c138290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a0cf0640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19c137de0 0x7fa19c138290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a0cf0640 1 -- 172.21.15.106:0/3613870369 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c071730 con 0x7fa19c1dda90 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a14f1640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa188006f10 0x7fa19c140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a0cf0640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa19c1dda90 0x7fa19c1412c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00e810 tx=0x7fa18c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa191ffb640 1 -- 172.21.15.106:0/3613870369 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00c8d0 con 0x7fa19c1dda90 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa191ffb640 1 -- 172.21.15.106:0/3613870369 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c00ca30 con 0x7fa19c1dda90 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa191ffb640 1 -- 172.21.15.106:0/3613870369 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00cdc0 con 0x7fa19c1dda90 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c1dd090 con 0x7fa19c1dda90 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.748+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c0c1670 con 0x7fa19c1dda90 2023-12-22T09:14:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.750+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c073f10 con 0x7fa19c1dda90 2023-12-22T09:14:24.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.750+0000 7fa191ffb640 1 -- 172.21.15.106:0/3613870369 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa18c013410 con 0x7fa19c1dda90 2023-12-22T09:14:24.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.751+0000 7fa191ffb640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa18006a460 0x7fa18006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:24.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.751+0000 7fa191ffb640 1 -- 172.21.15.106:0/3613870369 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa18c088520 con 0x7fa19c1dda90 2023-12-22T09:14:24.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.752+0000 7fa1a14f1640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa18006a460 0x7fa18006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:24.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.752+0000 7fa1a14f1640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa18006a460 0x7fa18006c920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa198000ef0 tx=0x7fa198009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:24.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.756+0000 7fa191ffb640 1 -- 172.21.15.106:0/3613870369 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa18c053dc0 con 0x7fa19c1dda90 2023-12-22T09:14:24.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.949+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa19c0718c0 con 0x7fa19c1dda90 2023-12-22T09:14:24.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.951+0000 7fa191ffb640 1 -- 172.21.15.106:0/3613870369 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fa18c0573e0 con 0x7fa19c1dda90 2023-12-22T09:14:24.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:24.952 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":17,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:19.074317+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa18006a460 msgr2=0x7fa18006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa18006a460 0x7fa18006c920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa198000ef0 tx=0x7fa198009040 comp rx=0 tx=0).stop 2023-12-22T09:14:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa19c1dda90 msgr2=0x7fa19c1412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa19c1dda90 0x7fa19c1412c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00e810 tx=0x7fa18c00ecd0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 shutdown_connections 2023-12-22T09:14:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa18006a460 0x7fa18006c920 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa19c137de0 0x7fa19c138290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa19c1dda90 0x7fa19c1412c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 --2- 172.21.15.106:0/3613870369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa188006f10 0x7fa19c140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 >> 172.21.15.106:0/3613870369 conn(0x7fa19c0c5360 msgr2=0x7fa19c1440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 shutdown_connections 2023-12-22T09:14:24.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:24.954+0000 7fa1a3755640 1 -- 172.21.15.106:0/3613870369 wait complete. 2023-12-22T09:14:24.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:14:24.973 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:14:25.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.178+0000 7f86164e7640 1 Processor -- start 2023-12-22T09:14:25.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.178+0000 7f86164e7640 1 -- start start 2023-12-22T09:14:25.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f86164e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86100c6150 0x7f86100c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f86164e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86100c7640 0x7f861006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f86164e7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86100c4560 con 0x7f861006ca00 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f86164e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86100c4f90 con 0x7f86100c7640 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f86164e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8610154720 con 0x7f86100c6150 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f8614a84640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f861006ca00 0x7f861006b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:36198/0 (socket says 172.21.15.106:36198) 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f8614a84640 1 -- 172.21.15.106:0/3879694580 learned_addr learned my addr 172.21.15.106:0/3879694580 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f860ffff640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86100c6150 0x7f86100c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f860f7fe640 1 --2- 172.21.15.106:0/3879694580 >> v2:172.21.15.132:3300/0 conn(0x7f86100c7640 0x7f861006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.180+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926190388 0 0) 0x7f86100c4560 con 0x7f861006ca00 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f8003520 con 0x7f861006ca00 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2195200149 0 0) 0x7f85f8003520 con 0x7f861006ca00 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86100c6150 msgr2=0x7f86100c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86100c6150 0x7f86100c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 >> v2:172.21.15.132:3300/0 conn(0x7f86100c7640 msgr2=0x7f861006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:25.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 --2- 172.21.15.106:0/3879694580 >> v2:172.21.15.132:3300/0 conn(0x7f86100c7640 0x7f861006b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8610154c50 con 0x7f861006ca00 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f86080019f0 con 0x7f861006ca00 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 >> v1:172.21.15.106:6789/0 conn(0x7f861006ca00 legacy=0x7f861006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f8003970 0x7f85f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86100c6150 0x7f85f80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85f8004d00 0x7f85f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8610154720 con 0x7f85f8004d00 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f800b980 con 0x7f85f8003970 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f800bb40 con 0x7f86100c6150 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f8614a84640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85f8004d00 0x7f85f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.181+0000 7f860ffff640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f8003970 0x7f85f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.182+0000 7f860f7fe640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86100c6150 0x7f85f80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.182+0000 7f8614a84640 1 -- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86100c6150 msgr2=0x7f85f80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.182+0000 7f8614a84640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f86100c6150 0x7f85f80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.182+0000 7f8614a84640 1 -- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f8003970 msgr2=0x7f85f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.182+0000 7f8614a84640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f8003970 0x7f85f8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.182+0000 7f8614a84640 1 -- 172.21.15.106:0/3879694580 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8003520 con 0x7f85f8004d00 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.183+0000 7f8614a84640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85f8004d00 0x7f85f8005180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f860800a860 tx=0x7f85f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c6ea51416b3c40 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.183+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608034630 con 0x7f85f8004d00 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.183+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860802f070 con 0x7f85f8004d00 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.183+0000 7f860effd640 1 -- 172.21.15.106:0/3879694580 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86080349f0 con 0x7f85f8004d00 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.184+0000 7f86164e7640 1 -- 172.21.15.106:0/3879694580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85f8004d00 msgr2=0x7f85f8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.184+0000 7f86164e7640 1 --2- 172.21.15.106:0/3879694580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85f8004d00 0x7f85f8005180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f860800a860 tx=0x7f85f80057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.184+0000 7f8614a84640 1 -- 172.21.15.106:0/3879694580 reap_dead start 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.184+0000 7f86164e7640 1 -- 172.21.15.106:0/3879694580 shutdown_connections 2023-12-22T09:14:25.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.184+0000 7f86164e7640 1 -- 172.21.15.106:0/3879694580 >> 172.21.15.106:0/3879694580 conn(0x7f86100ab330 msgr2=0x7f86100ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.184+0000 7f86164e7640 1 -- 172.21.15.106:0/3879694580 shutdown_connections 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.184+0000 7f86164e7640 1 -- 172.21.15.106:0/3879694580 wait complete. 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.186+0000 7f86164e7640 1 Processor -- start 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.186+0000 7f86164e7640 1 -- start start 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f86164e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f8004d00 0x7f86101ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f86164e7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86100bcc00 0x7f8610156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f86164e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8610157b90 0x7f86100c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f86164e7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86100aee30 con 0x7f86100bcc00 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f86164e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86100c35a0 con 0x7f85f8004d00 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f86164e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86100c2f70 con 0x7f8610157b90 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f860f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86100bcc00 0x7f8610156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f860f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86100bcc00 0x7f8610156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42108/0 (socket says 172.21.15.106:42108) 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f860f7fe640 1 -- 172.21.15.106:0/106384119 learned_addr learned my addr 172.21.15.106:0/106384119 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:25.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f8614a84640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8610157b90 0x7f86100c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f860ffff640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f8004d00 0x7f86101ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f860f7fe640 1 -- 172.21.15.106:0/106384119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8610157b90 msgr2=0x7f86100c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f860f7fe640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8610157b90 0x7f86100c12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f860f7fe640 1 -- 172.21.15.106:0/106384119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f8004d00 msgr2=0x7f86101ecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f860f7fe640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f8004d00 0x7f86101ecb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.187+0000 7f860f7fe640 1 -- 172.21.15.106:0/106384119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86101ed370 con 0x7f86100bcc00 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.188+0000 7f860f7fe640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86100bcc00 0x7f8610156f20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86040115f0 tx=0x7f8604011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.188+0000 7f860cff9640 1 -- 172.21.15.106:0/106384119 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400f8f0 con 0x7f86100bcc00 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.188+0000 7f860cff9640 1 -- 172.21.15.106:0/106384119 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860400fa50 con 0x7f86100bcc00 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.188+0000 7f860cff9640 1 -- 172.21.15.106:0/106384119 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400fde0 con 0x7f86100bcc00 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.188+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86101ed650 con 0x7f86100bcc00 2023-12-22T09:14:25.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.188+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86101ed070 con 0x7f86100bcc00 2023-12-22T09:14:25.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.189+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8610069ca0 con 0x7f86100bcc00 2023-12-22T09:14:25.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.190+0000 7f860cff9640 1 -- 172.21.15.106:0/106384119 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8604015460 con 0x7f86100bcc00 2023-12-22T09:14:25.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.191+0000 7f860cff9640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f85fc06a430 0x7f85fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.191+0000 7f860cff9640 1 -- 172.21.15.106:0/106384119 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8604088df0 con 0x7f86100bcc00 2023-12-22T09:14:25.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.191+0000 7f860ffff640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f85fc06a430 0x7f85fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.192+0000 7f860ffff640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f85fc06a430 0x7f85fc06c8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8600009980 tx=0x7f8600008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:25.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.195+0000 7f860cff9640 1 -- 172.21.15.106:0/106384119 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86040547c0 con 0x7f86100bcc00 2023-12-22T09:14:25.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.387+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86100aab80 con 0x7f86100bcc00 2023-12-22T09:14:25.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.388+0000 7f860cff9640 1 -- 172.21.15.106:0/106384119 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8604057de0 con 0x7f86100bcc00 2023-12-22T09:14:25.388 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:14:25.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f85fc06a430 msgr2=0x7f85fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f85fc06a430 0x7f85fc06c8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8600009980 tx=0x7f8600008040 comp rx=0 tx=0).stop 2023-12-22T09:14:25.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86100bcc00 msgr2=0x7f8610156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86100bcc00 0x7f8610156f20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86040115f0 tx=0x7f8604011ab0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 shutdown_connections 2023-12-22T09:14:25.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f85fc06a430 0x7f85fc06c8f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8610157b90 0x7f86100c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86100bcc00 0x7f8610156f20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 --2- 172.21.15.106:0/106384119 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85f8004d00 0x7f86101ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.390+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 >> 172.21.15.106:0/106384119 conn(0x7f86100ab330 msgr2=0x7f86100aa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.391+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 shutdown_connections 2023-12-22T09:14:25.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.391+0000 7f86164e7640 1 -- 172.21.15.106:0/106384119 wait complete. 2023-12-22T09:14:25.411 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T09:14:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.614+0000 7f23f4cdb640 1 Processor -- start 2023-12-22T09:14:25.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.614+0000 7f23f4cdb640 1 -- start start 2023-12-22T09:14:25.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23f4cdb640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f23f006bc70 0x7f23f00c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23f4cdb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f00be6e0 0x7f23f0069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23f4cdb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f00beb50 con 0x7f23f0151300 2023-12-22T09:14:25.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23f4cdb640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f0154ce0 con 0x7f23f006bc70 2023-12-22T09:14:25.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23f4cdb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f01516e0 con 0x7f23f00be6e0 2023-12-22T09:14:25.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23e7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f23f006bc70 0x7f23f00c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23e7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f23f006bc70 0x7f23f00c1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42122/0 (socket says 172.21.15.106:42122) 2023-12-22T09:14:25.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23e7fff640 1 -- 172.21.15.106:0/3259427221 learned_addr learned my addr 172.21.15.106:0/3259427221 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:25.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23eed9d640 1 --2- 172.21.15.106:0/3259427221 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f00be6e0 0x7f23f0069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23e7fff640 1 -- 172.21.15.106:0/3259427221 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f00be6e0 msgr2=0x7f23f0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23e7fff640 1 --2- 172.21.15.106:0/3259427221 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f00be6e0 0x7f23f0069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23e7fff640 1 -- 172.21.15.106:0/3259427221 >> v1:172.21.15.132:6789/0 conn(0x7f23f0151300 legacy=0x7f23f01545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.616+0000 7f23e7fff640 1 -- 172.21.15.106:0/3259427221 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f006c7b0 con 0x7f23f006bc70 2023-12-22T09:14:25.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.618+0000 7f23e7fff640 1 --2- 172.21.15.106:0/3259427221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f006bc70 0x7f23f00c1640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009870 tx=0x7f23d802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aec987b7a6dc12 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:25.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.618+0000 7f23edd9b640 1 -- 172.21.15.106:0/3259427221 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d80317c0 con 0x7f23f006bc70 2023-12-22T09:14:25.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.618+0000 7f23edd9b640 1 -- 172.21.15.106:0/3259427221 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d8031920 con 0x7f23f006bc70 2023-12-22T09:14:25.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.618+0000 7f23edd9b640 1 -- 172.21.15.106:0/3259427221 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8031cb0 con 0x7f23f006bc70 2023-12-22T09:14:25.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.619+0000 7f23f4cdb640 1 -- 172.21.15.106:0/3259427221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f006bc70 msgr2=0x7f23f00c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.619+0000 7f23f4cdb640 1 --2- 172.21.15.106:0/3259427221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f006bc70 0x7f23f00c1640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009870 tx=0x7f23d802b860 comp rx=0 tx=0).stop 2023-12-22T09:14:25.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.619+0000 7f23f4cdb640 1 -- 172.21.15.106:0/3259427221 shutdown_connections 2023-12-22T09:14:25.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.619+0000 7f23f4cdb640 1 --2- 172.21.15.106:0/3259427221 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f00be6e0 0x7f23f0069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.619+0000 7f23f4cdb640 1 --2- 172.21.15.106:0/3259427221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f006bc70 0x7f23f00c1640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.619+0000 7f23f4cdb640 1 -- 172.21.15.106:0/3259427221 >> 172.21.15.106:0/3259427221 conn(0x7f23f00c1db0 msgr2=0x7f23f00c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:25.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.619+0000 7f23f4cdb640 1 -- 172.21.15.106:0/3259427221 shutdown_connections 2023-12-22T09:14:25.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.619+0000 7f23f4cdb640 1 -- 172.21.15.106:0/3259427221 wait complete. 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.621+0000 7f23f4cdb640 1 Processor -- start 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.621+0000 7f23f4cdb640 1 -- start start 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.622+0000 7f23f4cdb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f006bc70 0x7f23f014ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.622+0000 7f23f4cdb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f00be6e0 0x7f23f01499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.622+0000 7f23f4cdb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f0151300 0x7f23f0149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23f4cdb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f014e240 con 0x7f23f0151300 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23f4cdb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00c5180 con 0x7f23f00be6e0 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23f4cdb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00c5460 con 0x7f23f006bc70 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23eed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f0151300 0x7f23f0149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23eed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f0151300 0x7f23f0149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42134/0 (socket says 172.21.15.106:42134) 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23eed9d640 1 -- 172.21.15.106:0/1611732835 learned_addr learned my addr 172.21.15.106:0/1611732835 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23e7fff640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f00be6e0 0x7f23f01499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23ee59c640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f006bc70 0x7f23f014ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23eed9d640 1 -- 172.21.15.106:0/1611732835 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f006bc70 msgr2=0x7f23f014ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23eed9d640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f006bc70 0x7f23f014ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23eed9d640 1 -- 172.21.15.106:0/1611732835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f00be6e0 msgr2=0x7f23f01499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23eed9d640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f00be6e0 0x7f23f01499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.623+0000 7f23eed9d640 1 -- 172.21.15.106:0/1611732835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80094d0 con 0x7f23f0151300 2023-12-22T09:14:25.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.624+0000 7f23eed9d640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f0151300 0x7f23f0149ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23e8007e40 tx=0x7f23e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:25.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.624+0000 7f23e6ffd640 1 -- 172.21.15.106:0/1611732835 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8014620 con 0x7f23f0151300 2023-12-22T09:14:25.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.624+0000 7f23e6ffd640 1 -- 172.21.15.106:0/1611732835 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e800ee90 con 0x7f23f0151300 2023-12-22T09:14:25.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.624+0000 7f23e6ffd640 1 -- 172.21.15.106:0/1611732835 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e80149e0 con 0x7f23f0151300 2023-12-22T09:14:25.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.624+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f00c5b70 con 0x7f23f0151300 2023-12-22T09:14:25.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.624+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f00c6090 con 0x7f23f0151300 2023-12-22T09:14:25.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.625+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f00c5620 con 0x7f23f0151300 2023-12-22T09:14:25.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.626+0000 7f23e6ffd640 1 -- 172.21.15.106:0/1611732835 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23e8014b40 con 0x7f23f0151300 2023-12-22T09:14:25.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.627+0000 7f23e6ffd640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f23d006a430 0x7f23d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:25.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.627+0000 7f23e6ffd640 1 -- 172.21.15.106:0/1611732835 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23e8089010 con 0x7f23f0151300 2023-12-22T09:14:25.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.627+0000 7f23ee59c640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f23d006a430 0x7f23d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:25.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.628+0000 7f23ee59c640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f23d006a430 0x7f23d006c8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23f01e6d20 tx=0x7f23e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:25.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.631+0000 7f23e6ffd640 1 -- 172.21.15.106:0/1611732835 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23f00c5620 con 0x7f23f0151300 2023-12-22T09:14:25.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.829+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f23f00c59d0 con 0x7f23f0151300 2023-12-22T09:14:25.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.829+0000 7f23e6ffd640 1 -- 172.21.15.106:0/1611732835 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f23f00c59d0 con 0x7f23f0151300 2023-12-22T09:14:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:25.829 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2023-12-22T09:14:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:14:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2023-12-22T09:14:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2023-12-22T09:14:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:14:25.830 INFO:teuthology.orchestra.run.smithi106.stdout:] 2023-12-22T09:14:25.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f23d006a430 msgr2=0x7f23d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f23d006a430 0x7f23d006c8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23f01e6d20 tx=0x7f23e0008040 comp rx=0 tx=0).stop 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f0151300 msgr2=0x7f23f0149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f0151300 0x7f23f0149ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23e8007e40 tx=0x7f23e800e4b0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 shutdown_connections 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f23d006a430 0x7f23d006c8f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f0151300 0x7f23f0149ef0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23f00be6e0 0x7f23f01499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 --2- 172.21.15.106:0/1611732835 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23f006bc70 0x7f23f014ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 >> 172.21.15.106:0/1611732835 conn(0x7f23f00c1db0 msgr2=0x7f23f0152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 shutdown_connections 2023-12-22T09:14:25.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:25.832+0000 7f23f4cdb640 1 -- 172.21.15.106:0/1611732835 wait complete. 2023-12-22T09:14:25.850 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T09:14:25.850 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T09:14:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.062+0000 7f3591dd3640 1 Processor -- start 2023-12-22T09:14:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.063+0000 7f3591dd3640 1 -- start start 2023-12-22T09:14:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.064+0000 7f3591dd3640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f358c0aa220 0x7f358c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.064+0000 7f3591dd3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f358c0c2400 0x7f358c0c0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.064+0000 7f3591dd3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358c152ac0 con 0x7f358c0c1f70 2023-12-22T09:14:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.064+0000 7f3591dd3640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c0c2830 con 0x7f358c0aa220 2023-12-22T09:14:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.064+0000 7f3591dd3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1560c0 con 0x7f358c0c2400 2023-12-22T09:14:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.064+0000 7f358b7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f358c0aa220 0x7f358c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.065+0000 7f358b7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f358c0aa220 0x7f358c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42144/0 (socket says 172.21.15.106:42144) 2023-12-22T09:14:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.065+0000 7f358b7fe640 1 -- 172.21.15.106:0/3022120952 learned_addr learned my addr 172.21.15.106:0/3022120952 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.065+0000 7f358b7fe640 1 -- 172.21.15.106:0/3022120952 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f358c0c2400 msgr2=0x7f358c0c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.065+0000 7f358b7fe640 1 --2- 172.21.15.106:0/3022120952 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f358c0c2400 0x7f358c0c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.065+0000 7f358b7fe640 1 -- 172.21.15.106:0/3022120952 >> v1:172.21.15.132:6789/0 conn(0x7f358c0c1f70 legacy=0x7f358c0bff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.065+0000 7f358b7fe640 1 -- 172.21.15.106:0/3022120952 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c151f40 con 0x7f358c0aa220 2023-12-22T09:14:26.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.066+0000 7f358b7fe640 1 --2- 172.21.15.106:0/3022120952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 0x7f358c155b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f357c009870 tx=0x7f357c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126be6440a05b034 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:26.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.066+0000 7f358a7fc640 1 -- 172.21.15.106:0/3022120952 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c031740 con 0x7f358c0aa220 2023-12-22T09:14:26.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.066+0000 7f358a7fc640 1 -- 172.21.15.106:0/3022120952 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c0318a0 con 0x7f358c0aa220 2023-12-22T09:14:26.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.066+0000 7f358a7fc640 1 -- 172.21.15.106:0/3022120952 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c031c30 con 0x7f358c0aa220 2023-12-22T09:14:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.067+0000 7f3591dd3640 1 -- 172.21.15.106:0/3022120952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 msgr2=0x7f358c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.067+0000 7f3591dd3640 1 --2- 172.21.15.106:0/3022120952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 0x7f358c155b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f357c009870 tx=0x7f357c02b7e0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.067+0000 7f3591dd3640 1 -- 172.21.15.106:0/3022120952 shutdown_connections 2023-12-22T09:14:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.067+0000 7f3591dd3640 1 --2- 172.21.15.106:0/3022120952 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f358c0c2400 0x7f358c0c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.067+0000 7f3591dd3640 1 --2- 172.21.15.106:0/3022120952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 0x7f358c155b80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.067+0000 7f3591dd3640 1 -- 172.21.15.106:0/3022120952 >> 172.21.15.106:0/3022120952 conn(0x7f358c069dd0 msgr2=0x7f358c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:26.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.067+0000 7f3591dd3640 1 -- 172.21.15.106:0/3022120952 shutdown_connections 2023-12-22T09:14:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.067+0000 7f3591dd3640 1 -- 172.21.15.106:0/3022120952 wait complete. 2023-12-22T09:14:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.069+0000 7f3591dd3640 1 Processor -- start 2023-12-22T09:14:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.069+0000 7f3591dd3640 1 -- start start 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.070+0000 7f3591dd3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 0x7f358c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.070+0000 7f3591dd3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f358c0c1f70 0x7f358c155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.070+0000 7f3591dd3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f358c0c2400 0x7f358c06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.070+0000 7f3591dd3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1519c0 con 0x7f358c0aa220 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.070+0000 7f3591dd3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c150dd0 con 0x7f358c0c1f70 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.070+0000 7f3591dd3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1508b0 con 0x7f358c0c2400 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.070+0000 7f358b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 0x7f358c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.070+0000 7f358b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 0x7f358c150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42152/0 (socket says 172.21.15.106:42152) 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.070+0000 7f358b7fe640 1 -- 172.21.15.106:0/2297476869 learned_addr learned my addr 172.21.15.106:0/2297476869 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f358affd640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f358c0c1f70 0x7f358c155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f358b7fe640 1 -- 172.21.15.106:0/2297476869 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f358c0c2400 msgr2=0x7f358c06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:26.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f358bfff640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f358c0c2400 0x7f358c06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f358b7fe640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f358c0c2400 0x7f358c06cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f358b7fe640 1 -- 172.21.15.106:0/2297476869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f358c0c1f70 msgr2=0x7f358c155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f358b7fe640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f358c0c1f70 0x7f358c155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f358b7fe640 1 -- 172.21.15.106:0/2297476869 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0094d0 con 0x7f358c0aa220 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f358affd640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f358c0c1f70 0x7f358c155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f358b7fe640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 0x7f358c150370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f357c009870 tx=0x7f357c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f3573fff640 1 -- 172.21.15.106:0/2297476869 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c033d60 con 0x7f358c0aa220 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f3573fff640 1 -- 172.21.15.106:0/2297476869 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c03c400 con 0x7f358c0aa220 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f3573fff640 1 -- 172.21.15.106:0/2297476869 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c03c7b0 con 0x7f358c0aa220 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.071+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c151090 con 0x7f358c0aa220 2023-12-22T09:14:26.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.072+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c151650 con 0x7f358c0aa220 2023-12-22T09:14:26.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.073+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c1517e0 con 0x7f358c0aa220 2023-12-22T09:14:26.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.074+0000 7f3573fff640 1 -- 172.21.15.106:0/2297476869 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f357c03a040 con 0x7f358c0aa220 2023-12-22T09:14:26.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.074+0000 7f3573fff640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f357806a430 0x7f357806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.075+0000 7f3573fff640 1 -- 172.21.15.106:0/2297476869 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f357c0aa1a0 con 0x7f358c0aa220 2023-12-22T09:14:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.075+0000 7f358affd640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f357806a430 0x7f357806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.075+0000 7f358affd640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f357806a430 0x7f357806c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f358c1e5560 tx=0x7f3580009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:26.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.079+0000 7f3573fff640 1 -- 172.21.15.106:0/2297476869 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f357c075c90 con 0x7f358c0aa220 2023-12-22T09:14:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.270+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f358c073f10 con 0x7f358c0aa220 2023-12-22T09:14:26.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.945+0000 7f3573fff640 1 -- 172.21.15.106:0/2297476869 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f357c0792b0 con 0x7f358c0aa220 2023-12-22T09:14:26.946 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2023-12-22T09:14:26.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.950+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f357806a430 msgr2=0x7f357806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:26.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.950+0000 7f3591dd3640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f357806a430 0x7f357806c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f358c1e5560 tx=0x7f3580009040 comp rx=0 tx=0).stop 2023-12-22T09:14:26.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 msgr2=0x7f358c150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:26.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 0x7f358c150370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f357c009870 tx=0x7f357c0046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 shutdown_connections 2023-12-22T09:14:26.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f357806a430 0x7f357806c8f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f358c0c2400 0x7f358c06cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f358c0c1f70 0x7f358c155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 --2- 172.21.15.106:0/2297476869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0aa220 0x7f358c150370 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:26.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 >> 172.21.15.106:0/2297476869 conn(0x7f358c069dd0 msgr2=0x7f358c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:26.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 shutdown_connections 2023-12-22T09:14:26.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:26.951+0000 7f3591dd3640 1 -- 172.21.15.106:0/2297476869 wait complete. 2023-12-22T09:14:26.974 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-22T09:14:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.179+0000 7f842e0ec640 1 Processor -- start 2023-12-22T09:14:27.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.180+0000 7f842e0ec640 1 -- start start 2023-12-22T09:14:27.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f842e0ec640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f84280c5ca0 0x7f8428150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:27.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f842e0ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f842806bdc0 0x7f842814a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:27.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f842e0ec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8428070000 con 0x7f8428071e30 2023-12-22T09:14:27.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f842e0ec640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84280702e0 con 0x7f84280c5ca0 2023-12-22T09:14:27.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f842e0ec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84280705c0 con 0x7f842806bdc0 2023-12-22T09:14:27.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f84277fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f84280c5ca0 0x7f8428150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:27.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f84277fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f84280c5ca0 0x7f8428150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42156/0 (socket says 172.21.15.106:42156) 2023-12-22T09:14:27.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f84277fe640 1 -- 172.21.15.106:0/3386860482 learned_addr learned my addr 172.21.15.106:0/3386860482 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:27.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f84277fe640 1 -- 172.21.15.106:0/3386860482 >> v2:172.21.15.132:3300/0 conn(0x7f842806bdc0 msgr2=0x7f842814a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:27.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f84277fe640 1 --2- 172.21.15.106:0/3386860482 >> v2:172.21.15.132:3300/0 conn(0x7f842806bdc0 0x7f842814a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f84277fe640 1 -- 172.21.15.106:0/3386860482 >> v1:172.21.15.132:6789/0 conn(0x7f8428071e30 legacy=0x7f84280710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:27.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.181+0000 7f84277fe640 1 -- 172.21.15.106:0/3386860482 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280708a0 con 0x7f84280c5ca0 2023-12-22T09:14:27.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.183+0000 7f84277fe640 1 --2- 172.21.15.106:0/3386860482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 0x7f8428150af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f842806df80 tx=0x7f841802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35eda115301f4b55 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:27.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.183+0000 7f84267fc640 1 -- 172.21.15.106:0/3386860482 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180317e0 con 0x7f84280c5ca0 2023-12-22T09:14:27.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.183+0000 7f84267fc640 1 -- 172.21.15.106:0/3386860482 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418031940 con 0x7f84280c5ca0 2023-12-22T09:14:27.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.183+0000 7f84267fc640 1 -- 172.21.15.106:0/3386860482 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418031cd0 con 0x7f84280c5ca0 2023-12-22T09:14:27.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.183+0000 7f842e0ec640 1 -- 172.21.15.106:0/3386860482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 msgr2=0x7f8428150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:27.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.183+0000 7f842e0ec640 1 --2- 172.21.15.106:0/3386860482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 0x7f8428150af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f842806df80 tx=0x7f841802b880 comp rx=0 tx=0).stop 2023-12-22T09:14:27.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.184+0000 7f842e0ec640 1 -- 172.21.15.106:0/3386860482 shutdown_connections 2023-12-22T09:14:27.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.184+0000 7f842e0ec640 1 --2- 172.21.15.106:0/3386860482 >> v2:172.21.15.132:3300/0 conn(0x7f842806bdc0 0x7f842814a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.184+0000 7f842e0ec640 1 --2- 172.21.15.106:0/3386860482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 0x7f8428150af0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.184+0000 7f842e0ec640 1 -- 172.21.15.106:0/3386860482 >> 172.21.15.106:0/3386860482 conn(0x7f842806a220 msgr2=0x7f84280c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:27.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.184+0000 7f842e0ec640 1 -- 172.21.15.106:0/3386860482 shutdown_connections 2023-12-22T09:14:27.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.184+0000 7f842e0ec640 1 -- 172.21.15.106:0/3386860482 wait complete. 2023-12-22T09:14:27.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.185+0000 7f842e0ec640 1 Processor -- start 2023-12-22T09:14:27.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.186+0000 7f842e0ec640 1 -- start start 2023-12-22T09:14:27.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f842e0ec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f842806bdc0 0x7f84281ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:27.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f842e0ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8428071e30 0x7f8428152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:27.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f842e0ec640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 0x7f8428153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f842e0ec640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281ed250 con 0x7f84280c5ca0 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f842e0ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281e9cf0 con 0x7f8428071e30 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f842e0ec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84281e9a10 con 0x7f842806bdc0 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f8427fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 0x7f8428153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f8427fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 0x7f8428153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42168/0 (socket says 172.21.15.106:42168) 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f8427fff640 1 -- 172.21.15.106:0/3621501308 learned_addr learned my addr 172.21.15.106:0/3621501308 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f84277fe640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f842806bdc0 0x7f84281ecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f8426ffd640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8428071e30 0x7f8428152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f8427fff640 1 -- 172.21.15.106:0/3621501308 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f842806bdc0 msgr2=0x7f84281ecd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f8427fff640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f842806bdc0 0x7f84281ecd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f8427fff640 1 -- 172.21.15.106:0/3621501308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8428071e30 msgr2=0x7f8428152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:27.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f8427fff640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8428071e30 0x7f8428152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.187+0000 7f8427fff640 1 -- 172.21.15.106:0/3621501308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180094d0 con 0x7f84280c5ca0 2023-12-22T09:14:27.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.188+0000 7f8427fff640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 0x7f8428153990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f842000b9e0 tx=0x7f842000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:27.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.188+0000 7f840ffff640 1 -- 172.21.15.106:0/3621501308 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842000caa0 con 0x7f84280c5ca0 2023-12-22T09:14:27.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.188+0000 7f840ffff640 1 -- 172.21.15.106:0/3621501308 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842000cc20 con 0x7f84280c5ca0 2023-12-22T09:14:27.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.188+0000 7f840ffff640 1 -- 172.21.15.106:0/3621501308 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420014440 con 0x7f84280c5ca0 2023-12-22T09:14:27.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.188+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84281ec510 con 0x7f84280c5ca0 2023-12-22T09:14:27.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.188+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8428153520 con 0x7f84280c5ca0 2023-12-22T09:14:27.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.189+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84281eca30 con 0x7f84280c5ca0 2023-12-22T09:14:27.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.190+0000 7f840ffff640 1 -- 172.21.15.106:0/3621501308 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f842001d3b0 con 0x7f84280c5ca0 2023-12-22T09:14:27.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.191+0000 7f840ffff640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f841406a430 0x7f841406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:27.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.191+0000 7f840ffff640 1 -- 172.21.15.106:0/3621501308 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8420088660 con 0x7f84280c5ca0 2023-12-22T09:14:27.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.191+0000 7f84277fe640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f841406a430 0x7f841406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:27.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.192+0000 7f84277fe640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f841406a430 0x7f841406c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8418036000 tx=0x7f841803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:27.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.196+0000 7f840ffff640 1 -- 172.21.15.106:0/3621501308 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f84281eca30 con 0x7f84280c5ca0 2023-12-22T09:14:27.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.389+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f84281eca30 con 0x7f84280c5ca0 2023-12-22T09:14:27.967 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2023-12-22T09:14:27.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.966+0000 7f840ffff640 1 -- 172.21.15.106:0/3621501308 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f84281eca30 con 0x7f84280c5ca0 2023-12-22T09:14:27.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.974+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f841406a430 msgr2=0x7f841406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:27.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.974+0000 7f842e0ec640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f841406a430 0x7f841406c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8418036000 tx=0x7f841803d040 comp rx=0 tx=0).stop 2023-12-22T09:14:27.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.974+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 msgr2=0x7f8428153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:27.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.974+0000 7f842e0ec640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 0x7f8428153990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f842000b9e0 tx=0x7f842000bea0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.975+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 shutdown_connections 2023-12-22T09:14:27.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.975+0000 7f842e0ec640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f841406a430 0x7f841406c8f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.975+0000 7f842e0ec640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84280c5ca0 0x7f8428153990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.975+0000 7f842e0ec640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8428071e30 0x7f8428152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.975+0000 7f842e0ec640 1 --2- 172.21.15.106:0/3621501308 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f842806bdc0 0x7f84281ecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:27.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.975+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 >> 172.21.15.106:0/3621501308 conn(0x7f842806a220 msgr2=0x7f84280c4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:27.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.976+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 shutdown_connections 2023-12-22T09:14:27.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:27.978+0000 7f842e0ec640 1 -- 172.21.15.106:0/3621501308 wait complete. 2023-12-22T09:14:28.009 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T09:14:28.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.195+0000 7fe41d0d7640 1 Processor -- start 2023-12-22T09:14:28.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.195+0000 7fe41d0d7640 1 -- start start 2023-12-22T09:14:28.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe41d0d7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe41814dfd0 0x7fe418150880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe41d0d7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe4180bfb00 0x7fe4180c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe41d0d7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4180c20d0 0x7fe418151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe41d0d7640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe418071940 con 0x7fe4180bfb00 2023-12-22T09:14:28.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe41d0d7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4180c0c10 con 0x7fe41814dfd0 2023-12-22T09:14:28.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe41d0d7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4180c0000 con 0x7fe4180c20d0 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe40ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe4180bfb00 0x7fe4180c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe40ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe4180bfb00 0x7fe4180c1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42174/0 (socket says 172.21.15.106:42174) 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe40ffff640 1 -- 172.21.15.106:0/2643986860 learned_addr learned my addr 172.21.15.106:0/2643986860 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.197+0000 7fe41c8d6640 1 --2- 172.21.15.106:0/2643986860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4180c20d0 0x7fe418151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.198+0000 7fe417fff640 1 --2- 172.21.15.106:0/2643986860 >> v2:172.21.15.132:3300/0 conn(0x7fe41814dfd0 0x7fe418150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.198+0000 7fe40ffff640 1 -- 172.21.15.106:0/2643986860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4180c20d0 msgr2=0x7fe418151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.198+0000 7fe40ffff640 1 --2- 172.21.15.106:0/2643986860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4180c20d0 0x7fe418151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.198+0000 7fe40ffff640 1 -- 172.21.15.106:0/2643986860 >> v2:172.21.15.132:3300/0 conn(0x7fe41814dfd0 msgr2=0x7fe418150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.198+0000 7fe40ffff640 1 --2- 172.21.15.106:0/2643986860 >> v2:172.21.15.132:3300/0 conn(0x7fe41814dfd0 0x7fe418150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.198+0000 7fe40ffff640 1 -- 172.21.15.106:0/2643986860 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4180c02e0 con 0x7fe4180bfb00 2023-12-22T09:14:28.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.199+0000 7fe40ffff640 1 --2- 172.21.15.106:0/2643986860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180bfb00 0x7fe4180c1b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe41806db10 tx=0x7fe40002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1ef13a96635af7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:28.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.199+0000 7fe4177fe640 1 -- 172.21.15.106:0/2643986860 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40002ee00 con 0x7fe4180bfb00 2023-12-22T09:14:28.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.199+0000 7fe4177fe640 1 -- 172.21.15.106:0/2643986860 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe400036440 con 0x7fe4180bfb00 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.199+0000 7fe4177fe640 1 -- 172.21.15.106:0/2643986860 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000367d0 con 0x7fe4180bfb00 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.200+0000 7fe41d0d7640 1 -- 172.21.15.106:0/2643986860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180bfb00 msgr2=0x7fe4180c1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.200+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/2643986860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180bfb00 0x7fe4180c1b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe41806db10 tx=0x7fe40002e050 comp rx=0 tx=0).stop 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.200+0000 7fe41d0d7640 1 -- 172.21.15.106:0/2643986860 shutdown_connections 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.200+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/2643986860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4180c20d0 0x7fe418151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.200+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/2643986860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180bfb00 0x7fe4180c1b90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.200+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/2643986860 >> v2:172.21.15.132:3300/0 conn(0x7fe41814dfd0 0x7fe418150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.200+0000 7fe41d0d7640 1 -- 172.21.15.106:0/2643986860 >> 172.21.15.106:0/2643986860 conn(0x7fe418069bf0 msgr2=0x7fe418069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.200+0000 7fe41d0d7640 1 -- 172.21.15.106:0/2643986860 shutdown_connections 2023-12-22T09:14:28.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.200+0000 7fe41d0d7640 1 -- 172.21.15.106:0/2643986860 wait complete. 2023-12-22T09:14:28.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.202+0000 7fe41d0d7640 1 Processor -- start 2023-12-22T09:14:28.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.202+0000 7fe41d0d7640 1 -- start start 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe41d0d7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4180bfb00 0x7fe41806ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe41d0d7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180c20d0 0x7fe418150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe41d0d7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe41814dfd0 0x7fe418153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe41d0d7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4181f04a0 con 0x7fe4180c20d0 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe41d0d7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe418151710 con 0x7fe4180bfb00 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe41d0d7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe418150ed0 con 0x7fe41814dfd0 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180c20d0 0x7fe418150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180c20d0 0x7fe418150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42180/0 (socket says 172.21.15.106:42180) 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe40ffff640 1 -- 172.21.15.106:0/4167185493 learned_addr learned my addr 172.21.15.106:0/4167185493 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe40ffff640 1 -- 172.21.15.106:0/4167185493 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe41814dfd0 msgr2=0x7fe418153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:28.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe40ffff640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe41814dfd0 0x7fe418153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe40ffff640 1 -- 172.21.15.106:0/4167185493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4180bfb00 msgr2=0x7fe41806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:28.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe40ffff640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4180bfb00 0x7fe41806ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.203+0000 7fe40ffff640 1 -- 172.21.15.106:0/4167185493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40000b770 con 0x7fe4180c20d0 2023-12-22T09:14:28.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.204+0000 7fe40ffff640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180c20d0 0x7fe418150990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe40002e090 tx=0x7fe4000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:28.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.204+0000 7fe4157fa640 1 -- 172.21.15.106:0/4167185493 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400034850 con 0x7fe4180c20d0 2023-12-22T09:14:28.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.204+0000 7fe4157fa640 1 -- 172.21.15.106:0/4167185493 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4000349b0 con 0x7fe4180c20d0 2023-12-22T09:14:28.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.204+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41814ec70 con 0x7fe4180c20d0 2023-12-22T09:14:28.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.204+0000 7fe4157fa640 1 -- 172.21.15.106:0/4167185493 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400034d60 con 0x7fe4180c20d0 2023-12-22T09:14:28.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.204+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4181f06b0 con 0x7fe4180c20d0 2023-12-22T09:14:28.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.205+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41804e8d0 con 0x7fe4180c20d0 2023-12-22T09:14:28.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.206+0000 7fe4157fa640 1 -- 172.21.15.106:0/4167185493 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe4000403e0 con 0x7fe4180c20d0 2023-12-22T09:14:28.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.207+0000 7fe4157fa640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe3f806a430 0x7fe3f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.207+0000 7fe4157fa640 1 -- 172.21.15.106:0/4167185493 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe4000aae80 con 0x7fe4180c20d0 2023-12-22T09:14:28.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.208+0000 7fe417fff640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe3f806a430 0x7fe3f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.208+0000 7fe417fff640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe3f806a430 0x7fe3f806c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4180718f0 tx=0x7fe408008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:28.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.212+0000 7fe4157fa640 1 -- 172.21.15.106:0/4167185493 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe4000764c0 con 0x7fe4180c20d0 2023-12-22T09:14:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.432+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe4180a8150 con 0x7fe4180c20d0 2023-12-22T09:14:28.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.442+0000 7fe4157fa640 1 -- 172.21.15.106:0/4167185493 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe400079ae0 con 0x7fe4180c20d0 2023-12-22T09:14:28.442 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 2 and data pool 3 2023-12-22T09:14:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.445+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe3f806a430 msgr2=0x7fe3f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.445+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe3f806a430 0x7fe3f806c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4180718f0 tx=0x7fe408008040 comp rx=0 tx=0).stop 2023-12-22T09:14:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.445+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180c20d0 msgr2=0x7fe418150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.445+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180c20d0 0x7fe418150990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe40002e090 tx=0x7fe4000046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.446+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 shutdown_connections 2023-12-22T09:14:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.446+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe3f806a430 0x7fe3f806c8f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.446+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe41814dfd0 0x7fe418153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.446+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4180c20d0 0x7fe418150990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.446+0000 7fe41d0d7640 1 --2- 172.21.15.106:0/4167185493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4180bfb00 0x7fe41806ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.446+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 >> 172.21.15.106:0/4167185493 conn(0x7fe418069bf0 msgr2=0x7fe41814c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:28.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.446+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 shutdown_connections 2023-12-22T09:14:28.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.446+0000 7fe41d0d7640 1 -- 172.21.15.106:0/4167185493 wait complete. 2023-12-22T09:14:28.481 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-22T09:14:28.482 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-22T09:14:28.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.659+0000 7f67e3981640 1 Processor -- start 2023-12-22T09:14:28.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.660+0000 7f67e3981640 1 -- start start 2023-12-22T09:14:28.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.661+0000 7f67e3981640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f67dc0c4970 0x7f67dc0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.661+0000 7f67e3981640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f67dc0c4420 0x7f67dc0c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.661+0000 7f67e3981640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc06b460 0x7f67dc157b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.661+0000 7f67e3981640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc157680 con 0x7f67dc0c4420 2023-12-22T09:14:28.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.661+0000 7f67e3981640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc0c58b0 con 0x7f67dc0c4970 2023-12-22T09:14:28.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.661+0000 7f67e3981640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c5b90 con 0x7f67dc06b460 2023-12-22T09:14:28.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.661+0000 7f67e0f1c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f67dc0c4420 0x7f67dc0c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.661+0000 7f67e0f1c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f67dc0c4420 0x7f67dc0c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42184/0 (socket says 172.21.15.106:42184) 2023-12-22T09:14:28.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.661+0000 7f67e0f1c640 1 -- 172.21.15.106:0/1994464679 learned_addr learned my addr 172.21.15.106:0/1994464679 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:28.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.662+0000 7f67e1f1e640 1 --2- 172.21.15.106:0/1994464679 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc06b460 0x7f67dc157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.662+0000 7f67e0f1c640 1 -- 172.21.15.106:0/1994464679 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc06b460 msgr2=0x7f67dc157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:28.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.662+0000 7f67e0f1c640 1 --2- 172.21.15.106:0/1994464679 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc06b460 0x7f67dc157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.662+0000 7f67e0f1c640 1 -- 172.21.15.106:0/1994464679 >> v2:172.21.15.132:3300/0 conn(0x7f67dc0c4970 msgr2=0x7f67dc0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:28.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.662+0000 7f67e0f1c640 1 --2- 172.21.15.106:0/1994464679 >> v2:172.21.15.132:3300/0 conn(0x7f67dc0c4970 0x7f67dc0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.662+0000 7f67e0f1c640 1 -- 172.21.15.106:0/1994464679 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0c5e70 con 0x7f67dc0c4420 2023-12-22T09:14:28.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.663+0000 7f67e0f1c640 1 --2- 172.21.15.106:0/1994464679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc0c4420 0x7f67dc0c4d50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f67dc072300 tx=0x7f67d002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d625b0b53069a36 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:28.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.663+0000 7f67dbfff640 1 -- 172.21.15.106:0/1994464679 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00317d0 con 0x7f67dc0c4420 2023-12-22T09:14:28.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.663+0000 7f67dbfff640 1 -- 172.21.15.106:0/1994464679 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0031930 con 0x7f67dc0c4420 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.663+0000 7f67dbfff640 1 -- 172.21.15.106:0/1994464679 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0031cc0 con 0x7f67dc0c4420 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.663+0000 7f67e3981640 1 -- 172.21.15.106:0/1994464679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc0c4420 msgr2=0x7f67dc0c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.663+0000 7f67e3981640 1 --2- 172.21.15.106:0/1994464679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc0c4420 0x7f67dc0c4d50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f67dc072300 tx=0x7f67d002b870 comp rx=0 tx=0).stop 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.664+0000 7f67e3981640 1 -- 172.21.15.106:0/1994464679 shutdown_connections 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.664+0000 7f67e3981640 1 --2- 172.21.15.106:0/1994464679 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc06b460 0x7f67dc157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.664+0000 7f67e3981640 1 --2- 172.21.15.106:0/1994464679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc0c4420 0x7f67dc0c4d50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.664+0000 7f67e3981640 1 --2- 172.21.15.106:0/1994464679 >> v2:172.21.15.132:3300/0 conn(0x7f67dc0c4970 0x7f67dc0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.664+0000 7f67e3981640 1 -- 172.21.15.106:0/1994464679 >> 172.21.15.106:0/1994464679 conn(0x7f67dc0c96d0 msgr2=0x7f67dc0c9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.664+0000 7f67e3981640 1 -- 172.21.15.106:0/1994464679 shutdown_connections 2023-12-22T09:14:28.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.664+0000 7f67e3981640 1 -- 172.21.15.106:0/1994464679 wait complete. 2023-12-22T09:14:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.665+0000 7f67e3981640 1 Processor -- start 2023-12-22T09:14:28.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.665+0000 7f67e3981640 1 -- start start 2023-12-22T09:14:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.666+0000 7f67e3981640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc06b460 0x7f67dc1ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.666+0000 7f67e3981640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67dc0c4420 0x7f67dc0a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.666+0000 7f67e3981640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc0c4970 0x7f67dc0a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.666+0000 7f67e3981640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc1ed940 con 0x7f67dc06b460 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.666+0000 7f67e3981640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0ac360 con 0x7f67dc0c4420 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.666+0000 7f67e3981640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc1ed660 con 0x7f67dc0c4970 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.666+0000 7f67e171d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc06b460 0x7f67dc1ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.666+0000 7f67e171d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc06b460 0x7f67dc1ecc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42186/0 (socket says 172.21.15.106:42186) 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.666+0000 7f67e171d640 1 -- 172.21.15.106:0/1297900274 learned_addr learned my addr 172.21.15.106:0/1297900274 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67e1f1e640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc0c4970 0x7f67dc0a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67e171d640 1 -- 172.21.15.106:0/1297900274 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc0c4970 msgr2=0x7f67dc0a9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67e171d640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc0c4970 0x7f67dc0a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67e171d640 1 -- 172.21.15.106:0/1297900274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67dc0c4420 msgr2=0x7f67dc0a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67e171d640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67dc0c4420 0x7f67dc0a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67e171d640 1 -- 172.21.15.106:0/1297900274 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d00094d0 con 0x7f67dc06b460 2023-12-22T09:14:28.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67e171d640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc06b460 0x7f67dc1ecc70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00b410 tx=0x7f67cc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:28.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67d9ffb640 1 -- 172.21.15.106:0/1297900274 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc011830 con 0x7f67dc06b460 2023-12-22T09:14:28.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67d9ffb640 1 -- 172.21.15.106:0/1297900274 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc0119b0 con 0x7f67dc06b460 2023-12-22T09:14:28.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67d9ffb640 1 -- 172.21.15.106:0/1297900274 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc011d60 con 0x7f67dc06b460 2023-12-22T09:14:28.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc0a9110 con 0x7f67dc06b460 2023-12-22T09:14:28.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.667+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc0c9e30 con 0x7f67dc06b460 2023-12-22T09:14:28.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.668+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc0a9630 con 0x7f67dc06b460 2023-12-22T09:14:28.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.669+0000 7f67d9ffb640 1 -- 172.21.15.106:0/1297900274 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f67cc01a400 con 0x7f67dc06b460 2023-12-22T09:14:28.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.670+0000 7f67d9ffb640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f67c806a430 0x7f67c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:28.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.670+0000 7f67d9ffb640 1 -- 172.21.15.106:0/1297900274 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67cc088ab0 con 0x7f67dc06b460 2023-12-22T09:14:28.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.670+0000 7f67e0f1c640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f67c806a430 0x7f67c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:28.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.671+0000 7f67e0f1c640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f67c806a430 0x7f67c806c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67d0036000 tx=0x7f67d0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:28.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.675+0000 7f67d9ffb640 1 -- 172.21.15.106:0/1297900274 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f67dc0a9630 con 0x7f67dc06b460 2023-12-22T09:14:28.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:28.861+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f67dc14fea0 con 0x7f67dc06b460 2023-12-22T09:14:29.391 INFO:tasks.ceph.mds.b.smithi132.stderr:2023-12-22T09:14:29.391+0000 7f077d07c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T09:14:29.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.452+0000 7f67d9ffb640 1 -- 172.21.15.106:0/1297900274 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f67cc015020 con 0x7f67dc06b460 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f67c806a430 msgr2=0x7f67c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f67c806a430 0x7f67c806c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67d0036000 tx=0x7f67d0030000 comp rx=0 tx=0).stop 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc06b460 msgr2=0x7f67dc1ecc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc06b460 0x7f67dc1ecc70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00b410 tx=0x7f67cc00b8d0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 shutdown_connections 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f67c806a430 0x7f67c806c8f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67dc0c4970 0x7f67dc0a9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67dc0c4420 0x7f67dc0a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 --2- 172.21.15.106:0/1297900274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67dc06b460 0x7f67dc1ecc70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 >> 172.21.15.106:0/1297900274 conn(0x7f67dc0c96d0 msgr2=0x7f67dc149d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:29.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 shutdown_connections 2023-12-22T09:14:29.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.456+0000 7f67e3981640 1 -- 172.21.15.106:0/1297900274 wait complete. 2023-12-22T09:14:29.475 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T09:14:29.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.695+0000 7efdffbc9640 1 Processor -- start 2023-12-22T09:14:29.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.696+0000 7efdffbc9640 1 -- start start 2023-12-22T09:14:29.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.697+0000 7efdffbc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efdf813a520 0x7efdf8151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:29.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.697+0000 7efdffbc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf81559e0 0x7efdf813aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:29.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.697+0000 7efdffbc9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efdf8155e40 0x7efdf80bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:29.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.697+0000 7efdffbc9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf81555c0 con 0x7efdf8155e40 2023-12-22T09:14:29.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.697+0000 7efdffbc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf8152090 con 0x7efdf813a520 2023-12-22T09:14:29.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.697+0000 7efdffbc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80c26e0 con 0x7efdf81559e0 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.697+0000 7efdfe166640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efdf8155e40 0x7efdf80bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.697+0000 7efdfe166640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efdf8155e40 0x7efdf80bfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42190/0 (socket says 172.21.15.106:42190) 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.697+0000 7efdfe166640 1 -- 172.21.15.106:0/3051253156 learned_addr learned my addr 172.21.15.106:0/3051253156 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.698+0000 7efdfd965640 1 --2- 172.21.15.106:0/3051253156 >> v2:172.21.15.132:3300/0 conn(0x7efdf813a520 0x7efdf8151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.698+0000 7efdfd164640 1 --2- 172.21.15.106:0/3051253156 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf81559e0 0x7efdf813aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.698+0000 7efdfe166640 1 -- 172.21.15.106:0/3051253156 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf81559e0 msgr2=0x7efdf813aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.698+0000 7efdfe166640 1 --2- 172.21.15.106:0/3051253156 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf81559e0 0x7efdf813aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.698+0000 7efdfe166640 1 -- 172.21.15.106:0/3051253156 >> v2:172.21.15.132:3300/0 conn(0x7efdf813a520 msgr2=0x7efdf8151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.698+0000 7efdfe166640 1 --2- 172.21.15.106:0/3051253156 >> v2:172.21.15.132:3300/0 conn(0x7efdf813a520 0x7efdf8151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.698+0000 7efdfe166640 1 -- 172.21.15.106:0/3051253156 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80c2120 con 0x7efdf8155e40 2023-12-22T09:14:29.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.699+0000 7efdfe166640 1 --2- 172.21.15.106:0/3051253156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 0x7efdf80bfcb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efdf806db70 tx=0x7efdf002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901344f001db1cb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:29.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.699+0000 7efdfc963640 1 -- 172.21.15.106:0/3051253156 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf002c950 con 0x7efdf8155e40 2023-12-22T09:14:29.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.699+0000 7efdfc963640 1 -- 172.21.15.106:0/3051253156 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf002cab0 con 0x7efdf8155e40 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.699+0000 7efdfc963640 1 -- 172.21.15.106:0/3051253156 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf002ce40 con 0x7efdf8155e40 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.700+0000 7efdffbc9640 1 -- 172.21.15.106:0/3051253156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 msgr2=0x7efdf80bfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.700+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3051253156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 0x7efdf80bfcb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efdf806db70 tx=0x7efdf002bdb0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.700+0000 7efdffbc9640 1 -- 172.21.15.106:0/3051253156 shutdown_connections 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.700+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3051253156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 0x7efdf80bfcb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.700+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3051253156 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf81559e0 0x7efdf813aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.700+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3051253156 >> v2:172.21.15.132:3300/0 conn(0x7efdf813a520 0x7efdf8151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.700+0000 7efdffbc9640 1 -- 172.21.15.106:0/3051253156 >> 172.21.15.106:0/3051253156 conn(0x7efdf8069bf0 msgr2=0x7efdf8069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.700+0000 7efdffbc9640 1 -- 172.21.15.106:0/3051253156 shutdown_connections 2023-12-22T09:14:29.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.700+0000 7efdffbc9640 1 -- 172.21.15.106:0/3051253156 wait complete. 2023-12-22T09:14:29.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.702+0000 7efdffbc9640 1 Processor -- start 2023-12-22T09:14:29.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.702+0000 7efdffbc9640 1 -- start start 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdffbc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf813a520 0x7efdf81e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdffbc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdf81559e0 0x7efdf8139930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdffbc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 0x7efdf81530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdffbc9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8153630 con 0x7efdf8155e40 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdffbc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8153890 con 0x7efdf81559e0 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdffbc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8153b70 con 0x7efdf813a520 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdfe166640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 0x7efdf81530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdfe166640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 0x7efdf81530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42198/0 (socket says 172.21.15.106:42198) 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdfe166640 1 -- 172.21.15.106:0/3182439268 learned_addr learned my addr 172.21.15.106:0/3182439268 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdfd965640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf813a520 0x7efdf81e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.703+0000 7efdfd164640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdf81559e0 0x7efdf8139930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:29.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdfe166640 1 -- 172.21.15.106:0/3182439268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf813a520 msgr2=0x7efdf81e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdfe166640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf813a520 0x7efdf81e89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdfe166640 1 -- 172.21.15.106:0/3182439268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdf81559e0 msgr2=0x7efdf8139930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdfe166640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdf81559e0 0x7efdf8139930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdfe166640 1 -- 172.21.15.106:0/3182439268 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0009b30 con 0x7efdf8155e40 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdfe166640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 0x7efdf81530f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efdf0036040 tx=0x7efdf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdee7fc640 1 -- 172.21.15.106:0/3182439268 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0009510 con 0x7efdf8155e40 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdee7fc640 1 -- 172.21.15.106:0/3182439268 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf003e450 con 0x7efdf8155e40 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf81e7f00 con 0x7efdf8155e40 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdee7fc640 1 -- 172.21.15.106:0/3182439268 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf003e800 con 0x7efdf8155e40 2023-12-22T09:14:29.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.704+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf81e84c0 con 0x7efdf8155e40 2023-12-22T09:14:29.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.705+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf8073f10 con 0x7efdf8155e40 2023-12-22T09:14:29.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.706+0000 7efdee7fc640 1 -- 172.21.15.106:0/3182439268 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efdf003e960 con 0x7efdf8155e40 2023-12-22T09:14:29.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.707+0000 7efdee7fc640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efddc06a430 0x7efddc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:29.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.707+0000 7efdee7fc640 1 -- 172.21.15.106:0/3182439268 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7efdf00ab7d0 con 0x7efdf8155e40 2023-12-22T09:14:29.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.708+0000 7efdfd965640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efddc06a430 0x7efddc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:29.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.708+0000 7efdfd965640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efddc06a430 0x7efddc06c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdf814f0b0 tx=0x7efdf4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:29.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.712+0000 7efdee7fc640 1 -- 172.21.15.106:0/3182439268 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efdf0076cd0 con 0x7efdf8155e40 2023-12-22T09:14:29.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:29.903+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efdf80c2930 con 0x7efdf8155e40 2023-12-22T09:14:31.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.460+0000 7efdee7fc640 1 -- 172.21.15.106:0/3182439268 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7efdf007a2f0 con 0x7efdf8155e40 2023-12-22T09:14:31.462 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data_ec' created 2023-12-22T09:14:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.468+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efddc06a430 msgr2=0x7efddc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.468+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efddc06a430 0x7efddc06c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdf814f0b0 tx=0x7efdf4008040 comp rx=0 tx=0).stop 2023-12-22T09:14:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.468+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 msgr2=0x7efdf81530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.468+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 0x7efdf81530f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efdf0036040 tx=0x7efdf0004a40 comp rx=0 tx=0).stop 2023-12-22T09:14:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.469+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 shutdown_connections 2023-12-22T09:14:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.469+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efddc06a430 0x7efddc06c8f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.469+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdf8155e40 0x7efdf81530f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.469+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efdf81559e0 0x7efdf8139930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:31.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.469+0000 7efdffbc9640 1 --2- 172.21.15.106:0/3182439268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efdf813a520 0x7efdf81e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:31.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.469+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 >> 172.21.15.106:0/3182439268 conn(0x7efdf8069bf0 msgr2=0x7efdf80aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:31.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.470+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 shutdown_connections 2023-12-22T09:14:31.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.471+0000 7efdffbc9640 1 -- 172.21.15.106:0/3182439268 wait complete. 2023-12-22T09:14:31.494 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-22T09:14:31.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.686+0000 7fcedc64c640 1 Processor -- start 2023-12-22T09:14:31.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.687+0000 7fcedc64c640 1 -- start start 2023-12-22T09:14:31.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.688+0000 7fcedc64c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fced40c75b0 0x7fced41540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:31.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.688+0000 7fcedc64c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced4157430 con 0x7fced4151540 2023-12-22T09:14:31.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.688+0000 7fcedc64c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced4157710 con 0x7fced4154630 2023-12-22T09:14:31.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.688+0000 7fcedc64c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced4151920 con 0x7fced40c75b0 2023-12-22T09:14:31.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.688+0000 7fced9be7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fced40c75b0 0x7fced41540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:31.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.688+0000 7fced9be7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fced40c75b0 0x7fced41540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42206/0 (socket says 172.21.15.106:42206) 2023-12-22T09:14:31.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.688+0000 7fced9be7640 1 -- 172.21.15.106:0/2309770022 learned_addr learned my addr 172.21.15.106:0/2309770022 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:31.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.688+0000 7fced9be7640 1 -- 172.21.15.106:0/2309770022 >> v1:172.21.15.132:6789/0 conn(0x7fced4154630 legacy=0x7fced415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:31.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.688+0000 7fced9be7640 1 -- 172.21.15.106:0/2309770022 >> v1:172.21.15.106:6789/0 conn(0x7fced4151540 legacy=0x7fced40c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:31.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.689+0000 7fced9be7640 1 -- 172.21.15.106:0/2309770022 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced41579f0 con 0x7fced40c75b0 2023-12-22T09:14:31.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.690+0000 7fced9be7640 1 --2- 172.21.15.106:0/2309770022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 0x7fced41540f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009870 tx=0x7fcec802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f27d53563bb9f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:31.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.690+0000 7fced93e6640 1 -- 172.21.15.106:0/2309770022 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8031870 con 0x7fced40c75b0 2023-12-22T09:14:31.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.690+0000 7fced93e6640 1 -- 172.21.15.106:0/2309770022 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec80319d0 con 0x7fced40c75b0 2023-12-22T09:14:31.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.690+0000 7fced93e6640 1 -- 172.21.15.106:0/2309770022 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8031d60 con 0x7fced40c75b0 2023-12-22T09:14:31.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.690+0000 7fcedc64c640 1 -- 172.21.15.106:0/2309770022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 msgr2=0x7fced41540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:31.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.690+0000 7fcedc64c640 1 --2- 172.21.15.106:0/2309770022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 0x7fced41540f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009870 tx=0x7fcec802b910 comp rx=0 tx=0).stop 2023-12-22T09:14:31.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.691+0000 7fcedc64c640 1 -- 172.21.15.106:0/2309770022 shutdown_connections 2023-12-22T09:14:31.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.691+0000 7fcedc64c640 1 --2- 172.21.15.106:0/2309770022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 0x7fced41540f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:31.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.691+0000 7fcedc64c640 1 -- 172.21.15.106:0/2309770022 >> 172.21.15.106:0/2309770022 conn(0x7fced4071740 msgr2=0x7fced4071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:31.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.691+0000 7fcedc64c640 1 -- 172.21.15.106:0/2309770022 shutdown_connections 2023-12-22T09:14:31.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.691+0000 7fcedc64c640 1 -- 172.21.15.106:0/2309770022 wait complete. 2023-12-22T09:14:31.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.692+0000 7fcedc64c640 1 Processor -- start 2023-12-22T09:14:31.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.692+0000 7fcedc64c640 1 -- start start 2023-12-22T09:14:31.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.693+0000 7fcedc64c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 0x7fced40ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:31.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.693+0000 7fcedc64c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced4151540 0x7fced4146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:31.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.693+0000 7fcedc64c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fced4154630 0x7fced4146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.693+0000 7fcedc64c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4147410 con 0x7fced40c75b0 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.693+0000 7fcedc64c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced41ed980 con 0x7fced4151540 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.693+0000 7fcedc64c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced40aa810 con 0x7fced4154630 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fceda3e8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 0x7fced40ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fceda3e8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 0x7fced40ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42218/0 (socket says 172.21.15.106:42218) 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fceda3e8640 1 -- 172.21.15.106:0/195988973 learned_addr learned my addr 172.21.15.106:0/195988973 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fceda3e8640 1 -- 172.21.15.106:0/195988973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fced4154630 msgr2=0x7fced4146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fceda3e8640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fced4154630 0x7fced4146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fceda3e8640 1 -- 172.21.15.106:0/195988973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced4151540 msgr2=0x7fced4146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:31.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fceda3e8640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced4151540 0x7fced4146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:31.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fceda3e8640 1 -- 172.21.15.106:0/195988973 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec80094d0 con 0x7fced40c75b0 2023-12-22T09:14:31.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fceda3e8640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 0x7fced40ab6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcec400c8a0 tx=0x7fcec400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:31.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fced2ffd640 1 -- 172.21.15.106:0/195988973 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4003b70 con 0x7fced40c75b0 2023-12-22T09:14:31.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fced2ffd640 1 -- 172.21.15.106:0/195988973 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec4003cf0 con 0x7fced40c75b0 2023-12-22T09:14:31.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.694+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced40a9a00 con 0x7fced40c75b0 2023-12-22T09:14:31.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.695+0000 7fced2ffd640 1 -- 172.21.15.106:0/195988973 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400aa30 con 0x7fced40c75b0 2023-12-22T09:14:31.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.695+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced40aec80 con 0x7fced40c75b0 2023-12-22T09:14:31.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.696+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced4073f10 con 0x7fced40c75b0 2023-12-22T09:14:31.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.697+0000 7fced2ffd640 1 -- 172.21.15.106:0/195988973 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcec400ab90 con 0x7fced40c75b0 2023-12-22T09:14:31.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.698+0000 7fced2ffd640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcec006a430 0x7fcec006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:31.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.698+0000 7fced2ffd640 1 -- 172.21.15.106:0/195988973 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fcec40889e0 con 0x7fced40c75b0 2023-12-22T09:14:31.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.698+0000 7fced9be7640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcec006a430 0x7fcec006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:31.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.699+0000 7fced9be7640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcec006a430 0x7fcec006c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcec8036000 tx=0x7fcec8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:31.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.703+0000 7fced2ffd640 1 -- 172.21.15.106:0/195988973 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcec4053da0 con 0x7fced40c75b0 2023-12-22T09:14:31.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:31.891+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fced406c7d0 con 0x7fced40c75b0 2023-12-22T09:14:32.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.466+0000 7fced2ffd640 1 -- 172.21.15.106:0/195988973 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcec4003e60 con 0x7fced40c75b0 2023-12-22T09:14:32.470 INFO:teuthology.orchestra.run.smithi106.stderr:set pool 4 allow_ec_overwrites to true 2023-12-22T09:14:32.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.475+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcec006a430 msgr2=0x7fcec006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:32.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.475+0000 7fcedc64c640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcec006a430 0x7fcec006c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcec8036000 tx=0x7fcec8030000 comp rx=0 tx=0).stop 2023-12-22T09:14:32.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.475+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 msgr2=0x7fced40ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:32.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.475+0000 7fcedc64c640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 0x7fced40ab6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcec400c8a0 tx=0x7fcec400cd60 comp rx=0 tx=0).stop 2023-12-22T09:14:32.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.477+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 shutdown_connections 2023-12-22T09:14:32.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.477+0000 7fcedc64c640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcec006a430 0x7fcec006c8f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.477+0000 7fcedc64c640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fced4154630 0x7fced4146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.477+0000 7fcedc64c640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced4151540 0x7fced4146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.477+0000 7fcedc64c640 1 --2- 172.21.15.106:0/195988973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fced40c75b0 0x7fced40ab6e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.477+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 >> 172.21.15.106:0/195988973 conn(0x7fced4071740 msgr2=0x7fced4149ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:32.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.478+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 shutdown_connections 2023-12-22T09:14:32.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.478+0000 7fcedc64c640 1 -- 172.21.15.106:0/195988973 wait complete. 2023-12-22T09:14:32.514 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-22T09:14:32.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.700+0000 7f2eeffff640 1 Processor -- start 2023-12-22T09:14:32.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.700+0000 7f2eeffff640 1 -- start start 2023-12-22T09:14:32.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.701+0000 7f2eeffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ef014df30 0x7f2ef01547f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:32.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.701+0000 7f2eeffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2ef0070de0 0x7f2ef0150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:32.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.701+0000 7f2eeffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ef0151510 0x7f2ef006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:32.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.701+0000 7f2eeffff640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef0154d30 con 0x7f2ef0070de0 2023-12-22T09:14:32.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.701+0000 7f2eeffff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef0150b40 con 0x7f2ef0151510 2023-12-22T09:14:32.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.701+0000 7f2eeffff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef006fa90 con 0x7f2ef014df30 2023-12-22T09:14:32.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2ee67fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2ef0070de0 0x7f2ef0150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:32.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2ee67fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2ef0070de0 0x7f2ef0150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42228/0 (socket says 172.21.15.106:42228) 2023-12-22T09:14:32.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2ee67fc640 1 -- 172.21.15.106:0/4100163871 learned_addr learned my addr 172.21.15.106:0/4100163871 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2ee67fc640 1 -- 172.21.15.106:0/4100163871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ef014df30 msgr2=0x7f2ef01547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2ee67fc640 1 --2- 172.21.15.106:0/4100163871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ef014df30 0x7f2ef01547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2ee67fc640 1 -- 172.21.15.106:0/4100163871 >> v2:172.21.15.132:3300/0 conn(0x7f2ef0151510 msgr2=0x7f2ef006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2eef7fe640 1 --2- 172.21.15.106:0/4100163871 >> v2:172.21.15.132:3300/0 conn(0x7f2ef0151510 0x7f2ef006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2ee67fc640 1 --2- 172.21.15.106:0/4100163871 >> v2:172.21.15.132:3300/0 conn(0x7f2ef0151510 0x7f2ef006b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2ee67fc640 1 -- 172.21.15.106:0/4100163871 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef01507f0 con 0x7f2ef0070de0 2023-12-22T09:14:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.702+0000 7f2eef7fe640 1 --2- 172.21.15.106:0/4100163871 >> v2:172.21.15.132:3300/0 conn(0x7f2ef0151510 0x7f2ef006b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:32.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.703+0000 7f2ee67fc640 1 --2- 172.21.15.106:0/4100163871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef0070de0 0x7f2ef0150fd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00a8c00 tx=0x7f2ed802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c1a1d5b7ca62ac server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:32.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.703+0000 7f2eee7fc640 1 -- 172.21.15.106:0/4100163871 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80317e0 con 0x7f2ef0070de0 2023-12-22T09:14:32.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eee7fc640 1 -- 172.21.15.106:0/4100163871 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed8031940 con 0x7f2ef0070de0 2023-12-22T09:14:32.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eee7fc640 1 -- 172.21.15.106:0/4100163871 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8031cd0 con 0x7f2ef0070de0 2023-12-22T09:14:32.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eeffff640 1 -- 172.21.15.106:0/4100163871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef0070de0 msgr2=0x7f2ef0150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:32.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eeffff640 1 --2- 172.21.15.106:0/4100163871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef0070de0 0x7f2ef0150fd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00a8c00 tx=0x7f2ed802b880 comp rx=0 tx=0).stop 2023-12-22T09:14:32.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eeffff640 1 -- 172.21.15.106:0/4100163871 shutdown_connections 2023-12-22T09:14:32.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eeffff640 1 --2- 172.21.15.106:0/4100163871 >> v2:172.21.15.132:3300/0 conn(0x7f2ef0151510 0x7f2ef006b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eeffff640 1 --2- 172.21.15.106:0/4100163871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef0070de0 0x7f2ef0150fd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eeffff640 1 --2- 172.21.15.106:0/4100163871 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ef014df30 0x7f2ef01547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eeffff640 1 -- 172.21.15.106:0/4100163871 >> 172.21.15.106:0/4100163871 conn(0x7f2ef00c1ba0 msgr2=0x7f2ef00c1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:32.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eeffff640 1 -- 172.21.15.106:0/4100163871 shutdown_connections 2023-12-22T09:14:32.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.704+0000 7f2eeffff640 1 -- 172.21.15.106:0/4100163871 wait complete. 2023-12-22T09:14:32.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.706+0000 7f2eeffff640 1 Processor -- start 2023-12-22T09:14:32.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.706+0000 7f2eeffff640 1 -- start start 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eeffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ef0070de0 0x7f2ef013be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eeffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ef014df30 0x7f2ef00aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eeffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef01d9f20 0x7f2ef01423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eeffff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01e8c60 con 0x7f2ef01d9f20 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eeffff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01e8f40 con 0x7f2ef0070de0 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eeffff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef013c350 con 0x7f2ef014df30 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eef7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef01d9f20 0x7f2ef01423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eef7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef01d9f20 0x7f2ef01423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:42236/0 (socket says 172.21.15.106:42236) 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eef7fe640 1 -- 172.21.15.106:0/1668526872 learned_addr learned my addr 172.21.15.106:0/1668526872 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.707+0000 7f2eeeffd640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ef0070de0 0x7f2ef013be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2ee67fc640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ef014df30 0x7f2ef00aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eef7fe640 1 -- 172.21.15.106:0/1668526872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ef014df30 msgr2=0x7f2ef00aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eef7fe640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ef014df30 0x7f2ef00aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eef7fe640 1 -- 172.21.15.106:0/1668526872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ef0070de0 msgr2=0x7f2ef013be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eef7fe640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ef0070de0 0x7f2ef013be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eef7fe640 1 -- 172.21.15.106:0/1668526872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80094d0 con 0x7f2ef01d9f20 2023-12-22T09:14:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eeeffd640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ef0070de0 0x7f2ef013be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:14:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eef7fe640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef01d9f20 0x7f2ef01423a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c820 tx=0x7f2ee800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eecff9640 1 -- 172.21.15.106:0/1668526872 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8007a30 con 0x7f2ef01d9f20 2023-12-22T09:14:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eecff9640 1 -- 172.21.15.106:0/1668526872 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8007b90 con 0x7f2ef01d9f20 2023-12-22T09:14:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eecff9640 1 -- 172.21.15.106:0/1668526872 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800ce10 con 0x7f2ef01d9f20 2023-12-22T09:14:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef0154380 con 0x7f2ef01d9f20 2023-12-22T09:14:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.708+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef0154940 con 0x7f2ef01d9f20 2023-12-22T09:14:32.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.709+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef01e90f0 con 0x7f2ef01d9f20 2023-12-22T09:14:32.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.710+0000 7f2eecff9640 1 -- 172.21.15.106:0/1668526872 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ee80113f0 con 0x7f2ef01d9f20 2023-12-22T09:14:32.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.711+0000 7f2eecff9640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ed006a430 0x7f2ed006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.711+0000 7f2eecff9640 1 -- 172.21.15.106:0/1668526872 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f2ee8088d20 con 0x7f2ef01d9f20 2023-12-22T09:14:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.712+0000 7f2eeeffd640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ed006a430 0x7f2ed006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.712+0000 7f2eeeffd640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ed006a430 0x7f2ed006c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009fa0 tx=0x7f2ee0009570 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.716+0000 7f2eecff9640 1 -- 172.21.15.106:0/1668526872 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ef01e90f0 con 0x7f2ef01d9f20 2023-12-22T09:14:32.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.943+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f2ef01e90f0 con 0x7f2ef01d9f20 2023-12-22T09:14:32.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.950+0000 7f2eecff9640 1 -- 172.21.15.106:0/1668526872 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2ef01e90f0 con 0x7f2ef01d9f20 2023-12-22T09:14:32.951 INFO:teuthology.orchestra.run.smithi106.stderr:added data pool 4 to fsmap 2023-12-22T09:14:32.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.953+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ed006a430 msgr2=0x7f2ed006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:32.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.953+0000 7f2eeffff640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ed006a430 0x7f2ed006c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009fa0 tx=0x7f2ee0009570 comp rx=0 tx=0).stop 2023-12-22T09:14:32.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.953+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef01d9f20 msgr2=0x7f2ef01423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:32.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.953+0000 7f2eeffff640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef01d9f20 0x7f2ef01423a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c820 tx=0x7f2ee800cce0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.954+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 shutdown_connections 2023-12-22T09:14:32.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.954+0000 7f2eeffff640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ed006a430 0x7f2ed006c8f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.954+0000 7f2eeffff640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ef01d9f20 0x7f2ef01423a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.954+0000 7f2eeffff640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ef014df30 0x7f2ef00aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.954+0000 7f2eeffff640 1 --2- 172.21.15.106:0/1668526872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ef0070de0 0x7f2ef013be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:32.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.954+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 >> 172.21.15.106:0/1668526872 conn(0x7f2ef00c1ba0 msgr2=0x7f2ef014fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:32.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.954+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 shutdown_connections 2023-12-22T09:14:32.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:32.954+0000 7f2eeffff640 1 -- 172.21.15.106:0/1668526872 wait complete. 2023-12-22T09:14:32.970 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:14:33.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.168+0000 7fd979994640 1 Processor -- start 2023-12-22T09:14:33.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.169+0000 7fd979994640 1 -- start start 2023-12-22T09:14:33.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.170+0000 7fd979994640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd97414f050 0x7fd9740c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.170+0000 7fd979994640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd9740c2360 0x7fd974070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.170+0000 7fd979994640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd974152300 con 0x7fd9740a8150 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.170+0000 7fd979994640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97414f430 con 0x7fd9740c2360 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.170+0000 7fd979994640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9741519f0 con 0x7fd97414f050 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.170+0000 7fd973fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd9740c2360 0x7fd974070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.170+0000 7fd973fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd9740c2360 0x7fd974070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39766/0 (socket says 172.21.15.106:39766) 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.171+0000 7fd973fff640 1 -- 172.21.15.106:0/1279242650 learned_addr learned my addr 172.21.15.106:0/1279242650 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.171+0000 7fd978992640 1 --2- 172.21.15.106:0/1279242650 >> v2:172.21.15.132:3300/0 conn(0x7fd97414f050 0x7fd9740c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.171+0000 7fd973fff640 1 -- 172.21.15.106:0/1279242650 >> v2:172.21.15.132:3300/0 conn(0x7fd97414f050 msgr2=0x7fd9740c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.171+0000 7fd973fff640 1 --2- 172.21.15.106:0/1279242650 >> v2:172.21.15.132:3300/0 conn(0x7fd97414f050 0x7fd9740c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.171+0000 7fd973fff640 1 -- 172.21.15.106:0/1279242650 >> v1:172.21.15.106:6789/0 conn(0x7fd9740a8150 legacy=0x7fd974154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.171+0000 7fd973fff640 1 -- 172.21.15.106:0/1279242650 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9740c0860 con 0x7fd9740c2360 2023-12-22T09:14:33.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.171+0000 7fd978992640 1 --2- 172.21.15.106:0/1279242650 >> v2:172.21.15.132:3300/0 conn(0x7fd97414f050 0x7fd9740c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:33.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.172+0000 7fd973fff640 1 --2- 172.21.15.106:0/1279242650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 0x7fd974070e00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9740c0fc0 tx=0x7fd96802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2584b616418a8e24 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:33.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.172+0000 7fd9737fe640 1 -- 172.21.15.106:0/1279242650 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968031870 con 0x7fd9740c2360 2023-12-22T09:14:33.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.172+0000 7fd9737fe640 1 -- 172.21.15.106:0/1279242650 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680319d0 con 0x7fd9740c2360 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.172+0000 7fd9737fe640 1 -- 172.21.15.106:0/1279242650 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968031d60 con 0x7fd9740c2360 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.173+0000 7fd979994640 1 -- 172.21.15.106:0/1279242650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 msgr2=0x7fd974070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.173+0000 7fd979994640 1 --2- 172.21.15.106:0/1279242650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 0x7fd974070e00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9740c0fc0 tx=0x7fd96802b910 comp rx=0 tx=0).stop 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.173+0000 7fd979994640 1 -- 172.21.15.106:0/1279242650 shutdown_connections 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.173+0000 7fd979994640 1 --2- 172.21.15.106:0/1279242650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 0x7fd974070e00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.173+0000 7fd979994640 1 --2- 172.21.15.106:0/1279242650 >> v2:172.21.15.132:3300/0 conn(0x7fd97414f050 0x7fd9740c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.173+0000 7fd979994640 1 -- 172.21.15.106:0/1279242650 >> 172.21.15.106:0/1279242650 conn(0x7fd974069dd0 msgr2=0x7fd97406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.173+0000 7fd979994640 1 -- 172.21.15.106:0/1279242650 shutdown_connections 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.173+0000 7fd979994640 1 -- 172.21.15.106:0/1279242650 wait complete. 2023-12-22T09:14:33.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.174+0000 7fd979994640 1 Processor -- start 2023-12-22T09:14:33.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.175+0000 7fd979994640 1 -- start start 2023-12-22T09:14:33.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.175+0000 7fd979994640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9740a8150 0x7fd9740c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.175+0000 7fd979994640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 0x7fd974152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd979994640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd97414f050 0x7fd97413a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd979994640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97414cd00 con 0x7fd9740c2360 2023-12-22T09:14:33.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd979994640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974149270 con 0x7fd9740a8150 2023-12-22T09:14:33.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd979994640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97414c360 con 0x7fd97414f050 2023-12-22T09:14:33.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd973fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 0x7fd974152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:33.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd973fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 0x7fd974152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39768/0 (socket says 172.21.15.106:39768) 2023-12-22T09:14:33.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd973fff640 1 -- 172.21.15.106:0/301514461 learned_addr learned my addr 172.21.15.106:0/301514461 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:33.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd973fff640 1 -- 172.21.15.106:0/301514461 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd97414f050 msgr2=0x7fd97413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd973fff640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd97414f050 0x7fd97413a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd973fff640 1 -- 172.21.15.106:0/301514461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9740a8150 msgr2=0x7fd9740c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd973fff640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9740a8150 0x7fd9740c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd973fff640 1 -- 172.21.15.106:0/301514461 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680094d0 con 0x7fd9740c2360 2023-12-22T09:14:33.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.176+0000 7fd973fff640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 0x7fd974152d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd968000c00 tx=0x7fd9680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:33.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.177+0000 7fd9717fa640 1 -- 172.21.15.106:0/301514461 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968031860 con 0x7fd9740c2360 2023-12-22T09:14:33.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.177+0000 7fd9717fa640 1 -- 172.21.15.106:0/301514461 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680443f0 con 0x7fd9740c2360 2023-12-22T09:14:33.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.177+0000 7fd9717fa640 1 -- 172.21.15.106:0/301514461 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680447a0 con 0x7fd9740c2360 2023-12-22T09:14:33.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.177+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97414c640 con 0x7fd9740c2360 2023-12-22T09:14:33.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.177+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97414df60 con 0x7fd9740c2360 2023-12-22T09:14:33.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.178+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd974151f70 con 0x7fd9740c2360 2023-12-22T09:14:33.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.179+0000 7fd9717fa640 1 -- 172.21.15.106:0/301514461 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd968044900 con 0x7fd9740c2360 2023-12-22T09:14:33.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.180+0000 7fd9717fa640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd96006a430 0x7fd96006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.180+0000 7fd9717fa640 1 -- 172.21.15.106:0/301514461 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd96802d040 con 0x7fd9740c2360 2023-12-22T09:14:33.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.180+0000 7fd978992640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd96006a430 0x7fd96006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:33.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.181+0000 7fd978992640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd96006a430 0x7fd96006c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd964006fd0 tx=0x7fd964008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:33.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.184+0000 7fd9717fa640 1 -- 172.21.15.106:0/301514461 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd974151f70 con 0x7fd9740c2360 2023-12-22T09:14:33.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.393+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd974151f70 con 0x7fd9740c2360 2023-12-22T09:14:33.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.394+0000 7fd9717fa640 1 -- 172.21.15.106:0/301514461 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4653 (secure 0 0 0) 0x7fd974151f70 con 0x7fd9740c2360 2023-12-22T09:14:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:33.395 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:32.946073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-22T09:14:33.395 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2023-12-22T09:14:33.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.396+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd96006a430 msgr2=0x7fd96006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.396+0000 7fd979994640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd96006a430 0x7fd96006c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd964006fd0 tx=0x7fd964008040 comp rx=0 tx=0).stop 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.396+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 msgr2=0x7fd974152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.396+0000 7fd979994640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 0x7fd974152d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd968000c00 tx=0x7fd9680046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.397+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 shutdown_connections 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.397+0000 7fd979994640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd96006a430 0x7fd96006c8f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.397+0000 7fd979994640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd97414f050 0x7fd97413a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.397+0000 7fd979994640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9740c2360 0x7fd974152d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.397+0000 7fd979994640 1 --2- 172.21.15.106:0/301514461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9740a8150 0x7fd9740c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.397+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 >> 172.21.15.106:0/301514461 conn(0x7fd974069dd0 msgr2=0x7fd97414a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.397+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 shutdown_connections 2023-12-22T09:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.397+0000 7fd979994640 1 -- 172.21.15.106:0/301514461 wait complete. 2023-12-22T09:14:33.418 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:33.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.606+0000 7f30ab2a1640 1 Processor -- start 2023-12-22T09:14:33.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.607+0000 7f30ab2a1640 1 -- start start 2023-12-22T09:14:33.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.608+0000 7f30ab2a1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30a4150a80 0x7f30a4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.608+0000 7f30ab2a1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30a4071ea0 0x7f30a41524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.608+0000 7f30ab2a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a40bfce0 con 0x7f30a4069e60 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.608+0000 7f30ab2a1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40c0960 con 0x7f30a4071ea0 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.608+0000 7f30ab2a1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a406aba0 con 0x7f30a4150a80 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.609+0000 7f30a983e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30a4071ea0 0x7f30a41524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.609+0000 7f30a983e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30a4071ea0 0x7f30a41524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39776/0 (socket says 172.21.15.106:39776) 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.609+0000 7f30a983e640 1 -- 172.21.15.106:0/257473717 learned_addr learned my addr 172.21.15.106:0/257473717 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.609+0000 7f30a883c640 1 --2- 172.21.15.106:0/257473717 >> v2:172.21.15.132:3300/0 conn(0x7f30a4150a80 0x7f30a4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.609+0000 7f30a983e640 1 -- 172.21.15.106:0/257473717 >> v2:172.21.15.132:3300/0 conn(0x7f30a4150a80 msgr2=0x7f30a4151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.609+0000 7f30a983e640 1 --2- 172.21.15.106:0/257473717 >> v2:172.21.15.132:3300/0 conn(0x7f30a4150a80 0x7f30a4151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.609+0000 7f30a983e640 1 -- 172.21.15.106:0/257473717 >> v1:172.21.15.132:6789/0 conn(0x7f30a4069e60 legacy=0x7f30a414a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:33.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.609+0000 7f30a983e640 1 -- 172.21.15.106:0/257473717 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a40bffc0 con 0x7f30a4071ea0 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.610+0000 7f30a983e640 1 --2- 172.21.15.106:0/257473717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 0x7f30a41524b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f30a40c63e0 tx=0x7f309c02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7779e81dee0538 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.610+0000 7f309bfff640 1 -- 172.21.15.106:0/257473717 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c02c960 con 0x7f30a4071ea0 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.610+0000 7f309bfff640 1 -- 172.21.15.106:0/257473717 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c02cac0 con 0x7f30a4071ea0 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.610+0000 7f309bfff640 1 -- 172.21.15.106:0/257473717 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c02ce50 con 0x7f30a4071ea0 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.611+0000 7f30ab2a1640 1 -- 172.21.15.106:0/257473717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 msgr2=0x7f30a41524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.611+0000 7f30ab2a1640 1 --2- 172.21.15.106:0/257473717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 0x7f30a41524b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f30a40c63e0 tx=0x7f309c02bdc0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.611+0000 7f30ab2a1640 1 -- 172.21.15.106:0/257473717 shutdown_connections 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.611+0000 7f30ab2a1640 1 --2- 172.21.15.106:0/257473717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 0x7f30a41524b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.611+0000 7f30ab2a1640 1 --2- 172.21.15.106:0/257473717 >> v2:172.21.15.132:3300/0 conn(0x7f30a4150a80 0x7f30a4151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.611+0000 7f30ab2a1640 1 -- 172.21.15.106:0/257473717 >> 172.21.15.106:0/257473717 conn(0x7f30a40c5360 msgr2=0x7f30a40c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:33.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.611+0000 7f30ab2a1640 1 -- 172.21.15.106:0/257473717 shutdown_connections 2023-12-22T09:14:33.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.611+0000 7f30ab2a1640 1 -- 172.21.15.106:0/257473717 wait complete. 2023-12-22T09:14:33.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.613+0000 7f30ab2a1640 1 Processor -- start 2023-12-22T09:14:33.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.613+0000 7f30ab2a1640 1 -- start start 2023-12-22T09:14:33.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30ab2a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30a4069e60 0x7f30a41de530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30ab2a1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 0x7f30a4139b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30ab2a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a4150a80 0x7f30a413a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30ab2a1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4146680 con 0x7f30a4071ea0 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30ab2a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a41ece70 con 0x7f30a4150a80 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30ab2a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a41ed3a0 con 0x7f30a4069e60 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30a883c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 0x7f30a4139b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30a883c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 0x7f30a4139b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39788/0 (socket says 172.21.15.106:39788) 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30a883c640 1 -- 172.21.15.106:0/2389099609 learned_addr learned my addr 172.21.15.106:0/2389099609 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30a903d640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30a4069e60 0x7f30a41de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30a883c640 1 -- 172.21.15.106:0/2389099609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30a4069e60 msgr2=0x7f30a41de530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30a883c640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30a4069e60 0x7f30a41de530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30a883c640 1 -- 172.21.15.106:0/2389099609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a4150a80 msgr2=0x7f30a413a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30a883c640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a4150a80 0x7f30a413a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.614+0000 7f30a883c640 1 -- 172.21.15.106:0/2389099609 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c009b30 con 0x7f30a4071ea0 2023-12-22T09:14:33.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.615+0000 7f30a883c640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 0x7f30a4139b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f309400c7f0 tx=0x7f309400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:33.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.615+0000 7f3099ffb640 1 -- 172.21.15.106:0/2389099609 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094004220 con 0x7f30a4071ea0 2023-12-22T09:14:33.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.615+0000 7f3099ffb640 1 -- 172.21.15.106:0/2389099609 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3094004380 con 0x7f30a4071ea0 2023-12-22T09:14:33.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.615+0000 7f3099ffb640 1 -- 172.21.15.106:0/2389099609 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094007840 con 0x7f30a4071ea0 2023-12-22T09:14:33.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.615+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a414fea0 con 0x7f30a4071ea0 2023-12-22T09:14:33.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.615+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a4147650 con 0x7f30a4071ea0 2023-12-22T09:14:33.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.616+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a4144b80 con 0x7f30a4071ea0 2023-12-22T09:14:33.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.617+0000 7f3099ffb640 1 -- 172.21.15.106:0/2389099609 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3094007bb0 con 0x7f30a4071ea0 2023-12-22T09:14:33.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.618+0000 7f3099ffb640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f308806a460 0x7f308806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:33.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.618+0000 7f3099ffb640 1 -- 172.21.15.106:0/2389099609 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3094088a20 con 0x7f30a4071ea0 2023-12-22T09:14:33.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.618+0000 7f30a903d640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f308806a460 0x7f308806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:33.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.619+0000 7f30a903d640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f308806a460 0x7f308806c920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30a000a790 tx=0x7f30a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:33.622 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.622+0000 7f3099ffb640 1 -- 172.21.15.106:0/2389099609 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f30a4144b80 con 0x7f30a4071ea0 2023-12-22T09:14:33.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.814+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30a4144b80 con 0x7f30a4071ea0 2023-12-22T09:14:33.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.817+0000 7f3099ffb640 1 -- 172.21.15.106:0/2389099609 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f30a4144b80 con 0x7f30a4071ea0 2023-12-22T09:14:33.818 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:33.818 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:33.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.819+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f308806a460 msgr2=0x7f308806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.819+0000 7f30ab2a1640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f308806a460 0x7f308806c920 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30a000a790 tx=0x7f30a0008040 comp rx=0 tx=0).stop 2023-12-22T09:14:33.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.819+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 msgr2=0x7f30a4139b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:33.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.819+0000 7f30ab2a1640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 0x7f30a4139b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f309400c7f0 tx=0x7f309400ccb0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.819+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 shutdown_connections 2023-12-22T09:14:33.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.820+0000 7f30ab2a1640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f308806a460 0x7f308806c920 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.820+0000 7f30ab2a1640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30a4150a80 0x7f30a413a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.820+0000 7f30ab2a1640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30a4071ea0 0x7f30a4139b40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.820+0000 7f30ab2a1640 1 --2- 172.21.15.106:0/2389099609 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30a4069e60 0x7f30a41de530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:33.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.820+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 >> 172.21.15.106:0/2389099609 conn(0x7f30a40c5360 msgr2=0x7f30a41441f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:33.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.820+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 shutdown_connections 2023-12-22T09:14:33.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:33.820+0000 7f30ab2a1640 1 -- 172.21.15.106:0/2389099609 wait complete. 2023-12-22T09:14:33.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:34.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.051+0000 7f32a25a4640 1 Processor -- start 2023-12-22T09:14:34.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.052+0000 7f32a25a4640 1 -- start start 2023-12-22T09:14:34.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.053+0000 7f32a25a4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f329c13b060 0x7f329c06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.053+0000 7f32a25a4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c0bf770 con 0x7f329c151b30 2023-12-22T09:14:34.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.053+0000 7f32a25a4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c155120 con 0x7f329c0bfce0 2023-12-22T09:14:34.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.053+0000 7f32a25a4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c155400 con 0x7f329c13b060 2023-12-22T09:14:34.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.053+0000 7f329bfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f329c13b060 0x7f329c06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.054+0000 7f329bfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f329c13b060 0x7f329c06a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39802/0 (socket says 172.21.15.106:39802) 2023-12-22T09:14:34.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.054+0000 7f32a0b41640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f329c151b30 0x7f329c151f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49038/0 (socket says 172.21.15.106:49038) 2023-12-22T09:14:34.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.054+0000 7f329bfff640 1 -- 172.21.15.106:0/2304157707 learned_addr learned my addr 172.21.15.106:0/2304157707 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:34.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.054+0000 7f329bfff640 1 -- 172.21.15.106:0/2304157707 >> v1:172.21.15.132:6789/0 conn(0x7f329c0bfce0 legacy=0x7f329c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.054+0000 7f329bfff640 1 -- 172.21.15.106:0/2304157707 >> v1:172.21.15.106:6789/0 conn(0x7f329c151b30 legacy=0x7f329c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.054+0000 7f329bfff640 1 -- 172.21.15.106:0/2304157707 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c1556e0 con 0x7f329c13b060 2023-12-22T09:14:34.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.055+0000 7f329bfff640 1 --2- 172.21.15.106:0/2304157707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c13b060 0x7f329c06a6b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f328c009850 tx=0x7f328c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1cd12a2b6053f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:34.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.055+0000 7f329b7fe640 1 -- 172.21.15.106:0/2304157707 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c004230 con 0x7f329c13b060 2023-12-22T09:14:34.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.055+0000 7f329b7fe640 1 -- 172.21.15.106:0/2304157707 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c004390 con 0x7f329c13b060 2023-12-22T09:14:34.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.055+0000 7f329b7fe640 1 -- 172.21.15.106:0/2304157707 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c003810 con 0x7f329c13b060 2023-12-22T09:14:34.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.056+0000 7f32a25a4640 1 -- 172.21.15.106:0/2304157707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c13b060 msgr2=0x7f329c06a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.056+0000 7f32a25a4640 1 --2- 172.21.15.106:0/2304157707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c13b060 0x7f329c06a6b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f328c009850 tx=0x7f328c02b8f0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.056+0000 7f32a25a4640 1 -- 172.21.15.106:0/2304157707 shutdown_connections 2023-12-22T09:14:34.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.056+0000 7f32a25a4640 1 --2- 172.21.15.106:0/2304157707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c13b060 0x7f329c06a6b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.056+0000 7f32a25a4640 1 -- 172.21.15.106:0/2304157707 >> 172.21.15.106:0/2304157707 conn(0x7f329c0c5360 msgr2=0x7f329c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:34.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.056+0000 7f32a25a4640 1 -- 172.21.15.106:0/2304157707 shutdown_connections 2023-12-22T09:14:34.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.056+0000 7f32a25a4640 1 -- 172.21.15.106:0/2304157707 wait complete. 2023-12-22T09:14:34.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.058+0000 7f32a25a4640 1 Processor -- start 2023-12-22T09:14:34.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.059+0000 7f32a25a4640 1 -- start start 2023-12-22T09:14:34.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32a25a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0bfce0 0x7f329c070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32a25a4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f329c13b060 0x7f329c1ed650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32a25a4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c151b30 0x7f329c0be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32a25a4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c154dd0 con 0x7f329c151b30 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32a25a4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c1e96d0 con 0x7f329c0bfce0 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32a25a4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c1542a0 con 0x7f329c13b060 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32a0b41640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c151b30 0x7f329c0be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32a0b41640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c151b30 0x7f329c0be8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39810/0 (socket says 172.21.15.106:39810) 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32a0b41640 1 -- 172.21.15.106:0/1210069839 learned_addr learned my addr 172.21.15.106:0/1210069839 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f329bfff640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0bfce0 0x7f329c070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.060+0000 7f32937fe640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f329c13b060 0x7f329c1ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32a0b41640 1 -- 172.21.15.106:0/1210069839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f329c13b060 msgr2=0x7f329c1ed650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32a0b41640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f329c13b060 0x7f329c1ed650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32a0b41640 1 -- 172.21.15.106:0/1210069839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0bfce0 msgr2=0x7f329c070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32a0b41640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0bfce0 0x7f329c070ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32a0b41640 1 -- 172.21.15.106:0/1210069839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c009460 con 0x7f329c151b30 2023-12-22T09:14:34.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f329bfff640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0bfce0 0x7f329c070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:34.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32a0b41640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c151b30 0x7f329c0be8e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f329400c780 tx=0x7f329400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:34.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32997fa640 1 -- 172.21.15.106:0/1210069839 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400ce90 con 0x7f329c151b30 2023-12-22T09:14:34.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32997fa640 1 -- 172.21.15.106:0/1210069839 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329400a640 con 0x7f329c151b30 2023-12-22T09:14:34.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32997fa640 1 -- 172.21.15.106:0/1210069839 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400a9b0 con 0x7f329c151b30 2023-12-22T09:14:34.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c152cf0 con 0x7f329c151b30 2023-12-22T09:14:34.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.061+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c071510 con 0x7f329c151b30 2023-12-22T09:14:34.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.062+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c1e9820 con 0x7f329c151b30 2023-12-22T09:14:34.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.064+0000 7f32997fa640 1 -- 172.21.15.106:0/1210069839 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f329400ab10 con 0x7f329c151b30 2023-12-22T09:14:34.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.065+0000 7f32997fa640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f327c06a430 0x7f327c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.065+0000 7f32997fa640 1 -- 172.21.15.106:0/1210069839 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3294088340 con 0x7f329c151b30 2023-12-22T09:14:34.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.065+0000 7f329bfff640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f327c06a430 0x7f327c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.065+0000 7f329bfff640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f327c06a430 0x7f327c06c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f328c035000 tx=0x7f328c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:34.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.071+0000 7f32997fa640 1 -- 172.21.15.106:0/1210069839 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f329c1e9820 con 0x7f329c151b30 2023-12-22T09:14:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.263+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f329c1e9820 con 0x7f329c151b30 2023-12-22T09:14:34.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.265+0000 7f32997fa640 1 -- 172.21.15.106:0/1210069839 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f329c1e9820 con 0x7f329c151b30 2023-12-22T09:14:34.266 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:34.266 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f327c06a430 msgr2=0x7f327c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f327c06a430 0x7f327c06c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f328c035000 tx=0x7f328c008030 comp rx=0 tx=0).stop 2023-12-22T09:14:34.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c151b30 msgr2=0x7f329c0be8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c151b30 0x7f329c0be8e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f329400c780 tx=0x7f329400cc40 comp rx=0 tx=0).stop 2023-12-22T09:14:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 shutdown_connections 2023-12-22T09:14:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f327c06a430 0x7f327c06c8f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f329c151b30 0x7f329c0be8e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f329c13b060 0x7f329c1ed650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 --2- 172.21.15.106:0/1210069839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0bfce0 0x7f329c070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 >> 172.21.15.106:0/1210069839 conn(0x7f329c0c5360 msgr2=0x7f329c0c0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 shutdown_connections 2023-12-22T09:14:34.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.268+0000 7f32a25a4640 1 -- 172.21.15.106:0/1210069839 wait complete. 2023-12-22T09:14:34.303 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:14:34.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.512+0000 7fa38e85e640 1 Processor -- start 2023-12-22T09:14:34.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.512+0000 7fa38e85e640 1 -- start start 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38e85e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa38806ae70 0x7fa3881523e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38e85e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa38806b250 0x7fa38814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38e85e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa3880a4d40 0x7fa3880c0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38e85e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38806e050 con 0x7fa38806ae70 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38e85e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa388152920 con 0x7fa38806b250 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38e85e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38806d180 con 0x7fa3880a4d40 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38d85c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa38806ae70 0x7fa3881523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38d85c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa38806ae70 0x7fa3881523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39822/0 (socket says 172.21.15.106:39822) 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38d85c640 1 -- 172.21.15.106:0/163553861 learned_addr learned my addr 172.21.15.106:0/163553861 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38d85c640 1 -- 172.21.15.106:0/163553861 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa3880a4d40 msgr2=0x7fa3880c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38d85c640 1 --2- 172.21.15.106:0/163553861 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa3880a4d40 0x7fa3880c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38d85c640 1 -- 172.21.15.106:0/163553861 >> v2:172.21.15.132:3300/0 conn(0x7fa38806b250 msgr2=0x7fa38814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38d85c640 1 --2- 172.21.15.106:0/163553861 >> v2:172.21.15.132:3300/0 conn(0x7fa38806b250 0x7fa38814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.514+0000 7fa38d85c640 1 -- 172.21.15.106:0/163553861 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38806d440 con 0x7fa38806ae70 2023-12-22T09:14:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.515+0000 7fa38d85c640 1 --2- 172.21.15.106:0/163553861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa38806ae70 0x7fa3881523e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa388065c80 tx=0x7fa38402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dff3b1ac7074dd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.516+0000 7fa38c85a640 1 -- 172.21.15.106:0/163553861 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384031870 con 0x7fa38806ae70 2023-12-22T09:14:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.516+0000 7fa38c85a640 1 -- 172.21.15.106:0/163553861 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3840319d0 con 0x7fa38806ae70 2023-12-22T09:14:34.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.516+0000 7fa38c85a640 1 -- 172.21.15.106:0/163553861 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384031d60 con 0x7fa38806ae70 2023-12-22T09:14:34.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.516+0000 7fa38e85e640 1 -- 172.21.15.106:0/163553861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa38806ae70 msgr2=0x7fa3881523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.516+0000 7fa38e85e640 1 --2- 172.21.15.106:0/163553861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa38806ae70 0x7fa3881523e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa388065c80 tx=0x7fa38402b910 comp rx=0 tx=0).stop 2023-12-22T09:14:34.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.517+0000 7fa38e85e640 1 -- 172.21.15.106:0/163553861 shutdown_connections 2023-12-22T09:14:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.517+0000 7fa38e85e640 1 --2- 172.21.15.106:0/163553861 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa3880a4d40 0x7fa3880c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.517+0000 7fa38e85e640 1 --2- 172.21.15.106:0/163553861 >> v2:172.21.15.132:3300/0 conn(0x7fa38806b250 0x7fa38814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.517+0000 7fa38e85e640 1 --2- 172.21.15.106:0/163553861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa38806ae70 0x7fa3881523e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.517+0000 7fa38e85e640 1 -- 172.21.15.106:0/163553861 >> 172.21.15.106:0/163553861 conn(0x7fa3880c2480 msgr2=0x7fa3880c2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.517+0000 7fa38e85e640 1 -- 172.21.15.106:0/163553861 shutdown_connections 2023-12-22T09:14:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.517+0000 7fa38e85e640 1 -- 172.21.15.106:0/163553861 wait complete. 2023-12-22T09:14:34.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.519+0000 7fa38e85e640 1 Processor -- start 2023-12-22T09:14:34.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.519+0000 7fa38e85e640 1 -- start start 2023-12-22T09:14:34.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.520+0000 7fa38e85e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa38806ae70 0x7fa388151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.520+0000 7fa38e85e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3880a4d40 0x7fa3881e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.520+0000 7fa38e85e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3880c4bf0 0x7fa3881eccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.520+0000 7fa38e85e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa388151910 con 0x7fa3880a4d40 2023-12-22T09:14:34.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.520+0000 7fa38e85e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881ec560 con 0x7fa3880c4bf0 2023-12-22T09:14:34.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.520+0000 7fa38e85e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881ec840 con 0x7fa38806ae70 2023-12-22T09:14:34.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d05b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3880a4d40 0x7fa3881e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d05b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3880a4d40 0x7fa3881e8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39824/0 (socket says 172.21.15.106:39824) 2023-12-22T09:14:34.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d05b640 1 -- 172.21.15.106:0/699942311 learned_addr learned my addr 172.21.15.106:0/699942311 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:34.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d85c640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa38806ae70 0x7fa388151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d05b640 1 -- 172.21.15.106:0/699942311 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa38806ae70 msgr2=0x7fa388151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d05b640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa38806ae70 0x7fa388151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d05b640 1 -- 172.21.15.106:0/699942311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3880c4bf0 msgr2=0x7fa3881eccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d05b640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3880c4bf0 0x7fa3881eccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d05b640 1 -- 172.21.15.106:0/699942311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840094d0 con 0x7fa3880a4d40 2023-12-22T09:14:34.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.521+0000 7fa38d05b640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3880a4d40 0x7fa3881e8ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa37800b4a0 tx=0x7fa37800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:34.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.522+0000 7fa37e7fc640 1 -- 172.21.15.106:0/699942311 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378010610 con 0x7fa3880a4d40 2023-12-22T09:14:34.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.522+0000 7fa37e7fc640 1 -- 172.21.15.106:0/699942311 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa378010770 con 0x7fa3880a4d40 2023-12-22T09:14:34.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.522+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3880a5790 con 0x7fa3880a4d40 2023-12-22T09:14:34.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.522+0000 7fa37e7fc640 1 -- 172.21.15.106:0/699942311 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378010b20 con 0x7fa3880a4d40 2023-12-22T09:14:34.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.522+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38814a120 con 0x7fa3880a4d40 2023-12-22T09:14:34.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.523+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3881ec9b0 con 0x7fa3880a4d40 2023-12-22T09:14:34.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.524+0000 7fa37e7fc640 1 -- 172.21.15.106:0/699942311 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa378010c80 con 0x7fa3880a4d40 2023-12-22T09:14:34.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.525+0000 7fa37e7fc640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa36c06a430 0x7fa36c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.525+0000 7fa37e7fc640 1 -- 172.21.15.106:0/699942311 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa378088820 con 0x7fa3880a4d40 2023-12-22T09:14:34.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.525+0000 7fa38d85c640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa36c06a430 0x7fa36c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.526+0000 7fa38d85c640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa36c06a430 0x7fa36c06c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa384036000 tx=0x7fa38403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:34.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.530+0000 7fa37e7fc640 1 -- 172.21.15.106:0/699942311 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa378053b10 con 0x7fa3880a4d40 2023-12-22T09:14:34.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.759+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa38804e8d0 con 0x7fa3880a4d40 2023-12-22T09:14:34.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.760+0000 7fa37e7fc640 1 -- 172.21.15.106:0/699942311 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4653 (secure 0 0 0) 0x7fa378057130 con 0x7fa3880a4d40 2023-12-22T09:14:34.760 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:34.760 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:32.946073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-22T09:14:34.761 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 6 2023-12-22T09:14:34.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa36c06a430 msgr2=0x7fa36c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa36c06a430 0x7fa36c06c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa384036000 tx=0x7fa38403c040 comp rx=0 tx=0).stop 2023-12-22T09:14:34.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3880a4d40 msgr2=0x7fa3881e8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3880a4d40 0x7fa3881e8ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa37800b4a0 tx=0x7fa37800b960 comp rx=0 tx=0).stop 2023-12-22T09:14:34.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 shutdown_connections 2023-12-22T09:14:34.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa36c06a430 0x7fa36c06c8f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3880c4bf0 0x7fa3881eccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3880a4d40 0x7fa3881e8ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 --2- 172.21.15.106:0/699942311 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa38806ae70 0x7fa388151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.762+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 >> 172.21.15.106:0/699942311 conn(0x7fa3880c2480 msgr2=0x7fa3880c0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:34.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.763+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 shutdown_connections 2023-12-22T09:14:34.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.763+0000 7fa38e85e640 1 -- 172.21.15.106:0/699942311 wait complete. 2023-12-22T09:14:34.783 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:34.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.993+0000 7f087a78b640 1 Processor -- start 2023-12-22T09:14:34.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.993+0000 7f087a78b640 1 -- start start 2023-12-22T09:14:34.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.994+0000 7f087a78b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f087413b060 0x7f087406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.994+0000 7f087a78b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740bfce0 0x7f0874069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.995+0000 7f087a78b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08740bf770 con 0x7f087406a130 2023-12-22T09:14:34.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.995+0000 7f087a78b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0874155120 con 0x7f087413b060 2023-12-22T09:14:34.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.995+0000 7f087a78b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0874155400 con 0x7f08740bfce0 2023-12-22T09:14:34.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.995+0000 7f0878d28640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f087406a130 0x7f0874151b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49042/0 (socket says 172.21.15.106:49042) 2023-12-22T09:14:34.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.995+0000 7f0878d28640 1 -- 172.21.15.106:0/1389270370 learned_addr learned my addr 172.21.15.106:0/1389270370 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:34.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.995+0000 7f0873fff640 1 --2- 172.21.15.106:0/1389270370 >> v2:172.21.15.132:3300/0 conn(0x7f087413b060 0x7f087406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.995+0000 7f08737fe640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740bfce0 0x7f0874069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.995+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708533941 0 0) 0x7f08740bf770 con 0x7f087406a130 2023-12-22T09:14:34.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.995+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f085c003520 con 0x7f087406a130 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2377243503 0 0) 0x7f085c003520 con 0x7f087406a130 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740bfce0 msgr2=0x7f0874069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740bfce0 0x7f0874069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 >> v2:172.21.15.132:3300/0 conn(0x7f087413b060 msgr2=0x7f087406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 --2- 172.21.15.106:0/1389270370 >> v2:172.21.15.132:3300/0 conn(0x7f087413b060 0x7f087406a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08741556e0 con 0x7f087406a130 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f086c0019f0 con 0x7f087406a130 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 >> v1:172.21.15.106:6789/0 conn(0x7f087406a130 legacy=0x7f0874151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f085c003970 0x7f085c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c0047c0 0x7f085c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740bfce0 0x7f085c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0874155120 con 0x7f085c0047c0 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0874155400 con 0x7f085c003970 2023-12-22T09:14:34.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c00b980 con 0x7f08740bfce0 2023-12-22T09:14:34.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f08737fe640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c0047c0 0x7f085c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.996+0000 7f0873fff640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f085c003970 0x7f085c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:34.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.997+0000 7f08737fe640 1 -- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740bfce0 msgr2=0x7f085c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:34.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.997+0000 7f08737fe640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740bfce0 0x7f085c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.997+0000 7f08737fe640 1 -- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f085c003970 msgr2=0x7f085c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:34.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.997+0000 7f08737fe640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f085c003970 0x7f085c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:34.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.997+0000 7f08737fe640 1 -- 172.21.15.106:0/1389270370 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c003520 con 0x7f085c0047c0 2023-12-22T09:14:35.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.998+0000 7f08737fe640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c0047c0 0x7f085c004c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0868009af0 tx=0x7f085c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1f8c8d260e29a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.998+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086802c710 con 0x7f085c0047c0 2023-12-22T09:14:35.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.998+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086802c870 con 0x7f085c0047c0 2023-12-22T09:14:35.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.998+0000 7f0872ffd640 1 -- 172.21.15.106:0/1389270370 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086802cc00 con 0x7f085c0047c0 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.998+0000 7f087a78b640 1 -- 172.21.15.106:0/1389270370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c0047c0 msgr2=0x7f085c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.998+0000 7f087a78b640 1 --2- 172.21.15.106:0/1389270370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085c0047c0 0x7f085c004c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0868009af0 tx=0x7f085c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.998+0000 7f0878d28640 1 -- 172.21.15.106:0/1389270370 reap_dead start 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.999+0000 7f087a78b640 1 -- 172.21.15.106:0/1389270370 shutdown_connections 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.999+0000 7f087a78b640 1 -- 172.21.15.106:0/1389270370 >> 172.21.15.106:0/1389270370 conn(0x7f08740c5360 msgr2=0x7f08740c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.999+0000 7f087a78b640 1 -- 172.21.15.106:0/1389270370 shutdown_connections 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:34.999+0000 7f087a78b640 1 -- 172.21.15.106:0/1389270370 wait complete. 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.000+0000 7f087a78b640 1 Processor -- start 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.001+0000 7f087a78b640 1 -- start start 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.001+0000 7f087a78b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f085c0047c0 0x7f08740c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.001+0000 7f087a78b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740c4e80 0x7f08741e9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.001+0000 7f087a78b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08740c4750 0x7f08741e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.001+0000 7f087a78b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0874133ee0 con 0x7f08740c4750 2023-12-22T09:14:35.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.001+0000 7f087a78b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08741e9dd0 con 0x7f085c0047c0 2023-12-22T09:14:35.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.001+0000 7f087a78b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0874135570 con 0x7f08740c4e80 2023-12-22T09:14:35.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0878d28640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08740c4750 0x7f08741e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0878d28640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08740c4750 0x7f08741e9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39842/0 (socket says 172.21.15.106:39842) 2023-12-22T09:14:35.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0878d28640 1 -- 172.21.15.106:0/441916042 learned_addr learned my addr 172.21.15.106:0/441916042 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:35.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0873fff640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f085c0047c0 0x7f08740c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f08737fe640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740c4e80 0x7f08741e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0878d28640 1 -- 172.21.15.106:0/441916042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740c4e80 msgr2=0x7f08741e9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0878d28640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740c4e80 0x7f08741e9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0878d28640 1 -- 172.21.15.106:0/441916042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f085c0047c0 msgr2=0x7f08740c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0878d28640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f085c0047c0 0x7f08740c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0878d28640 1 -- 172.21.15.106:0/441916042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08741340e0 con 0x7f08740c4750 2023-12-22T09:14:35.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f08737fe640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740c4e80 0x7f08741e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:35.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.002+0000 7f0878d28640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08740c4750 0x7f08741e9890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f086c0012e0 tx=0x7f086c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.003+0000 7f0870ff9640 1 -- 172.21.15.106:0/441916042 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00a610 con 0x7f08740c4750 2023-12-22T09:14:35.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.003+0000 7f0870ff9640 1 -- 172.21.15.106:0/441916042 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c00a7b0 con 0x7f08740c4750 2023-12-22T09:14:35.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.003+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08741ec8c0 con 0x7f08740c4750 2023-12-22T09:14:35.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.003+0000 7f0870ff9640 1 -- 172.21.15.106:0/441916042 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00ab60 con 0x7f08740c4750 2023-12-22T09:14:35.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.003+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08741ece80 con 0x7f08740c4750 2023-12-22T09:14:35.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.004+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087406ad90 con 0x7f08740c4750 2023-12-22T09:14:35.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.005+0000 7f0870ff9640 1 -- 172.21.15.106:0/441916042 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f086c00acc0 con 0x7f08740c4750 2023-12-22T09:14:35.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.006+0000 7f0870ff9640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f086006a430 0x7f086006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.006+0000 7f0870ff9640 1 -- 172.21.15.106:0/441916042 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f086c088620 con 0x7f08740c4750 2023-12-22T09:14:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.006+0000 7f0873fff640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f086006a430 0x7f086006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.007+0000 7f0873fff640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f086006a430 0x7f086006c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0864009a80 tx=0x7f0864008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.010+0000 7f0870ff9640 1 -- 172.21.15.106:0/441916042 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f086c053910 con 0x7f08740c4750 2023-12-22T09:14:35.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.200+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0874073f10 con 0x7f08740c4750 2023-12-22T09:14:35.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.201+0000 7f0870ff9640 1 -- 172.21.15.106:0/441916042 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f086c056f30 con 0x7f08740c4750 2023-12-22T09:14:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:35.202 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f086006a430 msgr2=0x7f086006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f086006a430 0x7f086006c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0864009a80 tx=0x7f0864008040 comp rx=0 tx=0).stop 2023-12-22T09:14:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08740c4750 msgr2=0x7f08741e9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08740c4750 0x7f08741e9890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f086c0012e0 tx=0x7f086c00cf00 comp rx=0 tx=0).stop 2023-12-22T09:14:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 shutdown_connections 2023-12-22T09:14:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f086006a430 0x7f086006c8f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08740c4750 0x7f08741e9890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08740c4e80 0x7f08741e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 --2- 172.21.15.106:0/441916042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f085c0047c0 0x7f08740c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 >> 172.21.15.106:0/441916042 conn(0x7f08740c5360 msgr2=0x7f08740aa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.204+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 shutdown_connections 2023-12-22T09:14:35.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.205+0000 7f087a78b640 1 -- 172.21.15.106:0/441916042 wait complete. 2023-12-22T09:14:35.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T09:14:28.433865+0000', 'modified': '2023-12-22T09:14:32.946073+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6835/4132787606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6833', 'nonce': 4132787606}, {'type': 'v1', 'addr': '172.21.15.132:6835', 'nonce': 4132787606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-22T09:14:35.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T09:14:35.626 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-22T09:14:35.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.848+0000 7fe1acc17640 1 Processor -- start 2023-12-22T09:14:35.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.848+0000 7fe1acc17640 1 -- start start 2023-12-22T09:14:35.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.850+0000 7fe1acc17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1a806aad0 0x7fe1a80c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.850+0000 7fe1acc17640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a80c4660 con 0x7fe1a80c4130 2023-12-22T09:14:35.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.850+0000 7fe1acc17640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a8153d60 con 0x7fe1a81514b0 2023-12-22T09:14:35.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.850+0000 7fe1acc17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8154c50 con 0x7fe1a806aad0 2023-12-22T09:14:35.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.850+0000 7fe19ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe1a80c4130 0x7fe1a80c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49054/0 (socket says 172.21.15.106:49054) 2023-12-22T09:14:35.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.850+0000 7fe19ffff640 1 -- 172.21.15.106:0/2593606989 learned_addr learned my addr 172.21.15.106:0/2593606989 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:35.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.850+0000 7fe1a6d9d640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1a806aad0 0x7fe1a80c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771339036 0 0) 0x7fe1a80c4660 con 0x7fe1a80c4130 2023-12-22T09:14:35.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe194003520 con 0x7fe1a80c4130 2023-12-22T09:14:35.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 268591990 0 0) 0x7fe194003520 con 0x7fe1a80c4130 2023-12-22T09:14:35.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1a806aad0 msgr2=0x7fe1a80c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1a806aad0 0x7fe1a80c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 >> v1:172.21.15.132:6789/0 conn(0x7fe1a81514b0 legacy=0x7fe1a8154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a806b250 con 0x7fe1a80c4130 2023-12-22T09:14:35.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fe190001670 con 0x7fe1a80c4130 2023-12-22T09:14:35.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 >> v1:172.21.15.106:6789/0 conn(0x7fe1a80c4130 legacy=0x7fe1a80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1940039a0 0x7fe194003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1940047c0 0x7fe194004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1a806aad0 0x7fe1940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8154c50 con 0x7fe1940039a0 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19400bab0 con 0x7fe1940047c0 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19400bc70 con 0x7fe1a806aad0 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.851+0000 7fe1a659c640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1940039a0 0x7fe194003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.852+0000 7fe1a659c640 1 -- 172.21.15.106:0/2593606989 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1a806aad0 msgr2=0x7fe1940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.852+0000 7fe1a659c640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1a806aad0 0x7fe1940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.852+0000 7fe1a659c640 1 -- 172.21.15.106:0/2593606989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1940047c0 msgr2=0x7fe194004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.852+0000 7fe1a659c640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1940047c0 0x7fe194004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.852+0000 7fe1a659c640 1 -- 172.21.15.106:0/2593606989 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe194003520 con 0x7fe1940039a0 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.853+0000 7fe1a659c640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1940039a0 0x7fe194003dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe198001750 tx=0x7fe1940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e16e227a88d6e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.853+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980052d0 con 0x7fe1940039a0 2023-12-22T09:14:35.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.853+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19802e050 con 0x7fe1940039a0 2023-12-22T09:14:35.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.853+0000 7fe1a5d9b640 1 -- 172.21.15.106:0/2593606989 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980035f0 con 0x7fe1940039a0 2023-12-22T09:14:35.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.854+0000 7fe1acc17640 1 -- 172.21.15.106:0/2593606989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1940039a0 msgr2=0x7fe194003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.854+0000 7fe1acc17640 1 --2- 172.21.15.106:0/2593606989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1940039a0 0x7fe194003dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe198001750 tx=0x7fe1940057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.854+0000 7fe1a6d9d640 1 -- 172.21.15.106:0/2593606989 reap_dead start 2023-12-22T09:14:35.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.854+0000 7fe1acc17640 1 -- 172.21.15.106:0/2593606989 shutdown_connections 2023-12-22T09:14:35.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.854+0000 7fe1acc17640 1 -- 172.21.15.106:0/2593606989 >> 172.21.15.106:0/2593606989 conn(0x7fe1a80ab1a0 msgr2=0x7fe1a80ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:35.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.854+0000 7fe1acc17640 1 -- 172.21.15.106:0/2593606989 shutdown_connections 2023-12-22T09:14:35.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.854+0000 7fe1acc17640 1 -- 172.21.15.106:0/2593606989 wait complete. 2023-12-22T09:14:35.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.856+0000 7fe1acc17640 1 Processor -- start 2023-12-22T09:14:35.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.856+0000 7fe1acc17640 1 -- start start 2023-12-22T09:14:35.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe1acc17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1940039a0 0x7fe1a81ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe1acc17640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1a81533b0 0x7fe1a81e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe1acc17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1a81e99a0 0x7fe1a8142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe1acc17640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a81ed2f0 con 0x7fe1a81533b0 2023-12-22T09:14:35.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe1acc17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8150cd0 con 0x7fe1a81e99a0 2023-12-22T09:14:35.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe1acc17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8150430 con 0x7fe1940039a0 2023-12-22T09:14:35.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe19ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1a81533b0 0x7fe1a81e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe19ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1a81533b0 0x7fe1a81e9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39858/0 (socket says 172.21.15.106:39858) 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe19ffff640 1 -- 172.21.15.106:0/2178797777 learned_addr learned my addr 172.21.15.106:0/2178797777 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe1a659c640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1940039a0 0x7fe1a81ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.857+0000 7fe1a6d9d640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1a81e99a0 0x7fe1a8142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe19ffff640 1 -- 172.21.15.106:0/2178797777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1940039a0 msgr2=0x7fe1a81ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe19ffff640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1940039a0 0x7fe1a81ecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe19ffff640 1 -- 172.21.15.106:0/2178797777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1a81e99a0 msgr2=0x7fe1a8142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe19ffff640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1a81e99a0 0x7fe1a8142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe19ffff640 1 -- 172.21.15.106:0/2178797777 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8150710 con 0x7fe1a81533b0 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe19ffff640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1a81533b0 0x7fe1a81e9460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe19000c730 tx=0x7fe19000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe19effd640 1 -- 172.21.15.106:0/2178797777 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1900072d0 con 0x7fe1a81533b0 2023-12-22T09:14:35.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe19effd640 1 -- 172.21.15.106:0/2178797777 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe190007430 con 0x7fe1a81533b0 2023-12-22T09:14:35.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe19effd640 1 -- 172.21.15.106:0/2178797777 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1900047e0 con 0x7fe1a81533b0 2023-12-22T09:14:35.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe1acc17640 1 -- 172.21.15.106:0/2178797777 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a81509f0 con 0x7fe1a81533b0 2023-12-22T09:14:35.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.858+0000 7fe1acc17640 1 -- 172.21.15.106:0/2178797777 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a80a9320 con 0x7fe1a81533b0 2023-12-22T09:14:35.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.860+0000 7fe19effd640 1 -- 172.21.15.106:0/2178797777 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe190004b50 con 0x7fe1a81533b0 2023-12-22T09:14:35.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.861+0000 7fe19effd640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe18806a460 0x7fe18806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.861+0000 7fe19effd640 1 -- 172.21.15.106:0/2178797777 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1900881b0 con 0x7fe1a81533b0 2023-12-22T09:14:35.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.861+0000 7fe1a659c640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe18806a460 0x7fe18806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.862+0000 7fe1af785740 1 Processor -- start 2023-12-22T09:14:35.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.862+0000 7fe1a659c640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe18806a460 0x7fe18806c920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe198033000 tx=0x7fe198009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.862+0000 7fe1af785740 1 -- start start 2023-12-22T09:14:35.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.863+0000 7fe1af785740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5e887d0 0x5596b5ec30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.863+0000 7fe1af785740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ec3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.863+0000 7fe1af785740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.863+0000 7fe1af785740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b5df2f80 con 0x5596b5e89860 2023-12-22T09:14:35.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.863+0000 7fe1af785740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b5df0710 con 0x5596b5e88bb0 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.863+0000 7fe1af785740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596b5dec000 con 0x5596b5e887d0 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.863+0000 7fe1a6d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.863+0000 7fe1a6d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39866/0 (socket says 172.21.15.106:39866) 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.863+0000 7fe1a6d9d640 1 -- 172.21.15.106:0/2126091318 learned_addr learned my addr 172.21.15.106:0/2126091318 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe1a659c640 1 --2- 172.21.15.106:0/2126091318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5e887d0 0x5596b5ec30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe19ffff640 1 --2- 172.21.15.106:0/2126091318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ec3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe1a6d9d640 1 -- 172.21.15.106:0/2126091318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5e887d0 msgr2=0x5596b5ec30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe1a6d9d640 1 --2- 172.21.15.106:0/2126091318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5e887d0 0x5596b5ec30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe1a6d9d640 1 -- 172.21.15.106:0/2126091318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 msgr2=0x5596b5ec3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe1a6d9d640 1 --2- 172.21.15.106:0/2126091318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ec3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe1a6d9d640 1 -- 172.21.15.106:0/2126091318 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596b5db3690 con 0x5596b5e89860 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe1a6d9d640 1 --2- 172.21.15.106:0/2126091318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec4630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe194004740 tx=0x7fe1a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d84db5344a4e9a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe187fff640 1 -- 172.21.15.106:0/2126091318 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0010070 con 0x5596b5e89860 2023-12-22T09:14:35.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe187fff640 1 -- 172.21.15.106:0/2126091318 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0011040 con 0x5596b5e89860 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.864+0000 7fe187fff640 1 -- 172.21.15.106:0/2126091318 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0015840 con 0x5596b5e89860 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.865+0000 7fe1af785740 1 -- 172.21.15.106:0/2126091318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 msgr2=0x5596b5ec4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.865+0000 7fe1af785740 1 --2- 172.21.15.106:0/2126091318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec4630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe194004740 tx=0x7fe1a000b040 comp rx=0 tx=0).stop 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.865+0000 7fe1af785740 1 -- 172.21.15.106:0/2126091318 shutdown_connections 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.865+0000 7fe1af785740 1 --2- 172.21.15.106:0/2126091318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec4630 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.865+0000 7fe1af785740 1 --2- 172.21.15.106:0/2126091318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ec3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.865+0000 7fe1af785740 1 --2- 172.21.15.106:0/2126091318 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5e887d0 0x5596b5ec30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.865+0000 7fe1af785740 1 -- 172.21.15.106:0/2126091318 >> 172.21.15.106:0/2126091318 conn(0x5596b5e84ea0 msgr2=0x5596b5ea98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.865+0000 7fe1af785740 1 -- 172.21.15.106:0/2126091318 shutdown_connections 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.865+0000 7fe1af785740 1 -- 172.21.15.106:0/2126091318 wait complete. 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.866+0000 7fe1af785740 1 -- start start 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.866+0000 7fe1af785740 1 Processor -- start 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1af785740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e88bb0 0x5596b5ecc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1af785740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e89860 0x5596b5eabd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1af785740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5ea5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1af785740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b5d8d7d0 con 0x5596b5e88bb0 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1af785740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b5d8d470 con 0x5596b5e89860 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1af785740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596b5b53f20 con 0x5596b5ea59c0 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1af785740 10 client.0 _ll_register_callbacks cb 0x5596b5ddc1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1a659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e88bb0 0x5596b5ecc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1a659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e88bb0 0x5596b5ecc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39876/0 (socket says 172.21.15.106:39876) 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1a659c640 1 -- 172.21.15.106:0/1808701364 learned_addr learned my addr 172.21.15.106:0/1808701364 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.867+0000 7fe1a6d9d640 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5ea5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe19ffff640 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e89860 0x5596b5eabd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1a659c640 1 -- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 msgr2=0x5596b5ea5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1a659c640 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5ea5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1a659c640 1 -- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e89860 msgr2=0x5596b5eabd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1a659c640 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e89860 0x5596b5eabd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1a659c640 1 -- 172.21.15.106:0/1808701364 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a0009d00 con 0x5596b5e88bb0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe19ffff640 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e89860 0x5596b5eabd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1a659c640 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e88bb0 0x5596b5ecc7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe19802bd00 tx=0x7fe19802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bc7f4f95a4dc83 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1857fa640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1857fa640 1 -- 172.21.15.106:0/1808701364 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198006a50 con 0x5596b5e88bb0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1857fa640 1 -- 172.21.15.106:0/1808701364 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe198006bb0 con 0x5596b5e88bb0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.868+0000 7fe1af785740 1 -- 172.21.15.106:0/1808701364 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596b5e16550 con 0x5596b5e88bb0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1857fa640 1 -- 172.21.15.106:0/1808701364 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe198006d70 con 0x5596b5e88bb0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1af785740 10 client.4392 fetch_fsmap learned FSMap version 6 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1af785740 1 -- 172.21.15.106:0/1808701364 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5596b5dea680 con 0x5596b5e88bb0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1857fa640 1 -- 172.21.15.106:0/1808701364 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596b5e16550 con 0x5596b5e88bb0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1857fa640 1 -- 172.21.15.106:0/1808701364 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 6) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe1980035f0 con 0x5596b5e88bb0 2023-12-22T09:14:35.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1af785740 10 client.4392 fetch_fsmap finished waiting for FSMap version 6 2023-12-22T09:14:35.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1af785740 10 client.4392 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-22T09:14:35.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1af785740 20 client.4392 populate_metadata read hostname 'smithi106' 2023-12-22T09:14:35.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1af785740 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x5596b5ed7b30 0x5596b5ed7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1af785740 4 client.4392 mds_command: new command op to 4266 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T09:14:35.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.869+0000 7fe1af785740 1 -- 172.21.15.106:0/1808701364 --> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596b5ddeb50 con 0x5596b5ed7b30 2023-12-22T09:14:35.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.870+0000 7fe19ffff640 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x5596b5ed7b30 0x5596b5ed7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.870+0000 7fe19ffff640 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x5596b5ed7b30 0x5596b5ed7f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ac1d5bdec686005 server_cookie=f7dd5cb2ec703520 in_seq=0 out_seq=0 2023-12-22T09:14:35.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.870+0000 7fe1857fa640 10 client.4392 ms_handle_connect on v2:172.21.15.132:6833/4132787606 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.872+0000 7fe1857fa640 1 -- 172.21.15.106:0/1808701364 <== mds.0 v2:172.21.15.132:6833/4132787606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5596b5ddeb50 con 0x5596b5ed7b30 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.872+0000 7fe1857fa640 10 client.4392 handle_command_reply: tid=0 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 client.4392 shutdown 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 -- 172.21.15.106:0/1808701364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e88bb0 msgr2=0x5596b5ecc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e88bb0 0x5596b5ecc7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe19802bd00 tx=0x7fe19802d000 comp rx=0 tx=0).stop 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 -- 172.21.15.106:0/1808701364 shutdown_connections 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x5596b5ed7b30 0x5596b5ed7f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5ea5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e89860 0x5596b5eabd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 --2- 172.21.15.106:0/1808701364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e88bb0 0x5596b5ecc7a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 -- 172.21.15.106:0/1808701364 >> 172.21.15.106:0/1808701364 conn(0x5596b5e887d0 msgr2=0x5596b5ec8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1857fa640 0 client.4392 ms_handle_reset on v2:172.21.15.132:6833/4132787606 2023-12-22T09:14:35.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 -- 172.21.15.106:0/1808701364 shutdown_connections 2023-12-22T09:14:35.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 1 -- 172.21.15.106:0/1808701364 wait complete. 2023-12-22T09:14:35.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.873+0000 7fe1af785740 20 client.4392 trim_cache size 0 max 16384 2023-12-22T09:14:35.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.889+0000 7fe1af785740 1 Processor -- start 2023-12-22T09:14:35.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.889+0000 7fe1af785740 1 -- start start 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.890+0000 7fe1af785740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ec8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.890+0000 7fe1af785740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.890+0000 7fe1af785740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5ec32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.890+0000 7fe1af785740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b5e9c560 con 0x5596b5e89860 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.890+0000 7fe1af785740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b5ec7bb0 con 0x5596b5e88bb0 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.890+0000 7fe1af785740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596b5ea32c0 con 0x5596b5ea59c0 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.890+0000 7fe19ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.890+0000 7fe19ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39880/0 (socket says 172.21.15.106:39880) 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.890+0000 7fe19ffff640 1 -- 172.21.15.106:0/1311208038 learned_addr learned my addr 172.21.15.106:0/1311208038 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.891+0000 7fe19ffff640 1 -- 172.21.15.106:0/1311208038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 msgr2=0x5596b5ec32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.891+0000 7fe19ffff640 1 --2- 172.21.15.106:0/1311208038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5ec32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.891+0000 7fe19ffff640 1 -- 172.21.15.106:0/1311208038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 msgr2=0x5596b5ec8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.891+0000 7fe19ffff640 1 --2- 172.21.15.106:0/1311208038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ec8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.891+0000 7fe19ffff640 1 -- 172.21.15.106:0/1311208038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596b5d8c9e0 con 0x5596b5e89860 2023-12-22T09:14:35.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.891+0000 7fe19ffff640 1 --2- 172.21.15.106:0/1311208038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec2d70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe190057100 tx=0x7fe19001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2830c2429180db3f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.891+0000 7fe19cff9640 1 -- 172.21.15.106:0/1311208038 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190084070 con 0x5596b5e89860 2023-12-22T09:14:35.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.891+0000 7fe19cff9640 1 -- 172.21.15.106:0/1311208038 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19005afa0 con 0x5596b5e89860 2023-12-22T09:14:35.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.891+0000 7fe19cff9640 1 -- 172.21.15.106:0/1311208038 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19005f150 con 0x5596b5e89860 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.892+0000 7fe1af785740 1 -- 172.21.15.106:0/1311208038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 msgr2=0x5596b5ec2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.892+0000 7fe1af785740 1 --2- 172.21.15.106:0/1311208038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec2d70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe190057100 tx=0x7fe19001e040 comp rx=0 tx=0).stop 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.892+0000 7fe1af785740 1 -- 172.21.15.106:0/1311208038 shutdown_connections 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.892+0000 7fe1af785740 1 --2- 172.21.15.106:0/1311208038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5ec32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.892+0000 7fe1af785740 1 --2- 172.21.15.106:0/1311208038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ec2d70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.892+0000 7fe1af785740 1 --2- 172.21.15.106:0/1311208038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ec8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.892+0000 7fe1af785740 1 -- 172.21.15.106:0/1311208038 >> 172.21.15.106:0/1311208038 conn(0x5596b5e887d0 msgr2=0x5596b5ec1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.892+0000 7fe1af785740 1 -- 172.21.15.106:0/1311208038 shutdown_connections 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.892+0000 7fe1af785740 1 -- 172.21.15.106:0/1311208038 wait complete. 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.893+0000 7fe1af785740 1 -- start start 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.893+0000 7fe1af785740 1 Processor -- start 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe1af785740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ecbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe1af785740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ecacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe1af785740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5f2de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe1af785740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b5ecb200 con 0x5596b5e89860 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe1af785740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b5f2a590 con 0x5596b5e88bb0 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe1af785740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596b5f2d9d0 con 0x5596b5ea59c0 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe1af785740 10 client.0 _ll_register_callbacks cb 0x7fe1a0009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe19ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ecacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe19ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ecacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39888/0 (socket says 172.21.15.106:39888) 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe19ffff640 1 -- 172.21.15.106:0/3477096605 learned_addr learned my addr 172.21.15.106:0/3477096605 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe19ffff640 1 -- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 msgr2=0x5596b5f2de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe19ffff640 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5f2de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe19ffff640 1 -- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 msgr2=0x5596b5ecbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe19ffff640 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ecbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.894+0000 7fe19ffff640 1 -- 172.21.15.106:0/3477096605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a80a9320 con 0x5596b5e89860 2023-12-22T09:14:35.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe19ffff640 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ecacc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe190057100 tx=0x7fe198030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65df4b5a361c86c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:35.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1857fa640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-12-22T09:14:35.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1857fa640 1 -- 172.21.15.106:0/3477096605 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190084030 con 0x5596b5e89860 2023-12-22T09:14:35.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1857fa640 1 -- 172.21.15.106:0/3477096605 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe190055510 con 0x5596b5e89860 2023-12-22T09:14:35.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1af785740 1 -- 172.21.15.106:0/3477096605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1a0011040 con 0x5596b5e89860 2023-12-22T09:14:35.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1857fa640 1 -- 172.21.15.106:0/3477096605 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe190053880 con 0x5596b5e89860 2023-12-22T09:14:35.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1af785740 10 client.4398 fetch_fsmap learned FSMap version 6 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1af785740 1 -- 172.21.15.106:0/3477096605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5596b5db1ef0 con 0x5596b5e89860 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1857fa640 1 -- 172.21.15.106:0/3477096605 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0011040 con 0x5596b5e89860 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1857fa640 1 -- 172.21.15.106:0/3477096605 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 6) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe19005ecc0 con 0x5596b5e89860 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1af785740 10 client.4398 fetch_fsmap finished waiting for FSMap version 6 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1af785740 10 client.4398 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1af785740 20 client.4398 populate_metadata read hostname 'smithi106' 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1af785740 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x5596b5f24720 0x5596b5eb9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1af785740 4 client.4398 mds_command: new command op to 4266 tid=0[{"prefix": "status"}] 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.895+0000 7fe1af785740 1 -- 172.21.15.106:0/3477096605 --> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5596b5de5080 con 0x5596b5f24720 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.896+0000 7fe1a659c640 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x5596b5f24720 0x5596b5eb9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.897+0000 7fe1a659c640 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x5596b5f24720 0x5596b5eb9f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80c7312027b9e2e3 server_cookie=c81cc11a0f237d45 in_seq=0 out_seq=0 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.897+0000 7fe1857fa640 10 client.4398 ms_handle_connect on v2:172.21.15.132:6833/4132787606 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.897+0000 7fe1857fa640 1 -- 172.21.15.106:0/3477096605 <== mds.0 v2:172.21.15.132:6833/4132787606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5596b5de5080 con 0x5596b5f24720 2023-12-22T09:14:35.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.897+0000 7fe1857fa640 10 client.4398 handle_command_reply: tid=0 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.897+0000 7fe1af785740 1 client.4398 shutdown 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 -- 172.21.15.106:0/3477096605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 msgr2=0x5596b5ecacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ecacc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe190057100 tx=0x7fe198030000 comp rx=0 tx=0).stop 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 -- 172.21.15.106:0/3477096605 shutdown_connections 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x5596b5f24720 0x5596b5eb9f00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5596b5ea59c0 0x5596b5f2de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5596b5e89860 0x5596b5ecacc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 --2- 172.21.15.106:0/3477096605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5596b5e88bb0 0x5596b5ecbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1857fa640 0 client.4398 ms_handle_reset on v2:172.21.15.132:6833/4132787606 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 -- 172.21.15.106:0/3477096605 >> 172.21.15.106:0/3477096605 conn(0x5596b5e887d0 msgr2=0x5596b5ec8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 -- 172.21.15.106:0/3477096605 shutdown_connections 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 1 -- 172.21.15.106:0/3477096605 wait complete. 2023-12-22T09:14:35.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.898+0000 7fe1af785740 20 client.4398 trim_cache size 0 max 16384 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "c9422aac-a1e3-428b-87d0-2dbf321c6b46", 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4266, 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 7.4598705350000003, 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 6, 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 25, 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 24, 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 12.496548009 2023-12-22T09:14:35.903 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-12-22T09:14:35.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 -- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe18806a460 msgr2=0x7fe18806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe18806a460 0x7fe18806c920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe198033000 tx=0x7fe198009030 comp rx=0 tx=0).stop 2023-12-22T09:14:35.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 -- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1a81533b0 msgr2=0x7fe1a81e9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:35.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1a81533b0 0x7fe1a81e9460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe19000c730 tx=0x7fe19000cbf0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 -- 172.21.15.106:0/2178797777 shutdown_connections 2023-12-22T09:14:35.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe18806a460 0x7fe18806c920 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1a81e99a0 0x7fe1a8142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1a81533b0 0x7fe1a81e9460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 --2- 172.21.15.106:0/2178797777 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1940039a0 0x7fe1a81ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:35.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 -- 172.21.15.106:0/2178797777 >> 172.21.15.106:0/2178797777 conn(0x7fe1a80ab1a0 msgr2=0x7fe1a81da0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:35.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 -- 172.21.15.106:0/2178797777 shutdown_connections 2023-12-22T09:14:35.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:35.899+0000 7fe1acc17640 1 -- 172.21.15.106:0/2178797777 wait complete. 2023-12-22T09:14:35.916 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-22T09:14:35.916 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-22T09:14:35.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:14:36.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.118+0000 7ffba6b47640 1 Processor -- start 2023-12-22T09:14:36.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.118+0000 7ffba6b47640 1 -- start start 2023-12-22T09:14:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.120+0000 7ffba6b47640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffba0150a80 0x7ffba0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.120+0000 7ffba6b47640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0071ea0 0x7ffba01524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.120+0000 7ffba6b47640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba00bfce0 con 0x7ffba0069e60 2023-12-22T09:14:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.120+0000 7ffba6b47640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba00c0960 con 0x7ffba0150a80 2023-12-22T09:14:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.120+0000 7ffba6b47640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba006aba0 con 0x7ffba0071ea0 2023-12-22T09:14:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffba50e4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0071ea0 0x7ffba01524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffba48e3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ffba0069e60 0x7ffba014a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:39458/0 (socket says 172.21.15.106:39458) 2023-12-22T09:14:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffba48e3640 1 -- 172.21.15.106:0/2347233809 learned_addr learned my addr 172.21.15.106:0/2347233809 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffb9ffff640 1 --2- 172.21.15.106:0/2347233809 >> v2:172.21.15.132:3300/0 conn(0x7ffba0150a80 0x7ffba0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffb9f7fe640 1 -- 172.21.15.106:0/2347233809 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975827413 0 0) 0x7ffba00bfce0 con 0x7ffba0069e60 2023-12-22T09:14:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffb9f7fe640 1 -- 172.21.15.106:0/2347233809 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb90003520 con 0x7ffba0069e60 2023-12-22T09:14:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffba50e4640 1 -- 172.21.15.106:0/2347233809 >> v2:172.21.15.132:3300/0 conn(0x7ffba0150a80 msgr2=0x7ffba0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffba50e4640 1 --2- 172.21.15.106:0/2347233809 >> v2:172.21.15.132:3300/0 conn(0x7ffba0150a80 0x7ffba0151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffba50e4640 1 -- 172.21.15.106:0/2347233809 >> v1:172.21.15.132:6789/0 conn(0x7ffba0069e60 legacy=0x7ffba014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffba50e4640 1 -- 172.21.15.106:0/2347233809 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba00bffc0 con 0x7ffba0071ea0 2023-12-22T09:14:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.121+0000 7ffb9ffff640 1 --2- 172.21.15.106:0/2347233809 >> v2:172.21.15.132:3300/0 conn(0x7ffba0150a80 0x7ffba0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:36.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.123+0000 7ffba50e4640 1 --2- 172.21.15.106:0/2347233809 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0071ea0 0x7ffba01524b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009d90 tx=0x7ffb9802bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0baa2e57751fdd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:36.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.123+0000 7ffb9f7fe640 1 -- 172.21.15.106:0/2347233809 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9802cb40 con 0x7ffba0071ea0 2023-12-22T09:14:36.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffb9f7fe640 1 -- 172.21.15.106:0/2347233809 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9802cca0 con 0x7ffba0071ea0 2023-12-22T09:14:36.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffb9f7fe640 1 -- 172.21.15.106:0/2347233809 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98034660 con 0x7ffba0071ea0 2023-12-22T09:14:36.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffba6b47640 1 -- 172.21.15.106:0/2347233809 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0071ea0 msgr2=0x7ffba01524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:36.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffba6b47640 1 --2- 172.21.15.106:0/2347233809 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0071ea0 0x7ffba01524b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009d90 tx=0x7ffb9802bd90 comp rx=0 tx=0).stop 2023-12-22T09:14:36.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffba6b47640 1 -- 172.21.15.106:0/2347233809 shutdown_connections 2023-12-22T09:14:36.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffba6b47640 1 --2- 172.21.15.106:0/2347233809 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0071ea0 0x7ffba01524b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:36.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffba6b47640 1 --2- 172.21.15.106:0/2347233809 >> v2:172.21.15.132:3300/0 conn(0x7ffba0150a80 0x7ffba0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:36.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffba6b47640 1 -- 172.21.15.106:0/2347233809 >> 172.21.15.106:0/2347233809 conn(0x7ffba00c5360 msgr2=0x7ffba00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:36.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffba6b47640 1 -- 172.21.15.106:0/2347233809 shutdown_connections 2023-12-22T09:14:36.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.124+0000 7ffba6b47640 1 -- 172.21.15.106:0/2347233809 wait complete. 2023-12-22T09:14:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.126+0000 7ffba6b47640 1 Processor -- start 2023-12-22T09:14:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.126+0000 7ffba6b47640 1 -- start start 2023-12-22T09:14:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.127+0000 7ffba6b47640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0069e60 0x7ffba00c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.127+0000 7ffba6b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba0071ea0 0x7ffba0152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.127+0000 7ffba6b47640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba0150a80 0x7ffba0139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.127+0000 7ffba6b47640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0141f70 con 0x7ffba0150a80 2023-12-22T09:14:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.127+0000 7ffba6b47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00c3f90 con 0x7ffba0071ea0 2023-12-22T09:14:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.127+0000 7ffba6b47640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba00c4270 con 0x7ffba0069e60 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.127+0000 7ffba50e4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba0150a80 0x7ffba0139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.127+0000 7ffba50e4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba0150a80 0x7ffba0139920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39892/0 (socket says 172.21.15.106:39892) 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.127+0000 7ffba50e4640 1 -- 172.21.15.106:0/488086160 learned_addr learned my addr 172.21.15.106:0/488086160 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffba48e3640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0069e60 0x7ffba00c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffb9ffff640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba0071ea0 0x7ffba0152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffba50e4640 1 -- 172.21.15.106:0/488086160 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0069e60 msgr2=0x7ffba00c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffba50e4640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0069e60 0x7ffba00c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffba50e4640 1 -- 172.21.15.106:0/488086160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba0071ea0 msgr2=0x7ffba0152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffba50e4640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba0071ea0 0x7ffba0152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffba50e4640 1 -- 172.21.15.106:0/488086160 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c009400 con 0x7ffba0150a80 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffba50e4640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba0150a80 0x7ffba0139920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009d90 tx=0x7ffb98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffb9d7fa640 1 -- 172.21.15.106:0/488086160 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98040650 con 0x7ffba0150a80 2023-12-22T09:14:36.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.128+0000 7ffb9d7fa640 1 -- 172.21.15.106:0/488086160 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb980407b0 con 0x7ffba0150a80 2023-12-22T09:14:36.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.129+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb98009a70 con 0x7ffba0150a80 2023-12-22T09:14:36.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.129+0000 7ffb9d7fa640 1 -- 172.21.15.106:0/488086160 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98040b60 con 0x7ffba0150a80 2023-12-22T09:14:36.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.129+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba00c4830 con 0x7ffba0150a80 2023-12-22T09:14:36.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.130+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba00c4a20 con 0x7ffba0150a80 2023-12-22T09:14:36.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.131+0000 7ffb9d7fa640 1 -- 172.21.15.106:0/488086160 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb98040cc0 con 0x7ffba0150a80 2023-12-22T09:14:36.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.132+0000 7ffb9d7fa640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb8406a460 0x7ffb8406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:36.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.132+0000 7ffb9d7fa640 1 -- 172.21.15.106:0/488086160 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffb980ab6a0 con 0x7ffba0150a80 2023-12-22T09:14:36.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.132+0000 7ffba48e3640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb8406a460 0x7ffb8406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:36.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.133+0000 7ffba48e3640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb8406a460 0x7ffb8406c920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffb94001230 tx=0x7ffb94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:36.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.136+0000 7ffb9d7fa640 1 -- 172.21.15.106:0/488086160 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffb98076b50 con 0x7ffba0150a80 2023-12-22T09:14:36.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.365+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffba0073f10 con 0x7ffba0150a80 2023-12-22T09:14:36.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.366+0000 7ffb9d7fa640 1 -- 172.21.15.106:0/488086160 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7ffb9807a170 con 0x7ffba0150a80 2023-12-22T09:14:36.366 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-22T09:14:36.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.368+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb8406a460 msgr2=0x7ffb8406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:36.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.368+0000 7ffba6b47640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb8406a460 0x7ffb8406c920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffb94001230 tx=0x7ffb94009040 comp rx=0 tx=0).stop 2023-12-22T09:14:36.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.368+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba0150a80 msgr2=0x7ffba0139920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:36.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.368+0000 7ffba6b47640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba0150a80 0x7ffba0139920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009d90 tx=0x7ffb98004a40 comp rx=0 tx=0).stop 2023-12-22T09:14:36.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.369+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 shutdown_connections 2023-12-22T09:14:36.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.369+0000 7ffba6b47640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb8406a460 0x7ffb8406c920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:36.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.369+0000 7ffba6b47640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffba0150a80 0x7ffba0139920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:36.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.369+0000 7ffba6b47640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba0071ea0 0x7ffba0152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:36.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.369+0000 7ffba6b47640 1 --2- 172.21.15.106:0/488086160 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffba0069e60 0x7ffba00c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:36.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.369+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 >> 172.21.15.106:0/488086160 conn(0x7ffba00c5360 msgr2=0x7ffba014e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:36.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.369+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 shutdown_connections 2023-12-22T09:14:36.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:36.369+0000 7ffba6b47640 1 -- 172.21.15.106:0/488086160 wait complete. 2023-12-22T09:14:36.387 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T09:14:36.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:14:36.388 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2023-12-22T09:14:36.388 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-22T09:14:36.388 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-22T09:14:36.388 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T09:14:36.388 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T09:14:36.388 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T09:14:36.388 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-22T09:14:36.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:36.388 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2023-12-22T09:14:36.439 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:14:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:14:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:14:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:14:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-12-22T09:14:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:14:36.439 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42359sec preferred_lft 42359sec 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2023-12-22T09:14:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:14:36.441 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-22T09:14:36.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:36.441 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:14:36.441 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:14:36.441 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2023-12-22T09:14:36.441 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2023-12-22T09:14:36.441 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2023-12-22T09:14:36.441 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-22T09:14:36.442 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:14:36.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:36.924 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:14:36.999 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-12-22T09:14:37.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:37.003 DEBUG:teuthology.orchestra.run.smithi106:> route 2023-12-22T09:14:37.061 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2023-12-22T09:14:37.061 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:14:37.061 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:14:37.062 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:14:37.062 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:14:37.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:37.062 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:14:37.062 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:14:37.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:14:37.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:14:37.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:14:37.062 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:14:37.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:37.784 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-12-22T09:14:37.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:37.836 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2023-12-22T09:14:37.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:37.923 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:14:37.923 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:14:37.923 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-22T09:14:37.923 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-22T09:14:37.923 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:14:38.098 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-22T09:14:38.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:38.098 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:14:38.099 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:14:38.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-22T09:14:38.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-22T09:14:38.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-22T09:14:38.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-22T09:14:38.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-22T09:14:38.099 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:14:38.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:38.361 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:14:38.361 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:14:38.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2023-12-22T09:14:38.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2023-12-22T09:14:38.362 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:14:38.507 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-22T09:14:38.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:14:38.508 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-22T09:14:38.551 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-22T09:14:38.551 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:14:38.552 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-22T09:14:38.644 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2023-12-22T09:14:38.726 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T09:14:38.727 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T09:14:38.799 INFO:teuthology.orchestra.run.smithi106.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T09:14:38.802 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T09:14:38.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:38.803 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2023-12-22T09:14:38.843 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-22T09:14:38.843 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-22T09:14:38.892 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2023-12-22T09:14:38.970 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T09:14:38.970 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T09:14:39.042 INFO:teuthology.orchestra.run.smithi106.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T09:14:39.044 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T09:14:39.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:39.045 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2023-12-22T09:14:39.092 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi106.stderr:2023-12-22T09:14:39.091+0000 7f7ec3045480 -1 init, newargv = 0x559e1df3d630 newargc=15 2023-12-22T09:14:39.092 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi106.stderr:ceph-fuse[95377]: starting ceph client 2023-12-22T09:14:39.105 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi106.stderr:ceph-fuse[95377]: starting fuse 2023-12-22T09:14:40.188 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2023-12-22T09:14:40.292 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T09:14:40.292 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T09:14:40.386 INFO:teuthology.orchestra.run.smithi106.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T09:14:40.389 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T09:14:40.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:40.390 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2023-12-22T09:14:40.444 INFO:teuthology.orchestra.run.smithi106.stdout:40 2023-12-22T09:14:40.444 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2023-12-22T09:14:40.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T09:14:40.444 DEBUG:teuthology.orchestra.run.smithi106:> import glob 2023-12-22T09:14:40.444 DEBUG:teuthology.orchestra.run.smithi106:> import re 2023-12-22T09:14:40.444 DEBUG:teuthology.orchestra.run.smithi106:> import os 2023-12-22T09:14:40.444 DEBUG:teuthology.orchestra.run.smithi106:> import subprocess 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> def _find_admin_socket(client_name): 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> files = glob.glob(asok_path) 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> # Given a non-glob path, it better be there 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> if "*" not in asok_path: 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> assert(len(files) == 1) 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> return files[0] 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> for f in files: 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-22T09:14:40.445 DEBUG:teuthology.orchestra.run.smithi106:> contents = proc_f.read() 2023-12-22T09:14:40.446 DEBUG:teuthology.orchestra.run.smithi106:> if mountpoint in contents: 2023-12-22T09:14:40.446 DEBUG:teuthology.orchestra.run.smithi106:> return f 2023-12-22T09:14:40.446 DEBUG:teuthology.orchestra.run.smithi106:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-22T09:14:40.446 DEBUG:teuthology.orchestra.run.smithi106:> 2023-12-22T09:14:40.446 DEBUG:teuthology.orchestra.run.smithi106:> print(_find_admin_socket("client.admin")) 2023-12-22T09:14:40.446 DEBUG:teuthology.orchestra.run.smithi106:> ' 2023-12-22T09:14:40.624 INFO:teuthology.orchestra.run.smithi106.stdout:/var/run/ceph/ceph-client.admin.95377.asok 2023-12-22T09:14:40.805 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.95377.asok 2023-12-22T09:14:40.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:40.805 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.95377.asok status 2023-12-22T09:14:41.050 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-12-22T09:14:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "metadata": { 2023-12-22T09:14:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_sha1": "24e2e32ab893c11f7e31ee84381b2f961d1b317c", 2023-12-22T09:14:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 18.2.0-1377-g24e2e32a (24e2e32ab893c11f7e31ee84381b2f961d1b317c) reef (stable)", 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "entity_id": "admin", 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": "smithi106", 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "pid": "95377", 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "root": "/" 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_count": 0, 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_pinned_count": 0, 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4404, 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "inst": { 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "name": { 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "client", 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4404 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:14:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 92948995 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.1:0", 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 92948995 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "inst_str": "client.4404 192.168.0.1:0/92948995", 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "addr_str": "192.168.0.1:0/92948995", 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "inode_count": 1, 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_epoch": 6, 2023-12-22T09:14:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch": 25, 2023-12-22T09:14:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch_barrier": 0, 2023-12-22T09:14:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklisted": false, 2023-12-22T09:14:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs" 2023-12-22T09:14:41.053 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-12-22T09:14:41.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:41.065 DEBUG:teuthology.orchestra.run.smithi106:> stat --file-system '--printf=%T 2023-12-22T09:14:41.065 DEBUG:teuthology.orchestra.run.smithi106:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-22T09:14:41.118 INFO:teuthology.orchestra.run.smithi106.stdout:fuseblk 2023-12-22T09:14:41.118 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-22T09:14:41.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:41.119 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-22T09:14:41.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:41.215 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-22T09:14:41.306 INFO:teuthology.orchestra.run.smithi106.stdout:# file: . 2023-12-22T09:14:41.306 INFO:teuthology.orchestra.run.smithi106.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-22T09:14:41.306 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:41.307 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:14:41.307 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:14:41.363 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:41.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.567+0000 7f78e558b640 1 Processor -- start 2023-12-22T09:14:41.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.567+0000 7f78e558b640 1 -- start start 2023-12-22T09:14:41.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.568+0000 7f78e558b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e006a6b0 0x7f78e0152240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:41.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.569+0000 7f78e558b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e006ab00 con 0x7f78e00bfce0 2023-12-22T09:14:41.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.569+0000 7f78e558b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e00bf770 con 0x7f78e013b060 2023-12-22T09:14:41.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.569+0000 7f78e558b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0152780 con 0x7f78e006a6b0 2023-12-22T09:14:41.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.569+0000 7f78de7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f78e00bfce0 0x7f78e0151b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49064/0 (socket says 172.21.15.106:49064) 2023-12-22T09:14:41.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.569+0000 7f78de7fc640 1 -- 172.21.15.106:0/105266161 learned_addr learned my addr 172.21.15.106:0/105266161 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:41.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.569+0000 7f78df7fe640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e006a6b0 0x7f78e0152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:41.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.569+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998746789 0 0) 0x7f78d4001110 con 0x7f78e00bfce0 2023-12-22T09:14:41.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.569+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c8003520 con 0x7f78e00bfce0 2023-12-22T09:14:41.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1202640485 0 0) 0x7f78c8003520 con 0x7f78e00bfce0 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e006a6b0 msgr2=0x7f78e0152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e006a6b0 0x7f78e0152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 >> v1:172.21.15.132:6789/0 conn(0x7f78e013b060 legacy=0x7f78e0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e0155120 con 0x7f78e00bfce0 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f78d4001800 con 0x7f78e00bfce0 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 >> v1:172.21.15.106:6789/0 conn(0x7f78e00bfce0 legacy=0x7f78e0151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e006a6b0 0x7f78c80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78c8003f70 0x7f78c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c8004d00 0x7f78c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0152780 con 0x7f78c8004d00 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c800bb70 con 0x7f78c8003f70 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c800bd30 con 0x7f78e006a6b0 2023-12-22T09:14:41.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78df7fe640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c8004d00 0x7f78c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:41.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78deffd640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e006a6b0 0x7f78c80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:41.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.570+0000 7f78de7fc640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78c8003f70 0x7f78c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:41.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.571+0000 7f78df7fe640 1 -- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e006a6b0 msgr2=0x7f78c80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:41.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.571+0000 7f78df7fe640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e006a6b0 0x7f78c80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.571+0000 7f78df7fe640 1 -- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78c8003f70 msgr2=0x7f78c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:41.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.571+0000 7f78df7fe640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78c8003f70 0x7f78c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.571+0000 7f78df7fe640 1 -- 172.21.15.106:0/105266161 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8003520 con 0x7f78c8004d00 2023-12-22T09:14:41.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.572+0000 7f78df7fe640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c8004d00 0x7f78c8005180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009fc0 tx=0x7f78c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d527816ed4b3dd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:41.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.572+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d802cc20 con 0x7f78c8004d00 2023-12-22T09:14:41.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.572+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d800f040 con 0x7f78c8004d00 2023-12-22T09:14:41.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.572+0000 7f78ddffb640 1 -- 172.21.15.106:0/105266161 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8034440 con 0x7f78c8004d00 2023-12-22T09:14:41.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.572+0000 7f78e558b640 1 -- 172.21.15.106:0/105266161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c8004d00 msgr2=0x7f78c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:41.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.572+0000 7f78e558b640 1 --2- 172.21.15.106:0/105266161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c8004d00 0x7f78c8005180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009fc0 tx=0x7f78c80057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.572+0000 7f78df7fe640 1 -- 172.21.15.106:0/105266161 reap_dead start 2023-12-22T09:14:41.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.573+0000 7f78e558b640 1 -- 172.21.15.106:0/105266161 shutdown_connections 2023-12-22T09:14:41.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.573+0000 7f78e558b640 1 -- 172.21.15.106:0/105266161 >> 172.21.15.106:0/105266161 conn(0x7f78e00c5360 msgr2=0x7f78e00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:41.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.573+0000 7f78e558b640 1 -- 172.21.15.106:0/105266161 shutdown_connections 2023-12-22T09:14:41.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.573+0000 7f78e558b640 1 -- 172.21.15.106:0/105266161 wait complete. 2023-12-22T09:14:41.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.574+0000 7f78e558b640 1 Processor -- start 2023-12-22T09:14:41.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.574+0000 7f78e558b640 1 -- start start 2023-12-22T09:14:41.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.575+0000 7f78e558b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78e01dd740 0x7f78e0070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:41.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.575+0000 7f78e558b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e01ddb20 0x7f78e01e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.575+0000 7f78e558b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e00c4df0 0x7f78e01ea040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.575+0000 7f78e558b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e01ea580 con 0x7f78e00c4df0 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.575+0000 7f78e558b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0137d00 con 0x7f78e01dd740 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.575+0000 7f78e558b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0137ed0 con 0x7f78e01ddb20 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78df7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e00c4df0 0x7f78e01ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78df7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e00c4df0 0x7f78e01ea040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39914/0 (socket says 172.21.15.106:39914) 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78df7fe640 1 -- 172.21.15.106:0/709127674 learned_addr learned my addr 172.21.15.106:0/709127674 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78deffd640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78e01dd740 0x7f78e0070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78de7fc640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e01ddb20 0x7f78e01e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78df7fe640 1 -- 172.21.15.106:0/709127674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e01ddb20 msgr2=0x7f78e01e9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78df7fe640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e01ddb20 0x7f78e01e9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78df7fe640 1 -- 172.21.15.106:0/709127674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78e01dd740 msgr2=0x7f78e0070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78df7fe640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78e01dd740 0x7f78e0070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78df7fe640 1 -- 172.21.15.106:0/709127674 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e01e9640 con 0x7f78e00c4df0 2023-12-22T09:14:41.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.576+0000 7f78df7fe640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e00c4df0 0x7f78e01ea040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f78d802c690 tx=0x7f78d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:41.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.577+0000 7f78c77fe640 1 -- 172.21.15.106:0/709127674 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8034cd0 con 0x7f78e00c4df0 2023-12-22T09:14:41.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.577+0000 7f78c77fe640 1 -- 172.21.15.106:0/709127674 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d8034e30 con 0x7f78e00c4df0 2023-12-22T09:14:41.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.577+0000 7f78c77fe640 1 -- 172.21.15.106:0/709127674 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8003b90 con 0x7f78e00c4df0 2023-12-22T09:14:41.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.577+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e014f9a0 con 0x7f78e00c4df0 2023-12-22T09:14:41.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.577+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e0150ec0 con 0x7f78e00c4df0 2023-12-22T09:14:41.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.578+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e01e9820 con 0x7f78e00c4df0 2023-12-22T09:14:41.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.579+0000 7f78c77fe640 1 -- 172.21.15.106:0/709127674 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f78d803e440 con 0x7f78e00c4df0 2023-12-22T09:14:41.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.580+0000 7f78c77fe640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78cc06a460 0x7f78cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:41.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.581+0000 7f78c77fe640 1 -- 172.21.15.106:0/709127674 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f78d80aa800 con 0x7f78e00c4df0 2023-12-22T09:14:41.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.581+0000 7f78deffd640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78cc06a460 0x7f78cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:41.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.581+0000 7f78deffd640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78cc06a460 0x7f78cc06c920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f78d0000c00 tx=0x7f78d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:41.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.585+0000 7f78c77fe640 1 -- 172.21.15.106:0/709127674 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f78e01e9820 con 0x7f78e00c4df0 2023-12-22T09:14:41.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.778+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78e01e9820 con 0x7f78e00c4df0 2023-12-22T09:14:41.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.781+0000 7f78c77fe640 1 -- 172.21.15.106:0/709127674 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f78e01e9820 con 0x7f78e00c4df0 2023-12-22T09:14:41.782 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:41.782 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:41.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.784+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78cc06a460 msgr2=0x7f78cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:41.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.784+0000 7f78e558b640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78cc06a460 0x7f78cc06c920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f78d0000c00 tx=0x7f78d0009040 comp rx=0 tx=0).stop 2023-12-22T09:14:41.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.784+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e00c4df0 msgr2=0x7f78e01ea040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:41.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.784+0000 7f78e558b640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e00c4df0 0x7f78e01ea040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f78d802c690 tx=0x7f78d8009750 comp rx=0 tx=0).stop 2023-12-22T09:14:41.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.785+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 shutdown_connections 2023-12-22T09:14:41.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.785+0000 7f78e558b640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78cc06a460 0x7f78cc06c920 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.785+0000 7f78e558b640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e00c4df0 0x7f78e01ea040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.785+0000 7f78e558b640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f78e01ddb20 0x7f78e01e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.785+0000 7f78e558b640 1 --2- 172.21.15.106:0/709127674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78e01dd740 0x7f78e0070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:41.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.785+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 >> 172.21.15.106:0/709127674 conn(0x7f78e00c5360 msgr2=0x7f78e0139550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:41.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.785+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 shutdown_connections 2023-12-22T09:14:41.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:41.785+0000 7f78e558b640 1 -- 172.21.15.106:0/709127674 wait complete. 2023-12-22T09:14:41.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:14:41.805 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:14:42.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.015+0000 7fd62a50a640 1 Processor -- start 2023-12-22T09:14:42.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.015+0000 7fd62a50a640 1 -- start start 2023-12-22T09:14:42.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.016+0000 7fd62a50a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd62406c840 0x7fd624155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.016+0000 7fd62a50a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62414e1b0 con 0x7fd6240c5460 2023-12-22T09:14:42.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.016+0000 7fd62a50a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6241548c0 con 0x7fd6241557d0 2023-12-22T09:14:42.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.016+0000 7fd62a50a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240c63c0 con 0x7fd62406c840 2023-12-22T09:14:42.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd623fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd6240c5460 0x7fd6240c5840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49072/0 (socket says 172.21.15.106:49072) 2023-12-22T09:14:42.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd623fff640 1 -- 172.21.15.106:0/2297391207 learned_addr learned my addr 172.21.15.106:0/2297391207 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:42.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226295675 0 0) 0x7fd62414e1b0 con 0x7fd6240c5460 2023-12-22T09:14:42.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd60c003520 con 0x7fd6240c5460 2023-12-22T09:14:42.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd6237fe640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd62406c840 0x7fd624155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 671524674 0 0) 0x7fd60c003520 con 0x7fd6240c5460 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd62406c840 msgr2=0x7fd624155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd622ffd640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd62406c840 0x7fd624155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 >> v1:172.21.15.132:6789/0 conn(0x7fd6241557d0 legacy=0x7fd62415e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62406ada0 con 0x7fd6240c5460 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.017+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fd614001670 con 0x7fd6240c5460 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 >> v1:172.21.15.106:6789/0 conn(0x7fd6240c5460 legacy=0x7fd6240c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd622ffd640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd60c0039a0 0x7fd60c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd622ffd640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd60c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd622ffd640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd62406c840 0x7fd60c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240c63c0 con 0x7fd60c0047c0 2023-12-22T09:14:42.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c00bb10 con 0x7fd60c0039a0 2023-12-22T09:14:42.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c00bcd0 con 0x7fd62406c840 2023-12-22T09:14:42.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd6237fe640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd60c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd623fff640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd60c0039a0 0x7fd60c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd628aa7640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd62406c840 0x7fd60c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd6237fe640 1 -- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd62406c840 msgr2=0x7fd60c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:42.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd6237fe640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd62406c840 0x7fd60c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd6237fe640 1 -- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd60c0039a0 msgr2=0x7fd60c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:42.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd6237fe640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd60c0039a0 0x7fd60c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.018+0000 7fd6237fe640 1 -- 172.21.15.106:0/2297391207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c003520 con 0x7fd60c0047c0 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.019+0000 7fd6237fe640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd60c004c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd61800ba30 tx=0x7fd60c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc4994c0b46e530 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.020+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618032640 con 0x7fd60c0047c0 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.020+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6180327a0 con 0x7fd60c0047c0 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.020+0000 7fd622ffd640 1 -- 172.21.15.106:0/2297391207 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618032b30 con 0x7fd60c0047c0 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.020+0000 7fd62a50a640 1 -- 172.21.15.106:0/2297391207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 msgr2=0x7fd60c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.020+0000 7fd62a50a640 1 --2- 172.21.15.106:0/2297391207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd60c004c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd61800ba30 tx=0x7fd60c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.020+0000 7fd628aa7640 1 -- 172.21.15.106:0/2297391207 reap_dead start 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.021+0000 7fd62a50a640 1 -- 172.21.15.106:0/2297391207 shutdown_connections 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.021+0000 7fd62a50a640 1 -- 172.21.15.106:0/2297391207 >> 172.21.15.106:0/2297391207 conn(0x7fd6240a90d0 msgr2=0x7fd6240a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.021+0000 7fd62a50a640 1 -- 172.21.15.106:0/2297391207 shutdown_connections 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.021+0000 7fd62a50a640 1 -- 172.21.15.106:0/2297391207 wait complete. 2023-12-22T09:14:42.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.022+0000 7fd62a50a640 1 Processor -- start 2023-12-22T09:14:42.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.023+0000 7fd62a50a640 1 -- start start 2023-12-22T09:14:42.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.023+0000 7fd62a50a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd624157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.023+0000 7fd62a50a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6240ac970 0x7fd62414cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.023+0000 7fd62a50a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6240acdf0 0x7fd62414d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.023+0000 7fd62a50a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6241e8fd0 con 0x7fd60c0047c0 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.023+0000 7fd62a50a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6241e91e0 con 0x7fd6240ac970 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.023+0000 7fd62a50a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6241e94c0 con 0x7fd6240acdf0 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd623fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd624157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd623fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd624157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39932/0 (socket says 172.21.15.106:39932) 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd623fff640 1 -- 172.21.15.106:0/3424799975 learned_addr learned my addr 172.21.15.106:0/3424799975 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd628aa7640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6240acdf0 0x7fd62414d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd6237fe640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6240ac970 0x7fd62414cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd623fff640 1 -- 172.21.15.106:0/3424799975 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6240acdf0 msgr2=0x7fd62414d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd623fff640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6240acdf0 0x7fd62414d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd623fff640 1 -- 172.21.15.106:0/3424799975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6240ac970 msgr2=0x7fd62414cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd623fff640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6240ac970 0x7fd62414cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd623fff640 1 -- 172.21.15.106:0/3424799975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6241e97a0 con 0x7fd60c0047c0 2023-12-22T09:14:42.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.024+0000 7fd623fff640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd624157a60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd61400e7f0 tx=0x7fd61400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:42.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.025+0000 7fd620ff9640 1 -- 172.21.15.106:0/3424799975 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61400c870 con 0x7fd60c0047c0 2023-12-22T09:14:42.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.025+0000 7fd620ff9640 1 -- 172.21.15.106:0/3424799975 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61400c9d0 con 0x7fd60c0047c0 2023-12-22T09:14:42.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.025+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6241e9a80 con 0x7fd60c0047c0 2023-12-22T09:14:42.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.025+0000 7fd620ff9640 1 -- 172.21.15.106:0/3424799975 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61400cd80 con 0x7fd60c0047c0 2023-12-22T09:14:42.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.025+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6241554f0 con 0x7fd60c0047c0 2023-12-22T09:14:42.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.026+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd624073f10 con 0x7fd60c0047c0 2023-12-22T09:14:42.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.027+0000 7fd620ff9640 1 -- 172.21.15.106:0/3424799975 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd61401d460 con 0x7fd60c0047c0 2023-12-22T09:14:42.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.028+0000 7fd620ff9640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd61006a430 0x7fd61006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.028+0000 7fd620ff9640 1 -- 172.21.15.106:0/3424799975 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd614088c00 con 0x7fd60c0047c0 2023-12-22T09:14:42.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.029+0000 7fd6237fe640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd61006a430 0x7fd61006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.029+0000 7fd6237fe640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd61006a430 0x7fd61006c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd61800ba00 tx=0x7fd61803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:42.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.033+0000 7fd620ff9640 1 -- 172.21.15.106:0/3424799975 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd614053ef0 con 0x7fd60c0047c0 2023-12-22T09:14:42.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.221+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6240c3e00 con 0x7fd60c0047c0 2023-12-22T09:14:42.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.221+0000 7fd620ff9640 1 -- 172.21.15.106:0/3424799975 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd614001570 con 0x7fd60c0047c0 2023-12-22T09:14:42.222 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:14:42.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd61006a430 msgr2=0x7fd61006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd61006a430 0x7fd61006c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd61800ba00 tx=0x7fd61803d040 comp rx=0 tx=0).stop 2023-12-22T09:14:42.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 msgr2=0x7fd624157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd624157a60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd61400e7f0 tx=0x7fd61400ecb0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 shutdown_connections 2023-12-22T09:14:42.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd61006a430 0x7fd61006c8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6240acdf0 0x7fd62414d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6240ac970 0x7fd62414cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 --2- 172.21.15.106:0/3424799975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd60c0047c0 0x7fd624157a60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.224+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 >> 172.21.15.106:0/3424799975 conn(0x7fd6240a90d0 msgr2=0x7fd62406f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:42.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.225+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 shutdown_connections 2023-12-22T09:14:42.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.225+0000 7fd62a50a640 1 -- 172.21.15.106:0/3424799975 wait complete. 2023-12-22T09:14:42.245 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:14:42.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.446+0000 7f5464d6c640 1 Processor -- start 2023-12-22T09:14:42.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.446+0000 7f5464d6c640 1 -- start start 2023-12-22T09:14:42.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.447+0000 7f5464d6c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f54600a8360 0x7f54600a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.448+0000 7f5464d6c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600c0050 0x7f5460152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.448+0000 7f5464d6c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54601550b0 con 0x7f54600bfb40 2023-12-22T09:14:42.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.448+0000 7f5464d6c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600a93d0 con 0x7f54600a8360 2023-12-22T09:14:42.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.448+0000 7f5464d6c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5460155390 con 0x7f54600c0050 2023-12-22T09:14:42.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.448+0000 7f5457fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f54600bfb40 0x7f5460151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:39490/0 (socket says 172.21.15.106:39490) 2023-12-22T09:14:42.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.448+0000 7f5457fff640 1 -- 172.21.15.106:0/2527186426 learned_addr learned my addr 172.21.15.106:0/2527186426 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:42.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.448+0000 7f545ffff640 1 --2- 172.21.15.106:0/2527186426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600c0050 0x7f5460152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.448+0000 7f545f7fe640 1 --2- 172.21.15.106:0/2527186426 >> v2:172.21.15.132:3300/0 conn(0x7f54600a8360 0x7f54600a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.449+0000 7f545ffff640 1 -- 172.21.15.106:0/2527186426 >> v2:172.21.15.132:3300/0 conn(0x7f54600a8360 msgr2=0x7f54600a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:42.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.449+0000 7f545ffff640 1 --2- 172.21.15.106:0/2527186426 >> v2:172.21.15.132:3300/0 conn(0x7f54600a8360 0x7f54600a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.449+0000 7f545ffff640 1 -- 172.21.15.106:0/2527186426 >> v1:172.21.15.132:6789/0 conn(0x7f54600bfb40 legacy=0x7f5460151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.449+0000 7f545ffff640 1 -- 172.21.15.106:0/2527186426 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460155670 con 0x7f54600c0050 2023-12-22T09:14:42.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.449+0000 7f545effd640 1 -- 172.21.15.106:0/2527186426 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389663577 0 0) 0x7f54601550b0 con 0x7f54600bfb40 2023-12-22T09:14:42.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.450+0000 7f545ffff640 1 --2- 172.21.15.106:0/2527186426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600c0050 0x7f5460152250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5458009d90 tx=0x7f545802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e5c9cbc2afc31f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:42.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.451+0000 7f545effd640 1 -- 172.21.15.106:0/2527186426 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545802cbc0 con 0x7f54600c0050 2023-12-22T09:14:42.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.451+0000 7f545effd640 1 -- 172.21.15.106:0/2527186426 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545802cd20 con 0x7f54600c0050 2023-12-22T09:14:42.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.451+0000 7f545effd640 1 -- 172.21.15.106:0/2527186426 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458034660 con 0x7f54600c0050 2023-12-22T09:14:42.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.451+0000 7f5464d6c640 1 -- 172.21.15.106:0/2527186426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600c0050 msgr2=0x7f5460152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.451+0000 7f5464d6c640 1 --2- 172.21.15.106:0/2527186426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600c0050 0x7f5460152250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5458009d90 tx=0x7f545802be10 comp rx=0 tx=0).stop 2023-12-22T09:14:42.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.451+0000 7f5464d6c640 1 -- 172.21.15.106:0/2527186426 shutdown_connections 2023-12-22T09:14:42.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.451+0000 7f5464d6c640 1 --2- 172.21.15.106:0/2527186426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600c0050 0x7f5460152250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.451+0000 7f5464d6c640 1 --2- 172.21.15.106:0/2527186426 >> v2:172.21.15.132:3300/0 conn(0x7f54600a8360 0x7f54600a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.451+0000 7f5464d6c640 1 -- 172.21.15.106:0/2527186426 >> 172.21.15.106:0/2527186426 conn(0x7f5460069bf0 msgr2=0x7f5460069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:42.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.452+0000 7f5464d6c640 1 -- 172.21.15.106:0/2527186426 shutdown_connections 2023-12-22T09:14:42.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.452+0000 7f5464d6c640 1 -- 172.21.15.106:0/2527186426 wait complete. 2023-12-22T09:14:42.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.453+0000 7f5464d6c640 1 Processor -- start 2023-12-22T09:14:42.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.453+0000 7f5464d6c640 1 -- start start 2023-12-22T09:14:42.455 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.454+0000 7f5464d6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54600a8360 0x7f546014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.454+0000 7f5464d6c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600bfb40 0x7f5460144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.454+0000 7f5464d6c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54600c0050 0x7f5460144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.454+0000 7f5464d6c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5460145400 con 0x7f54600c0050 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.454+0000 7f5464d6c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54601e7860 con 0x7f54600a8360 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.454+0000 7f5464d6c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54601e6990 con 0x7f54600bfb40 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54600c0050 0x7f5460144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54600c0050 0x7f5460144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39934/0 (socket says 172.21.15.106:39934) 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545ffff640 1 -- 172.21.15.106:0/3001813915 learned_addr learned my addr 172.21.15.106:0/3001813915 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545f7fe640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54600a8360 0x7f546014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f5457fff640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600bfb40 0x7f5460144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545ffff640 1 -- 172.21.15.106:0/3001813915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600bfb40 msgr2=0x7f5460144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545ffff640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600bfb40 0x7f5460144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545ffff640 1 -- 172.21.15.106:0/3001813915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54600a8360 msgr2=0x7f546014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545ffff640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54600a8360 0x7f546014ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545ffff640 1 -- 172.21.15.106:0/3001813915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458009a70 con 0x7f54600c0050 2023-12-22T09:14:42.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f5457fff640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600bfb40 0x7f5460144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:42.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.455+0000 7f545ffff640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54600c0050 0x7f5460144ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5458009d90 tx=0x7f5458004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:42.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.456+0000 7f545cff9640 1 -- 172.21.15.106:0/3001813915 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458040650 con 0x7f54600c0050 2023-12-22T09:14:42.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.456+0000 7f545cff9640 1 -- 172.21.15.106:0/3001813915 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545802ce90 con 0x7f54600c0050 2023-12-22T09:14:42.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.456+0000 7f545cff9640 1 -- 172.21.15.106:0/3001813915 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54580409f0 con 0x7f54600c0050 2023-12-22T09:14:42.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.456+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54601e6c50 con 0x7f54600c0050 2023-12-22T09:14:42.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.456+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54601e7210 con 0x7f54600c0050 2023-12-22T09:14:42.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.457+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546004e8d0 con 0x7f54600c0050 2023-12-22T09:14:42.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.458+0000 7f545cff9640 1 -- 172.21.15.106:0/3001813915 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5458040b50 con 0x7f54600c0050 2023-12-22T09:14:42.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.459+0000 7f545cff9640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f544006a430 0x7f544006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.459+0000 7f545cff9640 1 -- 172.21.15.106:0/3001813915 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f54580ab850 con 0x7f54600c0050 2023-12-22T09:14:42.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.459+0000 7f545f7fe640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f544006a430 0x7f544006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.460+0000 7f545f7fe640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f544006a430 0x7f544006c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5450009ad0 tx=0x7f5450008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:42.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.463+0000 7f545cff9640 1 -- 172.21.15.106:0/3001813915 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5458076c60 con 0x7f54600c0050 2023-12-22T09:14:42.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.651+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54600c57f0 con 0x7f54600c0050 2023-12-22T09:14:42.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.652+0000 7f545cff9640 1 -- 172.21.15.106:0/3001813915 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5458009450 con 0x7f54600c0050 2023-12-22T09:14:42.653 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:14:42.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.654+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f544006a430 msgr2=0x7f544006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.654+0000 7f5464d6c640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f544006a430 0x7f544006c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5450009ad0 tx=0x7f5450008040 comp rx=0 tx=0).stop 2023-12-22T09:14:42.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.654+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54600c0050 msgr2=0x7f5460144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.654+0000 7f5464d6c640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54600c0050 0x7f5460144ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5458009d90 tx=0x7f5458004a40 comp rx=0 tx=0).stop 2023-12-22T09:14:42.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.655+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 shutdown_connections 2023-12-22T09:14:42.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.655+0000 7f5464d6c640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f544006a430 0x7f544006c8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.655+0000 7f5464d6c640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54600c0050 0x7f5460144ec0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.655+0000 7f5464d6c640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54600bfb40 0x7f5460144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.655+0000 7f5464d6c640 1 --2- 172.21.15.106:0/3001813915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54600a8360 0x7f546014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.655+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 >> 172.21.15.106:0/3001813915 conn(0x7f5460069bf0 msgr2=0x7f54600c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:42.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.655+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 shutdown_connections 2023-12-22T09:14:42.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.655+0000 7f5464d6c640 1 -- 172.21.15.106:0/3001813915 wait complete. 2023-12-22T09:14:42.672 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:14:42.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.891+0000 7f7346aec640 1 Processor -- start 2023-12-22T09:14:42.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.891+0000 7f7346aec640 1 -- start start 2023-12-22T09:14:42.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.892+0000 7f7346aec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f734014dfe0 0x7f7340154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.892+0000 7f7346aec640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7340071890 0x7f73400c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.892+0000 7f7346aec640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7340150cc0 con 0x7f7340151760 2023-12-22T09:14:42.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7346aec640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7340150ab0 con 0x7f7340071890 2023-12-22T09:14:42.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7346aec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7340072130 con 0x7f734014dfe0 2023-12-22T09:14:42.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7345089640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7340071890 0x7f73400c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7345089640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7340071890 0x7f73400c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51966/0 (socket says 172.21.15.106:51966) 2023-12-22T09:14:42.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7345089640 1 -- 172.21.15.106:0/3540194101 learned_addr learned my addr 172.21.15.106:0/3540194101 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:42.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7344888640 1 --2- 172.21.15.106:0/3540194101 >> v2:172.21.15.132:3300/0 conn(0x7f734014dfe0 0x7f7340154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7345089640 1 -- 172.21.15.106:0/3540194101 >> v2:172.21.15.132:3300/0 conn(0x7f734014dfe0 msgr2=0x7f7340154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:42.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7345089640 1 --2- 172.21.15.106:0/3540194101 >> v2:172.21.15.132:3300/0 conn(0x7f734014dfe0 0x7f7340154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7345089640 1 -- 172.21.15.106:0/3540194101 >> v1:172.21.15.106:6789/0 conn(0x7f7340151760 legacy=0x7f73400a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f7345089640 1 -- 172.21.15.106:0/3540194101 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340154ff0 con 0x7f7340071890 2023-12-22T09:14:42.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.893+0000 7f733f7fe640 1 -- 172.21.15.106:0/3540194101 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666698560 0 0) 0x7f7340150cc0 con 0x7f7340151760 2023-12-22T09:14:42.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.894+0000 7f7345089640 1 --2- 172.21.15.106:0/3540194101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 0x7f73400c2010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f734006abb0 tx=0x7f733802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e0c4047f4a66c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:42.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.895+0000 7f733f7fe640 1 -- 172.21.15.106:0/3540194101 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733802ca80 con 0x7f7340071890 2023-12-22T09:14:42.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.895+0000 7f733f7fe640 1 -- 172.21.15.106:0/3540194101 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733802cbe0 con 0x7f7340071890 2023-12-22T09:14:42.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.895+0000 7f733f7fe640 1 -- 172.21.15.106:0/3540194101 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73380343f0 con 0x7f7340071890 2023-12-22T09:14:42.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.895+0000 7f7346aec640 1 -- 172.21.15.106:0/3540194101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 msgr2=0x7f73400c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.895+0000 7f7346aec640 1 --2- 172.21.15.106:0/3540194101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 0x7f73400c2010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f734006abb0 tx=0x7f733802bee0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.895+0000 7f7346aec640 1 -- 172.21.15.106:0/3540194101 shutdown_connections 2023-12-22T09:14:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.895+0000 7f7346aec640 1 --2- 172.21.15.106:0/3540194101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 0x7f73400c2010 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.895+0000 7f7346aec640 1 --2- 172.21.15.106:0/3540194101 >> v2:172.21.15.132:3300/0 conn(0x7f734014dfe0 0x7f7340154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.895+0000 7f7346aec640 1 -- 172.21.15.106:0/3540194101 >> 172.21.15.106:0/3540194101 conn(0x7f7340069dd0 msgr2=0x7f734006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.896+0000 7f7346aec640 1 -- 172.21.15.106:0/3540194101 shutdown_connections 2023-12-22T09:14:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.896+0000 7f7346aec640 1 -- 172.21.15.106:0/3540194101 wait complete. 2023-12-22T09:14:42.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.897+0000 7f7346aec640 1 Processor -- start 2023-12-22T09:14:42.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.897+0000 7f7346aec640 1 -- start start 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.898+0000 7f7346aec640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 0x7f73400c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.898+0000 7f7346aec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f734014dfe0 0x7f73400c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.898+0000 7f7346aec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7340151760 0x7f73401417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.898+0000 7f7346aec640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734013f910 con 0x7f7340071890 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.898+0000 7f7346aec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400c4fc0 con 0x7f7340151760 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.898+0000 7f7346aec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7340154640 con 0x7f734014dfe0 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.898+0000 7f7344888640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 0x7f73400c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.898+0000 7f7344888640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 0x7f73400c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51980/0 (socket says 172.21.15.106:51980) 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.898+0000 7f7344888640 1 -- 172.21.15.106:0/3834179741 learned_addr learned my addr 172.21.15.106:0/3834179741 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f7344888640 1 -- 172.21.15.106:0/3834179741 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f734014dfe0 msgr2=0x7f73400c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f7344888640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f734014dfe0 0x7f73400c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f7344888640 1 -- 172.21.15.106:0/3834179741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7340151760 msgr2=0x7f73401417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:42.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f7344888640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7340151760 0x7f73401417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:42.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f7344888640 1 -- 172.21.15.106:0/3834179741 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338009b30 con 0x7f7340071890 2023-12-22T09:14:42.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f7344888640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 0x7f73400c4540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f733400d800 tx=0x7f733400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:42.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f733d7fa640 1 -- 172.21.15.106:0/3834179741 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733400b6c0 con 0x7f7340071890 2023-12-22T09:14:42.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f733d7fa640 1 -- 172.21.15.106:0/3834179741 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733400b820 con 0x7f7340071890 2023-12-22T09:14:42.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734006d940 con 0x7f7340071890 2023-12-22T09:14:42.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.899+0000 7f733d7fa640 1 -- 172.21.15.106:0/3834179741 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733400bbb0 con 0x7f7340071890 2023-12-22T09:14:42.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.900+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734013f530 con 0x7f7340071890 2023-12-22T09:14:42.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.901+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73400734a0 con 0x7f7340071890 2023-12-22T09:14:42.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.902+0000 7f733d7fa640 1 -- 172.21.15.106:0/3834179741 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f733400bd10 con 0x7f7340071890 2023-12-22T09:14:42.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.902+0000 7f733d7fa640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f732c06a430 0x7f732c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:42.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.903+0000 7f733d7fa640 1 -- 172.21.15.106:0/3834179741 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7334089100 con 0x7f7340071890 2023-12-22T09:14:42.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.903+0000 7f733ffff640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f732c06a430 0x7f732c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:42.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.903+0000 7f733ffff640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f732c06a430 0x7f732c06c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f734006e000 tx=0x7f7330007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:42.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:42.907+0000 7f733d7fa640 1 -- 172.21.15.106:0/3834179741 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f73340543f0 con 0x7f7340071890 2023-12-22T09:14:43.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.099+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f734013f6c0 con 0x7f7340071890 2023-12-22T09:14:43.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.100+0000 7f733d7fa640 1 -- 172.21.15.106:0/3834179741 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7334057a10 con 0x7f7340071890 2023-12-22T09:14:43.100 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:14:43.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f732c06a430 msgr2=0x7f732c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f732c06a430 0x7f732c06c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f734006e000 tx=0x7f7330007930 comp rx=0 tx=0).stop 2023-12-22T09:14:43.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 msgr2=0x7f73400c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 0x7f73400c4540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f733400d800 tx=0x7f733400dcc0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 shutdown_connections 2023-12-22T09:14:43.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f732c06a430 0x7f732c06c8f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7340151760 0x7f73401417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f734014dfe0 0x7f73400c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 --2- 172.21.15.106:0/3834179741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7340071890 0x7f73400c4540 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.102+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 >> 172.21.15.106:0/3834179741 conn(0x7f7340069dd0 msgr2=0x7f73400c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:43.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.103+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 shutdown_connections 2023-12-22T09:14:43.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.103+0000 7f7346aec640 1 -- 172.21.15.106:0/3834179741 wait complete. 2023-12-22T09:14:43.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:14:43.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.336+0000 7f1b8b4d5640 1 Processor -- start 2023-12-22T09:14:43.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.336+0000 7f1b8b4d5640 1 -- start start 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b8b4d5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1b840c5ca0 0x7f1b84150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b8b4d5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 0x7f1b840710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b8b4d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b8406bdc0 0x7f1b8414a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b8b4d5640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b84070000 con 0x7f1b840c5ca0 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b8b4d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b840702e0 con 0x7f1b8406bdc0 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b8b4d5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840705c0 con 0x7f1b84071e30 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b89271640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1b840c5ca0 0x7f1b84150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b89271640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1b840c5ca0 0x7f1b84150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51988/0 (socket says 172.21.15.106:51988) 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b89271640 1 -- 172.21.15.106:0/4261889937 learned_addr learned my addr 172.21.15.106:0/4261889937 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b88a70640 1 --2- 172.21.15.106:0/4261889937 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 0x7f1b840710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.338+0000 7f1b89a72640 1 --2- 172.21.15.106:0/4261889937 >> v2:172.21.15.132:3300/0 conn(0x7f1b8406bdc0 0x7f1b8414a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.339+0000 7f1b89271640 1 -- 172.21.15.106:0/4261889937 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 msgr2=0x7f1b840710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:43.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.339+0000 7f1b89271640 1 --2- 172.21.15.106:0/4261889937 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 0x7f1b840710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.339+0000 7f1b89271640 1 -- 172.21.15.106:0/4261889937 >> v2:172.21.15.132:3300/0 conn(0x7f1b8406bdc0 msgr2=0x7f1b8414a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:43.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.339+0000 7f1b89271640 1 --2- 172.21.15.106:0/4261889937 >> v2:172.21.15.132:3300/0 conn(0x7f1b8406bdc0 0x7f1b8414a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.339+0000 7f1b89271640 1 -- 172.21.15.106:0/4261889937 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b840708a0 con 0x7f1b840c5ca0 2023-12-22T09:14:43.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.339+0000 7f1b89a72640 1 --2- 172.21.15.106:0/4261889937 >> v2:172.21.15.132:3300/0 conn(0x7f1b8406bdc0 0x7f1b8414a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.340+0000 7f1b89271640 1 --2- 172.21.15.106:0/4261889937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b840c5ca0 0x7f1b84150af0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b840a8500 tx=0x7f1b8002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5a6322b0dca777 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.340+0000 7f1b7bfff640 1 -- 172.21.15.106:0/4261889937 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b800317e0 con 0x7f1b840c5ca0 2023-12-22T09:14:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.340+0000 7f1b7bfff640 1 -- 172.21.15.106:0/4261889937 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b80031940 con 0x7f1b840c5ca0 2023-12-22T09:14:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.340+0000 7f1b7bfff640 1 -- 172.21.15.106:0/4261889937 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80031cd0 con 0x7f1b840c5ca0 2023-12-22T09:14:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.340+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4261889937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b840c5ca0 msgr2=0x7f1b84150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.340+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4261889937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b840c5ca0 0x7f1b84150af0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b840a8500 tx=0x7f1b8002b880 comp rx=0 tx=0).stop 2023-12-22T09:14:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.341+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4261889937 shutdown_connections 2023-12-22T09:14:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.341+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4261889937 >> v2:172.21.15.132:3300/0 conn(0x7f1b8406bdc0 0x7f1b8414a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.341+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4261889937 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 0x7f1b840710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.341+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4261889937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b840c5ca0 0x7f1b84150af0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.341+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4261889937 >> 172.21.15.106:0/4261889937 conn(0x7f1b8406a220 msgr2=0x7f1b840c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.341+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4261889937 shutdown_connections 2023-12-22T09:14:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.341+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4261889937 wait complete. 2023-12-22T09:14:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.343+0000 7f1b8b4d5640 1 Processor -- start 2023-12-22T09:14:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.343+0000 7f1b8b4d5640 1 -- start start 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b8b4d5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b8406bdc0 0x7f1b84146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b8b4d5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 0x7f1b840baa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b8b4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b840c5ca0 0x7f1b840be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b8b4d5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84155040 con 0x7f1b8406bdc0 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b8b4d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840baf50 con 0x7f1b840c5ca0 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b8b4d5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840bf160 con 0x7f1b84071e30 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89271640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b8406bdc0 0x7f1b84146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89271640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b8406bdc0 0x7f1b84146860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52004/0 (socket says 172.21.15.106:52004) 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89271640 1 -- 172.21.15.106:0/4116661105 learned_addr learned my addr 172.21.15.106:0/4116661105 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b88a70640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 0x7f1b840baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89a72640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b840c5ca0 0x7f1b840be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89271640 1 -- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 msgr2=0x7f1b840baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89271640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 0x7f1b840baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89271640 1 -- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b840c5ca0 msgr2=0x7f1b840be7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89271640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b840c5ca0 0x7f1b840be7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89271640 1 -- 172.21.15.106:0/4116661105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800094d0 con 0x7f1b8406bdc0 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b88a70640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 0x7f1b840baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.344+0000 7f1b89a72640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b840c5ca0 0x7f1b840be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.345+0000 7f1b89271640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b8406bdc0 0x7f1b84146860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b80000c00 tx=0x7f1b800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.345+0000 7f1b79ffb640 1 -- 172.21.15.106:0/4116661105 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80032880 con 0x7f1b8406bdc0 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.345+0000 7f1b79ffb640 1 -- 172.21.15.106:0/4116661105 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b80032a20 con 0x7f1b8406bdc0 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.345+0000 7f1b79ffb640 1 -- 172.21.15.106:0/4116661105 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80032dd0 con 0x7f1b8406bdc0 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.345+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b84154a80 con 0x7f1b8406bdc0 2023-12-22T09:14:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.345+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b84153410 con 0x7f1b8406bdc0 2023-12-22T09:14:43.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.346+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b84153270 con 0x7f1b8406bdc0 2023-12-22T09:14:43.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.347+0000 7f1b79ffb640 1 -- 172.21.15.106:0/4116661105 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1b8004e450 con 0x7f1b8406bdc0 2023-12-22T09:14:43.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.348+0000 7f1b79ffb640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b6806a460 0x7f1b6806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.348+0000 7f1b79ffb640 1 -- 172.21.15.106:0/4116661105 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b800aad10 con 0x7f1b8406bdc0 2023-12-22T09:14:43.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.348+0000 7f1b88a70640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b6806a460 0x7f1b6806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.349+0000 7f1b88a70640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b6806a460 0x7f1b6806c920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b840bf690 tx=0x7f1b74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:43.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.352+0000 7f1b79ffb640 1 -- 172.21.15.106:0/4116661105 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1b84153270 con 0x7f1b8406bdc0 2023-12-22T09:14:43.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.540+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1b84153270 con 0x7f1b8406bdc0 2023-12-22T09:14:43.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.541+0000 7f1b79ffb640 1 -- 172.21.15.106:0/4116661105 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1b84153270 con 0x7f1b8406bdc0 2023-12-22T09:14:43.542 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:14:43.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b6806a460 msgr2=0x7f1b6806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b6806a460 0x7f1b6806c920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b840bf690 tx=0x7f1b74008040 comp rx=0 tx=0).stop 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b8406bdc0 msgr2=0x7f1b84146860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b8406bdc0 0x7f1b84146860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b80000c00 tx=0x7f1b800046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 shutdown_connections 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b6806a460 0x7f1b6806c920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b840c5ca0 0x7f1b840be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b84071e30 0x7f1b840baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 --2- 172.21.15.106:0/4116661105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b8406bdc0 0x7f1b84146860 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 >> 172.21.15.106:0/4116661105 conn(0x7f1b8406a220 msgr2=0x7f1b840c4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 shutdown_connections 2023-12-22T09:14:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.544+0000 7f1b8b4d5640 1 -- 172.21.15.106:0/4116661105 wait complete. 2023-12-22T09:14:43.564 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T09:14:43.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.775+0000 7fc11dd3e640 1 Processor -- start 2023-12-22T09:14:43.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.775+0000 7fc11dd3e640 1 -- start start 2023-12-22T09:14:43.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.777+0000 7fc11dd3e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc11814f370 0x7fc118071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.777+0000 7fc11dd3e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1181551c0 0x7fc11806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.777+0000 7fc11dd3e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11806c510 con 0x7fc118071570 2023-12-22T09:14:43.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.777+0000 7fc11dd3e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11806c1e0 con 0x7fc11814f370 2023-12-22T09:14:43.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.777+0000 7fc11dd3e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc118071a30 con 0x7fc1181551c0 2023-12-22T09:14:43.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.777+0000 7fc1177fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc11814f370 0x7fc118071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.777+0000 7fc1177fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc11814f370 0x7fc118071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52014/0 (socket says 172.21.15.106:52014) 2023-12-22T09:14:43.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.777+0000 7fc1177fe640 1 -- 172.21.15.106:0/1425246073 learned_addr learned my addr 172.21.15.106:0/1425246073 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:43.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.777+0000 7fc117fff640 1 --2- 172.21.15.106:0/1425246073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1181551c0 0x7fc11806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.778+0000 7fc1177fe640 1 -- 172.21.15.106:0/1425246073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1181551c0 msgr2=0x7fc11806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:43.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.778+0000 7fc1177fe640 1 --2- 172.21.15.106:0/1425246073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1181551c0 0x7fc11806c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.778+0000 7fc1177fe640 1 -- 172.21.15.106:0/1425246073 >> v1:172.21.15.132:6789/0 conn(0x7fc118071570 legacy=0x7fc118069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.778+0000 7fc1177fe640 1 -- 172.21.15.106:0/1425246073 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118071d10 con 0x7fc11814f370 2023-12-22T09:14:43.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.779+0000 7fc1177fe640 1 --2- 172.21.15.106:0/1425246073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc11814f370 0x7fc118071030 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc108009ea0 tx=0x7fc10802bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279f7d52113bdba5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:43.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.779+0000 7fc1167fc640 1 -- 172.21.15.106:0/1425246073 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10802cb40 con 0x7fc11814f370 2023-12-22T09:14:43.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.779+0000 7fc1167fc640 1 -- 172.21.15.106:0/1425246073 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10802cca0 con 0x7fc11814f370 2023-12-22T09:14:43.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.779+0000 7fc1167fc640 1 -- 172.21.15.106:0/1425246073 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108034610 con 0x7fc11814f370 2023-12-22T09:14:43.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.780+0000 7fc11dd3e640 1 -- 172.21.15.106:0/1425246073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc11814f370 msgr2=0x7fc118071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.780+0000 7fc11dd3e640 1 --2- 172.21.15.106:0/1425246073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc11814f370 0x7fc118071030 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc108009ea0 tx=0x7fc10802bfa0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.780+0000 7fc11dd3e640 1 -- 172.21.15.106:0/1425246073 shutdown_connections 2023-12-22T09:14:43.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.780+0000 7fc11dd3e640 1 --2- 172.21.15.106:0/1425246073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc1181551c0 0x7fc11806c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.780+0000 7fc11dd3e640 1 --2- 172.21.15.106:0/1425246073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc11814f370 0x7fc118071030 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.780+0000 7fc11dd3e640 1 -- 172.21.15.106:0/1425246073 >> 172.21.15.106:0/1425246073 conn(0x7fc1180c1db0 msgr2=0x7fc1180c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:43.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.780+0000 7fc11dd3e640 1 -- 172.21.15.106:0/1425246073 shutdown_connections 2023-12-22T09:14:43.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.780+0000 7fc11dd3e640 1 -- 172.21.15.106:0/1425246073 wait complete. 2023-12-22T09:14:43.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.782+0000 7fc11dd3e640 1 Processor -- start 2023-12-22T09:14:43.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.782+0000 7fc11dd3e640 1 -- start start 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc11dd3e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc118071570 0x7fc118146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc11dd3e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc11814f370 0x7fc118144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc11dd3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1181551c0 0x7fc118144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc11dd3e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180c50f0 con 0x7fc118071570 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc11dd3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180c5f40 con 0x7fc1181551c0 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc11dd3e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180c5980 con 0x7fc11814f370 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc1177fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc118071570 0x7fc118146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc1177fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc118071570 0x7fc118146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52030/0 (socket says 172.21.15.106:52030) 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc1177fe640 1 -- 172.21.15.106:0/802088710 learned_addr learned my addr 172.21.15.106:0/802088710 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc117fff640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1181551c0 0x7fc118144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.783+0000 7fc116ffd640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc11814f370 0x7fc118144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc1177fe640 1 -- 172.21.15.106:0/802088710 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc11814f370 msgr2=0x7fc118144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc1177fe640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc11814f370 0x7fc118144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc1177fe640 1 -- 172.21.15.106:0/802088710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1181551c0 msgr2=0x7fc118144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc1177fe640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1181551c0 0x7fc118144590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc1177fe640 1 -- 172.21.15.106:0/802088710 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc108009b30 con 0x7fc118071570 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc1177fe640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc118071570 0x7fc118146480 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc108000f80 tx=0x7fc108004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc10ffff640 1 -- 172.21.15.106:0/802088710 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108009510 con 0x7fc118071570 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc10ffff640 1 -- 172.21.15.106:0/802088710 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10803e450 con 0x7fc118071570 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1180c5c60 con 0x7fc118071570 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc10ffff640 1 -- 172.21.15.106:0/802088710 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10803e800 con 0x7fc118071570 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.784+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1181469c0 con 0x7fc118071570 2023-12-22T09:14:43.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.786+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc118073f10 con 0x7fc118071570 2023-12-22T09:14:43.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.787+0000 7fc10ffff640 1 -- 172.21.15.106:0/802088710 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc10803e960 con 0x7fc118071570 2023-12-22T09:14:43.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.788+0000 7fc10ffff640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc0f806a460 0x7fc0f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:43.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.788+0000 7fc10ffff640 1 -- 172.21.15.106:0/802088710 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1080ab9d0 con 0x7fc118071570 2023-12-22T09:14:43.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.788+0000 7fc116ffd640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc0f806a460 0x7fc0f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:43.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.788+0000 7fc116ffd640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc0f806a460 0x7fc0f806c920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1181defa0 tx=0x7fc100009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:43.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.792+0000 7fc10ffff640 1 -- 172.21.15.106:0/802088710 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc108076de0 con 0x7fc118071570 2023-12-22T09:14:43.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.997+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc11806bf20 con 0x7fc118071570 2023-12-22T09:14:43.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:43.998+0000 7fc10ffff640 1 -- 172.21.15.106:0/802088710 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc10807a400 con 0x7fc118071570 2023-12-22T09:14:43.999 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc0f806a460 msgr2=0x7fc0f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc0f806a460 0x7fc0f806c920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1181defa0 tx=0x7fc100009040 comp rx=0 tx=0).stop 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc118071570 msgr2=0x7fc118146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc118071570 0x7fc118146480 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc108000f80 tx=0x7fc108004a40 comp rx=0 tx=0).stop 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 shutdown_connections 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc0f806a460 0x7fc0f806c920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1181551c0 0x7fc118144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc11814f370 0x7fc118144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 --2- 172.21.15.106:0/802088710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc118071570 0x7fc118146480 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 >> 172.21.15.106:0/802088710 conn(0x7fc1180c1db0 msgr2=0x7fc1180c2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:44.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 shutdown_connections 2023-12-22T09:14:44.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.001+0000 7fc11dd3e640 1 -- 172.21.15.106:0/802088710 wait complete. 2023-12-22T09:14:44.019 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:14:44.019 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:14:44.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:44.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.334+0000 7fe6d5c5f640 1 Processor -- start 2023-12-22T09:14:44.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.334+0000 7fe6d5c5f640 1 -- start start 2023-12-22T09:14:44.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.335+0000 7fe6d5c5f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe6d013b060 0x7fe6d006a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.335+0000 7fe6d5c5f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d0151b30 0x7fe6d0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.336+0000 7fe6d5c5f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00bf770 con 0x7fe6d00bfce0 2023-12-22T09:14:44.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.336+0000 7fe6d5c5f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d0155120 con 0x7fe6d013b060 2023-12-22T09:14:44.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.336+0000 7fe6d5c5f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0155400 con 0x7fe6d0151b30 2023-12-22T09:14:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.336+0000 7fe6cffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d0151b30 0x7fe6d0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.336+0000 7fe6c7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe6d00bfce0 0x7fe6d0069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:38484/0 (socket says 172.21.15.106:38484) 2023-12-22T09:14:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.336+0000 7fe6c7fff640 1 -- 172.21.15.106:0/459511349 learned_addr learned my addr 172.21.15.106:0/459511349 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:44.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.336+0000 7fe6cf7fe640 1 --2- 172.21.15.106:0/459511349 >> v2:172.21.15.132:3300/0 conn(0x7fe6d013b060 0x7fe6d006a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.337+0000 7fe6ceffd640 1 -- 172.21.15.106:0/459511349 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948908428 0 0) 0x7fe6d00bf770 con 0x7fe6d00bfce0 2023-12-22T09:14:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.337+0000 7fe6ceffd640 1 -- 172.21.15.106:0/459511349 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6bc003520 con 0x7fe6d00bfce0 2023-12-22T09:14:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.337+0000 7fe6cffff640 1 -- 172.21.15.106:0/459511349 >> v2:172.21.15.132:3300/0 conn(0x7fe6d013b060 msgr2=0x7fe6d006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.337+0000 7fe6cffff640 1 --2- 172.21.15.106:0/459511349 >> v2:172.21.15.132:3300/0 conn(0x7fe6d013b060 0x7fe6d006a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.337+0000 7fe6cffff640 1 -- 172.21.15.106:0/459511349 >> v1:172.21.15.132:6789/0 conn(0x7fe6d00bfce0 legacy=0x7fe6d0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.337+0000 7fe6cffff640 1 -- 172.21.15.106:0/459511349 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d01556e0 con 0x7fe6d0151b30 2023-12-22T09:14:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.338+0000 7fe6cffff640 1 --2- 172.21.15.106:0/459511349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d0151b30 0x7fe6d0151f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009d90 tx=0x7fe6c802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbcbb92508a44184 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:44.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6ceffd640 1 -- 172.21.15.106:0/459511349 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c802cbc0 con 0x7fe6d0151b30 2023-12-22T09:14:44.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6ceffd640 1 -- 172.21.15.106:0/459511349 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c802cd20 con 0x7fe6d0151b30 2023-12-22T09:14:44.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6ceffd640 1 -- 172.21.15.106:0/459511349 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8034660 con 0x7fe6d0151b30 2023-12-22T09:14:44.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/459511349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d0151b30 msgr2=0x7fe6d0151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6d5c5f640 1 --2- 172.21.15.106:0/459511349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d0151b30 0x7fe6d0151f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009d90 tx=0x7fe6c802be10 comp rx=0 tx=0).stop 2023-12-22T09:14:44.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/459511349 shutdown_connections 2023-12-22T09:14:44.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6d5c5f640 1 --2- 172.21.15.106:0/459511349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d0151b30 0x7fe6d0151f80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6d5c5f640 1 --2- 172.21.15.106:0/459511349 >> v2:172.21.15.132:3300/0 conn(0x7fe6d013b060 0x7fe6d006a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/459511349 >> 172.21.15.106:0/459511349 conn(0x7fe6d00c5360 msgr2=0x7fe6d00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:44.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.339+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/459511349 shutdown_connections 2023-12-22T09:14:44.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.340+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/459511349 wait complete. 2023-12-22T09:14:44.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.341+0000 7fe6d5c5f640 1 Processor -- start 2023-12-22T09:14:44.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.341+0000 7fe6d5c5f640 1 -- start start 2023-12-22T09:14:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.342+0000 7fe6d5c5f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d00bfce0 0x7fe6d01db7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.342+0000 7fe6d5c5f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d013b060 0x7fe6d00c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.342+0000 7fe6d5c5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6d0151b30 0x7fe6d01e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.342+0000 7fe6d5c5f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01e78e0 con 0x7fe6d00bfce0 2023-12-22T09:14:44.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.342+0000 7fe6d5c5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01dbdc0 con 0x7fe6d0151b30 2023-12-22T09:14:44.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.342+0000 7fe6d5c5f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00c4120 con 0x7fe6d013b060 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cf7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d00bfce0 0x7fe6d01db7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cf7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d00bfce0 0x7fe6d01db7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52032/0 (socket says 172.21.15.106:52032) 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cf7fe640 1 -- 172.21.15.106:0/930938265 learned_addr learned my addr 172.21.15.106:0/930938265 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6c7fff640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d013b060 0x7fe6d00c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cf7fe640 1 -- 172.21.15.106:0/930938265 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d013b060 msgr2=0x7fe6d00c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cf7fe640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d013b060 0x7fe6d00c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cf7fe640 1 -- 172.21.15.106:0/930938265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6d0151b30 msgr2=0x7fe6d01e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cffff640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6d0151b30 0x7fe6d01e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cf7fe640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6d0151b30 0x7fe6d01e73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cf7fe640 1 -- 172.21.15.106:0/930938265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8009a70 con 0x7fe6d00bfce0 2023-12-22T09:14:44.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.343+0000 7fe6cf7fe640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d00bfce0 0x7fe6d01db7e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000e870 tx=0x7fe6c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:44.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.344+0000 7fe6ccff9640 1 -- 172.21.15.106:0/930938265 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00095c0 con 0x7fe6d00bfce0 2023-12-22T09:14:44.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.344+0000 7fe6ccff9640 1 -- 172.21.15.106:0/930938265 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c000c940 con 0x7fe6d00bfce0 2023-12-22T09:14:44.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.344+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d00c4400 con 0x7fe6d00bfce0 2023-12-22T09:14:44.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.344+0000 7fe6ccff9640 1 -- 172.21.15.106:0/930938265 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c000ccb0 con 0x7fe6d00bfce0 2023-12-22T09:14:44.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.344+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d0138370 con 0x7fe6d00bfce0 2023-12-22T09:14:44.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.345+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d00c3f80 con 0x7fe6d00bfce0 2023-12-22T09:14:44.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.346+0000 7fe6ccff9640 1 -- 172.21.15.106:0/930938265 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe6c0013470 con 0x7fe6d00bfce0 2023-12-22T09:14:44.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.347+0000 7fe6ccff9640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6b006a430 0x7fe6b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.347+0000 7fe6ccff9640 1 -- 172.21.15.106:0/930938265 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe6c00891d0 con 0x7fe6d00bfce0 2023-12-22T09:14:44.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.347+0000 7fe6c7fff640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6b006a430 0x7fe6b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.348+0000 7fe6c7fff640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6b006a430 0x7fe6b006c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80011e0 tx=0x7fe6b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:44.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.352+0000 7fe6ccff9640 1 -- 172.21.15.106:0/930938265 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe6d00c3f80 con 0x7fe6d00bfce0 2023-12-22T09:14:44.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.546+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6d00c3f80 con 0x7fe6d00bfce0 2023-12-22T09:14:44.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.548+0000 7fe6ccff9640 1 -- 172.21.15.106:0/930938265 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fe6d00c3f80 con 0x7fe6d00bfce0 2023-12-22T09:14:44.549 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:44.549 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:44.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6b006a430 msgr2=0x7fe6b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6b006a430 0x7fe6b006c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80011e0 tx=0x7fe6b8009040 comp rx=0 tx=0).stop 2023-12-22T09:14:44.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d00bfce0 msgr2=0x7fe6d01db7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d00bfce0 0x7fe6d01db7e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000e870 tx=0x7fe6c000ed30 comp rx=0 tx=0).stop 2023-12-22T09:14:44.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 shutdown_connections 2023-12-22T09:14:44.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6b006a430 0x7fe6b006c8f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6d0151b30 0x7fe6d01e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe6d013b060 0x7fe6d00c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 --2- 172.21.15.106:0/930938265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d00bfce0 0x7fe6d01db7e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 >> 172.21.15.106:0/930938265 conn(0x7fe6d00c5360 msgr2=0x7fe6d0151f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:44.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 shutdown_connections 2023-12-22T09:14:44.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.551+0000 7fe6d5c5f640 1 -- 172.21.15.106:0/930938265 wait complete. 2023-12-22T09:14:44.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:14:44.571 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:14:44.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.786+0000 7f96cb9fd640 1 Processor -- start 2023-12-22T09:14:44.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.786+0000 7f96cb9fd640 1 -- start start 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.787+0000 7f96cb9fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f96c40c1910 0x7f96c4151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.787+0000 7f96cb9fd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f96c406b960 0x7f96c40c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.787+0000 7f96cb9fd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c4155120 con 0x7f96c414f090 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96cb9fd640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c406e080 con 0x7f96c406b960 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96cb9fd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c4155fa0 con 0x7f96c40c1910 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96c9799640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f96c414f090 0x7f96c4155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41128/0 (socket says 172.21.15.106:41128) 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96c9799640 1 -- 172.21.15.106:0/2013064421 learned_addr learned my addr 172.21.15.106:0/2013064421 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96c9f9a640 1 --2- 172.21.15.106:0/2013064421 >> v2:172.21.15.106:3300/0 conn(0x7f96c406b960 0x7f96c40c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96c8f98640 1 --2- 172.21.15.106:0/2013064421 >> v2:172.21.15.132:3300/0 conn(0x7f96c40c1910 0x7f96c4151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96c9f9a640 1 -- 172.21.15.106:0/2013064421 >> v2:172.21.15.132:3300/0 conn(0x7f96c40c1910 msgr2=0x7f96c4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96c9f9a640 1 --2- 172.21.15.106:0/2013064421 >> v2:172.21.15.132:3300/0 conn(0x7f96c40c1910 0x7f96c4151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96c9f9a640 1 -- 172.21.15.106:0/2013064421 >> v1:172.21.15.106:6789/0 conn(0x7f96c414f090 legacy=0x7f96c4155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.788+0000 7f96c9f9a640 1 -- 172.21.15.106:0/2013064421 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40a8720 con 0x7f96c406b960 2023-12-22T09:14:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.790+0000 7f96c9f9a640 1 --2- 172.21.15.106:0/2013064421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 0x7f96c40c2010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f96c40c2ef0 tx=0x7f96bc02be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae3325348711a1f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.790+0000 7f96bbfff640 1 -- 172.21.15.106:0/2013064421 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc02cbe0 con 0x7f96c406b960 2023-12-22T09:14:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.790+0000 7f96bbfff640 1 -- 172.21.15.106:0/2013064421 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc02cd40 con 0x7f96c406b960 2023-12-22T09:14:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.790+0000 7f96bbfff640 1 -- 172.21.15.106:0/2013064421 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc034660 con 0x7f96c406b960 2023-12-22T09:14:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.790+0000 7f96cb9fd640 1 -- 172.21.15.106:0/2013064421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 msgr2=0x7f96c40c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.790+0000 7f96cb9fd640 1 --2- 172.21.15.106:0/2013064421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 0x7f96c40c2010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f96c40c2ef0 tx=0x7f96bc02be30 comp rx=0 tx=0).stop 2023-12-22T09:14:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.791+0000 7f96cb9fd640 1 -- 172.21.15.106:0/2013064421 shutdown_connections 2023-12-22T09:14:44.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.791+0000 7f96cb9fd640 1 --2- 172.21.15.106:0/2013064421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 0x7f96c40c2010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.791+0000 7f96cb9fd640 1 --2- 172.21.15.106:0/2013064421 >> v2:172.21.15.132:3300/0 conn(0x7f96c40c1910 0x7f96c4151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.791+0000 7f96cb9fd640 1 -- 172.21.15.106:0/2013064421 >> 172.21.15.106:0/2013064421 conn(0x7f96c4069dd0 msgr2=0x7f96c406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:44.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.791+0000 7f96cb9fd640 1 -- 172.21.15.106:0/2013064421 shutdown_connections 2023-12-22T09:14:44.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.791+0000 7f96cb9fd640 1 -- 172.21.15.106:0/2013064421 wait complete. 2023-12-22T09:14:44.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.792+0000 7f96cb9fd640 1 Processor -- start 2023-12-22T09:14:44.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.792+0000 7f96cb9fd640 1 -- start start 2023-12-22T09:14:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.793+0000 7f96cb9fd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 0x7f96c40c0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.793+0000 7f96cb9fd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96c40c1910 0x7f96c4144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.793+0000 7f96cb9fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96c414f090 0x7f96c41452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.793+0000 7f96cb9fd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4148ff0 con 0x7f96c406b960 2023-12-22T09:14:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.793+0000 7f96cb9fd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4148470 con 0x7f96c414f090 2023-12-22T09:14:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.793+0000 7f96cb9fd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4148750 con 0x7f96c40c1910 2023-12-22T09:14:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.793+0000 7f96c9799640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 0x7f96c40c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c9799640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 0x7f96c40c0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52062/0 (socket says 172.21.15.106:52062) 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c9799640 1 -- 172.21.15.106:0/3673477495 learned_addr learned my addr 172.21.15.106:0/3673477495 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c8f98640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96c40c1910 0x7f96c4144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c9f9a640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96c414f090 0x7f96c41452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c9799640 1 -- 172.21.15.106:0/3673477495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96c40c1910 msgr2=0x7f96c4144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c9799640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96c40c1910 0x7f96c4144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c9799640 1 -- 172.21.15.106:0/3673477495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96c414f090 msgr2=0x7f96c41452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c9799640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96c414f090 0x7f96c41452f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c9799640 1 -- 172.21.15.106:0/3673477495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc009a70 con 0x7f96c406b960 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.794+0000 7f96c9799640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 0x7f96c40c0630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c480 tx=0x7f96c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.795+0000 7f96b9ffb640 1 -- 172.21.15.106:0/3673477495 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0005ce0 con 0x7f96c406b960 2023-12-22T09:14:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.795+0000 7f96b9ffb640 1 -- 172.21.15.106:0/3673477495 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c0005e40 con 0x7f96c406b960 2023-12-22T09:14:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.795+0000 7f96b9ffb640 1 -- 172.21.15.106:0/3673477495 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c00072f0 con 0x7f96c406b960 2023-12-22T09:14:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.795+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c4148a30 con 0x7f96c406b960 2023-12-22T09:14:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.795+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c40c0b70 con 0x7f96c406b960 2023-12-22T09:14:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.796+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4073f10 con 0x7f96c406b960 2023-12-22T09:14:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.797+0000 7f96b9ffb640 1 -- 172.21.15.106:0/3673477495 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96c0007510 con 0x7f96c406b960 2023-12-22T09:14:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.798+0000 7f96b9ffb640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f96a806a430 0x7f96a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.798+0000 7f96b9ffb640 1 -- 172.21.15.106:0/3673477495 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96c0088120 con 0x7f96c406b960 2023-12-22T09:14:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.798+0000 7f96c8f98640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f96a806a430 0x7f96a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:44.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.799+0000 7f96c8f98640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f96a806a430 0x7f96a806c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96c4155090 tx=0x7f96b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.802+0000 7f96b9ffb640 1 -- 172.21.15.106:0/3673477495 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f96c00534c0 con 0x7f96c406b960 2023-12-22T09:14:44.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.991+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96c41e8f10 con 0x7f96c406b960 2023-12-22T09:14:44.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.991+0000 7f96b9ffb640 1 -- 172.21.15.106:0/3673477495 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96c0056ae0 con 0x7f96c406b960 2023-12-22T09:14:44.992 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:14:44.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.993+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f96a806a430 msgr2=0x7f96a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.993+0000 7f96cb9fd640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f96a806a430 0x7f96a806c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96c4155090 tx=0x7f96b4008040 comp rx=0 tx=0).stop 2023-12-22T09:14:44.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.993+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 msgr2=0x7f96c40c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:44.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.993+0000 7f96cb9fd640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 0x7f96c40c0630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c480 tx=0x7f96c000c940 comp rx=0 tx=0).stop 2023-12-22T09:14:44.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.994+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 shutdown_connections 2023-12-22T09:14:44.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.994+0000 7f96cb9fd640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f96a806a430 0x7f96a806c8f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.994+0000 7f96cb9fd640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96c414f090 0x7f96c41452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.994+0000 7f96cb9fd640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96c40c1910 0x7f96c4144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.994+0000 7f96cb9fd640 1 --2- 172.21.15.106:0/3673477495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96c406b960 0x7f96c40c0630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:44.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.994+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 >> 172.21.15.106:0/3673477495 conn(0x7f96c4069dd0 msgr2=0x7f96c40a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:44.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.994+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 shutdown_connections 2023-12-22T09:14:44.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:44.994+0000 7f96cb9fd640 1 -- 172.21.15.106:0/3673477495 wait complete. 2023-12-22T09:14:45.011 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:14:45.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.219+0000 7f2344755640 1 Processor -- start 2023-12-22T09:14:45.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.219+0000 7f2344755640 1 -- start start 2023-12-22T09:14:45.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.220+0000 7f2344755640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c0c5a30 0x7f233c0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.220+0000 7f2344755640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f233c06bdc0 0x7f233c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.220+0000 7f2344755640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c14f570 con 0x7f233c06c2d0 2023-12-22T09:14:45.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.220+0000 7f2344755640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c0a90f0 con 0x7f233c06bdc0 2023-12-22T09:14:45.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.220+0000 7f2344755640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c0b00 con 0x7f233c0c5a30 2023-12-22T09:14:45.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.221+0000 7f2341cf0640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f233c06bdc0 0x7f233c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.221+0000 7f2341cf0640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f233c06bdc0 0x7f233c1550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52070/0 (socket says 172.21.15.106:52070) 2023-12-22T09:14:45.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.221+0000 7f2341cf0640 1 -- 172.21.15.106:0/4289116697 learned_addr learned my addr 172.21.15.106:0/4289116697 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:45.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.221+0000 7f23424f1640 1 --2- 172.21.15.106:0/4289116697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c0c5a30 0x7f233c0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.221+0000 7f2341cf0640 1 -- 172.21.15.106:0/4289116697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c0c5a30 msgr2=0x7f233c0c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:45.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.221+0000 7f2341cf0640 1 --2- 172.21.15.106:0/4289116697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c0c5a30 0x7f233c0c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.221+0000 7f2341cf0640 1 -- 172.21.15.106:0/4289116697 >> v1:172.21.15.132:6789/0 conn(0x7f233c06c2d0 legacy=0x7f233c155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:45.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.221+0000 7f2341cf0640 1 -- 172.21.15.106:0/4289116697 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0bfd40 con 0x7f233c06bdc0 2023-12-22T09:14:45.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.221+0000 7f23424f1640 1 --2- 172.21.15.106:0/4289116697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c0c5a30 0x7f233c0c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:45.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.222+0000 7f2341cf0640 1 --2- 172.21.15.106:0/4289116697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06bdc0 0x7f233c1550e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f232c009870 tx=0x7f232c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82031bf22c353adb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f23414ef640 1 -- 172.21.15.106:0/4289116697 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0317c0 con 0x7f233c06bdc0 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f23414ef640 1 -- 172.21.15.106:0/4289116697 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c031920 con 0x7f233c06bdc0 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f23414ef640 1 -- 172.21.15.106:0/4289116697 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c031cb0 con 0x7f233c06bdc0 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f2344755640 1 -- 172.21.15.106:0/4289116697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06bdc0 msgr2=0x7f233c1550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f2344755640 1 --2- 172.21.15.106:0/4289116697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06bdc0 0x7f233c1550e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f232c009870 tx=0x7f232c02b860 comp rx=0 tx=0).stop 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f2344755640 1 -- 172.21.15.106:0/4289116697 shutdown_connections 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f2344755640 1 --2- 172.21.15.106:0/4289116697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06bdc0 0x7f233c1550e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f2344755640 1 --2- 172.21.15.106:0/4289116697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c0c5a30 0x7f233c0c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f2344755640 1 -- 172.21.15.106:0/4289116697 >> 172.21.15.106:0/4289116697 conn(0x7f233c06a220 msgr2=0x7f233c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:45.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f2344755640 1 -- 172.21.15.106:0/4289116697 shutdown_connections 2023-12-22T09:14:45.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.223+0000 7f2344755640 1 -- 172.21.15.106:0/4289116697 wait complete. 2023-12-22T09:14:45.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.225+0000 7f2344755640 1 Processor -- start 2023-12-22T09:14:45.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.225+0000 7f2344755640 1 -- start start 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.226+0000 7f2344755640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c06bdc0 0x7f233c0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.226+0000 7f2344755640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06c2d0 0x7f233c148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.226+0000 7f2344755640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f233c0c5a30 0x7f233c148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.226+0000 7f2344755640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0bc1e0 con 0x7f233c06c2d0 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.226+0000 7f2344755640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c1490e0 con 0x7f233c0c5a30 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.226+0000 7f2344755640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0c5340 con 0x7f233c06bdc0 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.226+0000 7f2341cf0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06c2d0 0x7f233c148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.226+0000 7f2341cf0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06c2d0 0x7f233c148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52076/0 (socket says 172.21.15.106:52076) 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.226+0000 7f2341cf0640 1 -- 172.21.15.106:0/1506498088 learned_addr learned my addr 172.21.15.106:0/1506498088 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f23424f1640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c06bdc0 0x7f233c0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2342cf2640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f233c0c5a30 0x7f233c148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2341cf0640 1 -- 172.21.15.106:0/1506498088 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c06bdc0 msgr2=0x7f233c0c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2341cf0640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c06bdc0 0x7f233c0c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2341cf0640 1 -- 172.21.15.106:0/1506498088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f233c0c5a30 msgr2=0x7f233c148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2341cf0640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f233c0c5a30 0x7f233c148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2341cf0640 1 -- 172.21.15.106:0/1506498088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0094d0 con 0x7f233c06c2d0 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f23424f1640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c06bdc0 0x7f233c0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2341cf0640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06c2d0 0x7f233c148660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f232c000c00 tx=0x7f232c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2332ffd640 1 -- 172.21.15.106:0/1506498088 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c032860 con 0x7f233c06c2d0 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2332ffd640 1 -- 172.21.15.106:0/1506498088 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c0329e0 con 0x7f233c06c2d0 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c0c5620 con 0x7f233c06c2d0 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.227+0000 7f2332ffd640 1 -- 172.21.15.106:0/1506498088 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c032d90 con 0x7f233c06c2d0 2023-12-22T09:14:45.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.228+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c14fe10 con 0x7f233c06c2d0 2023-12-22T09:14:45.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.229+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c073f10 con 0x7f233c06c2d0 2023-12-22T09:14:45.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.230+0000 7f2332ffd640 1 -- 172.21.15.106:0/1506498088 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f232c04d3f0 con 0x7f233c06c2d0 2023-12-22T09:14:45.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.231+0000 7f2332ffd640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f232006a430 0x7f232006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.231+0000 7f2332ffd640 1 -- 172.21.15.106:0/1506498088 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f232c0aaa30 con 0x7f233c06c2d0 2023-12-22T09:14:45.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.231+0000 7f23424f1640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f232006a430 0x7f232006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.232+0000 7f23424f1640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f232006a430 0x7f232006c8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2338006fd0 tx=0x7f2338008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:45.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.236+0000 7f2332ffd640 1 -- 172.21.15.106:0/1506498088 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f232c075dc0 con 0x7f233c06c2d0 2023-12-22T09:14:45.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.425+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f233c0ab2c0 con 0x7f233c06c2d0 2023-12-22T09:14:45.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.426+0000 7f2332ffd640 1 -- 172.21.15.106:0/1506498088 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f232c0793e0 con 0x7f233c06c2d0 2023-12-22T09:14:45.427 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:14:45.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f232006a430 msgr2=0x7f232006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f232006a430 0x7f232006c8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2338006fd0 tx=0x7f2338008040 comp rx=0 tx=0).stop 2023-12-22T09:14:45.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06c2d0 msgr2=0x7f233c148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06c2d0 0x7f233c148660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f232c000c00 tx=0x7f232c0046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 shutdown_connections 2023-12-22T09:14:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f232006a430 0x7f232006c8f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f233c0c5a30 0x7f233c148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f233c06c2d0 0x7f233c148660 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 --2- 172.21.15.106:0/1506498088 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f233c06bdc0 0x7f233c0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 >> 172.21.15.106:0/1506498088 conn(0x7f233c06a220 msgr2=0x7f233c0c25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 shutdown_connections 2023-12-22T09:14:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.429+0000 7f2344755640 1 -- 172.21.15.106:0/1506498088 wait complete. 2023-12-22T09:14:45.449 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:14:45.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.663+0000 7f6011df0640 1 Processor -- start 2023-12-22T09:14:45.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.663+0000 7f6011df0640 1 -- start start 2023-12-22T09:14:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.664+0000 7f6011df0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c06b960 0x7f600c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.664+0000 7f6011df0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c155120 con 0x7f600c14f090 2023-12-22T09:14:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.664+0000 7f6011df0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c155fa0 con 0x7f600c0c1910 2023-12-22T09:14:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.664+0000 7f6011df0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c06e080 con 0x7f600c06b960 2023-12-22T09:14:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f600c14f090 0x7f600c155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41136/0 (socket says 172.21.15.106:41136) 2023-12-22T09:14:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600b7fe640 1 -- 172.21.15.106:0/2768825295 learned_addr learned my addr 172.21.15.106:0/2768825295 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:45.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600bfff640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c06b960 0x7f600c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604390626 0 0) 0x7f600c155120 con 0x7f600c14f090 2023-12-22T09:14:45.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff4003520 con 0x7f600c14f090 2023-12-22T09:14:45.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 750740792 0 0) 0x7f5ff4003520 con 0x7f600c14f090 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c06b960 msgr2=0x7f600c151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600a7fc640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c06b960 0x7f600c151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 >> v1:172.21.15.132:6789/0 conn(0x7f600c0c1910 legacy=0x7f600c0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.665+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0a8720 con 0x7f600c14f090 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f5ffc001670 con 0x7f600c14f090 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 >> v1:172.21.15.106:6789/0 conn(0x7f600c14f090 legacy=0x7f600c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600a7fc640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c06b960 0x7f5ff40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600a7fc640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff4003fd0 0x7f5ff40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600a7fc640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f5ff4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff400bb90 con 0x7f5ff4004d00 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff400bd00 con 0x7f5ff4003fd0 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff400bec0 con 0x7f600c06b960 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600bfff640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f5ff4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600affd640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff4003fd0 0x7f5ff40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600b7fe640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c06b960 0x7f5ff40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600bfff640 1 -- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c06b960 msgr2=0x7f5ff40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600bfff640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c06b960 0x7f5ff40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600bfff640 1 -- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff4003fd0 msgr2=0x7f5ff40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600bfff640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff4003fd0 0x7f5ff40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.666+0000 7f600bfff640 1 -- 172.21.15.106:0/2768825295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff4003520 con 0x7f5ff4004d00 2023-12-22T09:14:45.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.667+0000 7f600bfff640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f5ff4005180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6004007360 tx=0x7f5ff40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1df63ad3aac638 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:45.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.668+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600402ccd0 con 0x7f5ff4004d00 2023-12-22T09:14:45.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.668+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600402ce30 con 0x7f5ff4004d00 2023-12-22T09:14:45.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.668+0000 7f600a7fc640 1 -- 172.21.15.106:0/2768825295 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004034660 con 0x7f5ff4004d00 2023-12-22T09:14:45.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.668+0000 7f6011df0640 1 -- 172.21.15.106:0/2768825295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 msgr2=0x7f5ff4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.668+0000 7f6011df0640 1 --2- 172.21.15.106:0/2768825295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f5ff4005180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6004007360 tx=0x7f5ff40057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.668+0000 7f600bfff640 1 -- 172.21.15.106:0/2768825295 reap_dead start 2023-12-22T09:14:45.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.668+0000 7f6011df0640 1 -- 172.21.15.106:0/2768825295 shutdown_connections 2023-12-22T09:14:45.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.668+0000 7f6011df0640 1 -- 172.21.15.106:0/2768825295 >> 172.21.15.106:0/2768825295 conn(0x7f600c069dd0 msgr2=0x7f600c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:45.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.669+0000 7f6011df0640 1 -- 172.21.15.106:0/2768825295 shutdown_connections 2023-12-22T09:14:45.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.669+0000 7f6011df0640 1 -- 172.21.15.106:0/2768825295 wait complete. 2023-12-22T09:14:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.670+0000 7f6011df0640 1 Processor -- start 2023-12-22T09:14:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.670+0000 7f6011df0640 1 -- start start 2023-12-22T09:14:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.671+0000 7f6011df0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f600c1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.671+0000 7f6011df0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f600c0c4ca0 0x7f600c0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.671+0000 7f6011df0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c1e4cc0 0x7f600c1e5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.671+0000 7f6011df0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c1e8230 con 0x7f5ff4004d00 2023-12-22T09:14:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.671+0000 7f6011df0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c1e8db0 con 0x7f600c0c4ca0 2023-12-22T09:14:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.671+0000 7f6011df0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c1e91d0 con 0x7f600c1e4cc0 2023-12-22T09:14:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.671+0000 7f600b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f600c1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.671+0000 7f600b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f600c1543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52090/0 (socket says 172.21.15.106:52090) 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.671+0000 7f600b7fe640 1 -- 172.21.15.106:0/1854173809 learned_addr learned my addr 172.21.15.106:0/1854173809 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f600bfff640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c1e4cc0 0x7f600c1e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f600affd640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f600c0c4ca0 0x7f600c0c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f600b7fe640 1 -- 172.21.15.106:0/1854173809 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c1e4cc0 msgr2=0x7f600c1e5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f600b7fe640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c1e4cc0 0x7f600c1e5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f600b7fe640 1 -- 172.21.15.106:0/1854173809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f600c0c4ca0 msgr2=0x7f600c0c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f600b7fe640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f600c0c4ca0 0x7f600c0c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f600b7fe640 1 -- 172.21.15.106:0/1854173809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c1e8410 con 0x7f5ff4004d00 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f600affd640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f600c0c4ca0 0x7f600c0c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f600b7fe640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f600c1543c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00e840 tx=0x7f5ffc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f5ff3fff640 1 -- 172.21.15.106:0/1854173809 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc00c8d0 con 0x7f5ff4004d00 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.672+0000 7f5ff3fff640 1 -- 172.21.15.106:0/1854173809 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc00ca50 con 0x7f5ff4004d00 2023-12-22T09:14:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.673+0000 7f5ff3fff640 1 -- 172.21.15.106:0/1854173809 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc00ce00 con 0x7f5ff4004d00 2023-12-22T09:14:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.673+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600c1e86f0 con 0x7f5ff4004d00 2023-12-22T09:14:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.673+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c146770 con 0x7f5ff4004d00 2023-12-22T09:14:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.674+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600c1e8ef0 con 0x7f5ff4004d00 2023-12-22T09:14:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.675+0000 7f5ff3fff640 1 -- 172.21.15.106:0/1854173809 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ffc01d460 con 0x7f5ff4004d00 2023-12-22T09:14:45.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.675+0000 7f5ff3fff640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ff806a430 0x7f5ff806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:45.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.676+0000 7f5ff3fff640 1 -- 172.21.15.106:0/1854173809 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ffc088c00 con 0x7f5ff4004d00 2023-12-22T09:14:45.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.676+0000 7f600affd640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ff806a430 0x7f5ff806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.676+0000 7f600affd640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ff806a430 0x7f5ff806c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f600c0c1da0 tx=0x7f6000009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:45.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.680+0000 7f5ff3fff640 1 -- 172.21.15.106:0/1854173809 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f600c1e8ef0 con 0x7f5ff4004d00 2023-12-22T09:14:45.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.869+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f600c1e8ef0 con 0x7f5ff4004d00 2023-12-22T09:14:45.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.870+0000 7f5ff3fff640 1 -- 172.21.15.106:0/1854173809 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f600c1e8ef0 con 0x7f5ff4004d00 2023-12-22T09:14:45.872 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:14:45.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.872+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ff806a430 msgr2=0x7f5ff806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.872+0000 7f6011df0640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ff806a430 0x7f5ff806c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f600c0c1da0 tx=0x7f6000009040 comp rx=0 tx=0).stop 2023-12-22T09:14:45.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.872+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 msgr2=0x7f600c1543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:45.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.872+0000 7f6011df0640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f600c1543c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00e840 tx=0x7f5ffc00ed00 comp rx=0 tx=0).stop 2023-12-22T09:14:45.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.873+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 shutdown_connections 2023-12-22T09:14:45.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.873+0000 7f6011df0640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ff806a430 0x7f5ff806c8f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.873+0000 7f6011df0640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f600c1e4cc0 0x7f600c1e5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.873+0000 7f6011df0640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f600c0c4ca0 0x7f600c0c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.873+0000 7f6011df0640 1 --2- 172.21.15.106:0/1854173809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ff4004d00 0x7f600c1543c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:45.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.873+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 >> 172.21.15.106:0/1854173809 conn(0x7f600c069dd0 msgr2=0x7f600c070300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:45.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.873+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 shutdown_connections 2023-12-22T09:14:45.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:45.873+0000 7f6011df0640 1 -- 172.21.15.106:0/1854173809 wait complete. 2023-12-22T09:14:45.892 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:14:46.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.107+0000 7f10d5226640 1 Processor -- start 2023-12-22T09:14:46.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.107+0000 7f10d5226640 1 -- start start 2023-12-22T09:14:46.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.109+0000 7f10d5226640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10d0151400 0x7f10d00c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.109+0000 7f10d5226640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10d00c7620 0x7f10d006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.109+0000 7f10d5226640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d00bcc70 con 0x7f10d006ca20 2023-12-22T09:14:46.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.109+0000 7f10d5226640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d01517e0 con 0x7f10d0151400 2023-12-22T09:14:46.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.109+0000 7f10d5226640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00c4c90 con 0x7f10d00c7620 2023-12-22T09:14:46.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.109+0000 7f10ced9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10d0151400 0x7f10d00c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.109+0000 7f10ced9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10d0151400 0x7f10d00c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52106/0 (socket says 172.21.15.106:52106) 2023-12-22T09:14:46.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.109+0000 7f10ced9d640 1 -- 172.21.15.106:0/613405193 learned_addr learned my addr 172.21.15.106:0/613405193 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.110+0000 7f10ced9d640 1 -- 172.21.15.106:0/613405193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10d00c7620 msgr2=0x7f10d006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.110+0000 7f10ced9d640 1 --2- 172.21.15.106:0/613405193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10d00c7620 0x7f10d006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.110+0000 7f10ced9d640 1 -- 172.21.15.106:0/613405193 >> v1:172.21.15.132:6789/0 conn(0x7f10d006ca20 legacy=0x7f10d006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.110+0000 7f10ced9d640 1 -- 172.21.15.106:0/613405193 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d00c42d0 con 0x7f10d0151400 2023-12-22T09:14:46.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.111+0000 7f10ced9d640 1 --2- 172.21.15.106:0/613405193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d0151400 0x7f10d00c6130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009870 tx=0x7f10c002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488c20212cf37d8d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:46.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10ce59c640 1 -- 172.21.15.106:0/613405193 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0031740 con 0x7f10d0151400 2023-12-22T09:14:46.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10ce59c640 1 -- 172.21.15.106:0/613405193 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c00318a0 con 0x7f10d0151400 2023-12-22T09:14:46.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10ce59c640 1 -- 172.21.15.106:0/613405193 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0031c30 con 0x7f10d0151400 2023-12-22T09:14:46.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10d5226640 1 -- 172.21.15.106:0/613405193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d0151400 msgr2=0x7f10d00c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10d5226640 1 --2- 172.21.15.106:0/613405193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d0151400 0x7f10d00c6130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009870 tx=0x7f10c002b7e0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10d5226640 1 -- 172.21.15.106:0/613405193 shutdown_connections 2023-12-22T09:14:46.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10d5226640 1 --2- 172.21.15.106:0/613405193 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10d00c7620 0x7f10d006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10d5226640 1 --2- 172.21.15.106:0/613405193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d0151400 0x7f10d00c6130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10d5226640 1 -- 172.21.15.106:0/613405193 >> 172.21.15.106:0/613405193 conn(0x7f10d00ab310 msgr2=0x7f10d00ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:46.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.112+0000 7f10d5226640 1 -- 172.21.15.106:0/613405193 shutdown_connections 2023-12-22T09:14:46.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.113+0000 7f10d5226640 1 -- 172.21.15.106:0/613405193 wait complete. 2023-12-22T09:14:46.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.114+0000 7f10d5226640 1 Processor -- start 2023-12-22T09:14:46.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.114+0000 7f10d5226640 1 -- start start 2023-12-22T09:14:46.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.115+0000 7f10d5226640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d006ca20 0x7f10d0151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.115+0000 7f10d5226640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10d00c7620 0x7f10d0152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.115+0000 7f10d5226640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10d0151400 0x7f10d0143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.115+0000 7f10d5226640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01530b0 con 0x7f10d006ca20 2023-12-22T09:14:46.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.115+0000 7f10d5226640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01ea2f0 con 0x7f10d0151400 2023-12-22T09:14:46.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.115+0000 7f10d5226640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0150c10 con 0x7f10d00c7620 2023-12-22T09:14:46.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.115+0000 7f10ced9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d006ca20 0x7f10d0151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.115+0000 7f10ced9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d006ca20 0x7f10d0151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52108/0 (socket says 172.21.15.106:52108) 2023-12-22T09:14:46.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.115+0000 7f10ced9d640 1 -- 172.21.15.106:0/2059951385 learned_addr learned my addr 172.21.15.106:0/2059951385 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.116+0000 7f10c7fff640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10d00c7620 0x7f10d0152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.116+0000 7f10ced9d640 1 -- 172.21.15.106:0/2059951385 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10d00c7620 msgr2=0x7f10d0152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.116+0000 7f10ced9d640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10d00c7620 0x7f10d0152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.116+0000 7f10cf59e640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10d0151400 0x7f10d0143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.116+0000 7f10ced9d640 1 -- 172.21.15.106:0/2059951385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10d0151400 msgr2=0x7f10d0143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.116+0000 7f10ced9d640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10d0151400 0x7f10d0143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.116+0000 7f10ced9d640 1 -- 172.21.15.106:0/2059951385 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00094d0 con 0x7f10d006ca20 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.116+0000 7f10ced9d640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d006ca20 0x7f10d0151fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009870 tx=0x7f10c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.117+0000 7f10c77fe640 1 -- 172.21.15.106:0/2059951385 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0033c70 con 0x7f10d006ca20 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.117+0000 7f10c77fe640 1 -- 172.21.15.106:0/2059951385 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0033dd0 con 0x7f10d006ca20 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.117+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d0146440 con 0x7f10d006ca20 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.117+0000 7f10c77fe640 1 -- 172.21.15.106:0/2059951385 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c003d6b0 con 0x7f10d006ca20 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.117+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d0146710 con 0x7f10d006ca20 2023-12-22T09:14:46.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.118+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d0073550 con 0x7f10d006ca20 2023-12-22T09:14:46.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.119+0000 7f10c77fe640 1 -- 172.21.15.106:0/2059951385 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f10c003a040 con 0x7f10d006ca20 2023-12-22T09:14:46.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.120+0000 7f10c77fe640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f10b006a430 0x7f10b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.120+0000 7f10c77fe640 1 -- 172.21.15.106:0/2059951385 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10c00aaab0 con 0x7f10d006ca20 2023-12-22T09:14:46.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.120+0000 7f10c7fff640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f10b006a430 0x7f10b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.121+0000 7f10c7fff640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f10b006a430 0x7f10b006c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10d0149410 tx=0x7f10b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:46.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.124+0000 7f10c77fe640 1 -- 172.21.15.106:0/2059951385 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f10c0075e40 con 0x7f10d006ca20 2023-12-22T09:14:46.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.314+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f10d0073f10 con 0x7f10d006ca20 2023-12-22T09:14:46.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.315+0000 7f10c77fe640 1 -- 172.21.15.106:0/2059951385 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f10c00380a0 con 0x7f10d006ca20 2023-12-22T09:14:46.315 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:14:46.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f10b006a430 msgr2=0x7f10b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f10b006a430 0x7f10b006c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10d0149410 tx=0x7f10b8009040 comp rx=0 tx=0).stop 2023-12-22T09:14:46.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d006ca20 msgr2=0x7f10d0151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d006ca20 0x7f10d0151fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009870 tx=0x7f10c00046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 shutdown_connections 2023-12-22T09:14:46.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f10b006a430 0x7f10b006c8f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f10d0151400 0x7f10d0143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f10d00c7620 0x7f10d0152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 --2- 172.21.15.106:0/2059951385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10d006ca20 0x7f10d0151fd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 >> 172.21.15.106:0/2059951385 conn(0x7f10d00ab310 msgr2=0x7f10d014b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:46.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 shutdown_connections 2023-12-22T09:14:46.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.318+0000 7f10d5226640 1 -- 172.21.15.106:0/2059951385 wait complete. 2023-12-22T09:14:46.337 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T09:14:46.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.537+0000 7f29f0e3e640 1 Processor -- start 2023-12-22T09:14:46.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.537+0000 7f29f0e3e640 1 -- start start 2023-12-22T09:14:46.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.538+0000 7f29f0e3e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec14f370 0x7f29ec071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.538+0000 7f29f0e3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29ec1551c0 0x7f29ec06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.538+0000 7f29f0e3e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec06c510 con 0x7f29ec071570 2023-12-22T09:14:46.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.538+0000 7f29f0e3e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec06c1e0 con 0x7f29ec1551c0 2023-12-22T09:14:46.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.538+0000 7f29f0e3e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec071a30 con 0x7f29ec14f370 2023-12-22T09:14:46.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.539+0000 7f29e3fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f29ec071570 0x7f29ec069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41146/0 (socket says 172.21.15.106:41146) 2023-12-22T09:14:46.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.539+0000 7f29e3fff640 1 -- 172.21.15.106:0/3044835100 learned_addr learned my addr 172.21.15.106:0/3044835100 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:46.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.539+0000 7f29ead9d640 1 --2- 172.21.15.106:0/3044835100 >> v2:172.21.15.132:3300/0 conn(0x7f29ec1551c0 0x7f29ec06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.539+0000 7f29ea59c640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec14f370 0x7f29ec071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.539+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509898000 0 0) 0x7f29ec06c510 con 0x7f29ec071570 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.539+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29d8003520 con 0x7f29ec071570 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.539+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3654048012 0 0) 0x7f29d8003520 con 0x7f29ec071570 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec14f370 msgr2=0x7f29ec071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec14f370 0x7f29ec071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 >> v2:172.21.15.132:3300/0 conn(0x7f29ec1551c0 msgr2=0x7f29ec06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 --2- 172.21.15.106:0/3044835100 >> v2:172.21.15.132:3300/0 conn(0x7f29ec1551c0 0x7f29ec06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec071d10 con 0x7f29ec071570 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f29d4001670 con 0x7f29ec071570 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 >> v1:172.21.15.106:6789/0 conn(0x7f29ec071570 legacy=0x7f29ec069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29d8003970 0x7f29d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29d80047c0 0x7f29d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec06c1e0 con 0x7f29d8005180 2023-12-22T09:14:46.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec071a30 con 0x7f29d80047c0 2023-12-22T09:14:46.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d800bf40 con 0x7f29d8003970 2023-12-22T09:14:46.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29ea59c640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec14f370 0x7f29ec071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:14:46.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29ead9d640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29ead9d640 1 -- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29d8003970 msgr2=0x7f29d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:46.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29ead9d640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29d8003970 0x7f29d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29ead9d640 1 -- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29d80047c0 msgr2=0x7f29d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:46.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29ead9d640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29d80047c0 0x7f29d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.540+0000 7f29ead9d640 1 -- 172.21.15.106:0/3044835100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d8003520 con 0x7f29d8005180 2023-12-22T09:14:46.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.542+0000 7f29ead9d640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29d800b980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009f90 tx=0x7f29d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f44775ad31da96 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:46.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.542+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e402cc20 con 0x7f29d8005180 2023-12-22T09:14:46.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.542+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400f040 con 0x7f29d8005180 2023-12-22T09:14:46.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.542+0000 7f29e9d9b640 1 -- 172.21.15.106:0/3044835100 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4034440 con 0x7f29d8005180 2023-12-22T09:14:46.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.542+0000 7f29f0e3e640 1 -- 172.21.15.106:0/3044835100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 msgr2=0x7f29d800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.542+0000 7f29f0e3e640 1 --2- 172.21.15.106:0/3044835100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29d800b980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009f90 tx=0x7f29d80057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.542+0000 7f29ead9d640 1 -- 172.21.15.106:0/3044835100 reap_dead start 2023-12-22T09:14:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.543+0000 7f29f0e3e640 1 -- 172.21.15.106:0/3044835100 shutdown_connections 2023-12-22T09:14:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.543+0000 7f29f0e3e640 1 -- 172.21.15.106:0/3044835100 >> 172.21.15.106:0/3044835100 conn(0x7f29ec0c1db0 msgr2=0x7f29ec0c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.543+0000 7f29f0e3e640 1 -- 172.21.15.106:0/3044835100 shutdown_connections 2023-12-22T09:14:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.543+0000 7f29f0e3e640 1 -- 172.21.15.106:0/3044835100 wait complete. 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.544+0000 7f29f0e3e640 1 Processor -- start 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.544+0000 7f29f0e3e640 1 -- start start 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.545+0000 7f29f0e3e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29ec146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.545+0000 7f29f0e3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ec145d20 0x7f29ec1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.545+0000 7f29f0e3e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec141a50 0x7f29ec141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.545+0000 7f29f0e3e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec147b30 con 0x7f29d8005180 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.545+0000 7f29f0e3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1e7dc0 con 0x7f29ec145d20 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.545+0000 7f29f0e3e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1e80a0 con 0x7f29ec141a50 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ea59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29ec146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ea59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29ec146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52116/0 (socket says 172.21.15.106:52116) 2023-12-22T09:14:46.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ea59c640 1 -- 172.21.15.106:0/1549202526 learned_addr learned my addr 172.21.15.106:0/1549202526 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ead9d640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec141a50 0x7f29ec141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29e3fff640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ec145d20 0x7f29ec1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ea59c640 1 -- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec141a50 msgr2=0x7f29ec141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ea59c640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec141a50 0x7f29ec141ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ea59c640 1 -- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ec145d20 msgr2=0x7f29ec1450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ea59c640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ec145d20 0x7f29ec1450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ea59c640 1 -- 172.21.15.106:0/1549202526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec1e8380 con 0x7f29d8005180 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ead9d640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec141a50 0x7f29ec141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29e3fff640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ec145d20 0x7f29ec1450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.546+0000 7f29ea59c640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29ec146c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00e4b0 tx=0x7f29dc00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.547+0000 7f29e2ffd640 1 -- 172.21.15.106:0/1549202526 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc005b90 con 0x7f29d8005180 2023-12-22T09:14:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.547+0000 7f29e2ffd640 1 -- 172.21.15.106:0/1549202526 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc005cf0 con 0x7f29d8005180 2023-12-22T09:14:46.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.547+0000 7f29e2ffd640 1 -- 172.21.15.106:0/1549202526 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc006260 con 0x7f29d8005180 2023-12-22T09:14:46.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.547+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec1e8660 con 0x7f29d8005180 2023-12-22T09:14:46.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.547+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec1455f0 con 0x7f29d8005180 2023-12-22T09:14:46.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.548+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec073f10 con 0x7f29d8005180 2023-12-22T09:14:46.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.549+0000 7f29e2ffd640 1 -- 172.21.15.106:0/1549202526 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f29dc0063c0 con 0x7f29d8005180 2023-12-22T09:14:46.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.550+0000 7f29e2ffd640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f29cc06a430 0x7f29cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:46.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.550+0000 7f29e2ffd640 1 -- 172.21.15.106:0/1549202526 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29dc088100 con 0x7f29d8005180 2023-12-22T09:14:46.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.550+0000 7f29e3fff640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f29cc06a430 0x7f29cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:46.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.551+0000 7f29e3fff640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f29cc06a430 0x7f29cc06c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29d40017a0 tx=0x7f29d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:46.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.554+0000 7f29e2ffd640 1 -- 172.21.15.106:0/1549202526 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f29dc053490 con 0x7f29d8005180 2023-12-22T09:14:46.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.758+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f29ec06bf20 con 0x7f29d8005180 2023-12-22T09:14:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.758+0000 7f29e2ffd640 1 -- 172.21.15.106:0/1549202526 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f29dc056ab0 con 0x7f29d8005180 2023-12-22T09:14:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-12-22T09:14:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.761+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f29cc06a430 msgr2=0x7f29cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.761+0000 7f29f0e3e640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f29cc06a430 0x7f29cc06c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29d40017a0 tx=0x7f29d4009040 comp rx=0 tx=0).stop 2023-12-22T09:14:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.761+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 msgr2=0x7f29ec146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.761+0000 7f29f0e3e640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29ec146c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00e4b0 tx=0x7f29dc00e970 comp rx=0 tx=0).stop 2023-12-22T09:14:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.762+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 shutdown_connections 2023-12-22T09:14:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.762+0000 7f29f0e3e640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f29cc06a430 0x7f29cc06c8f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.762+0000 7f29f0e3e640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29ec141a50 0x7f29ec141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.762+0000 7f29f0e3e640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ec145d20 0x7f29ec1450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.762+0000 7f29f0e3e640 1 --2- 172.21.15.106:0/1549202526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8005180 0x7f29ec146c40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.762+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 >> 172.21.15.106:0/1549202526 conn(0x7f29ec0c1db0 msgr2=0x7f29ec14c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.762+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 shutdown_connections 2023-12-22T09:14:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:46.762+0000 7f29f0e3e640 1 -- 172.21.15.106:0/1549202526 wait complete. 2023-12-22T09:14:46.782 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi106.front.sepia.ceph.com... 2023-12-22T09:14:46.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:46.783 DEBUG:teuthology.orchestra.run.smithi106:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-22T09:14:46.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi106.stderr:ceph-fuse[95377]: fuse finished with error 0 and tester_r 0 2023-12-22T09:14:46.881 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T09:14:49.948 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:14:49.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:14:52.982 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2023-12-22T09:14:52.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:14:52.982 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-22T09:14:53.052 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.258+0000 7fba32963640 1 Processor -- start 2023-12-22T09:14:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.258+0000 7fba32963640 1 -- start start 2023-12-22T09:14:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba32963640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c1514b0 0x7fba2c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba32963640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fba2c0c4130 0x7fba2c154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba32963640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2c0c4660 con 0x7fba2c154a80 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba32963640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c153d60 con 0x7fba2c0c4130 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba32963640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c06b250 con 0x7fba2c1514b0 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba23fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fba2c0c4130 0x7fba2c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba30f00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fba2c154a80 0x7fba2c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51898/0 (socket says 172.21.15.106:51898) 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba23fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fba2c0c4130 0x7fba2c154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40840/0 (socket says 172.21.15.106:40840) 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba30f00640 1 -- 172.21.15.106:0/148342961 learned_addr learned my addr 172.21.15.106:0/148342961 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.260+0000 7fba2bfff640 1 --2- 172.21.15.106:0/148342961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c1514b0 0x7fba2c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.261+0000 7fba23fff640 1 -- 172.21.15.106:0/148342961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c1514b0 msgr2=0x7fba2c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.261+0000 7fba23fff640 1 --2- 172.21.15.106:0/148342961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c1514b0 0x7fba2c0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.261+0000 7fba23fff640 1 -- 172.21.15.106:0/148342961 >> v1:172.21.15.106:6789/0 conn(0x7fba2c154a80 legacy=0x7fba2c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.261+0000 7fba23fff640 1 -- 172.21.15.106:0/148342961 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c06b530 con 0x7fba2c0c4130 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.262+0000 7fba23fff640 1 --2- 172.21.15.106:0/148342961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c4130 0x7fba2c154540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba140097a0 tx=0x7fba1402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df60b65a8f48bced server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.262+0000 7fba2b7fe640 1 -- 172.21.15.106:0/148342961 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14031780 con 0x7fba2c0c4130 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.262+0000 7fba2b7fe640 1 -- 172.21.15.106:0/148342961 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140318e0 con 0x7fba2c0c4130 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.262+0000 7fba2b7fe640 1 -- 172.21.15.106:0/148342961 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14031c70 con 0x7fba2c0c4130 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.263+0000 7fba32963640 1 -- 172.21.15.106:0/148342961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c4130 msgr2=0x7fba2c154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.263+0000 7fba32963640 1 --2- 172.21.15.106:0/148342961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c4130 0x7fba2c154540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba140097a0 tx=0x7fba1402b820 comp rx=0 tx=0).stop 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.263+0000 7fba32963640 1 -- 172.21.15.106:0/148342961 shutdown_connections 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.263+0000 7fba32963640 1 --2- 172.21.15.106:0/148342961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c4130 0x7fba2c154540 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.263+0000 7fba32963640 1 --2- 172.21.15.106:0/148342961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c1514b0 0x7fba2c0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.263+0000 7fba32963640 1 -- 172.21.15.106:0/148342961 >> 172.21.15.106:0/148342961 conn(0x7fba2c0ab1a0 msgr2=0x7fba2c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.263+0000 7fba32963640 1 -- 172.21.15.106:0/148342961 shutdown_connections 2023-12-22T09:14:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.263+0000 7fba32963640 1 -- 172.21.15.106:0/148342961 wait complete. 2023-12-22T09:14:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.265+0000 7fba32963640 1 Processor -- start 2023-12-22T09:14:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.265+0000 7fba32963640 1 -- start start 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba32963640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c0c4130 0x7fba2c1ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba32963640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba2c1514b0 0x7fba2c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba32963640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c8d90 0x7fba2c0c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba32963640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0bd640 con 0x7fba2c0c8d90 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba32963640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c1ed1a0 con 0x7fba2c1514b0 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba32963640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0c1100 con 0x7fba2c0c4130 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba30f00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c8d90 0x7fba2c0c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba30f00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c8d90 0x7fba2c0c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40856/0 (socket says 172.21.15.106:40856) 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba30f00640 1 -- 172.21.15.106:0/2712906940 learned_addr learned my addr 172.21.15.106:0/2712906940 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.266+0000 7fba2bfff640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c0c4130 0x7fba2c1ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba30f00640 1 -- 172.21.15.106:0/2712906940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c0c4130 msgr2=0x7fba2c1ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba30f00640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c0c4130 0x7fba2c1ecc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba30f00640 1 -- 172.21.15.106:0/2712906940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba2c1514b0 msgr2=0x7fba2c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba30f00640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba2c1514b0 0x7fba2c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba30f00640 1 -- 172.21.15.106:0/2712906940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba14009400 con 0x7fba2c0c8d90 2023-12-22T09:14:53.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba2bfff640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c0c4130 0x7fba2c1ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba30f00640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c8d90 0x7fba2c0c1a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba2400ca20 tx=0x7fba2400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba297fa640 1 -- 172.21.15.106:0/2712906940 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400abd0 con 0x7fba2c0c8d90 2023-12-22T09:14:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba297fa640 1 -- 172.21.15.106:0/2712906940 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2400ad30 con 0x7fba2c0c8d90 2023-12-22T09:14:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba297fa640 1 -- 172.21.15.106:0/2712906940 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400aea0 con 0x7fba2c0c8d90 2023-12-22T09:14:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2c0c0b40 con 0x7fba2c0c8d90 2023-12-22T09:14:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.267+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c1e8e80 con 0x7fba2c0c8d90 2023-12-22T09:14:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.268+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2c1e8ce0 con 0x7fba2c0c8d90 2023-12-22T09:14:53.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.269+0000 7fba297fa640 1 -- 172.21.15.106:0/2712906940 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fba24007070 con 0x7fba2c0c8d90 2023-12-22T09:14:53.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.271+0000 7fba297fa640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fba0c06a460 0x7fba0c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.271+0000 7fba297fa640 1 -- 172.21.15.106:0/2712906940 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba24088970 con 0x7fba2c0c8d90 2023-12-22T09:14:53.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.271+0000 7fba2bfff640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fba0c06a460 0x7fba0c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.272+0000 7fba2bfff640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fba0c06a460 0x7fba0c06c920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fba1c006fd0 tx=0x7fba1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:53.276 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.276+0000 7fba297fa640 1 -- 172.21.15.106:0/2712906940 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fba2c1e8ce0 con 0x7fba2c0c8d90 2023-12-22T09:14:53.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.467+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba2c1e8ce0 con 0x7fba2c0c8d90 2023-12-22T09:14:53.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.469+0000 7fba297fa640 1 -- 172.21.15.106:0/2712906940 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fba2c1e8ce0 con 0x7fba2c0c8d90 2023-12-22T09:14:53.470 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:53.470 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.471+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fba0c06a460 msgr2=0x7fba0c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.471+0000 7fba32963640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fba0c06a460 0x7fba0c06c920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fba1c006fd0 tx=0x7fba1c008040 comp rx=0 tx=0).stop 2023-12-22T09:14:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.471+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c8d90 msgr2=0x7fba2c0c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.471+0000 7fba32963640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c8d90 0x7fba2c0c1a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba2400ca20 tx=0x7fba2400cee0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.472+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 shutdown_connections 2023-12-22T09:14:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.472+0000 7fba32963640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fba0c06a460 0x7fba0c06c920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.472+0000 7fba32963640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba2c0c8d90 0x7fba2c0c1a10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.472+0000 7fba32963640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba2c1514b0 0x7fba2c14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.472+0000 7fba32963640 1 --2- 172.21.15.106:0/2712906940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba2c0c4130 0x7fba2c1ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.472+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 >> 172.21.15.106:0/2712906940 conn(0x7fba2c0ab1a0 msgr2=0x7fba2c0c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.472+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 shutdown_connections 2023-12-22T09:14:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.472+0000 7fba32963640 1 -- 172.21.15.106:0/2712906940 wait complete. 2023-12-22T09:14:53.491 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.700+0000 7f6485bf6640 1 Processor -- start 2023-12-22T09:14:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.700+0000 7f6485bf6640 1 -- start start 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.701+0000 7f6485bf6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6480069e60 0x7f64801551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f6485bf6640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f648015c070 0x7f6480155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f6485bf6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648006fe60 con 0x7f6480070480 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f6485bf6640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648015c5e0 con 0x7f648015c070 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f6485bf6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6480070140 con 0x7f6480069e60 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f647effd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f648015c070 0x7f6480155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f647effd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f648015c070 0x7f6480155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40862/0 (socket says 172.21.15.106:40862) 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f647effd640 1 -- 172.21.15.106:0/2156730743 learned_addr learned my addr 172.21.15.106:0/2156730743 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f647f7fe640 1 --2- 172.21.15.106:0/2156730743 >> v2:172.21.15.132:3300/0 conn(0x7f6480069e60 0x7f64801551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f647effd640 1 -- 172.21.15.106:0/2156730743 >> v2:172.21.15.132:3300/0 conn(0x7f6480069e60 msgr2=0x7f64801551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f647effd640 1 --2- 172.21.15.106:0/2156730743 >> v2:172.21.15.132:3300/0 conn(0x7f6480069e60 0x7f64801551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f647effd640 1 -- 172.21.15.106:0/2156730743 >> v1:172.21.15.106:6789/0 conn(0x7f6480070480 legacy=0x7f64800bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.702+0000 7f647effd640 1 -- 172.21.15.106:0/2156730743 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64800c1440 con 0x7f648015c070 2023-12-22T09:14:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.704+0000 7f647effd640 1 --2- 172.21.15.106:0/2156730743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 0x7f6480155730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6474009870 tx=0x7f647402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5696bf9d2ba25b72 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.704+0000 7f647e7fc640 1 -- 172.21.15.106:0/2156730743 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474030860 con 0x7f648015c070 2023-12-22T09:14:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.704+0000 7f647e7fc640 1 -- 172.21.15.106:0/2156730743 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64740309c0 con 0x7f648015c070 2023-12-22T09:14:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.704+0000 7f647e7fc640 1 -- 172.21.15.106:0/2156730743 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474030d50 con 0x7f648015c070 2023-12-22T09:14:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.704+0000 7f6485bf6640 1 -- 172.21.15.106:0/2156730743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 msgr2=0x7f6480155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.704+0000 7f6485bf6640 1 --2- 172.21.15.106:0/2156730743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 0x7f6480155730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6474009870 tx=0x7f647402b9a0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.705+0000 7f6485bf6640 1 -- 172.21.15.106:0/2156730743 shutdown_connections 2023-12-22T09:14:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.705+0000 7f6485bf6640 1 --2- 172.21.15.106:0/2156730743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 0x7f6480155730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.705+0000 7f6485bf6640 1 --2- 172.21.15.106:0/2156730743 >> v2:172.21.15.132:3300/0 conn(0x7f6480069e60 0x7f64801551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.705+0000 7f6485bf6640 1 -- 172.21.15.106:0/2156730743 >> 172.21.15.106:0/2156730743 conn(0x7f64800c5360 msgr2=0x7f64800c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.705+0000 7f6485bf6640 1 -- 172.21.15.106:0/2156730743 shutdown_connections 2023-12-22T09:14:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.705+0000 7f6485bf6640 1 -- 172.21.15.106:0/2156730743 wait complete. 2023-12-22T09:14:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.706+0000 7f6485bf6640 1 Processor -- start 2023-12-22T09:14:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.707+0000 7f6485bf6640 1 -- start start 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.707+0000 7f6485bf6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480069e60 0x7f64800a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.707+0000 7f6485bf6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6480070480 0x7f648014a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.707+0000 7f6485bf6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 0x7f64800c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.707+0000 7f6485bf6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64801519a0 con 0x7f648015c070 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.707+0000 7f6485bf6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800a9a90 con 0x7f6480069e60 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.707+0000 7f6485bf6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6480157270 con 0x7f6480070480 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 0x7f64800c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 0x7f64800c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40876/0 (socket says 172.21.15.106:40876) 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647ffff640 1 -- 172.21.15.106:0/2950586479 learned_addr learned my addr 172.21.15.106:0/2950586479 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647ffff640 1 -- 172.21.15.106:0/2950586479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6480070480 msgr2=0x7f648014a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647ffff640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6480070480 0x7f648014a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647f7fe640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480069e60 0x7f64800a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647ffff640 1 -- 172.21.15.106:0/2950586479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480069e60 msgr2=0x7f64800a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647ffff640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480069e60 0x7f64800a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647ffff640 1 -- 172.21.15.106:0/2950586479 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64740094d0 con 0x7f648015c070 2023-12-22T09:14:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.708+0000 7f647ffff640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 0x7f64800c3f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f647800c7a0 tx=0x7f647800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.709+0000 7f6467fff640 1 -- 172.21.15.106:0/2950586479 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478003b70 con 0x7f648015c070 2023-12-22T09:14:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.709+0000 7f6467fff640 1 -- 172.21.15.106:0/2950586479 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6478003cf0 con 0x7f648015c070 2023-12-22T09:14:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.709+0000 7f6467fff640 1 -- 172.21.15.106:0/2950586479 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478003ea0 con 0x7f648015c070 2023-12-22T09:14:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.709+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6480151650 con 0x7f648015c070 2023-12-22T09:14:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.709+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6480152260 con 0x7f648015c070 2023-12-22T09:14:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.710+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6480073f10 con 0x7f648015c070 2023-12-22T09:14:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.711+0000 7f6467fff640 1 -- 172.21.15.106:0/2950586479 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f647800aa90 con 0x7f648015c070 2023-12-22T09:14:53.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.712+0000 7f6467fff640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f646c06a430 0x7f646c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:53.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.712+0000 7f6467fff640 1 -- 172.21.15.106:0/2950586479 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6478088a60 con 0x7f648015c070 2023-12-22T09:14:53.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.712+0000 7f647f7fe640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f646c06a430 0x7f646c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:53.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.713+0000 7f647f7fe640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f646c06a430 0x7f646c06c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f64700096d0 tx=0x7f6470008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:53.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.716+0000 7f6467fff640 1 -- 172.21.15.106:0/2950586479 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6478053d50 con 0x7f648015c070 2023-12-22T09:14:53.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.913+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6480151ae0 con 0x7f648015c070 2023-12-22T09:14:53.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.914+0000 7f6467fff640 1 -- 172.21.15.106:0/2950586479 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f6478057370 con 0x7f648015c070 2023-12-22T09:14:53.915 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:53.915 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f646c06a430 msgr2=0x7f646c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f646c06a430 0x7f646c06c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f64700096d0 tx=0x7f6470008040 comp rx=0 tx=0).stop 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 msgr2=0x7f64800c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 0x7f64800c3f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f647800c7a0 tx=0x7f647800cc60 comp rx=0 tx=0).stop 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 shutdown_connections 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f646c06a430 0x7f646c06c8f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f648015c070 0x7f64800c3f30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6480070480 0x7f648014a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 --2- 172.21.15.106:0/2950586479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480069e60 0x7f64800a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:53.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 >> 172.21.15.106:0/2950586479 conn(0x7f64800c5360 msgr2=0x7f6480153930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:53.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 shutdown_connections 2023-12-22T09:14:53.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:53.917+0000 7f6485bf6640 1 -- 172.21.15.106:0/2950586479 wait complete. 2023-12-22T09:14:53.940 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T09:14:54.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.152+0000 7fb827e4c640 1 Processor -- start 2023-12-22T09:14:54.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.152+0000 7fb827e4c640 1 -- start start 2023-12-22T09:14:54.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.153+0000 7fb827e4c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb8200c5ca0 0x7fb820150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:54.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.153+0000 7fb827e4c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb820071e30 0x7fb8200710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:54.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.153+0000 7fb827e4c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb82006bdc0 0x7fb82014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:54.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.153+0000 7fb827e4c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb820070000 con 0x7fb8200c5ca0 2023-12-22T09:14:54.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.153+0000 7fb827e4c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8200702e0 con 0x7fb820071e30 2023-12-22T09:14:54.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.153+0000 7fb827e4c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200705c0 con 0x7fb82006bdc0 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb825be8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb8200c5ca0 0x7fb820150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb825be8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb8200c5ca0 0x7fb820150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40882/0 (socket says 172.21.15.106:40882) 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb825be8640 1 -- 172.21.15.106:0/3284229023 learned_addr learned my addr 172.21.15.106:0/3284229023 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb825be8640 1 -- 172.21.15.106:0/3284229023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb82006bdc0 msgr2=0x7fb82014a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb825be8640 1 --2- 172.21.15.106:0/3284229023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb82006bdc0 0x7fb82014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb8253e7640 1 --2- 172.21.15.106:0/3284229023 >> v2:172.21.15.132:3300/0 conn(0x7fb820071e30 0x7fb8200710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb825be8640 1 -- 172.21.15.106:0/3284229023 >> v2:172.21.15.132:3300/0 conn(0x7fb820071e30 msgr2=0x7fb8200710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb825be8640 1 --2- 172.21.15.106:0/3284229023 >> v2:172.21.15.132:3300/0 conn(0x7fb820071e30 0x7fb8200710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb825be8640 1 -- 172.21.15.106:0/3284229023 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200708a0 con 0x7fb8200c5ca0 2023-12-22T09:14:54.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.154+0000 7fb8253e7640 1 --2- 172.21.15.106:0/3284229023 >> v2:172.21.15.132:3300/0 conn(0x7fb820071e30 0x7fb8200710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:54.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.155+0000 7fb825be8640 1 --2- 172.21.15.106:0/3284229023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 0x7fb820150af0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8200ab490 tx=0x7fb81c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44480a0799f6094e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:54.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.155+0000 7fb824be6640 1 -- 172.21.15.106:0/3284229023 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0317e0 con 0x7fb8200c5ca0 2023-12-22T09:14:54.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.156+0000 7fb824be6640 1 -- 172.21.15.106:0/3284229023 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c031940 con 0x7fb8200c5ca0 2023-12-22T09:14:54.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.156+0000 7fb824be6640 1 -- 172.21.15.106:0/3284229023 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c031cd0 con 0x7fb8200c5ca0 2023-12-22T09:14:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.156+0000 7fb827e4c640 1 -- 172.21.15.106:0/3284229023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 msgr2=0x7fb820150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.156+0000 7fb827e4c640 1 --2- 172.21.15.106:0/3284229023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 0x7fb820150af0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8200ab490 tx=0x7fb81c02b880 comp rx=0 tx=0).stop 2023-12-22T09:14:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.156+0000 7fb827e4c640 1 -- 172.21.15.106:0/3284229023 shutdown_connections 2023-12-22T09:14:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.156+0000 7fb827e4c640 1 --2- 172.21.15.106:0/3284229023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb82006bdc0 0x7fb82014a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.156+0000 7fb827e4c640 1 --2- 172.21.15.106:0/3284229023 >> v2:172.21.15.132:3300/0 conn(0x7fb820071e30 0x7fb8200710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.156+0000 7fb827e4c640 1 --2- 172.21.15.106:0/3284229023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 0x7fb820150af0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.156+0000 7fb827e4c640 1 -- 172.21.15.106:0/3284229023 >> 172.21.15.106:0/3284229023 conn(0x7fb82006a220 msgr2=0x7fb8200c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.157+0000 7fb827e4c640 1 -- 172.21.15.106:0/3284229023 shutdown_connections 2023-12-22T09:14:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.157+0000 7fb827e4c640 1 -- 172.21.15.106:0/3284229023 wait complete. 2023-12-22T09:14:54.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.158+0000 7fb827e4c640 1 Processor -- start 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.158+0000 7fb827e4c640 1 -- start start 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.159+0000 7fb827e4c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb82006bdc0 0x7fb8201e5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.159+0000 7fb827e4c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb820071e30 0x7fb8201e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.159+0000 7fb827e4c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 0x7fb8201e24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.159+0000 7fb827e4c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200a92d0 con 0x7fb8200c5ca0 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.159+0000 7fb827e4c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82014eb00 con 0x7fb82006bdc0 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.159+0000 7fb827e4c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82014ede0 con 0x7fb820071e30 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8263e9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 0x7fb8201e24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8263e9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 0x7fb8201e24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40890/0 (socket says 172.21.15.106:40890) 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8263e9640 1 -- 172.21.15.106:0/1333735548 learned_addr learned my addr 172.21.15.106:0/1333735548 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb825be8640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb82006bdc0 0x7fb8201e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8253e7640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb820071e30 0x7fb8201e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8263e9640 1 -- 172.21.15.106:0/1333735548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb820071e30 msgr2=0x7fb8201e1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8263e9640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb820071e30 0x7fb8201e1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8263e9640 1 -- 172.21.15.106:0/1333735548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb82006bdc0 msgr2=0x7fb8201e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8263e9640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb82006bdc0 0x7fb8201e5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8263e9640 1 -- 172.21.15.106:0/1333735548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c0094d0 con 0x7fb8200c5ca0 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8253e7640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb820071e30 0x7fb8201e1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.160+0000 7fb8263e9640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 0x7fb8201e24e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b9e0 tx=0x7fb81800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.161+0000 7fb8167fc640 1 -- 172.21.15.106:0/1333735548 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800caa0 con 0x7fb8200c5ca0 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.161+0000 7fb8167fc640 1 -- 172.21.15.106:0/1333735548 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81800cc20 con 0x7fb8200c5ca0 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.161+0000 7fb8167fc640 1 -- 172.21.15.106:0/1333735548 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818014440 con 0x7fb8200c5ca0 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.161+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8200aaf80 con 0x7fb8200c5ca0 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.161+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8201509b0 con 0x7fb8200c5ca0 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.162+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82014ec40 con 0x7fb8200c5ca0 2023-12-22T09:14:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.163+0000 7fb8167fc640 1 -- 172.21.15.106:0/1333735548 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb818007370 con 0x7fb8200c5ca0 2023-12-22T09:14:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.164+0000 7fb8167fc640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb80406a430 0x7fb80406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.164+0000 7fb8167fc640 1 -- 172.21.15.106:0/1333735548 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb818088b40 con 0x7fb8200c5ca0 2023-12-22T09:14:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.164+0000 7fb825be8640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb80406a430 0x7fb80406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.165+0000 7fb825be8640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb80406a430 0x7fb80406c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb81c036000 tx=0x7fb81c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.169+0000 7fb8167fc640 1 -- 172.21.15.106:0/1333735548 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb82014ec40 con 0x7fb8200c5ca0 2023-12-22T09:14:54.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.396+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb8200a9410 con 0x7fb8200c5ca0 2023-12-22T09:14:54.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.946+0000 7fb8167fc640 1 -- 172.21.15.106:0/1333735548 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb8200a9410 con 0x7fb8200c5ca0 2023-12-22T09:14:54.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb80406a430 msgr2=0x7fb80406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb80406a430 0x7fb80406c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb81c036000 tx=0x7fb81c03d040 comp rx=0 tx=0).stop 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 msgr2=0x7fb8201e24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 0x7fb8201e24e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b9e0 tx=0x7fb81800bea0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 shutdown_connections 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb80406a430 0x7fb80406c8f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8200c5ca0 0x7fb8201e24e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb820071e30 0x7fb8201e1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 --2- 172.21.15.106:0/1333735548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb82006bdc0 0x7fb8201e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 >> 172.21.15.106:0/1333735548 conn(0x7fb82006a220 msgr2=0x7fb8200c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 shutdown_connections 2023-12-22T09:14:54.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:54.950+0000 7fb827e4c640 1 -- 172.21.15.106:0/1333735548 wait complete. 2023-12-22T09:14:54.971 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-22T09:14:54.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T09:14:55.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.188+0000 7feed233c640 1 Processor -- start 2023-12-22T09:14:55.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.188+0000 7feed233c640 1 -- start start 2023-12-22T09:14:55.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.190+0000 7feed233c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feecc06bdc0 0x7feecc1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:55.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.190+0000 7feed233c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc14f570 con 0x7feecc06c2d0 2023-12-22T09:14:55.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.190+0000 7feed233c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc0c0b00 con 0x7feecc0c5a30 2023-12-22T09:14:55.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.190+0000 7feed233c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc0a90f0 con 0x7feecc06bdc0 2023-12-22T09:14:55.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.190+0000 7feec3fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feecc06bdc0 0x7feecc1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:55.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.190+0000 7feed08d9640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7feecc06c2d0 0x7feecc15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51916/0 (socket says 172.21.15.106:51916) 2023-12-22T09:14:55.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.190+0000 7feed08d9640 1 -- 172.21.15.106:0/2240199229 learned_addr learned my addr 172.21.15.106:0/2240199229 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:55.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.191+0000 7feec3fff640 1 -- 172.21.15.106:0/2240199229 >> v1:172.21.15.132:6789/0 conn(0x7feecc0c5a30 legacy=0x7feecc1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:55.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.191+0000 7feec3fff640 1 -- 172.21.15.106:0/2240199229 >> v1:172.21.15.106:6789/0 conn(0x7feecc06c2d0 legacy=0x7feecc15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:55.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.191+0000 7feecb7fe640 1 -- 172.21.15.106:0/2240199229 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210176632 0 0) 0x7feecc14f570 con 0x7feecc06c2d0 2023-12-22T09:14:55.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.191+0000 7feec3fff640 1 -- 172.21.15.106:0/2240199229 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0bfd40 con 0x7feecc06bdc0 2023-12-22T09:14:55.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.192+0000 7feec3fff640 1 --2- 172.21.15.106:0/2240199229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc06bdc0 0x7feecc1557f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feeb40097a0 tx=0x7feeb402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842b27004972e80 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:55.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.192+0000 7feecb7fe640 1 -- 172.21.15.106:0/2240199229 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4031830 con 0x7feecc06bdc0 2023-12-22T09:14:55.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.192+0000 7feecb7fe640 1 -- 172.21.15.106:0/2240199229 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4031990 con 0x7feecc06bdc0 2023-12-22T09:14:55.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.192+0000 7feecb7fe640 1 -- 172.21.15.106:0/2240199229 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4031d20 con 0x7feecc06bdc0 2023-12-22T09:14:55.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.193+0000 7feed233c640 1 -- 172.21.15.106:0/2240199229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc06bdc0 msgr2=0x7feecc1557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:55.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.193+0000 7feed233c640 1 --2- 172.21.15.106:0/2240199229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc06bdc0 0x7feecc1557f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feeb40097a0 tx=0x7feeb402b8d0 comp rx=0 tx=0).stop 2023-12-22T09:14:55.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.193+0000 7feed233c640 1 -- 172.21.15.106:0/2240199229 shutdown_connections 2023-12-22T09:14:55.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.193+0000 7feed233c640 1 --2- 172.21.15.106:0/2240199229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc06bdc0 0x7feecc1557f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:55.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.193+0000 7feed233c640 1 -- 172.21.15.106:0/2240199229 >> 172.21.15.106:0/2240199229 conn(0x7feecc06a220 msgr2=0x7feecc0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:55.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.193+0000 7feed233c640 1 -- 172.21.15.106:0/2240199229 shutdown_connections 2023-12-22T09:14:55.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.193+0000 7feed233c640 1 -- 172.21.15.106:0/2240199229 wait complete. 2023-12-22T09:14:55.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.195+0000 7feed233c640 1 Processor -- start 2023-12-22T09:14:55.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.195+0000 7feed233c640 1 -- start start 2023-12-22T09:14:55.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed233c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feecc06bdc0 0x7feecc0bcb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:55.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed233c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc06c2d0 0x7feecc06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:55.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed233c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc0c5a30 0x7feecc0be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:55.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed233c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc1ec2f0 con 0x7feecc0c5a30 2023-12-22T09:14:55.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed233c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc06fb90 con 0x7feecc06c2d0 2023-12-22T09:14:55.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed233c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc1e9c00 con 0x7feecc06bdc0 2023-12-22T09:14:55.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed08d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc0c5a30 0x7feecc0be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:55.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed08d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc0c5a30 0x7feecc0be8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40894/0 (socket says 172.21.15.106:40894) 2023-12-22T09:14:55.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed08d9640 1 -- 172.21.15.106:0/3550986206 learned_addr learned my addr 172.21.15.106:0/3550986206 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:55.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feec3fff640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc06c2d0 0x7feecc06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:55.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed08d9640 1 -- 172.21.15.106:0/3550986206 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feecc06bdc0 msgr2=0x7feecc0bcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:55.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feecbfff640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feecc06bdc0 0x7feecc0bcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:55.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed08d9640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feecc06bdc0 0x7feecc0bcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:55.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed08d9640 1 -- 172.21.15.106:0/3550986206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc06c2d0 msgr2=0x7feecc06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:55.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed08d9640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc06c2d0 0x7feecc06d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:55.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feed08d9640 1 -- 172.21.15.106:0/3550986206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4009400 con 0x7feecc0c5a30 2023-12-22T09:14:55.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.196+0000 7feec3fff640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc06c2d0 0x7feecc06d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:55.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.197+0000 7feed08d9640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc0c5a30 0x7feecc0be8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feec4002230 tx=0x7feec400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:55.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.197+0000 7feec97fa640 1 -- 172.21.15.106:0/3550986206 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400ce30 con 0x7feecc0c5a30 2023-12-22T09:14:55.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.197+0000 7feec97fa640 1 -- 172.21.15.106:0/3550986206 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec400a640 con 0x7feecc0c5a30 2023-12-22T09:14:55.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.197+0000 7feec97fa640 1 -- 172.21.15.106:0/3550986206 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400a9f0 con 0x7feecc0c5a30 2023-12-22T09:14:55.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.197+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc14b850 con 0x7feecc0c5a30 2023-12-22T09:14:55.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.197+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc14be10 con 0x7feecc0c5a30 2023-12-22T09:14:55.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.198+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc14c000 con 0x7feecc0c5a30 2023-12-22T09:14:55.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.199+0000 7feec97fa640 1 -- 172.21.15.106:0/3550986206 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feec400ab50 con 0x7feecc0c5a30 2023-12-22T09:14:55.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.200+0000 7feec97fa640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feeac06a480 0x7feeac06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:55.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.200+0000 7feec97fa640 1 -- 172.21.15.106:0/3550986206 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feec40884b0 con 0x7feecc0c5a30 2023-12-22T09:14:55.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.200+0000 7feecbfff640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feeac06a480 0x7feeac06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:55.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.201+0000 7feecbfff640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feeac06a480 0x7feeac06c940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feebc000f60 tx=0x7feebc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:55.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.204+0000 7feec97fa640 1 -- 172.21.15.106:0/3550986206 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feec4053820 con 0x7feecc0c5a30 2023-12-22T09:14:55.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.434+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feecc0bfff0 con 0x7feecc0c5a30 2023-12-22T09:14:55.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.950+0000 7feec97fa640 1 -- 172.21.15.106:0/3550986206 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7feec4056e40 con 0x7feecc0c5a30 2023-12-22T09:14:55.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feeac06a480 msgr2=0x7feeac06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feeac06a480 0x7feeac06c940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feebc000f60 tx=0x7feebc009040 comp rx=0 tx=0).stop 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc0c5a30 msgr2=0x7feecc0be8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc0c5a30 0x7feecc0be8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feec4002230 tx=0x7feec400cbe0 comp rx=0 tx=0).stop 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 shutdown_connections 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feeac06a480 0x7feeac06c940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc0c5a30 0x7feecc0be8f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc06c2d0 0x7feecc06d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 --2- 172.21.15.106:0/3550986206 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feecc06bdc0 0x7feecc0bcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 >> 172.21.15.106:0/3550986206 conn(0x7feecc06a220 msgr2=0x7feecc0c1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 shutdown_connections 2023-12-22T09:14:55.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:55.954+0000 7feed233c640 1 -- 172.21.15.106:0/3550986206 wait complete. 2023-12-22T09:14:55.975 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T09:14:55.976 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:14:56.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.190+0000 7fcb52015640 1 Processor -- start 2023-12-22T09:14:56.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.191+0000 7fcb52015640 1 -- start start 2023-12-22T09:14:56.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.192+0000 7fcb52015640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c0bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.192+0000 7fcb52015640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb4c06b760 0x7fcb4c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.192+0000 7fcb52015640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c157550 con 0x7fcb4c1579e0 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.192+0000 7fcb52015640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c1544b0 con 0x7fcb4c06b760 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.192+0000 7fcb52015640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c154790 con 0x7fcb4c0c2090 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.192+0000 7fcb50812640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb4c06b760 0x7fcb4c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.192+0000 7fcb50812640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb4c06b760 0x7fcb4c153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40906/0 (socket says 172.21.15.106:40906) 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.192+0000 7fcb50812640 1 -- 172.21.15.106:0/2071661526 learned_addr learned my addr 172.21.15.106:0/2071661526 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.193+0000 7fcb51013640 1 --2- 172.21.15.106:0/2071661526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c0bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.193+0000 7fcb50812640 1 -- 172.21.15.106:0/2071661526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 msgr2=0x7fcb4c0bfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.193+0000 7fcb50812640 1 --2- 172.21.15.106:0/2071661526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c0bfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.193+0000 7fcb50812640 1 -- 172.21.15.106:0/2071661526 >> v1:172.21.15.132:6789/0 conn(0x7fcb4c1579e0 legacy=0x7fcb4c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.193+0000 7fcb50812640 1 -- 172.21.15.106:0/2071661526 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c154a70 con 0x7fcb4c06b760 2023-12-22T09:14:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.193+0000 7fcb51013640 1 --2- 172.21.15.106:0/2071661526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c0bfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:56.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.194+0000 7fcb50812640 1 --2- 172.21.15.106:0/2071661526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c06b760 0x7fcb4c153c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009870 tx=0x7fcb3c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d79223f818fe5c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.194+0000 7fcb43fff640 1 -- 172.21.15.106:0/2071661526 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0317c0 con 0x7fcb4c06b760 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.194+0000 7fcb43fff640 1 -- 172.21.15.106:0/2071661526 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c031920 con 0x7fcb4c06b760 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.194+0000 7fcb43fff640 1 -- 172.21.15.106:0/2071661526 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c031cb0 con 0x7fcb4c06b760 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.195+0000 7fcb52015640 1 -- 172.21.15.106:0/2071661526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c06b760 msgr2=0x7fcb4c153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.195+0000 7fcb52015640 1 --2- 172.21.15.106:0/2071661526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c06b760 0x7fcb4c153c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009870 tx=0x7fcb3c02b860 comp rx=0 tx=0).stop 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.195+0000 7fcb52015640 1 -- 172.21.15.106:0/2071661526 shutdown_connections 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.195+0000 7fcb52015640 1 --2- 172.21.15.106:0/2071661526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c06b760 0x7fcb4c153c10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.195+0000 7fcb52015640 1 --2- 172.21.15.106:0/2071661526 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c0bfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.195+0000 7fcb52015640 1 -- 172.21.15.106:0/2071661526 >> 172.21.15.106:0/2071661526 conn(0x7fcb4c069dd0 msgr2=0x7fcb4c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.195+0000 7fcb52015640 1 -- 172.21.15.106:0/2071661526 shutdown_connections 2023-12-22T09:14:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.195+0000 7fcb52015640 1 -- 172.21.15.106:0/2071661526 wait complete. 2023-12-22T09:14:56.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.197+0000 7fcb52015640 1 Processor -- start 2023-12-22T09:14:56.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.197+0000 7fcb52015640 1 -- start start 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb52015640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb4c06b760 0x7fcb4c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb52015640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c1e8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb52015640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c1579e0 0x7fcb4c1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb52015640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0c3dc0 con 0x7fcb4c1579e0 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb52015640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0c4010 con 0x7fcb4c06b760 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb52015640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0c49a0 con 0x7fcb4c0c2090 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb51814640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c1579e0 0x7fcb4c1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb51814640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c1579e0 0x7fcb4c1553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40910/0 (socket says 172.21.15.106:40910) 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb51814640 1 -- 172.21.15.106:0/2264000953 learned_addr learned my addr 172.21.15.106:0/2264000953 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb51013640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb4c06b760 0x7fcb4c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb50812640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c1e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb51814640 1 -- 172.21.15.106:0/2264000953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 msgr2=0x7fcb4c1e8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.198+0000 7fcb51814640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c1e8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb51814640 1 -- 172.21.15.106:0/2264000953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb4c06b760 msgr2=0x7fcb4c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb51814640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb4c06b760 0x7fcb4c148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb51814640 1 -- 172.21.15.106:0/2264000953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0094d0 con 0x7fcb4c1579e0 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb50812640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c1e8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb51814640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c1579e0 0x7fcb4c1553c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c780 tx=0x7fcb4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb41ffb640 1 -- 172.21.15.106:0/2264000953 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44004b60 con 0x7fcb4c1579e0 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb41ffb640 1 -- 172.21.15.106:0/2264000953 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4400ce90 con 0x7fcb4c1579e0 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb41ffb640 1 -- 172.21.15.106:0/2264000953 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400a850 con 0x7fcb4c1579e0 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c0c4c80 con 0x7fcb4c1579e0 2023-12-22T09:14:56.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.199+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c14c8b0 con 0x7fcb4c1579e0 2023-12-22T09:14:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.201+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c04e8d0 con 0x7fcb4c1579e0 2023-12-22T09:14:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.201+0000 7fcb41ffb640 1 -- 172.21.15.106:0/2264000953 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb4400a9b0 con 0x7fcb4c1579e0 2023-12-22T09:14:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.202+0000 7fcb41ffb640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a460 0x7fcb3006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.202+0000 7fcb41ffb640 1 -- 172.21.15.106:0/2264000953 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb44088d00 con 0x7fcb4c1579e0 2023-12-22T09:14:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.203+0000 7fcb51013640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a460 0x7fcb3006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.203+0000 7fcb51013640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a460 0x7fcb3006c920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800a990 tx=0x7fcb48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:56.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.207+0000 7fcb41ffb640 1 -- 172.21.15.106:0/2264000953 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcb44054090 con 0x7fcb4c1579e0 2023-12-22T09:14:56.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.432+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb4c0c5e10 con 0x7fcb4c1579e0 2023-12-22T09:14:56.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.433+0000 7fcb41ffb640 1 -- 172.21.15.106:0/2264000953 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4653 (secure 0 0 0) 0x7fcb440576b0 con 0x7fcb4c1579e0 2023-12-22T09:14:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:56.435 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:55.943828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T09:14:56.435 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-12-22T09:14:56.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a460 msgr2=0x7fcb3006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a460 0x7fcb3006c920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800a990 tx=0x7fcb48008040 comp rx=0 tx=0).stop 2023-12-22T09:14:56.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c1579e0 msgr2=0x7fcb4c1553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c1579e0 0x7fcb4c1553c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c780 tx=0x7fcb4400cc40 comp rx=0 tx=0).stop 2023-12-22T09:14:56.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 shutdown_connections 2023-12-22T09:14:56.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a460 0x7fcb3006c920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb4c1579e0 0x7fcb4c1553c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb4c0c2090 0x7fcb4c1e8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 --2- 172.21.15.106:0/2264000953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb4c06b760 0x7fcb4c148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 >> 172.21.15.106:0/2264000953 conn(0x7fcb4c069dd0 msgr2=0x7fcb4c0c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:56.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 shutdown_connections 2023-12-22T09:14:56.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.436+0000 7fcb52015640 1 -- 172.21.15.106:0/2264000953 wait complete. 2023-12-22T09:14:56.456 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:56.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.659+0000 7ff651bc9640 1 Processor -- start 2023-12-22T09:14:56.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.659+0000 7ff651bc9640 1 -- start start 2023-12-22T09:14:56.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff651bc9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff64c0bfce0 0x7ff64c06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff651bc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff64c151b30 0x7ff64c151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff651bc9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c0bf770 con 0x7ff64c13b060 2023-12-22T09:14:56.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff651bc9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c155120 con 0x7ff64c0bfce0 2023-12-22T09:14:56.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff651bc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c155400 con 0x7ff64c151b30 2023-12-22T09:14:56.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff64affd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff64c0bfce0 0x7ff64c06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff64affd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff64c0bfce0 0x7ff64c06a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40912/0 (socket says 172.21.15.106:40912) 2023-12-22T09:14:56.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff64affd640 1 -- 172.21.15.106:0/3010311170 learned_addr learned my addr 172.21.15.106:0/3010311170 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:56.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff64b7fe640 1 --1- 172.21.15.106:0/3010311170 >> v1:172.21.15.106:6789/0 conn(0x7ff64c13b060 0x7ff64c069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51928/0 (socket says 172.21.15.106:51928) 2023-12-22T09:14:56.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff64affd640 1 -- 172.21.15.106:0/3010311170 >> v2:172.21.15.132:3300/0 conn(0x7ff64c151b30 msgr2=0x7ff64c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:56.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff64affd640 1 --2- 172.21.15.106:0/3010311170 >> v2:172.21.15.132:3300/0 conn(0x7ff64c151b30 0x7ff64c151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff64affd640 1 -- 172.21.15.106:0/3010311170 >> v1:172.21.15.106:6789/0 conn(0x7ff64c13b060 legacy=0x7ff64c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.661+0000 7ff64affd640 1 -- 172.21.15.106:0/3010311170 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c1556e0 con 0x7ff64c0bfce0 2023-12-22T09:14:56.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.662+0000 7ff64affd640 1 --2- 172.21.15.106:0/3010311170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 0x7ff64c06a6b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0c02a0 tx=0x7ff64002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0168919aee6364 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:56.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.663+0000 7ff64a7fc640 1 -- 172.21.15.106:0/3010311170 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64002ca80 con 0x7ff64c0bfce0 2023-12-22T09:14:56.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.663+0000 7ff64a7fc640 1 -- 172.21.15.106:0/3010311170 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64002cbe0 con 0x7ff64c0bfce0 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.663+0000 7ff64a7fc640 1 -- 172.21.15.106:0/3010311170 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400343f0 con 0x7ff64c0bfce0 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.663+0000 7ff651bc9640 1 -- 172.21.15.106:0/3010311170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 msgr2=0x7ff64c06a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.663+0000 7ff651bc9640 1 --2- 172.21.15.106:0/3010311170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 0x7ff64c06a6b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0c02a0 tx=0x7ff64002bee0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.663+0000 7ff651bc9640 1 -- 172.21.15.106:0/3010311170 shutdown_connections 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.663+0000 7ff651bc9640 1 --2- 172.21.15.106:0/3010311170 >> v2:172.21.15.132:3300/0 conn(0x7ff64c151b30 0x7ff64c151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.663+0000 7ff651bc9640 1 --2- 172.21.15.106:0/3010311170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 0x7ff64c06a6b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.663+0000 7ff651bc9640 1 -- 172.21.15.106:0/3010311170 >> 172.21.15.106:0/3010311170 conn(0x7ff64c0c5360 msgr2=0x7ff64c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.664+0000 7ff651bc9640 1 -- 172.21.15.106:0/3010311170 shutdown_connections 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.664+0000 7ff651bc9640 1 -- 172.21.15.106:0/3010311170 wait complete. 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.665+0000 7ff651bc9640 1 Processor -- start 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.665+0000 7ff651bc9640 1 -- start start 2023-12-22T09:14:56.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.666+0000 7ff651bc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 0x7ff64c0c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.666+0000 7ff651bc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff64c13b060 0x7ff64c1ea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.666+0000 7ff651bc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff64c151b30 0x7ff64c14fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.666+0000 7ff651bc9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c153cc0 con 0x7ff64c0bfce0 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.666+0000 7ff651bc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c1547e0 con 0x7ff64c13b060 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.666+0000 7ff651bc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c1db7c0 con 0x7ff64c151b30 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 0x7ff64c0c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 0x7ff64c0c2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40928/0 (socket says 172.21.15.106:40928) 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64b7fe640 1 -- 172.21.15.106:0/2632643561 learned_addr learned my addr 172.21.15.106:0/2632643561 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64bfff640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff64c151b30 0x7ff64c14fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64b7fe640 1 -- 172.21.15.106:0/2632643561 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff64c151b30 msgr2=0x7ff64c14fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64affd640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff64c13b060 0x7ff64c1ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64b7fe640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff64c151b30 0x7ff64c14fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64b7fe640 1 -- 172.21.15.106:0/2632643561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff64c13b060 msgr2=0x7ff64c1ea850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64b7fe640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff64c13b060 0x7ff64c1ea850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64b7fe640 1 -- 172.21.15.106:0/2632643561 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640009b30 con 0x7ff64c0bfce0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.667+0000 7ff64b7fe640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 0x7ff64c0c2f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00c490 tx=0x7ff63c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.668+0000 7ff633fff640 1 -- 172.21.15.106:0/2632643561 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0074e0 con 0x7ff64c0bfce0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.668+0000 7ff633fff640 1 -- 172.21.15.106:0/2632643561 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c007640 con 0x7ff64c0bfce0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.668+0000 7ff633fff640 1 -- 172.21.15.106:0/2632643561 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0059e0 con 0x7ff64c0bfce0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.668+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c1eb360 con 0x7ff64c0bfce0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.668+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c154d10 con 0x7ff64c0bfce0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.669+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c073f10 con 0x7ff64c0bfce0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.670+0000 7ff633fff640 1 -- 172.21.15.106:0/2632643561 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff63c005b40 con 0x7ff64c0bfce0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.671+0000 7ff633fff640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff63806a460 0x7ff63806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.671+0000 7ff633fff640 1 -- 172.21.15.106:0/2632643561 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff63c0880f0 con 0x7ff64c0bfce0 2023-12-22T09:14:56.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.671+0000 7ff64affd640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff63806a460 0x7ff63806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:56.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.672+0000 7ff64affd640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff63806a460 0x7ff63806c920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff640035000 tx=0x7ff640030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:56.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.675+0000 7ff633fff640 1 -- 172.21.15.106:0/2632643561 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff63c056f10 con 0x7ff64c0bfce0 2023-12-22T09:14:56.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.870+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff64c155990 con 0x7ff64c0bfce0 2023-12-22T09:14:56.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.872+0000 7ff633fff640 1 -- 172.21.15.106:0/2632643561 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7ff63c056aa0 con 0x7ff64c0bfce0 2023-12-22T09:14:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:56.873 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff63806a460 msgr2=0x7ff63806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff63806a460 0x7ff63806c920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff640035000 tx=0x7ff640030000 comp rx=0 tx=0).stop 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 msgr2=0x7ff64c0c2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 0x7ff64c0c2f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00c490 tx=0x7ff63c00c950 comp rx=0 tx=0).stop 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 shutdown_connections 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff63806a460 0x7ff63806c920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff64c151b30 0x7ff64c14fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff64c13b060 0x7ff64c1ea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 --2- 172.21.15.106:0/2632643561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff64c0bfce0 0x7ff64c0c2f30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:56.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 >> 172.21.15.106:0/2632643561 conn(0x7ff64c0c5360 msgr2=0x7ff64c151f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:56.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 shutdown_connections 2023-12-22T09:14:56.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:56.875+0000 7ff651bc9640 1 -- 172.21.15.106:0/2632643561 wait complete. 2023-12-22T09:14:56.896 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T09:14:56.896 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:14:57.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.109+0000 7f1cb605f640 1 Processor -- start 2023-12-22T09:14:57.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.109+0000 7f1cb605f640 1 -- start start 2023-12-22T09:14:57.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1cb605f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1cb00bfce0 0x7f1cb006a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1cb605f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1cb0151b30 0x7f1cb0151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1cb605f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb00bf770 con 0x7f1cb013b060 2023-12-22T09:14:57.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1cb605f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb0155120 con 0x7f1cb00bfce0 2023-12-22T09:14:57.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1cb605f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb0155400 con 0x7f1cb0151b30 2023-12-22T09:14:57.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1caeffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1cb00bfce0 0x7f1cb006a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1caeffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1cb00bfce0 0x7f1cb006a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40940/0 (socket says 172.21.15.106:40940) 2023-12-22T09:14:57.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1caeffd640 1 -- 172.21.15.106:0/2350312274 learned_addr learned my addr 172.21.15.106:0/2350312274 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:57.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1caeffd640 1 -- 172.21.15.106:0/2350312274 >> v2:172.21.15.132:3300/0 conn(0x7f1cb0151b30 msgr2=0x7f1cb0151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:57.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1caeffd640 1 --2- 172.21.15.106:0/2350312274 >> v2:172.21.15.132:3300/0 conn(0x7f1cb0151b30 0x7f1cb0151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1caeffd640 1 -- 172.21.15.106:0/2350312274 >> v1:172.21.15.132:6789/0 conn(0x7f1cb013b060 legacy=0x7f1cb0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:57.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.111+0000 7f1caeffd640 1 -- 172.21.15.106:0/2350312274 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb01556e0 con 0x7f1cb00bfce0 2023-12-22T09:14:57.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.113+0000 7f1caeffd640 1 --2- 172.21.15.106:0/2350312274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb00bfce0 0x7f1cb006a6b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00c02a0 tx=0x7f1ca402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad5fa1fa0dbcc27 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:57.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.113+0000 7f1cae7fc640 1 -- 172.21.15.106:0/2350312274 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40317e0 con 0x7f1cb00bfce0 2023-12-22T09:14:57.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.113+0000 7f1cae7fc640 1 -- 172.21.15.106:0/2350312274 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4031940 con 0x7f1cb00bfce0 2023-12-22T09:14:57.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.113+0000 7f1cae7fc640 1 -- 172.21.15.106:0/2350312274 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4031cd0 con 0x7f1cb00bfce0 2023-12-22T09:14:57.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.114+0000 7f1cb605f640 1 -- 172.21.15.106:0/2350312274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb00bfce0 msgr2=0x7f1cb006a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.114+0000 7f1cb605f640 1 --2- 172.21.15.106:0/2350312274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb00bfce0 0x7f1cb006a6b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00c02a0 tx=0x7f1ca402b880 comp rx=0 tx=0).stop 2023-12-22T09:14:57.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.114+0000 7f1cb605f640 1 -- 172.21.15.106:0/2350312274 shutdown_connections 2023-12-22T09:14:57.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.114+0000 7f1cb605f640 1 --2- 172.21.15.106:0/2350312274 >> v2:172.21.15.132:3300/0 conn(0x7f1cb0151b30 0x7f1cb0151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.114+0000 7f1cb605f640 1 --2- 172.21.15.106:0/2350312274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb00bfce0 0x7f1cb006a6b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.114+0000 7f1cb605f640 1 -- 172.21.15.106:0/2350312274 >> 172.21.15.106:0/2350312274 conn(0x7f1cb00c5360 msgr2=0x7f1cb00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:57.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.114+0000 7f1cb605f640 1 -- 172.21.15.106:0/2350312274 shutdown_connections 2023-12-22T09:14:57.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.114+0000 7f1cb605f640 1 -- 172.21.15.106:0/2350312274 wait complete. 2023-12-22T09:14:57.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.116+0000 7f1cb605f640 1 Processor -- start 2023-12-22T09:14:57.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.116+0000 7f1cb605f640 1 -- start start 2023-12-22T09:14:57.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.116+0000 7f1cb605f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cb00bfce0 0x7f1cb00c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1cb605f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb013b060 0x7f1cb00be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1cb605f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cb0151b30 0x7f1cb006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1cb605f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01ec3f0 con 0x7f1cb013b060 2023-12-22T09:14:57.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1cb605f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01ecc50 con 0x7f1cb00bfce0 2023-12-22T09:14:57.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1cb605f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0071930 con 0x7f1cb0151b30 2023-12-22T09:14:57.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caeffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb013b060 0x7f1cb00be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caeffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb013b060 0x7f1cb00be8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40950/0 (socket says 172.21.15.106:40950) 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caeffd640 1 -- 172.21.15.106:0/3743177124 learned_addr learned my addr 172.21.15.106:0/3743177124 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caffff640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cb0151b30 0x7f1cb006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caeffd640 1 -- 172.21.15.106:0/3743177124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cb0151b30 msgr2=0x7f1cb006fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caeffd640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cb0151b30 0x7f1cb006fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caf7fe640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cb00bfce0 0x7f1cb00c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caeffd640 1 -- 172.21.15.106:0/3743177124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cb00bfce0 msgr2=0x7f1cb00c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caeffd640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cb00bfce0 0x7f1cb00c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.117+0000 7f1caeffd640 1 -- 172.21.15.106:0/3743177124 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca40094d0 con 0x7f1cb013b060 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.118+0000 7f1caeffd640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb013b060 0x7f1cb00be8e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4000c00 tx=0x7f1ca40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.118+0000 7f1c97fff640 1 -- 172.21.15.106:0/3743177124 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4032940 con 0x7f1cb013b060 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.118+0000 7f1c97fff640 1 -- 172.21.15.106:0/3743177124 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4032aa0 con 0x7f1cb013b060 2023-12-22T09:14:57.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.118+0000 7f1c97fff640 1 -- 172.21.15.106:0/3743177124 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4032e50 con 0x7f1cb013b060 2023-12-22T09:14:57.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.118+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb01ec600 con 0x7f1cb013b060 2023-12-22T09:14:57.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.118+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb00bee20 con 0x7f1cb013b060 2023-12-22T09:14:57.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.119+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb01ece00 con 0x7f1cb013b060 2023-12-22T09:14:57.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.120+0000 7f1c97fff640 1 -- 172.21.15.106:0/3743177124 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1ca40453f0 con 0x7f1cb013b060 2023-12-22T09:14:57.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.121+0000 7f1c97fff640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9c06a430 0x7f1c9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.121+0000 7f1c97fff640 1 -- 172.21.15.106:0/3743177124 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ca40aae80 con 0x7f1cb013b060 2023-12-22T09:14:57.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.121+0000 7f1caf7fe640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9c06a430 0x7f1c9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.122+0000 7f1caf7fe640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9c06a430 0x7f1c9c06c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000a700 tx=0x7f1ca0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:57.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.126+0000 7f1c97fff640 1 -- 172.21.15.106:0/3743177124 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1cb01ece00 con 0x7f1cb013b060 2023-12-22T09:14:57.312 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.312+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1cb0155ca0 con 0x7f1c9c06a430 2023-12-22T09:14:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.345+0000 7f1c97fff640 1 -- 172.21.15.106:0/3743177124 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345081 (secure 0 0 0) 0x7f1ca000a3a0 con 0x7f1c9c06a430 2023-12-22T09:14:57.350 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:14:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9c06a430 msgr2=0x7f1c9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9c06a430 0x7f1c9c06c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000a700 tx=0x7f1ca0008040 comp rx=0 tx=0).stop 2023-12-22T09:14:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb013b060 msgr2=0x7f1cb00be8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb013b060 0x7f1cb00be8e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4000c00 tx=0x7f1ca40046c0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 shutdown_connections 2023-12-22T09:14:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9c06a430 0x7f1c9c06c8f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cb0151b30 0x7f1cb006fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb013b060 0x7f1cb00be8e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 --2- 172.21.15.106:0/3743177124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cb00bfce0 0x7f1cb00c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 >> 172.21.15.106:0/3743177124 conn(0x7f1cb00c5360 msgr2=0x7f1cb0072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 shutdown_connections 2023-12-22T09:14:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.352+0000 7f1cb605f640 1 -- 172.21.15.106:0/3743177124 wait complete. 2023-12-22T09:14:57.375 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-22T09:14:56.704531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218888,"kb_used_data":3272,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755832,"statfs":{"total":773094113280,"available":772869971968,"internally_reserved":0,"allocated":3350528,"data_stored":2014524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005500"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491770+0000","last_change":"2023-12-22T09:14:27.999590+0000","last_active":"2023-12-22T09:14:32.491770+0000","last_peered":"2023-12-22T09:14:32.491770+0000","last_clean":"2023-12-22T09:14:32.491770+0000","last_became_active":"2023-12-22T09:14:27.999168+0000","last_became_peered":"2023-12-22T09:14:27.999168+0000","last_unstale":"2023-12-22T09:14:32.491770+0000","last_undegraded":"2023-12-22T09:14:32.491770+0000","last_fullsized":"2023-12-22T09:14:32.491770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:55.319959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468195+0000","last_change":"2023-12-22T09:14:28.471978+0000","last_active":"2023-12-22T09:14:32.468195+0000","last_peered":"2023-12-22T09:14:32.468195+0000","last_clean":"2023-12-22T09:14:32.468195+0000","last_became_active":"2023-12-22T09:14:28.471551+0000","last_became_peered":"2023-12-22T09:14:28.471551+0000","last_unstale":"2023-12-22T09:14:32.468195+0000","last_undegraded":"2023-12-22T09:14:32.468195+0000","last_fullsized":"2023-12-22T09:14:32.468195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.753370+0000","last_change":"2023-12-22T09:14:32.750885+0000","last_active":"2023-12-22T09:14:32.753370+0000","last_peered":"2023-12-22T09:14:32.753370+0000","last_clean":"2023-12-22T09:14:32.753370+0000","last_became_active":"2023-12-22T09:14:32.750410+0000","last_became_peered":"2023-12-22T09:14:32.750410+0000","last_unstale":"2023-12-22T09:14:32.753370+0000","last_undegraded":"2023-12-22T09:14:32.753370+0000","last_fullsized":"2023-12-22T09:14:32.753370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:03:15.507458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468717+0000","last_change":"2023-12-22T09:14:27.993421+0000","last_active":"2023-12-22T09:14:32.468717+0000","last_peered":"2023-12-22T09:14:32.468717+0000","last_clean":"2023-12-22T09:14:32.468717+0000","last_became_active":"2023-12-22T09:14:27.993088+0000","last_became_peered":"2023-12-22T09:14:27.993088+0000","last_unstale":"2023-12-22T09:14:32.468717+0000","last_undegraded":"2023-12-22T09:14:32.468717+0000","last_fullsized":"2023-12-22T09:14:32.468717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491593+0000","last_change":"2023-12-22T09:14:28.475345+0000","last_active":"2023-12-22T09:14:32.491593+0000","last_peered":"2023-12-22T09:14:32.491593+0000","last_clean":"2023-12-22T09:14:32.491593+0000","last_became_active":"2023-12-22T09:14:28.473015+0000","last_became_peered":"2023-12-22T09:14:28.473015+0000","last_unstale":"2023-12-22T09:14:32.491593+0000","last_undegraded":"2023-12-22T09:14:32.491593+0000","last_fullsized":"2023-12-22T09:14:32.491593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502282+0000","last_change":"2023-12-22T09:14:32.497444+0000","last_active":"2023-12-22T09:14:32.502282+0000","last_peered":"2023-12-22T09:14:32.502282+0000","last_clean":"2023-12-22T09:14:32.502282+0000","last_became_active":"2023-12-22T09:14:32.494648+0000","last_became_peered":"2023-12-22T09:14:32.494648+0000","last_unstale":"2023-12-22T09:14:32.502282+0000","last_undegraded":"2023-12-22T09:14:32.502282+0000","last_fullsized":"2023-12-22T09:14:32.502282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:47:30.609572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749932+0000","last_change":"2023-12-22T09:14:28.004480+0000","last_active":"2023-12-22T09:14:32.749932+0000","last_peered":"2023-12-22T09:14:32.749932+0000","last_clean":"2023-12-22T09:14:32.749932+0000","last_became_active":"2023-12-22T09:14:28.004122+0000","last_became_peered":"2023-12-22T09:14:28.004122+0000","last_unstale":"2023-12-22T09:14:32.749932+0000","last_undegraded":"2023-12-22T09:14:32.749932+0000","last_fullsized":"2023-12-22T09:14:32.749932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:21.127787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494251+0000","last_change":"2023-12-22T09:14:28.476757+0000","last_active":"2023-12-22T09:14:32.494251+0000","last_peered":"2023-12-22T09:14:32.494251+0000","last_clean":"2023-12-22T09:14:32.494251+0000","last_became_active":"2023-12-22T09:14:28.476378+0000","last_became_peered":"2023-12-22T09:14:28.476378+0000","last_unstale":"2023-12-22T09:14:32.494251+0000","last_undegraded":"2023-12-22T09:14:32.494251+0000","last_fullsized":"2023-12-22T09:14:32.494251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507391+0000","last_change":"2023-12-22T09:14:32.502471+0000","last_active":"2023-12-22T09:14:32.507391+0000","last_peered":"2023-12-22T09:14:32.507391+0000","last_clean":"2023-12-22T09:14:32.507391+0000","last_became_active":"2023-12-22T09:14:32.501880+0000","last_became_peered":"2023-12-22T09:14:32.501880+0000","last_unstale":"2023-12-22T09:14:32.507391+0000","last_undegraded":"2023-12-22T09:14:32.507391+0000","last_fullsized":"2023-12-22T09:14:32.507391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:16.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749172+0000","last_change":"2023-12-22T09:14:28.005371+0000","last_active":"2023-12-22T09:14:32.749172+0000","last_peered":"2023-12-22T09:14:32.749172+0000","last_clean":"2023-12-22T09:14:32.749172+0000","last_became_active":"2023-12-22T09:14:28.005096+0000","last_became_peered":"2023-12-22T09:14:28.005096+0000","last_unstale":"2023-12-22T09:14:32.749172+0000","last_undegraded":"2023-12-22T09:14:32.749172+0000","last_fullsized":"2023-12-22T09:14:32.749172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495790+0000","last_change":"2023-12-22T09:14:28.481890+0000","last_active":"2023-12-22T09:14:32.495790+0000","last_peered":"2023-12-22T09:14:32.495790+0000","last_clean":"2023-12-22T09:14:32.495790+0000","last_became_active":"2023-12-22T09:14:28.480455+0000","last_became_peered":"2023-12-22T09:14:28.480455+0000","last_unstale":"2023-12-22T09:14:32.495790+0000","last_undegraded":"2023-12-22T09:14:32.495790+0000","last_fullsized":"2023-12-22T09:14:32.495790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:34.191893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502319+0000","last_change":"2023-12-22T09:14:32.497995+0000","last_active":"2023-12-22T09:14:32.502319+0000","last_peered":"2023-12-22T09:14:32.502319+0000","last_clean":"2023-12-22T09:14:32.502319+0000","last_became_active":"2023-12-22T09:14:32.497136+0000","last_became_peered":"2023-12-22T09:14:32.497136+0000","last_unstale":"2023-12-22T09:14:32.502319+0000","last_undegraded":"2023-12-22T09:14:32.502319+0000","last_fullsized":"2023-12-22T09:14:32.502319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:02.042832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490410+0000","last_change":"2023-12-22T09:14:28.467962+0000","last_active":"2023-12-22T09:14:32.490410+0000","last_peered":"2023-12-22T09:14:32.490410+0000","last_clean":"2023-12-22T09:14:32.490410+0000","last_became_active":"2023-12-22T09:14:28.467669+0000","last_became_peered":"2023-12-22T09:14:28.467669+0000","last_unstale":"2023-12-22T09:14:32.490410+0000","last_undegraded":"2023-12-22T09:14:32.490410+0000","last_fullsized":"2023-12-22T09:14:32.490410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:14:12.211157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749464+0000","last_change":"2023-12-22T09:14:28.003252+0000","last_active":"2023-12-22T09:14:32.749464+0000","last_peered":"2023-12-22T09:14:32.749464+0000","last_clean":"2023-12-22T09:14:32.749464+0000","last_became_active":"2023-12-22T09:14:28.002818+0000","last_became_peered":"2023-12-22T09:14:28.002818+0000","last_unstale":"2023-12-22T09:14:32.749464+0000","last_undegraded":"2023-12-22T09:14:32.749464+0000","last_fullsized":"2023-12-22T09:14:32.749464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:41.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502344+0000","last_change":"2023-12-22T09:14:32.498105+0000","last_active":"2023-12-22T09:14:32.502344+0000","last_peered":"2023-12-22T09:14:32.502344+0000","last_clean":"2023-12-22T09:14:32.502344+0000","last_became_active":"2023-12-22T09:14:32.497287+0000","last_became_peered":"2023-12-22T09:14:32.497287+0000","last_unstale":"2023-12-22T09:14:32.502344+0000","last_undegraded":"2023-12-22T09:14:32.502344+0000","last_fullsized":"2023-12-22T09:14:32.502344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:20.526932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467458+0000","last_change":"2023-12-22T09:14:28.481525+0000","last_active":"2023-12-22T09:14:32.467458+0000","last_peered":"2023-12-22T09:14:32.467458+0000","last_clean":"2023-12-22T09:14:32.467458+0000","last_became_active":"2023-12-22T09:14:28.480895+0000","last_became_peered":"2023-12-22T09:14:28.480895+0000","last_unstale":"2023-12-22T09:14:32.467458+0000","last_undegraded":"2023-12-22T09:14:32.467458+0000","last_fullsized":"2023-12-22T09:14:32.467458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477412+0000","last_change":"2023-12-22T09:14:27.988542+0000","last_active":"2023-12-22T09:14:32.477412+0000","last_peered":"2023-12-22T09:14:32.477412+0000","last_clean":"2023-12-22T09:14:32.477412+0000","last_became_active":"2023-12-22T09:14:27.988286+0000","last_became_peered":"2023-12-22T09:14:27.988286+0000","last_unstale":"2023-12-22T09:14:32.477412+0000","last_undegraded":"2023-12-22T09:14:32.477412+0000","last_fullsized":"2023-12-22T09:14:32.477412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.496996+0000","last_change":"2023-12-22T09:14:32.489874+0000","last_active":"2023-12-22T09:14:32.496996+0000","last_peered":"2023-12-22T09:14:32.496996+0000","last_clean":"2023-12-22T09:14:32.496996+0000","last_became_active":"2023-12-22T09:14:32.489424+0000","last_became_peered":"2023-12-22T09:14:32.489424+0000","last_unstale":"2023-12-22T09:14:32.496996+0000","last_undegraded":"2023-12-22T09:14:32.496996+0000","last_fullsized":"2023-12-22T09:14:32.496996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:16.494365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466677+0000","last_change":"2023-12-22T09:14:28.479495+0000","last_active":"2023-12-22T09:14:32.466677+0000","last_peered":"2023-12-22T09:14:32.466677+0000","last_clean":"2023-12-22T09:14:32.466677+0000","last_became_active":"2023-12-22T09:14:28.479219+0000","last_became_peered":"2023-12-22T09:14:28.479219+0000","last_unstale":"2023-12-22T09:14:32.466677+0000","last_undegraded":"2023-12-22T09:14:32.466677+0000","last_fullsized":"2023-12-22T09:14:32.466677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:34.191893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479772+0000","last_change":"2023-12-22T09:14:27.998498+0000","last_active":"2023-12-22T09:14:32.479772+0000","last_peered":"2023-12-22T09:14:32.479772+0000","last_clean":"2023-12-22T09:14:32.479772+0000","last_became_active":"2023-12-22T09:14:27.998184+0000","last_became_peered":"2023-12-22T09:14:27.998184+0000","last_unstale":"2023-12-22T09:14:32.479772+0000","last_undegraded":"2023-12-22T09:14:32.479772+0000","last_fullsized":"2023-12-22T09:14:32.479772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:21.127787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.761912+0000","last_change":"2023-12-22T09:14:32.760763+0000","last_active":"2023-12-22T09:14:32.761912+0000","last_peered":"2023-12-22T09:14:32.761912+0000","last_clean":"2023-12-22T09:14:32.761912+0000","last_became_active":"2023-12-22T09:14:32.760138+0000","last_became_peered":"2023-12-22T09:14:32.760138+0000","last_unstale":"2023-12-22T09:14:32.761912+0000","last_undegraded":"2023-12-22T09:14:32.761912+0000","last_fullsized":"2023-12-22T09:14:32.761912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:16.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.478893+0000","last_change":"2023-12-22T09:14:28.467496+0000","last_active":"2023-12-22T09:14:32.478893+0000","last_peered":"2023-12-22T09:14:32.478893+0000","last_clean":"2023-12-22T09:14:32.478893+0000","last_became_active":"2023-12-22T09:14:28.463616+0000","last_became_peered":"2023-12-22T09:14:28.463616+0000","last_unstale":"2023-12-22T09:14:32.478893+0000","last_undegraded":"2023-12-22T09:14:32.478893+0000","last_fullsized":"2023-12-22T09:14:32.478893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:26.247244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.745036+0000","last_change":"2023-12-22T09:14:28.000212+0000","last_active":"2023-12-22T09:14:32.745036+0000","last_peered":"2023-12-22T09:14:32.745036+0000","last_clean":"2023-12-22T09:14:32.745036+0000","last_became_active":"2023-12-22T09:14:27.999905+0000","last_became_peered":"2023-12-22T09:14:27.999905+0000","last_unstale":"2023-12-22T09:14:32.745036+0000","last_undegraded":"2023-12-22T09:14:32.745036+0000","last_fullsized":"2023-12-22T09:14:32.745036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.504899+0000","last_change":"2023-12-22T09:14:32.502188+0000","last_active":"2023-12-22T09:14:32.504899+0000","last_peered":"2023-12-22T09:14:32.504899+0000","last_clean":"2023-12-22T09:14:32.504899+0000","last_became_active":"2023-12-22T09:14:32.501764+0000","last_became_peered":"2023-12-22T09:14:32.501764+0000","last_unstale":"2023-12-22T09:14:32.504899+0000","last_undegraded":"2023-12-22T09:14:32.504899+0000","last_fullsized":"2023-12-22T09:14:32.504899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:38.035204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491844+0000","last_change":"2023-12-22T09:14:28.463499+0000","last_active":"2023-12-22T09:14:32.491844+0000","last_peered":"2023-12-22T09:14:32.491844+0000","last_clean":"2023-12-22T09:14:32.491844+0000","last_became_active":"2023-12-22T09:14:28.463220+0000","last_became_peered":"2023-12-22T09:14:28.463220+0000","last_unstale":"2023-12-22T09:14:32.491844+0000","last_undegraded":"2023-12-22T09:14:32.491844+0000","last_fullsized":"2023-12-22T09:14:32.491844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489384+0000","last_change":"2023-12-22T09:14:27.999099+0000","last_active":"2023-12-22T09:14:32.489384+0000","last_peered":"2023-12-22T09:14:32.489384+0000","last_clean":"2023-12-22T09:14:32.489384+0000","last_became_active":"2023-12-22T09:14:27.998803+0000","last_became_peered":"2023-12-22T09:14:27.998803+0000","last_unstale":"2023-12-22T09:14:32.489384+0000","last_undegraded":"2023-12-22T09:14:32.489384+0000","last_fullsized":"2023-12-22T09:14:32.489384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:15:18.285741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.766019+0000","last_change":"2023-12-22T09:14:32.764135+0000","last_active":"2023-12-22T09:14:32.766019+0000","last_peered":"2023-12-22T09:14:32.766019+0000","last_clean":"2023-12-22T09:14:32.766019+0000","last_became_active":"2023-12-22T09:14:32.761760+0000","last_became_peered":"2023-12-22T09:14:32.761760+0000","last_unstale":"2023-12-22T09:14:32.766019+0000","last_undegraded":"2023-12-22T09:14:32.766019+0000","last_fullsized":"2023-12-22T09:14:32.766019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.471279+0000","last_change":"2023-12-22T09:14:28.475255+0000","last_active":"2023-12-22T09:14:32.471279+0000","last_peered":"2023-12-22T09:14:32.471279+0000","last_clean":"2023-12-22T09:14:32.471279+0000","last_became_active":"2023-12-22T09:14:28.475002+0000","last_became_peered":"2023-12-22T09:14:28.475002+0000","last_unstale":"2023-12-22T09:14:32.471279+0000","last_undegraded":"2023-12-22T09:14:32.471279+0000","last_fullsized":"2023-12-22T09:14:32.471279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:33.410634+0000","last_change":"2023-12-22T09:14:27.992093+0000","last_active":"2023-12-22T09:14:33.410634+0000","last_peered":"2023-12-22T09:14:33.410634+0000","last_clean":"2023-12-22T09:14:33.410634+0000","last_became_active":"2023-12-22T09:14:27.991810+0000","last_became_peered":"2023-12-22T09:14:27.991810+0000","last_unstale":"2023-12-22T09:14:33.410634+0000","last_undegraded":"2023-12-22T09:14:33.410634+0000","last_fullsized":"2023-12-22T09:14:33.410634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.753349+0000","last_change":"2023-12-22T09:14:32.750234+0000","last_active":"2023-12-22T09:14:32.753349+0000","last_peered":"2023-12-22T09:14:32.753349+0000","last_clean":"2023-12-22T09:14:32.753349+0000","last_became_active":"2023-12-22T09:14:32.749801+0000","last_became_peered":"2023-12-22T09:14:32.749801+0000","last_unstale":"2023-12-22T09:14:32.753349+0000","last_undegraded":"2023-12-22T09:14:32.753349+0000","last_fullsized":"2023-12-22T09:14:32.753349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:14:08.228677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477551+0000","last_change":"2023-12-22T09:14:28.454337+0000","last_active":"2023-12-22T09:14:32.477551+0000","last_peered":"2023-12-22T09:14:32.477551+0000","last_clean":"2023-12-22T09:14:32.477551+0000","last_became_active":"2023-12-22T09:14:28.454047+0000","last_became_peered":"2023-12-22T09:14:28.454047+0000","last_unstale":"2023-12-22T09:14:32.477551+0000","last_undegraded":"2023-12-22T09:14:32.477551+0000","last_fullsized":"2023-12-22T09:14:32.477551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.756169+0000","last_change":"2023-12-22T09:14:28.001870+0000","last_active":"2023-12-22T09:14:32.756169+0000","last_peered":"2023-12-22T09:14:32.756169+0000","last_clean":"2023-12-22T09:14:32.756169+0000","last_became_active":"2023-12-22T09:14:28.001090+0000","last_became_peered":"2023-12-22T09:14:28.001090+0000","last_unstale":"2023-12-22T09:14:32.756169+0000","last_undegraded":"2023-12-22T09:14:32.756169+0000","last_fullsized":"2023-12-22T09:14:32.756169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.752284+0000","last_change":"2023-12-22T09:14:32.748035+0000","last_active":"2023-12-22T09:14:32.752284+0000","last_peered":"2023-12-22T09:14:32.752284+0000","last_clean":"2023-12-22T09:14:32.752284+0000","last_became_active":"2023-12-22T09:14:32.747593+0000","last_became_peered":"2023-12-22T09:14:32.747593+0000","last_unstale":"2023-12-22T09:14:32.752284+0000","last_undegraded":"2023-12-22T09:14:32.752284+0000","last_fullsized":"2023-12-22T09:14:32.752284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495880+0000","last_change":"2023-12-22T09:14:28.478893+0000","last_active":"2023-12-22T09:14:32.495880+0000","last_peered":"2023-12-22T09:14:32.495880+0000","last_clean":"2023-12-22T09:14:32.495880+0000","last_became_active":"2023-12-22T09:14:28.478270+0000","last_became_peered":"2023-12-22T09:14:28.478270+0000","last_unstale":"2023-12-22T09:14:32.495880+0000","last_undegraded":"2023-12-22T09:14:32.495880+0000","last_fullsized":"2023-12-22T09:14:32.495880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477626+0000","last_change":"2023-12-22T09:14:27.993596+0000","last_active":"2023-12-22T09:14:32.477626+0000","last_peered":"2023-12-22T09:14:32.477626+0000","last_clean":"2023-12-22T09:14:32.477626+0000","last_became_active":"2023-12-22T09:14:27.993333+0000","last_became_peered":"2023-12-22T09:14:27.993333+0000","last_unstale":"2023-12-22T09:14:32.477626+0000","last_undegraded":"2023-12-22T09:14:32.477626+0000","last_fullsized":"2023-12-22T09:14:32.477626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505508+0000","last_change":"2023-12-22T09:14:32.497013+0000","last_active":"2023-12-22T09:14:32.505508+0000","last_peered":"2023-12-22T09:14:32.505508+0000","last_clean":"2023-12-22T09:14:32.505508+0000","last_became_active":"2023-12-22T09:14:32.496344+0000","last_became_peered":"2023-12-22T09:14:32.496344+0000","last_unstale":"2023-12-22T09:14:32.505508+0000","last_undegraded":"2023-12-22T09:14:32.505508+0000","last_fullsized":"2023-12-22T09:14:32.505508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479912+0000","last_change":"2023-12-22T09:14:28.467982+0000","last_active":"2023-12-22T09:14:32.479912+0000","last_peered":"2023-12-22T09:14:32.479912+0000","last_clean":"2023-12-22T09:14:32.479912+0000","last_became_active":"2023-12-22T09:14:28.467733+0000","last_became_peered":"2023-12-22T09:14:28.467733+0000","last_unstale":"2023-12-22T09:14:32.479912+0000","last_undegraded":"2023-12-22T09:14:32.479912+0000","last_fullsized":"2023-12-22T09:14:32.479912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:42.586936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494566+0000","last_change":"2023-12-22T09:14:27.992541+0000","last_active":"2023-12-22T09:14:32.494566+0000","last_peered":"2023-12-22T09:14:32.494566+0000","last_clean":"2023-12-22T09:14:32.494566+0000","last_became_active":"2023-12-22T09:14:27.988045+0000","last_became_peered":"2023-12-22T09:14:27.988045+0000","last_unstale":"2023-12-22T09:14:32.494566+0000","last_undegraded":"2023-12-22T09:14:32.494566+0000","last_fullsized":"2023-12-22T09:14:32.494566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.499768+0000","last_change":"2023-12-22T09:14:32.496063+0000","last_active":"2023-12-22T09:14:32.499768+0000","last_peered":"2023-12-22T09:14:32.499768+0000","last_clean":"2023-12-22T09:14:32.499768+0000","last_became_active":"2023-12-22T09:14:32.495488+0000","last_became_peered":"2023-12-22T09:14:32.495488+0000","last_unstale":"2023-12-22T09:14:32.499768+0000","last_undegraded":"2023-12-22T09:14:32.499768+0000","last_fullsized":"2023-12-22T09:14:32.499768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:44.670493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477408+0000","last_change":"2023-12-22T09:14:28.455447+0000","last_active":"2023-12-22T09:14:32.477408+0000","last_peered":"2023-12-22T09:14:32.477408+0000","last_clean":"2023-12-22T09:14:32.477408+0000","last_became_active":"2023-12-22T09:14:28.454567+0000","last_became_peered":"2023-12-22T09:14:28.454567+0000","last_unstale":"2023-12-22T09:14:32.477408+0000","last_undegraded":"2023-12-22T09:14:32.477408+0000","last_fullsized":"2023-12-22T09:14:32.477408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488568+0000","last_change":"2023-12-22T09:14:27.987747+0000","last_active":"2023-12-22T09:14:32.488568+0000","last_peered":"2023-12-22T09:14:32.488568+0000","last_clean":"2023-12-22T09:14:32.488568+0000","last_became_active":"2023-12-22T09:14:27.983166+0000","last_became_peered":"2023-12-22T09:14:27.983166+0000","last_unstale":"2023-12-22T09:14:32.488568+0000","last_undegraded":"2023-12-22T09:14:32.488568+0000","last_fullsized":"2023-12-22T09:14:32.488568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507955+0000","last_change":"2023-12-22T09:14:32.501586+0000","last_active":"2023-12-22T09:14:32.507955+0000","last_peered":"2023-12-22T09:14:32.507955+0000","last_clean":"2023-12-22T09:14:32.507955+0000","last_became_active":"2023-12-22T09:14:32.501007+0000","last_became_peered":"2023-12-22T09:14:32.501007+0000","last_unstale":"2023-12-22T09:14:32.507955+0000","last_undegraded":"2023-12-22T09:14:32.507955+0000","last_fullsized":"2023-12-22T09:14:32.507955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:18.752984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489906+0000","last_change":"2023-12-22T09:14:28.481869+0000","last_active":"2023-12-22T09:14:32.489906+0000","last_peered":"2023-12-22T09:14:32.489906+0000","last_clean":"2023-12-22T09:14:32.489906+0000","last_became_active":"2023-12-22T09:14:28.481649+0000","last_became_peered":"2023-12-22T09:14:28.481649+0000","last_unstale":"2023-12-22T09:14:32.489906+0000","last_undegraded":"2023-12-22T09:14:32.489906+0000","last_fullsized":"2023-12-22T09:14:32.489906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747355+0000","last_change":"2023-12-22T09:14:28.001413+0000","last_active":"2023-12-22T09:14:32.747355+0000","last_peered":"2023-12-22T09:14:32.747355+0000","last_clean":"2023-12-22T09:14:32.747355+0000","last_became_active":"2023-12-22T09:14:28.001068+0000","last_became_peered":"2023-12-22T09:14:28.001068+0000","last_unstale":"2023-12-22T09:14:32.747355+0000","last_undegraded":"2023-12-22T09:14:32.747355+0000","last_fullsized":"2023-12-22T09:14:32.747355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754573+0000","last_change":"2023-12-22T09:14:32.750326+0000","last_active":"2023-12-22T09:14:32.754573+0000","last_peered":"2023-12-22T09:14:32.754573+0000","last_clean":"2023-12-22T09:14:32.754573+0000","last_became_active":"2023-12-22T09:14:32.748190+0000","last_became_peered":"2023-12-22T09:14:32.748190+0000","last_unstale":"2023-12-22T09:14:32.754573+0000","last_undegraded":"2023-12-22T09:14:32.754573+0000","last_fullsized":"2023-12-22T09:14:32.754573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:33.308005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466660+0000","last_change":"2023-12-22T09:14:28.473067+0000","last_active":"2023-12-22T09:14:32.466660+0000","last_peered":"2023-12-22T09:14:32.466660+0000","last_clean":"2023-12-22T09:14:32.466660+0000","last_became_active":"2023-12-22T09:14:28.471735+0000","last_became_peered":"2023-12-22T09:14:28.471735+0000","last_unstale":"2023-12-22T09:14:32.466660+0000","last_undegraded":"2023-12-22T09:14:32.466660+0000","last_fullsized":"2023-12-22T09:14:32.466660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495258+0000","last_change":"2023-12-22T09:14:27.991666+0000","last_active":"2023-12-22T09:14:32.495258+0000","last_peered":"2023-12-22T09:14:32.495258+0000","last_clean":"2023-12-22T09:14:32.495258+0000","last_became_active":"2023-12-22T09:14:27.991399+0000","last_became_peered":"2023-12-22T09:14:27.991399+0000","last_unstale":"2023-12-22T09:14:32.495258+0000","last_undegraded":"2023-12-22T09:14:32.495258+0000","last_fullsized":"2023-12-22T09:14:32.495258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747364+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:14:32.747364+0000","last_peered":"2023-12-22T09:14:32.747364+0000","last_clean":"2023-12-22T09:14:32.747364+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:14:32.747364+0000","last_undegraded":"2023-12-22T09:14:32.747364+0000","last_fullsized":"2023-12-22T09:14:32.747364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.958460+0000","last_change":"2023-12-22T09:14:32.750023+0000","last_active":"2023-12-22T09:14:32.958460+0000","last_peered":"2023-12-22T09:14:32.958460+0000","last_clean":"2023-12-22T09:14:32.958460+0000","last_became_active":"2023-12-22T09:14:32.748764+0000","last_became_peered":"2023-12-22T09:14:32.748764+0000","last_unstale":"2023-12-22T09:14:32.958460+0000","last_undegraded":"2023-12-22T09:14:32.958460+0000","last_fullsized":"2023-12-22T09:14:32.958460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:42.444884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749613+0000","last_change":"2023-12-22T09:14:28.474500+0000","last_active":"2023-12-22T09:14:32.749613+0000","last_peered":"2023-12-22T09:14:32.749613+0000","last_clean":"2023-12-22T09:14:32.749613+0000","last_became_active":"2023-12-22T09:14:28.474257+0000","last_became_peered":"2023-12-22T09:14:28.474257+0000","last_unstale":"2023-12-22T09:14:32.749613+0000","last_undegraded":"2023-12-22T09:14:32.749613+0000","last_fullsized":"2023-12-22T09:14:32.749613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:14.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487370+0000","last_change":"2023-12-22T09:14:27.991242+0000","last_active":"2023-12-22T09:14:32.487370+0000","last_peered":"2023-12-22T09:14:32.487370+0000","last_clean":"2023-12-22T09:14:32.487370+0000","last_became_active":"2023-12-22T09:14:27.990742+0000","last_became_peered":"2023-12-22T09:14:27.990742+0000","last_unstale":"2023-12-22T09:14:32.487370+0000","last_undegraded":"2023-12-22T09:14:32.487370+0000","last_fullsized":"2023-12-22T09:14:32.487370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.957774+0000","last_change":"2023-12-22T09:14:32.749763+0000","last_active":"2023-12-22T09:14:32.957774+0000","last_peered":"2023-12-22T09:14:32.957774+0000","last_clean":"2023-12-22T09:14:32.957774+0000","last_became_active":"2023-12-22T09:14:32.748485+0000","last_became_peered":"2023-12-22T09:14:32.748485+0000","last_unstale":"2023-12-22T09:14:32.957774+0000","last_undegraded":"2023-12-22T09:14:32.957774+0000","last_fullsized":"2023-12-22T09:14:32.957774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:46:07.062719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494350+0000","last_change":"2023-12-22T09:14:28.477663+0000","last_active":"2023-12-22T09:14:32.494350+0000","last_peered":"2023-12-22T09:14:32.494350+0000","last_clean":"2023-12-22T09:14:32.494350+0000","last_became_active":"2023-12-22T09:14:28.477380+0000","last_became_peered":"2023-12-22T09:14:28.477380+0000","last_unstale":"2023-12-22T09:14:32.494350+0000","last_undegraded":"2023-12-22T09:14:32.494350+0000","last_fullsized":"2023-12-22T09:14:32.494350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.481313+0000","last_change":"2023-12-22T09:14:27.995562+0000","last_active":"2023-12-22T09:14:32.481313+0000","last_peered":"2023-12-22T09:14:32.481313+0000","last_clean":"2023-12-22T09:14:32.481313+0000","last_became_active":"2023-12-22T09:14:27.995251+0000","last_became_peered":"2023-12-22T09:14:27.995251+0000","last_unstale":"2023-12-22T09:14:32.481313+0000","last_undegraded":"2023-12-22T09:14:32.481313+0000","last_fullsized":"2023-12-22T09:14:32.481313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507091+0000","last_change":"2023-12-22T09:14:32.502846+0000","last_active":"2023-12-22T09:14:32.507091+0000","last_peered":"2023-12-22T09:14:32.507091+0000","last_clean":"2023-12-22T09:14:32.507091+0000","last_became_active":"2023-12-22T09:14:32.502395+0000","last_became_peered":"2023-12-22T09:14:32.502395+0000","last_unstale":"2023-12-22T09:14:32.507091+0000","last_undegraded":"2023-12-22T09:14:32.507091+0000","last_fullsized":"2023-12-22T09:14:32.507091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.758162+0000","last_change":"2023-12-22T09:14:28.482682+0000","last_active":"2023-12-22T09:14:32.758162+0000","last_peered":"2023-12-22T09:14:32.758162+0000","last_clean":"2023-12-22T09:14:32.758162+0000","last_became_active":"2023-12-22T09:14:28.475766+0000","last_became_peered":"2023-12-22T09:14:28.475766+0000","last_unstale":"2023-12-22T09:14:32.758162+0000","last_undegraded":"2023-12-22T09:14:32.758162+0000","last_fullsized":"2023-12-22T09:14:32.758162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:17.017778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486650+0000","last_change":"2023-12-22T09:14:27.982302+0000","last_active":"2023-12-22T09:14:32.486650+0000","last_peered":"2023-12-22T09:14:32.486650+0000","last_clean":"2023-12-22T09:14:32.486650+0000","last_became_active":"2023-12-22T09:14:27.982025+0000","last_became_peered":"2023-12-22T09:14:27.982025+0000","last_unstale":"2023-12-22T09:14:32.486650+0000","last_undegraded":"2023-12-22T09:14:32.486650+0000","last_fullsized":"2023-12-22T09:14:32.486650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757174+0000","last_change":"2023-12-22T09:14:32.754165+0000","last_active":"2023-12-22T09:14:32.757174+0000","last_peered":"2023-12-22T09:14:32.757174+0000","last_clean":"2023-12-22T09:14:32.757174+0000","last_became_active":"2023-12-22T09:14:32.753078+0000","last_became_peered":"2023-12-22T09:14:32.753078+0000","last_unstale":"2023-12-22T09:14:32.757174+0000","last_undegraded":"2023-12-22T09:14:32.757174+0000","last_fullsized":"2023-12-22T09:14:32.757174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.755255+0000","last_change":"2023-12-22T09:14:28.488566+0000","last_active":"2023-12-22T09:14:32.755255+0000","last_peered":"2023-12-22T09:14:32.755255+0000","last_clean":"2023-12-22T09:14:32.755255+0000","last_became_active":"2023-12-22T09:14:28.488216+0000","last_became_peered":"2023-12-22T09:14:28.488216+0000","last_unstale":"2023-12-22T09:14:32.755255+0000","last_undegraded":"2023-12-22T09:14:32.755255+0000","last_fullsized":"2023-12-22T09:14:32.755255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479697+0000","last_change":"2023-12-22T09:14:27.995501+0000","last_active":"2023-12-22T09:14:32.479697+0000","last_peered":"2023-12-22T09:14:32.479697+0000","last_clean":"2023-12-22T09:14:32.479697+0000","last_became_active":"2023-12-22T09:14:27.995234+0000","last_became_peered":"2023-12-22T09:14:27.995234+0000","last_unstale":"2023-12-22T09:14:32.479697+0000","last_undegraded":"2023-12-22T09:14:32.479697+0000","last_fullsized":"2023-12-22T09:14:32.479697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:23.399786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502467+0000","last_change":"2023-12-22T09:14:32.498587+0000","last_active":"2023-12-22T09:14:32.502467+0000","last_peered":"2023-12-22T09:14:32.502467+0000","last_clean":"2023-12-22T09:14:32.502467+0000","last_became_active":"2023-12-22T09:14:32.497206+0000","last_became_peered":"2023-12-22T09:14:32.497206+0000","last_unstale":"2023-12-22T09:14:32.502467+0000","last_undegraded":"2023-12-22T09:14:32.502467+0000","last_fullsized":"2023-12-22T09:14:32.502467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747037+0000","last_change":"2023-12-22T09:14:28.486764+0000","last_active":"2023-12-22T09:14:32.747037+0000","last_peered":"2023-12-22T09:14:32.747037+0000","last_clean":"2023-12-22T09:14:32.747037+0000","last_became_active":"2023-12-22T09:14:28.486496+0000","last_became_peered":"2023-12-22T09:14:28.486496+0000","last_unstale":"2023-12-22T09:14:32.747037+0000","last_undegraded":"2023-12-22T09:14:32.747037+0000","last_fullsized":"2023-12-22T09:14:32.747037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:50:41.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486193+0000","last_change":"2023-12-22T09:14:27.988914+0000","last_active":"2023-12-22T09:14:32.486193+0000","last_peered":"2023-12-22T09:14:32.486193+0000","last_clean":"2023-12-22T09:14:32.486193+0000","last_became_active":"2023-12-22T09:14:27.988557+0000","last_became_peered":"2023-12-22T09:14:27.988557+0000","last_unstale":"2023-12-22T09:14:32.486193+0000","last_undegraded":"2023-12-22T09:14:32.486193+0000","last_fullsized":"2023-12-22T09:14:32.486193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.509994+0000","last_change":"2023-12-22T09:14:32.504445+0000","last_active":"2023-12-22T09:14:32.509994+0000","last_peered":"2023-12-22T09:14:32.509994+0000","last_clean":"2023-12-22T09:14:32.509994+0000","last_became_active":"2023-12-22T09:14:32.504017+0000","last_became_peered":"2023-12-22T09:14:32.504017+0000","last_unstale":"2023-12-22T09:14:32.509994+0000","last_undegraded":"2023-12-22T09:14:32.509994+0000","last_fullsized":"2023-12-22T09:14:32.509994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:16.494365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486277+0000","last_change":"2023-12-22T09:14:28.471567+0000","last_active":"2023-12-22T09:14:32.486277+0000","last_peered":"2023-12-22T09:14:32.486277+0000","last_clean":"2023-12-22T09:14:32.486277+0000","last_became_active":"2023-12-22T09:14:28.471239+0000","last_became_peered":"2023-12-22T09:14:28.471239+0000","last_unstale":"2023-12-22T09:14:32.486277+0000","last_undegraded":"2023-12-22T09:14:32.486277+0000","last_fullsized":"2023-12-22T09:14:32.486277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:36.670203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487591+0000","last_change":"2023-12-22T09:14:27.997965+0000","last_active":"2023-12-22T09:14:32.487591+0000","last_peered":"2023-12-22T09:14:32.487591+0000","last_clean":"2023-12-22T09:14:32.487591+0000","last_became_active":"2023-12-22T09:14:27.995729+0000","last_became_peered":"2023-12-22T09:14:27.995729+0000","last_unstale":"2023-12-22T09:14:32.487591+0000","last_undegraded":"2023-12-22T09:14:32.487591+0000","last_fullsized":"2023-12-22T09:14:32.487591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:39.444798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.760822+0000","last_change":"2023-12-22T09:14:32.759895+0000","last_active":"2023-12-22T09:14:32.760822+0000","last_peered":"2023-12-22T09:14:32.760822+0000","last_clean":"2023-12-22T09:14:32.760822+0000","last_became_active":"2023-12-22T09:14:32.759468+0000","last_became_peered":"2023-12-22T09:14:32.759468+0000","last_unstale":"2023-12-22T09:14:32.760822+0000","last_undegraded":"2023-12-22T09:14:32.760822+0000","last_fullsized":"2023-12-22T09:14:32.760822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:50:22.096701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749005+0000","last_change":"2023-12-22T09:14:28.474331+0000","last_active":"2023-12-22T09:14:32.749005+0000","last_peered":"2023-12-22T09:14:32.749005+0000","last_clean":"2023-12-22T09:14:32.749005+0000","last_became_active":"2023-12-22T09:14:28.473856+0000","last_became_peered":"2023-12-22T09:14:28.473856+0000","last_unstale":"2023-12-22T09:14:32.749005+0000","last_undegraded":"2023-12-22T09:14:32.749005+0000","last_fullsized":"2023-12-22T09:14:32.749005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494464+0000","last_change":"2023-12-22T09:14:28.003970+0000","last_active":"2023-12-22T09:14:32.494464+0000","last_peered":"2023-12-22T09:14:32.494464+0000","last_clean":"2023-12-22T09:14:32.494464+0000","last_became_active":"2023-12-22T09:14:28.003627+0000","last_became_peered":"2023-12-22T09:14:28.003627+0000","last_unstale":"2023-12-22T09:14:32.494464+0000","last_undegraded":"2023-12-22T09:14:32.494464+0000","last_fullsized":"2023-12-22T09:14:32.494464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754851+0000","last_change":"2023-12-22T09:14:32.752183+0000","last_active":"2023-12-22T09:14:32.754851+0000","last_peered":"2023-12-22T09:14:32.754851+0000","last_clean":"2023-12-22T09:14:32.754851+0000","last_became_active":"2023-12-22T09:14:32.749483+0000","last_became_peered":"2023-12-22T09:14:32.749483+0000","last_unstale":"2023-12-22T09:14:32.754851+0000","last_undegraded":"2023-12-22T09:14:32.754851+0000","last_fullsized":"2023-12-22T09:14:32.754851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:09.047311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489001+0000","last_change":"2023-12-22T09:14:28.477740+0000","last_active":"2023-12-22T09:14:32.489001+0000","last_peered":"2023-12-22T09:14:32.489001+0000","last_clean":"2023-12-22T09:14:32.489001+0000","last_became_active":"2023-12-22T09:14:28.477495+0000","last_became_peered":"2023-12-22T09:14:28.477495+0000","last_unstale":"2023-12-22T09:14:32.489001+0000","last_undegraded":"2023-12-22T09:14:32.489001+0000","last_fullsized":"2023-12-22T09:14:32.489001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:28.625454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489565+0000","last_change":"2023-12-22T09:14:27.994572+0000","last_active":"2023-12-22T09:14:32.489565+0000","last_peered":"2023-12-22T09:14:32.489565+0000","last_clean":"2023-12-22T09:14:32.489565+0000","last_became_active":"2023-12-22T09:14:27.994200+0000","last_became_peered":"2023-12-22T09:14:27.994200+0000","last_unstale":"2023-12-22T09:14:32.489565+0000","last_undegraded":"2023-12-22T09:14:32.489565+0000","last_fullsized":"2023-12-22T09:14:32.489565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:50:40.407650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754400+0000","last_change":"2023-12-22T09:14:32.751024+0000","last_active":"2023-12-22T09:14:32.754400+0000","last_peered":"2023-12-22T09:14:32.754400+0000","last_clean":"2023-12-22T09:14:32.754400+0000","last_became_active":"2023-12-22T09:14:32.748055+0000","last_became_peered":"2023-12-22T09:14:32.748055+0000","last_unstale":"2023-12-22T09:14:32.754400+0000","last_undegraded":"2023-12-22T09:14:32.754400+0000","last_fullsized":"2023-12-22T09:14:32.754400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:18.069342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757751+0000","last_change":"2023-12-22T09:14:28.475564+0000","last_active":"2023-12-22T09:14:32.757751+0000","last_peered":"2023-12-22T09:14:32.757751+0000","last_clean":"2023-12-22T09:14:32.757751+0000","last_became_active":"2023-12-22T09:14:28.475209+0000","last_became_peered":"2023-12-22T09:14:28.475209+0000","last_unstale":"2023-12-22T09:14:32.757751+0000","last_undegraded":"2023-12-22T09:14:32.757751+0000","last_fullsized":"2023-12-22T09:14:32.757751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:46.880888+0000","last_change":"2023-12-22T09:14:27.986129+0000","last_active":"2023-12-22T09:14:46.880888+0000","last_peered":"2023-12-22T09:14:46.880888+0000","last_clean":"2023-12-22T09:14:46.880888+0000","last_became_active":"2023-12-22T09:14:27.984848+0000","last_became_peered":"2023-12-22T09:14:27.984848+0000","last_unstale":"2023-12-22T09:14:46.880888+0000","last_undegraded":"2023-12-22T09:14:46.880888+0000","last_fullsized":"2023-12-22T09:14:46.880888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:26:42.194176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505485+0000","last_change":"2023-12-22T09:14:32.496763+0000","last_active":"2023-12-22T09:14:32.505485+0000","last_peered":"2023-12-22T09:14:32.505485+0000","last_clean":"2023-12-22T09:14:32.505485+0000","last_became_active":"2023-12-22T09:14:32.495748+0000","last_became_peered":"2023-12-22T09:14:32.495748+0000","last_unstale":"2023-12-22T09:14:32.505485+0000","last_undegraded":"2023-12-22T09:14:32.505485+0000","last_fullsized":"2023-12-22T09:14:32.505485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479467+0000","last_change":"2023-12-22T09:14:28.479921+0000","last_active":"2023-12-22T09:14:32.479467+0000","last_peered":"2023-12-22T09:14:32.479467+0000","last_clean":"2023-12-22T09:14:32.479467+0000","last_became_active":"2023-12-22T09:14:28.479147+0000","last_became_peered":"2023-12-22T09:14:28.479147+0000","last_unstale":"2023-12-22T09:14:32.479467+0000","last_undegraded":"2023-12-22T09:14:32.479467+0000","last_fullsized":"2023-12-22T09:14:32.479467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:22.141418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.481162+0000","last_change":"2023-12-22T09:14:27.998821+0000","last_active":"2023-12-22T09:14:32.481162+0000","last_peered":"2023-12-22T09:14:32.481162+0000","last_clean":"2023-12-22T09:14:32.481162+0000","last_became_active":"2023-12-22T09:14:27.998503+0000","last_became_peered":"2023-12-22T09:14:27.998503+0000","last_unstale":"2023-12-22T09:14:32.481162+0000","last_undegraded":"2023-12-22T09:14:32.481162+0000","last_fullsized":"2023-12-22T09:14:32.481162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507446+0000","last_change":"2023-12-22T09:14:32.502980+0000","last_active":"2023-12-22T09:14:32.507446+0000","last_peered":"2023-12-22T09:14:32.507446+0000","last_clean":"2023-12-22T09:14:32.507446+0000","last_became_active":"2023-12-22T09:14:32.502553+0000","last_became_peered":"2023-12-22T09:14:32.502553+0000","last_unstale":"2023-12-22T09:14:32.507446+0000","last_undegraded":"2023-12-22T09:14:32.507446+0000","last_fullsized":"2023-12-22T09:14:32.507446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:45:19.291884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491688+0000","last_change":"2023-12-22T09:14:28.475888+0000","last_active":"2023-12-22T09:14:32.491688+0000","last_peered":"2023-12-22T09:14:32.491688+0000","last_clean":"2023-12-22T09:14:32.491688+0000","last_became_active":"2023-12-22T09:14:28.475647+0000","last_became_peered":"2023-12-22T09:14:28.475647+0000","last_unstale":"2023-12-22T09:14:32.491688+0000","last_undegraded":"2023-12-22T09:14:32.491688+0000","last_fullsized":"2023-12-22T09:14:32.491688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494265+0000","last_change":"2023-12-22T09:14:27.995374+0000","last_active":"2023-12-22T09:14:32.494265+0000","last_peered":"2023-12-22T09:14:32.494265+0000","last_clean":"2023-12-22T09:14:32.494265+0000","last_became_active":"2023-12-22T09:14:27.995047+0000","last_became_peered":"2023-12-22T09:14:27.995047+0000","last_unstale":"2023-12-22T09:14:32.494265+0000","last_undegraded":"2023-12-22T09:14:32.494265+0000","last_fullsized":"2023-12-22T09:14:32.494265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.497163+0000","last_change":"2023-12-22T09:14:32.493394+0000","last_active":"2023-12-22T09:14:32.497163+0000","last_peered":"2023-12-22T09:14:32.497163+0000","last_clean":"2023-12-22T09:14:32.497163+0000","last_became_active":"2023-12-22T09:14:32.492984+0000","last_became_peered":"2023-12-22T09:14:32.492984+0000","last_unstale":"2023-12-22T09:14:32.497163+0000","last_undegraded":"2023-12-22T09:14:32.497163+0000","last_fullsized":"2023-12-22T09:14:32.497163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:53:49.846745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494126+0000","last_change":"2023-12-22T09:14:28.486602+0000","last_active":"2023-12-22T09:14:32.494126+0000","last_peered":"2023-12-22T09:14:32.494126+0000","last_clean":"2023-12-22T09:14:32.494126+0000","last_became_active":"2023-12-22T09:14:28.485948+0000","last_became_peered":"2023-12-22T09:14:28.485948+0000","last_unstale":"2023-12-22T09:14:32.494126+0000","last_undegraded":"2023-12-22T09:14:32.494126+0000","last_fullsized":"2023-12-22T09:14:32.494126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:14.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489192+0000","last_change":"2023-12-22T09:14:28.000308+0000","last_active":"2023-12-22T09:14:32.489192+0000","last_peered":"2023-12-22T09:14:32.489192+0000","last_clean":"2023-12-22T09:14:32.489192+0000","last_became_active":"2023-12-22T09:14:28.000003+0000","last_became_peered":"2023-12-22T09:14:28.000003+0000","last_unstale":"2023-12-22T09:14:32.489192+0000","last_undegraded":"2023-12-22T09:14:32.489192+0000","last_fullsized":"2023-12-22T09:14:32.489192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:28:22.560684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.746514+0000","last_change":"2023-12-22T09:14:32.744415+0000","last_active":"2023-12-22T09:14:32.746514+0000","last_peered":"2023-12-22T09:14:32.746514+0000","last_clean":"2023-12-22T09:14:32.746514+0000","last_became_active":"2023-12-22T09:14:32.744068+0000","last_became_peered":"2023-12-22T09:14:32.744068+0000","last_unstale":"2023-12-22T09:14:32.746514+0000","last_undegraded":"2023-12-22T09:14:32.746514+0000","last_fullsized":"2023-12-22T09:14:32.746514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:57.666688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754553+0000","last_change":"2023-12-22T09:14:32.748417+0000","last_active":"2023-12-22T09:14:32.754553+0000","last_peered":"2023-12-22T09:14:32.754553+0000","last_clean":"2023-12-22T09:14:32.754553+0000","last_became_active":"2023-12-22T09:14:32.747730+0000","last_became_peered":"2023-12-22T09:14:32.747730+0000","last_unstale":"2023-12-22T09:14:32.754553+0000","last_undegraded":"2023-12-22T09:14:32.754553+0000","last_fullsized":"2023-12-22T09:14:32.754553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:18.069342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479643+0000","last_change":"2023-12-22T09:14:28.477761+0000","last_active":"2023-12-22T09:14:32.479643+0000","last_peered":"2023-12-22T09:14:32.479643+0000","last_clean":"2023-12-22T09:14:32.479643+0000","last_became_active":"2023-12-22T09:14:28.477515+0000","last_became_peered":"2023-12-22T09:14:28.477515+0000","last_unstale":"2023-12-22T09:14:32.479643+0000","last_undegraded":"2023-12-22T09:14:32.479643+0000","last_fullsized":"2023-12-22T09:14:32.479643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.493081+0000","last_change":"2023-12-22T09:14:27.997801+0000","last_active":"2023-12-22T09:14:32.493081+0000","last_peered":"2023-12-22T09:14:32.493081+0000","last_clean":"2023-12-22T09:14:32.493081+0000","last_became_active":"2023-12-22T09:14:27.995420+0000","last_became_peered":"2023-12-22T09:14:27.995420+0000","last_unstale":"2023-12-22T09:14:32.493081+0000","last_undegraded":"2023-12-22T09:14:32.493081+0000","last_fullsized":"2023-12-22T09:14:32.493081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.958796+0000","last_change":"2023-12-22T09:14:32.502003+0000","last_active":"2023-12-22T09:14:32.958796+0000","last_peered":"2023-12-22T09:14:32.958796+0000","last_clean":"2023-12-22T09:14:32.958796+0000","last_became_active":"2023-12-22T09:14:32.501565+0000","last_became_peered":"2023-12-22T09:14:32.501565+0000","last_unstale":"2023-12-22T09:14:32.958796+0000","last_undegraded":"2023-12-22T09:14:32.958796+0000","last_fullsized":"2023-12-22T09:14:32.958796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:53.560717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466430+0000","last_change":"2023-12-22T09:14:28.476695+0000","last_active":"2023-12-22T09:14:32.466430+0000","last_peered":"2023-12-22T09:14:32.466430+0000","last_clean":"2023-12-22T09:14:32.466430+0000","last_became_active":"2023-12-22T09:14:28.476418+0000","last_became_peered":"2023-12-22T09:14:28.476418+0000","last_unstale":"2023-12-22T09:14:32.466430+0000","last_undegraded":"2023-12-22T09:14:32.466430+0000","last_fullsized":"2023-12-22T09:14:32.466430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467174+0000","last_change":"2023-12-22T09:14:27.981491+0000","last_active":"2023-12-22T09:14:32.467174+0000","last_peered":"2023-12-22T09:14:32.467174+0000","last_clean":"2023-12-22T09:14:32.467174+0000","last_became_active":"2023-12-22T09:14:27.981149+0000","last_became_peered":"2023-12-22T09:14:27.981149+0000","last_unstale":"2023-12-22T09:14:32.467174+0000","last_undegraded":"2023-12-22T09:14:32.467174+0000","last_fullsized":"2023-12-22T09:14:32.467174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490549+0000","last_change":"2023-12-22T09:14:27.995250+0000","last_active":"2023-12-22T09:14:32.490549+0000","last_peered":"2023-12-22T09:14:32.490549+0000","last_clean":"2023-12-22T09:14:32.490549+0000","last_became_active":"2023-12-22T09:14:27.994964+0000","last_became_peered":"2023-12-22T09:14:27.994964+0000","last_unstale":"2023-12-22T09:14:32.490549+0000","last_undegraded":"2023-12-22T09:14:32.490549+0000","last_fullsized":"2023-12-22T09:14:32.490549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:08.238642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489470+0000","last_change":"2023-12-22T09:14:28.481744+0000","last_active":"2023-12-22T09:14:32.489470+0000","last_peered":"2023-12-22T09:14:32.489470+0000","last_clean":"2023-12-22T09:14:32.489470+0000","last_became_active":"2023-12-22T09:14:28.481329+0000","last_became_peered":"2023-12-22T09:14:28.481329+0000","last_unstale":"2023-12-22T09:14:32.489470+0000","last_undegraded":"2023-12-22T09:14:32.489470+0000","last_fullsized":"2023-12-22T09:14:32.489470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:18:59.454414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505339+0000","last_change":"2023-12-22T09:14:32.500565+0000","last_active":"2023-12-22T09:14:32.505339+0000","last_peered":"2023-12-22T09:14:32.505339+0000","last_clean":"2023-12-22T09:14:32.505339+0000","last_became_active":"2023-12-22T09:14:32.500063+0000","last_became_peered":"2023-12-22T09:14:32.500063+0000","last_unstale":"2023-12-22T09:14:32.505339+0000","last_undegraded":"2023-12-22T09:14:32.505339+0000","last_fullsized":"2023-12-22T09:14:32.505339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:19.878873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467700+0000","last_change":"2023-12-22T09:14:27.997689+0000","last_active":"2023-12-22T09:14:32.467700+0000","last_peered":"2023-12-22T09:14:32.467700+0000","last_clean":"2023-12-22T09:14:32.467700+0000","last_became_active":"2023-12-22T09:14:27.997332+0000","last_became_peered":"2023-12-22T09:14:27.997332+0000","last_unstale":"2023-12-22T09:14:32.467700+0000","last_undegraded":"2023-12-22T09:14:32.467700+0000","last_fullsized":"2023-12-22T09:14:32.467700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.478532+0000","last_change":"2023-12-22T09:14:28.466320+0000","last_active":"2023-12-22T09:14:32.478532+0000","last_peered":"2023-12-22T09:14:32.478532+0000","last_clean":"2023-12-22T09:14:32.478532+0000","last_became_active":"2023-12-22T09:14:28.465905+0000","last_became_peered":"2023-12-22T09:14:28.465905+0000","last_unstale":"2023-12-22T09:14:32.478532+0000","last_undegraded":"2023-12-22T09:14:32.478532+0000","last_fullsized":"2023-12-22T09:14:32.478532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:41.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.499215+0000","last_change":"2023-12-22T09:14:32.496695+0000","last_active":"2023-12-22T09:14:32.499215+0000","last_peered":"2023-12-22T09:14:32.499215+0000","last_clean":"2023-12-22T09:14:32.499215+0000","last_became_active":"2023-12-22T09:14:32.494463+0000","last_became_peered":"2023-12-22T09:14:32.494463+0000","last_unstale":"2023-12-22T09:14:32.499215+0000","last_undegraded":"2023-12-22T09:14:32.499215+0000","last_fullsized":"2023-12-22T09:14:32.499215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:05:19.971364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486096+0000","last_change":"2023-12-22T09:14:28.463582+0000","last_active":"2023-12-22T09:14:32.486096+0000","last_peered":"2023-12-22T09:14:32.486096+0000","last_clean":"2023-12-22T09:14:32.486096+0000","last_became_active":"2023-12-22T09:14:28.463247+0000","last_became_peered":"2023-12-22T09:14:28.463247+0000","last_unstale":"2023-12-22T09:14:32.486096+0000","last_undegraded":"2023-12-22T09:14:32.486096+0000","last_fullsized":"2023-12-22T09:14:32.486096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:52.250368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488481+0000","last_change":"2023-12-22T09:14:28.466146+0000","last_active":"2023-12-22T09:14:32.488481+0000","last_peered":"2023-12-22T09:14:32.488481+0000","last_clean":"2023-12-22T09:14:32.488481+0000","last_became_active":"2023-12-22T09:14:28.460909+0000","last_became_peered":"2023-12-22T09:14:28.460909+0000","last_unstale":"2023-12-22T09:14:32.488481+0000","last_undegraded":"2023-12-22T09:14:32.488481+0000","last_fullsized":"2023-12-22T09:14:32.488481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:13.826585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494360+0000","last_change":"2023-12-22T09:14:28.477080+0000","last_active":"2023-12-22T09:14:32.494360+0000","last_peered":"2023-12-22T09:14:32.494360+0000","last_clean":"2023-12-22T09:14:32.494360+0000","last_became_active":"2023-12-22T09:14:28.474190+0000","last_became_peered":"2023-12-22T09:14:28.474190+0000","last_unstale":"2023-12-22T09:14:32.494360+0000","last_undegraded":"2023-12-22T09:14:32.494360+0000","last_fullsized":"2023-12-22T09:14:32.494360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489372+0000","last_change":"2023-12-22T09:14:28.475187+0000","last_active":"2023-12-22T09:14:32.489372+0000","last_peered":"2023-12-22T09:14:32.489372+0000","last_clean":"2023-12-22T09:14:32.489372+0000","last_became_active":"2023-12-22T09:14:28.474944+0000","last_became_peered":"2023-12-22T09:14:28.474944+0000","last_unstale":"2023-12-22T09:14:32.489372+0000","last_undegraded":"2023-12-22T09:14:32.489372+0000","last_fullsized":"2023-12-22T09:14:32.489372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:54:29.516809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468613+0000","last_change":"2023-12-22T09:14:28.479990+0000","last_active":"2023-12-22T09:14:32.468613+0000","last_peered":"2023-12-22T09:14:32.468613+0000","last_clean":"2023-12-22T09:14:32.468613+0000","last_became_active":"2023-12-22T09:14:28.479746+0000","last_became_peered":"2023-12-22T09:14:28.479746+0000","last_unstale":"2023-12-22T09:14:32.468613+0000","last_undegraded":"2023-12-22T09:14:32.468613+0000","last_fullsized":"2023-12-22T09:14:32.468613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:26.849454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.480832+0000","last_change":"2023-12-22T09:14:28.472845+0000","last_active":"2023-12-22T09:14:32.480832+0000","last_peered":"2023-12-22T09:14:32.480832+0000","last_clean":"2023-12-22T09:14:32.480832+0000","last_became_active":"2023-12-22T09:14:28.472592+0000","last_became_peered":"2023-12-22T09:14:28.472592+0000","last_unstale":"2023-12-22T09:14:32.480832+0000","last_undegraded":"2023-12-22T09:14:32.480832+0000","last_fullsized":"2023-12-22T09:14:32.480832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:28.625454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489554+0000","last_change":"2023-12-22T09:14:28.476150+0000","last_active":"2023-12-22T09:14:32.489554+0000","last_peered":"2023-12-22T09:14:32.489554+0000","last_clean":"2023-12-22T09:14:32.489554+0000","last_became_active":"2023-12-22T09:14:28.475897+0000","last_became_peered":"2023-12-22T09:14:28.475897+0000","last_unstale":"2023-12-22T09:14:32.489554+0000","last_undegraded":"2023-12-22T09:14:32.489554+0000","last_fullsized":"2023-12-22T09:14:32.489554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:53:11.117313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.471112+0000","last_change":"2023-12-22T09:14:28.480478+0000","last_active":"2023-12-22T09:14:32.471112+0000","last_peered":"2023-12-22T09:14:32.471112+0000","last_clean":"2023-12-22T09:14:32.471112+0000","last_became_active":"2023-12-22T09:14:28.480143+0000","last_became_peered":"2023-12-22T09:14:28.480143+0000","last_unstale":"2023-12-22T09:14:32.471112+0000","last_undegraded":"2023-12-22T09:14:32.471112+0000","last_fullsized":"2023-12-22T09:14:32.471112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.492960+0000","last_change":"2023-12-22T09:14:28.478251+0000","last_active":"2023-12-22T09:14:32.492960+0000","last_peered":"2023-12-22T09:14:32.492960+0000","last_clean":"2023-12-22T09:14:32.492960+0000","last_became_active":"2023-12-22T09:14:28.477973+0000","last_became_peered":"2023-12-22T09:14:28.477973+0000","last_unstale":"2023-12-22T09:14:32.492960+0000","last_undegraded":"2023-12-22T09:14:32.492960+0000","last_fullsized":"2023-12-22T09:14:32.492960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467428+0000","last_change":"2023-12-22T09:14:28.479996+0000","last_active":"2023-12-22T09:14:32.467428+0000","last_peered":"2023-12-22T09:14:32.467428+0000","last_clean":"2023-12-22T09:14:32.467428+0000","last_became_active":"2023-12-22T09:14:28.479737+0000","last_became_peered":"2023-12-22T09:14:28.479737+0000","last_unstale":"2023-12-22T09:14:32.467428+0000","last_undegraded":"2023-12-22T09:14:32.467428+0000","last_fullsized":"2023-12-22T09:14:32.467428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494265+0000","last_change":"2023-12-22T09:14:28.479078+0000","last_active":"2023-12-22T09:14:32.494265+0000","last_peered":"2023-12-22T09:14:32.494265+0000","last_clean":"2023-12-22T09:14:32.494265+0000","last_became_active":"2023-12-22T09:14:28.478851+0000","last_became_peered":"2023-12-22T09:14:28.478851+0000","last_unstale":"2023-12-22T09:14:32.494265+0000","last_undegraded":"2023-12-22T09:14:32.494265+0000","last_fullsized":"2023-12-22T09:14:32.494265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:15.678969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489256+0000","last_change":"2023-12-22T09:14:28.480955+0000","last_active":"2023-12-22T09:14:32.489256+0000","last_peered":"2023-12-22T09:14:32.489256+0000","last_clean":"2023-12-22T09:14:32.489256+0000","last_became_active":"2023-12-22T09:14:28.479777+0000","last_became_peered":"2023-12-22T09:14:28.479777+0000","last_unstale":"2023-12-22T09:14:32.489256+0000","last_undegraded":"2023-12-22T09:14:32.489256+0000","last_fullsized":"2023-12-22T09:14:32.489256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488409+0000","last_change":"2023-12-22T09:14:28.477114+0000","last_active":"2023-12-22T09:14:32.488409+0000","last_peered":"2023-12-22T09:14:32.488409+0000","last_clean":"2023-12-22T09:14:32.488409+0000","last_became_active":"2023-12-22T09:14:28.476857+0000","last_became_peered":"2023-12-22T09:14:28.476857+0000","last_unstale":"2023-12-22T09:14:32.488409+0000","last_undegraded":"2023-12-22T09:14:32.488409+0000","last_fullsized":"2023-12-22T09:14:32.488409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:11:22.661582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.755992+0000","last_change":"2023-12-22T09:14:28.473400+0000","last_active":"2023-12-22T09:14:32.755992+0000","last_peered":"2023-12-22T09:14:32.755992+0000","last_clean":"2023-12-22T09:14:32.755992+0000","last_became_active":"2023-12-22T09:14:28.473079+0000","last_became_peered":"2023-12-22T09:14:28.473079+0000","last_unstale":"2023-12-22T09:14:32.755992+0000","last_undegraded":"2023-12-22T09:14:32.755992+0000","last_fullsized":"2023-12-22T09:14:32.755992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486749+0000","last_change":"2023-12-22T09:14:28.456928+0000","last_active":"2023-12-22T09:14:32.486749+0000","last_peered":"2023-12-22T09:14:32.486749+0000","last_clean":"2023-12-22T09:14:32.486749+0000","last_became_active":"2023-12-22T09:14:28.456756+0000","last_became_peered":"2023-12-22T09:14:28.456756+0000","last_unstale":"2023-12-22T09:14:32.486749+0000","last_undegraded":"2023-12-22T09:14:32.486749+0000","last_fullsized":"2023-12-22T09:14:32.486749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:42.031515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494912+0000","last_change":"2023-12-22T09:14:28.475388+0000","last_active":"2023-12-22T09:14:32.494912+0000","last_peered":"2023-12-22T09:14:32.494912+0000","last_clean":"2023-12-22T09:14:32.494912+0000","last_became_active":"2023-12-22T09:14:28.474472+0000","last_became_peered":"2023-12-22T09:14:28.474472+0000","last_unstale":"2023-12-22T09:14:32.494912+0000","last_undegraded":"2023-12-22T09:14:32.494912+0000","last_fullsized":"2023-12-22T09:14:32.494912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:17.017778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.492765+0000","last_change":"2023-12-22T09:14:28.471352+0000","last_active":"2023-12-22T09:14:32.492765+0000","last_peered":"2023-12-22T09:14:32.492765+0000","last_clean":"2023-12-22T09:14:32.492765+0000","last_became_active":"2023-12-22T09:14:28.471042+0000","last_became_peered":"2023-12-22T09:14:28.471042+0000","last_unstale":"2023-12-22T09:14:32.492765+0000","last_undegraded":"2023-12-22T09:14:32.492765+0000","last_fullsized":"2023-12-22T09:14:32.492765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479697+0000","last_change":"2023-12-22T09:14:28.470575+0000","last_active":"2023-12-22T09:14:32.479697+0000","last_peered":"2023-12-22T09:14:32.479697+0000","last_clean":"2023-12-22T09:14:32.479697+0000","last_became_active":"2023-12-22T09:14:28.470317+0000","last_became_peered":"2023-12-22T09:14:28.470317+0000","last_unstale":"2023-12-22T09:14:32.479697+0000","last_undegraded":"2023-12-22T09:14:32.479697+0000","last_fullsized":"2023-12-22T09:14:32.479697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488959+0000","last_change":"2023-12-22T09:14:28.471255+0000","last_active":"2023-12-22T09:14:32.488959+0000","last_peered":"2023-12-22T09:14:32.488959+0000","last_clean":"2023-12-22T09:14:32.488959+0000","last_became_active":"2023-12-22T09:14:28.470985+0000","last_became_peered":"2023-12-22T09:14:28.470985+0000","last_unstale":"2023-12-22T09:14:32.488959+0000","last_undegraded":"2023-12-22T09:14:32.488959+0000","last_fullsized":"2023-12-22T09:14:32.488959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:32:58.600762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467160+0000","last_change":"2023-12-22T09:14:28.474205+0000","last_active":"2023-12-22T09:14:32.467160+0000","last_peered":"2023-12-22T09:14:32.467160+0000","last_clean":"2023-12-22T09:14:32.467160+0000","last_became_active":"2023-12-22T09:14:28.473905+0000","last_became_peered":"2023-12-22T09:14:28.473905+0000","last_unstale":"2023-12-22T09:14:32.467160+0000","last_undegraded":"2023-12-22T09:14:32.467160+0000","last_fullsized":"2023-12-22T09:14:32.467160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479259+0000","last_change":"2023-12-22T09:14:28.469345+0000","last_active":"2023-12-22T09:14:32.479259+0000","last_peered":"2023-12-22T09:14:32.479259+0000","last_clean":"2023-12-22T09:14:32.479259+0000","last_became_active":"2023-12-22T09:14:28.469074+0000","last_became_peered":"2023-12-22T09:14:28.469074+0000","last_unstale":"2023-12-22T09:14:32.479259+0000","last_undegraded":"2023-12-22T09:14:32.479259+0000","last_fullsized":"2023-12-22T09:14:32.479259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:36.805116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487868+0000","last_change":"2023-12-22T09:14:28.465762+0000","last_active":"2023-12-22T09:14:32.487868+0000","last_peered":"2023-12-22T09:14:32.487868+0000","last_clean":"2023-12-22T09:14:32.487868+0000","last_became_active":"2023-12-22T09:14:28.465457+0000","last_became_peered":"2023-12-22T09:14:28.465457+0000","last_unstale":"2023-12-22T09:14:32.487868+0000","last_undegraded":"2023-12-22T09:14:32.487868+0000","last_fullsized":"2023-12-22T09:14:32.487868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:03.107378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489453+0000","last_change":"2023-12-22T09:14:28.464288+0000","last_active":"2023-12-22T09:14:32.489453+0000","last_peered":"2023-12-22T09:14:32.489453+0000","last_clean":"2023-12-22T09:14:32.489453+0000","last_became_active":"2023-12-22T09:14:28.463738+0000","last_became_peered":"2023-12-22T09:14:28.463738+0000","last_unstale":"2023-12-22T09:14:32.489453+0000","last_undegraded":"2023-12-22T09:14:32.489453+0000","last_fullsized":"2023-12-22T09:14:32.489453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:59:57.709549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757917+0000","last_change":"2023-12-22T09:14:28.474461+0000","last_active":"2023-12-22T09:14:32.757917+0000","last_peered":"2023-12-22T09:14:32.757917+0000","last_clean":"2023-12-22T09:14:32.757917+0000","last_became_active":"2023-12-22T09:14:28.474159+0000","last_became_peered":"2023-12-22T09:14:28.474159+0000","last_unstale":"2023-12-22T09:14:32.757917+0000","last_undegraded":"2023-12-22T09:14:32.757917+0000","last_fullsized":"2023-12-22T09:14:32.757917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:15.678969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.465111+0000","last_change":"2023-12-22T09:14:28.471807+0000","last_active":"2023-12-22T09:14:32.465111+0000","last_peered":"2023-12-22T09:14:32.465111+0000","last_clean":"2023-12-22T09:14:32.465111+0000","last_became_active":"2023-12-22T09:14:28.471516+0000","last_became_peered":"2023-12-22T09:14:28.471516+0000","last_unstale":"2023-12-22T09:14:32.465111+0000","last_undegraded":"2023-12-22T09:14:32.465111+0000","last_fullsized":"2023-12-22T09:14:32.465111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.746735+0000","last_change":"2023-12-22T09:14:28.472378+0000","last_active":"2023-12-22T09:14:32.746735+0000","last_peered":"2023-12-22T09:14:32.746735+0000","last_clean":"2023-12-22T09:14:32.746735+0000","last_became_active":"2023-12-22T09:14:28.472104+0000","last_became_peered":"2023-12-22T09:14:28.472104+0000","last_unstale":"2023-12-22T09:14:32.746735+0000","last_undegraded":"2023-12-22T09:14:32.746735+0000","last_fullsized":"2023-12-22T09:14:32.746735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494167+0000","last_change":"2023-12-22T09:14:28.465305+0000","last_active":"2023-12-22T09:14:32.494167+0000","last_peered":"2023-12-22T09:14:32.494167+0000","last_clean":"2023-12-22T09:14:32.494167+0000","last_became_active":"2023-12-22T09:14:28.464795+0000","last_became_peered":"2023-12-22T09:14:28.464795+0000","last_unstale":"2023-12-22T09:14:32.494167+0000","last_undegraded":"2023-12-22T09:14:32.494167+0000","last_fullsized":"2023-12-22T09:14:32.494167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:26.849454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754743+0000","last_change":"2023-12-22T09:14:28.471738+0000","last_active":"2023-12-22T09:14:32.754743+0000","last_peered":"2023-12-22T09:14:32.754743+0000","last_clean":"2023-12-22T09:14:32.754743+0000","last_became_active":"2023-12-22T09:14:28.470650+0000","last_became_peered":"2023-12-22T09:14:28.470650+0000","last_unstale":"2023-12-22T09:14:32.754743+0000","last_undegraded":"2023-12-22T09:14:32.754743+0000","last_fullsized":"2023-12-22T09:14:32.754743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494158+0000","last_change":"2023-12-22T09:14:28.477696+0000","last_active":"2023-12-22T09:14:32.494158+0000","last_peered":"2023-12-22T09:14:32.494158+0000","last_clean":"2023-12-22T09:14:32.494158+0000","last_became_active":"2023-12-22T09:14:28.477426+0000","last_became_peered":"2023-12-22T09:14:28.477426+0000","last_unstale":"2023-12-22T09:14:32.494158+0000","last_undegraded":"2023-12-22T09:14:32.494158+0000","last_fullsized":"2023-12-22T09:14:32.494158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:50:41.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490998+0000","last_change":"2023-12-22T09:14:28.467153+0000","last_active":"2023-12-22T09:14:32.490998+0000","last_peered":"2023-12-22T09:14:32.490998+0000","last_clean":"2023-12-22T09:14:32.490998+0000","last_became_active":"2023-12-22T09:14:28.466719+0000","last_became_peered":"2023-12-22T09:14:28.466719+0000","last_unstale":"2023-12-22T09:14:32.490998+0000","last_undegraded":"2023-12-22T09:14:32.490998+0000","last_fullsized":"2023-12-22T09:14:32.490998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:15:05.682773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.484628+0000","last_change":"2023-12-22T09:14:28.479238+0000","last_active":"2023-12-22T09:14:32.484628+0000","last_peered":"2023-12-22T09:14:32.484628+0000","last_clean":"2023-12-22T09:14:32.484628+0000","last_became_active":"2023-12-22T09:14:28.478984+0000","last_became_peered":"2023-12-22T09:14:28.478984+0000","last_unstale":"2023-12-22T09:14:32.484628+0000","last_undegraded":"2023-12-22T09:14:32.484628+0000","last_fullsized":"2023-12-22T09:14:32.484628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757917+0000","last_change":"2023-12-22T09:14:28.482492+0000","last_active":"2023-12-22T09:14:32.757917+0000","last_peered":"2023-12-22T09:14:32.757917+0000","last_clean":"2023-12-22T09:14:32.757917+0000","last_became_active":"2023-12-22T09:14:28.474439+0000","last_became_peered":"2023-12-22T09:14:28.474439+0000","last_unstale":"2023-12-22T09:14:32.757917+0000","last_undegraded":"2023-12-22T09:14:32.757917+0000","last_fullsized":"2023-12-22T09:14:32.757917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":694025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":106871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":106871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":103075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:14:57.386 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:14:57.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.633+0000 7f852c496640 1 Processor -- start 2023-12-22T09:14:57.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.633+0000 7f852c496640 1 -- start start 2023-12-22T09:14:57.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f852c496640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85240bfce0 0x7f852406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f852c496640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8524151b30 0x7f8524151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f852c496640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85240bf770 con 0x7f852413b060 2023-12-22T09:14:57.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f852c496640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8524155120 con 0x7f8524151b30 2023-12-22T09:14:57.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f852c496640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8524155400 con 0x7f85240bfce0 2023-12-22T09:14:57.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f852a232640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f852413b060 0x7f8524069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51934/0 (socket says 172.21.15.106:51934) 2023-12-22T09:14:57.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f852a232640 1 -- 172.21.15.106:0/4000525346 learned_addr learned my addr 172.21.15.106:0/4000525346 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:57.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f852aa33640 1 --2- 172.21.15.106:0/4000525346 >> v2:172.21.15.106:3300/0 conn(0x7f8524151b30 0x7f8524151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f8529a31640 1 --2- 172.21.15.106:0/4000525346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85240bfce0 0x7f852406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.635+0000 7f8529230640 1 -- 172.21.15.106:0/4000525346 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969182492 0 0) 0x7f85240bf770 con 0x7f852413b060 2023-12-22T09:14:57.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.636+0000 7f8529230640 1 -- 172.21.15.106:0/4000525346 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8510003520 con 0x7f852413b060 2023-12-22T09:14:57.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.636+0000 7f852aa33640 1 -- 172.21.15.106:0/4000525346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85240bfce0 msgr2=0x7f852406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:57.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.636+0000 7f852aa33640 1 --2- 172.21.15.106:0/4000525346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85240bfce0 0x7f852406a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.636+0000 7f852aa33640 1 -- 172.21.15.106:0/4000525346 >> v1:172.21.15.106:6789/0 conn(0x7f852413b060 legacy=0x7f8524069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.636+0000 7f852aa33640 1 -- 172.21.15.106:0/4000525346 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85241556e0 con 0x7f8524151b30 2023-12-22T09:14:57.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.637+0000 7f852aa33640 1 --2- 172.21.15.106:0/4000525346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8524151b30 0x7f8524151fa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f851c009d90 tx=0x7f851c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1c68b47fce64fa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:57.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.637+0000 7f8529230640 1 -- 172.21.15.106:0/4000525346 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c02cbc0 con 0x7f8524151b30 2023-12-22T09:14:57.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.637+0000 7f8529230640 1 -- 172.21.15.106:0/4000525346 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c02cd20 con 0x7f8524151b30 2023-12-22T09:14:57.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.637+0000 7f8529230640 1 -- 172.21.15.106:0/4000525346 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c034660 con 0x7f8524151b30 2023-12-22T09:14:57.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.637+0000 7f852c496640 1 -- 172.21.15.106:0/4000525346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8524151b30 msgr2=0x7f8524151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.637+0000 7f852c496640 1 --2- 172.21.15.106:0/4000525346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8524151b30 0x7f8524151fa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f851c009d90 tx=0x7f851c02be10 comp rx=0 tx=0).stop 2023-12-22T09:14:57.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.638+0000 7f852c496640 1 -- 172.21.15.106:0/4000525346 shutdown_connections 2023-12-22T09:14:57.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.638+0000 7f852c496640 1 --2- 172.21.15.106:0/4000525346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8524151b30 0x7f8524151fa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.638+0000 7f852c496640 1 --2- 172.21.15.106:0/4000525346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85240bfce0 0x7f852406a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.638+0000 7f852c496640 1 -- 172.21.15.106:0/4000525346 >> 172.21.15.106:0/4000525346 conn(0x7f85240c5360 msgr2=0x7f85240c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:57.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.638+0000 7f852c496640 1 -- 172.21.15.106:0/4000525346 shutdown_connections 2023-12-22T09:14:57.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.638+0000 7f852c496640 1 -- 172.21.15.106:0/4000525346 wait complete. 2023-12-22T09:14:57.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.639+0000 7f852c496640 1 Processor -- start 2023-12-22T09:14:57.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.640+0000 7f852c496640 1 -- start start 2023-12-22T09:14:57.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.640+0000 7f852c496640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85240bfce0 0x7f85241e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.640+0000 7f852c496640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f852413b060 0x7f8524150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f852c496640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8524151b30 0x7f85240be790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f852c496640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85240ba360 con 0x7f852413b060 2023-12-22T09:14:57.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f852c496640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85240c33f0 con 0x7f85240bfce0 2023-12-22T09:14:57.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f852c496640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85240aa7e0 con 0x7f8524151b30 2023-12-22T09:14:57.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f8529a31640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f852413b060 0x7f8524150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f8529a31640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f852413b060 0x7f8524150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40966/0 (socket says 172.21.15.106:40966) 2023-12-22T09:14:57.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f8529a31640 1 -- 172.21.15.106:0/2032513633 learned_addr learned my addr 172.21.15.106:0/2032513633 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:57.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f8529a31640 1 -- 172.21.15.106:0/2032513633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8524151b30 msgr2=0x7f85240be790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f852aa33640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8524151b30 0x7f85240be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f8529a31640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8524151b30 0x7f85240be790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f8529a31640 1 -- 172.21.15.106:0/2032513633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85240bfce0 msgr2=0x7f85241e7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f8529a31640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85240bfce0 0x7f85241e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.641+0000 7f8529a31640 1 -- 172.21.15.106:0/2032513633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009a70 con 0x7f852413b060 2023-12-22T09:14:57.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.642+0000 7f8529a31640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f852413b060 0x7f8524150e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f851400d620 tx=0x7f851400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:57.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.642+0000 7f851affd640 1 -- 172.21.15.106:0/2032513633 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400b620 con 0x7f852413b060 2023-12-22T09:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.642+0000 7f851affd640 1 -- 172.21.15.106:0/2032513633 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851400b780 con 0x7f852413b060 2023-12-22T09:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.642+0000 7f851affd640 1 -- 172.21.15.106:0/2032513633 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400bb30 con 0x7f852413b060 2023-12-22T09:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.642+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85240aaaa0 con 0x7f852413b060 2023-12-22T09:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.642+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85240ab060 con 0x7f852413b060 2023-12-22T09:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.643+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85241ea820 con 0x7f852413b060 2023-12-22T09:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.644+0000 7f851affd640 1 -- 172.21.15.106:0/2032513633 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f851400bc90 con 0x7f852413b060 2023-12-22T09:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.645+0000 7f851affd640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f850806a460 0x7f850806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.645+0000 7f851affd640 1 -- 172.21.15.106:0/2032513633 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8514089080 con 0x7f852413b060 2023-12-22T09:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.645+0000 7f852a232640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f850806a460 0x7f850806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.646+0000 7f852a232640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f850806a460 0x7f850806c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8520001360 tx=0x7f85200077c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.649+0000 7f851affd640 1 -- 172.21.15.106:0/2032513633 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f85140bbc80 con 0x7f852413b060 2023-12-22T09:14:57.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.835+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8524155ca0 con 0x7f850806a460 2023-12-22T09:14:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.857+0000 7f851affd640 1 -- 172.21.15.106:0/2032513633 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345081 (secure 0 0 0) 0x7f8520007070 con 0x7f850806a460 2023-12-22T09:14:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:14:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f850806a460 msgr2=0x7f850806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f850806a460 0x7f850806c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8520001360 tx=0x7f85200077c0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f852413b060 msgr2=0x7f8524150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f852413b060 0x7f8524150e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f851400d620 tx=0x7f851400dae0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 shutdown_connections 2023-12-22T09:14:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f850806a460 0x7f850806c920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8524151b30 0x7f85240be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f852413b060 0x7f8524150e50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 --2- 172.21.15.106:0/2032513633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85240bfce0 0x7f85241e7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 >> 172.21.15.106:0/2032513633 conn(0x7f85240c5360 msgr2=0x7f85240c0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 shutdown_connections 2023-12-22T09:14:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:57.865+0000 7f852c496640 1 -- 172.21.15.106:0/2032513633 wait complete. 2023-12-22T09:14:57.887 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-22T09:14:56.704531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218888,"kb_used_data":3272,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755832,"statfs":{"total":773094113280,"available":772869971968,"internally_reserved":0,"allocated":3350528,"data_stored":2014524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005500"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491770+0000","last_change":"2023-12-22T09:14:27.999590+0000","last_active":"2023-12-22T09:14:32.491770+0000","last_peered":"2023-12-22T09:14:32.491770+0000","last_clean":"2023-12-22T09:14:32.491770+0000","last_became_active":"2023-12-22T09:14:27.999168+0000","last_became_peered":"2023-12-22T09:14:27.999168+0000","last_unstale":"2023-12-22T09:14:32.491770+0000","last_undegraded":"2023-12-22T09:14:32.491770+0000","last_fullsized":"2023-12-22T09:14:32.491770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:55.319959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468195+0000","last_change":"2023-12-22T09:14:28.471978+0000","last_active":"2023-12-22T09:14:32.468195+0000","last_peered":"2023-12-22T09:14:32.468195+0000","last_clean":"2023-12-22T09:14:32.468195+0000","last_became_active":"2023-12-22T09:14:28.471551+0000","last_became_peered":"2023-12-22T09:14:28.471551+0000","last_unstale":"2023-12-22T09:14:32.468195+0000","last_undegraded":"2023-12-22T09:14:32.468195+0000","last_fullsized":"2023-12-22T09:14:32.468195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.753370+0000","last_change":"2023-12-22T09:14:32.750885+0000","last_active":"2023-12-22T09:14:32.753370+0000","last_peered":"2023-12-22T09:14:32.753370+0000","last_clean":"2023-12-22T09:14:32.753370+0000","last_became_active":"2023-12-22T09:14:32.750410+0000","last_became_peered":"2023-12-22T09:14:32.750410+0000","last_unstale":"2023-12-22T09:14:32.753370+0000","last_undegraded":"2023-12-22T09:14:32.753370+0000","last_fullsized":"2023-12-22T09:14:32.753370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:03:15.507458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468717+0000","last_change":"2023-12-22T09:14:27.993421+0000","last_active":"2023-12-22T09:14:32.468717+0000","last_peered":"2023-12-22T09:14:32.468717+0000","last_clean":"2023-12-22T09:14:32.468717+0000","last_became_active":"2023-12-22T09:14:27.993088+0000","last_became_peered":"2023-12-22T09:14:27.993088+0000","last_unstale":"2023-12-22T09:14:32.468717+0000","last_undegraded":"2023-12-22T09:14:32.468717+0000","last_fullsized":"2023-12-22T09:14:32.468717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491593+0000","last_change":"2023-12-22T09:14:28.475345+0000","last_active":"2023-12-22T09:14:32.491593+0000","last_peered":"2023-12-22T09:14:32.491593+0000","last_clean":"2023-12-22T09:14:32.491593+0000","last_became_active":"2023-12-22T09:14:28.473015+0000","last_became_peered":"2023-12-22T09:14:28.473015+0000","last_unstale":"2023-12-22T09:14:32.491593+0000","last_undegraded":"2023-12-22T09:14:32.491593+0000","last_fullsized":"2023-12-22T09:14:32.491593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502282+0000","last_change":"2023-12-22T09:14:32.497444+0000","last_active":"2023-12-22T09:14:32.502282+0000","last_peered":"2023-12-22T09:14:32.502282+0000","last_clean":"2023-12-22T09:14:32.502282+0000","last_became_active":"2023-12-22T09:14:32.494648+0000","last_became_peered":"2023-12-22T09:14:32.494648+0000","last_unstale":"2023-12-22T09:14:32.502282+0000","last_undegraded":"2023-12-22T09:14:32.502282+0000","last_fullsized":"2023-12-22T09:14:32.502282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:47:30.609572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749932+0000","last_change":"2023-12-22T09:14:28.004480+0000","last_active":"2023-12-22T09:14:32.749932+0000","last_peered":"2023-12-22T09:14:32.749932+0000","last_clean":"2023-12-22T09:14:32.749932+0000","last_became_active":"2023-12-22T09:14:28.004122+0000","last_became_peered":"2023-12-22T09:14:28.004122+0000","last_unstale":"2023-12-22T09:14:32.749932+0000","last_undegraded":"2023-12-22T09:14:32.749932+0000","last_fullsized":"2023-12-22T09:14:32.749932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:21.127787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494251+0000","last_change":"2023-12-22T09:14:28.476757+0000","last_active":"2023-12-22T09:14:32.494251+0000","last_peered":"2023-12-22T09:14:32.494251+0000","last_clean":"2023-12-22T09:14:32.494251+0000","last_became_active":"2023-12-22T09:14:28.476378+0000","last_became_peered":"2023-12-22T09:14:28.476378+0000","last_unstale":"2023-12-22T09:14:32.494251+0000","last_undegraded":"2023-12-22T09:14:32.494251+0000","last_fullsized":"2023-12-22T09:14:32.494251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507391+0000","last_change":"2023-12-22T09:14:32.502471+0000","last_active":"2023-12-22T09:14:32.507391+0000","last_peered":"2023-12-22T09:14:32.507391+0000","last_clean":"2023-12-22T09:14:32.507391+0000","last_became_active":"2023-12-22T09:14:32.501880+0000","last_became_peered":"2023-12-22T09:14:32.501880+0000","last_unstale":"2023-12-22T09:14:32.507391+0000","last_undegraded":"2023-12-22T09:14:32.507391+0000","last_fullsized":"2023-12-22T09:14:32.507391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:16.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749172+0000","last_change":"2023-12-22T09:14:28.005371+0000","last_active":"2023-12-22T09:14:32.749172+0000","last_peered":"2023-12-22T09:14:32.749172+0000","last_clean":"2023-12-22T09:14:32.749172+0000","last_became_active":"2023-12-22T09:14:28.005096+0000","last_became_peered":"2023-12-22T09:14:28.005096+0000","last_unstale":"2023-12-22T09:14:32.749172+0000","last_undegraded":"2023-12-22T09:14:32.749172+0000","last_fullsized":"2023-12-22T09:14:32.749172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495790+0000","last_change":"2023-12-22T09:14:28.481890+0000","last_active":"2023-12-22T09:14:32.495790+0000","last_peered":"2023-12-22T09:14:32.495790+0000","last_clean":"2023-12-22T09:14:32.495790+0000","last_became_active":"2023-12-22T09:14:28.480455+0000","last_became_peered":"2023-12-22T09:14:28.480455+0000","last_unstale":"2023-12-22T09:14:32.495790+0000","last_undegraded":"2023-12-22T09:14:32.495790+0000","last_fullsized":"2023-12-22T09:14:32.495790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:34.191893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502319+0000","last_change":"2023-12-22T09:14:32.497995+0000","last_active":"2023-12-22T09:14:32.502319+0000","last_peered":"2023-12-22T09:14:32.502319+0000","last_clean":"2023-12-22T09:14:32.502319+0000","last_became_active":"2023-12-22T09:14:32.497136+0000","last_became_peered":"2023-12-22T09:14:32.497136+0000","last_unstale":"2023-12-22T09:14:32.502319+0000","last_undegraded":"2023-12-22T09:14:32.502319+0000","last_fullsized":"2023-12-22T09:14:32.502319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:02.042832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490410+0000","last_change":"2023-12-22T09:14:28.467962+0000","last_active":"2023-12-22T09:14:32.490410+0000","last_peered":"2023-12-22T09:14:32.490410+0000","last_clean":"2023-12-22T09:14:32.490410+0000","last_became_active":"2023-12-22T09:14:28.467669+0000","last_became_peered":"2023-12-22T09:14:28.467669+0000","last_unstale":"2023-12-22T09:14:32.490410+0000","last_undegraded":"2023-12-22T09:14:32.490410+0000","last_fullsized":"2023-12-22T09:14:32.490410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:14:12.211157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749464+0000","last_change":"2023-12-22T09:14:28.003252+0000","last_active":"2023-12-22T09:14:32.749464+0000","last_peered":"2023-12-22T09:14:32.749464+0000","last_clean":"2023-12-22T09:14:32.749464+0000","last_became_active":"2023-12-22T09:14:28.002818+0000","last_became_peered":"2023-12-22T09:14:28.002818+0000","last_unstale":"2023-12-22T09:14:32.749464+0000","last_undegraded":"2023-12-22T09:14:32.749464+0000","last_fullsized":"2023-12-22T09:14:32.749464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:41.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502344+0000","last_change":"2023-12-22T09:14:32.498105+0000","last_active":"2023-12-22T09:14:32.502344+0000","last_peered":"2023-12-22T09:14:32.502344+0000","last_clean":"2023-12-22T09:14:32.502344+0000","last_became_active":"2023-12-22T09:14:32.497287+0000","last_became_peered":"2023-12-22T09:14:32.497287+0000","last_unstale":"2023-12-22T09:14:32.502344+0000","last_undegraded":"2023-12-22T09:14:32.502344+0000","last_fullsized":"2023-12-22T09:14:32.502344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:20.526932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467458+0000","last_change":"2023-12-22T09:14:28.481525+0000","last_active":"2023-12-22T09:14:32.467458+0000","last_peered":"2023-12-22T09:14:32.467458+0000","last_clean":"2023-12-22T09:14:32.467458+0000","last_became_active":"2023-12-22T09:14:28.480895+0000","last_became_peered":"2023-12-22T09:14:28.480895+0000","last_unstale":"2023-12-22T09:14:32.467458+0000","last_undegraded":"2023-12-22T09:14:32.467458+0000","last_fullsized":"2023-12-22T09:14:32.467458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477412+0000","last_change":"2023-12-22T09:14:27.988542+0000","last_active":"2023-12-22T09:14:32.477412+0000","last_peered":"2023-12-22T09:14:32.477412+0000","last_clean":"2023-12-22T09:14:32.477412+0000","last_became_active":"2023-12-22T09:14:27.988286+0000","last_became_peered":"2023-12-22T09:14:27.988286+0000","last_unstale":"2023-12-22T09:14:32.477412+0000","last_undegraded":"2023-12-22T09:14:32.477412+0000","last_fullsized":"2023-12-22T09:14:32.477412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.496996+0000","last_change":"2023-12-22T09:14:32.489874+0000","last_active":"2023-12-22T09:14:32.496996+0000","last_peered":"2023-12-22T09:14:32.496996+0000","last_clean":"2023-12-22T09:14:32.496996+0000","last_became_active":"2023-12-22T09:14:32.489424+0000","last_became_peered":"2023-12-22T09:14:32.489424+0000","last_unstale":"2023-12-22T09:14:32.496996+0000","last_undegraded":"2023-12-22T09:14:32.496996+0000","last_fullsized":"2023-12-22T09:14:32.496996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:16.494365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466677+0000","last_change":"2023-12-22T09:14:28.479495+0000","last_active":"2023-12-22T09:14:32.466677+0000","last_peered":"2023-12-22T09:14:32.466677+0000","last_clean":"2023-12-22T09:14:32.466677+0000","last_became_active":"2023-12-22T09:14:28.479219+0000","last_became_peered":"2023-12-22T09:14:28.479219+0000","last_unstale":"2023-12-22T09:14:32.466677+0000","last_undegraded":"2023-12-22T09:14:32.466677+0000","last_fullsized":"2023-12-22T09:14:32.466677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:34.191893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479772+0000","last_change":"2023-12-22T09:14:27.998498+0000","last_active":"2023-12-22T09:14:32.479772+0000","last_peered":"2023-12-22T09:14:32.479772+0000","last_clean":"2023-12-22T09:14:32.479772+0000","last_became_active":"2023-12-22T09:14:27.998184+0000","last_became_peered":"2023-12-22T09:14:27.998184+0000","last_unstale":"2023-12-22T09:14:32.479772+0000","last_undegraded":"2023-12-22T09:14:32.479772+0000","last_fullsized":"2023-12-22T09:14:32.479772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:21.127787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.761912+0000","last_change":"2023-12-22T09:14:32.760763+0000","last_active":"2023-12-22T09:14:32.761912+0000","last_peered":"2023-12-22T09:14:32.761912+0000","last_clean":"2023-12-22T09:14:32.761912+0000","last_became_active":"2023-12-22T09:14:32.760138+0000","last_became_peered":"2023-12-22T09:14:32.760138+0000","last_unstale":"2023-12-22T09:14:32.761912+0000","last_undegraded":"2023-12-22T09:14:32.761912+0000","last_fullsized":"2023-12-22T09:14:32.761912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:16.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.478893+0000","last_change":"2023-12-22T09:14:28.467496+0000","last_active":"2023-12-22T09:14:32.478893+0000","last_peered":"2023-12-22T09:14:32.478893+0000","last_clean":"2023-12-22T09:14:32.478893+0000","last_became_active":"2023-12-22T09:14:28.463616+0000","last_became_peered":"2023-12-22T09:14:28.463616+0000","last_unstale":"2023-12-22T09:14:32.478893+0000","last_undegraded":"2023-12-22T09:14:32.478893+0000","last_fullsized":"2023-12-22T09:14:32.478893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:26.247244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.745036+0000","last_change":"2023-12-22T09:14:28.000212+0000","last_active":"2023-12-22T09:14:32.745036+0000","last_peered":"2023-12-22T09:14:32.745036+0000","last_clean":"2023-12-22T09:14:32.745036+0000","last_became_active":"2023-12-22T09:14:27.999905+0000","last_became_peered":"2023-12-22T09:14:27.999905+0000","last_unstale":"2023-12-22T09:14:32.745036+0000","last_undegraded":"2023-12-22T09:14:32.745036+0000","last_fullsized":"2023-12-22T09:14:32.745036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.504899+0000","last_change":"2023-12-22T09:14:32.502188+0000","last_active":"2023-12-22T09:14:32.504899+0000","last_peered":"2023-12-22T09:14:32.504899+0000","last_clean":"2023-12-22T09:14:32.504899+0000","last_became_active":"2023-12-22T09:14:32.501764+0000","last_became_peered":"2023-12-22T09:14:32.501764+0000","last_unstale":"2023-12-22T09:14:32.504899+0000","last_undegraded":"2023-12-22T09:14:32.504899+0000","last_fullsized":"2023-12-22T09:14:32.504899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:38.035204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491844+0000","last_change":"2023-12-22T09:14:28.463499+0000","last_active":"2023-12-22T09:14:32.491844+0000","last_peered":"2023-12-22T09:14:32.491844+0000","last_clean":"2023-12-22T09:14:32.491844+0000","last_became_active":"2023-12-22T09:14:28.463220+0000","last_became_peered":"2023-12-22T09:14:28.463220+0000","last_unstale":"2023-12-22T09:14:32.491844+0000","last_undegraded":"2023-12-22T09:14:32.491844+0000","last_fullsized":"2023-12-22T09:14:32.491844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489384+0000","last_change":"2023-12-22T09:14:27.999099+0000","last_active":"2023-12-22T09:14:32.489384+0000","last_peered":"2023-12-22T09:14:32.489384+0000","last_clean":"2023-12-22T09:14:32.489384+0000","last_became_active":"2023-12-22T09:14:27.998803+0000","last_became_peered":"2023-12-22T09:14:27.998803+0000","last_unstale":"2023-12-22T09:14:32.489384+0000","last_undegraded":"2023-12-22T09:14:32.489384+0000","last_fullsized":"2023-12-22T09:14:32.489384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:15:18.285741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.766019+0000","last_change":"2023-12-22T09:14:32.764135+0000","last_active":"2023-12-22T09:14:32.766019+0000","last_peered":"2023-12-22T09:14:32.766019+0000","last_clean":"2023-12-22T09:14:32.766019+0000","last_became_active":"2023-12-22T09:14:32.761760+0000","last_became_peered":"2023-12-22T09:14:32.761760+0000","last_unstale":"2023-12-22T09:14:32.766019+0000","last_undegraded":"2023-12-22T09:14:32.766019+0000","last_fullsized":"2023-12-22T09:14:32.766019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.471279+0000","last_change":"2023-12-22T09:14:28.475255+0000","last_active":"2023-12-22T09:14:32.471279+0000","last_peered":"2023-12-22T09:14:32.471279+0000","last_clean":"2023-12-22T09:14:32.471279+0000","last_became_active":"2023-12-22T09:14:28.475002+0000","last_became_peered":"2023-12-22T09:14:28.475002+0000","last_unstale":"2023-12-22T09:14:32.471279+0000","last_undegraded":"2023-12-22T09:14:32.471279+0000","last_fullsized":"2023-12-22T09:14:32.471279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:33.410634+0000","last_change":"2023-12-22T09:14:27.992093+0000","last_active":"2023-12-22T09:14:33.410634+0000","last_peered":"2023-12-22T09:14:33.410634+0000","last_clean":"2023-12-22T09:14:33.410634+0000","last_became_active":"2023-12-22T09:14:27.991810+0000","last_became_peered":"2023-12-22T09:14:27.991810+0000","last_unstale":"2023-12-22T09:14:33.410634+0000","last_undegraded":"2023-12-22T09:14:33.410634+0000","last_fullsized":"2023-12-22T09:14:33.410634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.753349+0000","last_change":"2023-12-22T09:14:32.750234+0000","last_active":"2023-12-22T09:14:32.753349+0000","last_peered":"2023-12-22T09:14:32.753349+0000","last_clean":"2023-12-22T09:14:32.753349+0000","last_became_active":"2023-12-22T09:14:32.749801+0000","last_became_peered":"2023-12-22T09:14:32.749801+0000","last_unstale":"2023-12-22T09:14:32.753349+0000","last_undegraded":"2023-12-22T09:14:32.753349+0000","last_fullsized":"2023-12-22T09:14:32.753349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:14:08.228677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477551+0000","last_change":"2023-12-22T09:14:28.454337+0000","last_active":"2023-12-22T09:14:32.477551+0000","last_peered":"2023-12-22T09:14:32.477551+0000","last_clean":"2023-12-22T09:14:32.477551+0000","last_became_active":"2023-12-22T09:14:28.454047+0000","last_became_peered":"2023-12-22T09:14:28.454047+0000","last_unstale":"2023-12-22T09:14:32.477551+0000","last_undegraded":"2023-12-22T09:14:32.477551+0000","last_fullsized":"2023-12-22T09:14:32.477551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.756169+0000","last_change":"2023-12-22T09:14:28.001870+0000","last_active":"2023-12-22T09:14:32.756169+0000","last_peered":"2023-12-22T09:14:32.756169+0000","last_clean":"2023-12-22T09:14:32.756169+0000","last_became_active":"2023-12-22T09:14:28.001090+0000","last_became_peered":"2023-12-22T09:14:28.001090+0000","last_unstale":"2023-12-22T09:14:32.756169+0000","last_undegraded":"2023-12-22T09:14:32.756169+0000","last_fullsized":"2023-12-22T09:14:32.756169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.752284+0000","last_change":"2023-12-22T09:14:32.748035+0000","last_active":"2023-12-22T09:14:32.752284+0000","last_peered":"2023-12-22T09:14:32.752284+0000","last_clean":"2023-12-22T09:14:32.752284+0000","last_became_active":"2023-12-22T09:14:32.747593+0000","last_became_peered":"2023-12-22T09:14:32.747593+0000","last_unstale":"2023-12-22T09:14:32.752284+0000","last_undegraded":"2023-12-22T09:14:32.752284+0000","last_fullsized":"2023-12-22T09:14:32.752284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495880+0000","last_change":"2023-12-22T09:14:28.478893+0000","last_active":"2023-12-22T09:14:32.495880+0000","last_peered":"2023-12-22T09:14:32.495880+0000","last_clean":"2023-12-22T09:14:32.495880+0000","last_became_active":"2023-12-22T09:14:28.478270+0000","last_became_peered":"2023-12-22T09:14:28.478270+0000","last_unstale":"2023-12-22T09:14:32.495880+0000","last_undegraded":"2023-12-22T09:14:32.495880+0000","last_fullsized":"2023-12-22T09:14:32.495880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477626+0000","last_change":"2023-12-22T09:14:27.993596+0000","last_active":"2023-12-22T09:14:32.477626+0000","last_peered":"2023-12-22T09:14:32.477626+0000","last_clean":"2023-12-22T09:14:32.477626+0000","last_became_active":"2023-12-22T09:14:27.993333+0000","last_became_peered":"2023-12-22T09:14:27.993333+0000","last_unstale":"2023-12-22T09:14:32.477626+0000","last_undegraded":"2023-12-22T09:14:32.477626+0000","last_fullsized":"2023-12-22T09:14:32.477626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505508+0000","last_change":"2023-12-22T09:14:32.497013+0000","last_active":"2023-12-22T09:14:32.505508+0000","last_peered":"2023-12-22T09:14:32.505508+0000","last_clean":"2023-12-22T09:14:32.505508+0000","last_became_active":"2023-12-22T09:14:32.496344+0000","last_became_peered":"2023-12-22T09:14:32.496344+0000","last_unstale":"2023-12-22T09:14:32.505508+0000","last_undegraded":"2023-12-22T09:14:32.505508+0000","last_fullsized":"2023-12-22T09:14:32.505508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479912+0000","last_change":"2023-12-22T09:14:28.467982+0000","last_active":"2023-12-22T09:14:32.479912+0000","last_peered":"2023-12-22T09:14:32.479912+0000","last_clean":"2023-12-22T09:14:32.479912+0000","last_became_active":"2023-12-22T09:14:28.467733+0000","last_became_peered":"2023-12-22T09:14:28.467733+0000","last_unstale":"2023-12-22T09:14:32.479912+0000","last_undegraded":"2023-12-22T09:14:32.479912+0000","last_fullsized":"2023-12-22T09:14:32.479912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:42.586936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494566+0000","last_change":"2023-12-22T09:14:27.992541+0000","last_active":"2023-12-22T09:14:32.494566+0000","last_peered":"2023-12-22T09:14:32.494566+0000","last_clean":"2023-12-22T09:14:32.494566+0000","last_became_active":"2023-12-22T09:14:27.988045+0000","last_became_peered":"2023-12-22T09:14:27.988045+0000","last_unstale":"2023-12-22T09:14:32.494566+0000","last_undegraded":"2023-12-22T09:14:32.494566+0000","last_fullsized":"2023-12-22T09:14:32.494566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.499768+0000","last_change":"2023-12-22T09:14:32.496063+0000","last_active":"2023-12-22T09:14:32.499768+0000","last_peered":"2023-12-22T09:14:32.499768+0000","last_clean":"2023-12-22T09:14:32.499768+0000","last_became_active":"2023-12-22T09:14:32.495488+0000","last_became_peered":"2023-12-22T09:14:32.495488+0000","last_unstale":"2023-12-22T09:14:32.499768+0000","last_undegraded":"2023-12-22T09:14:32.499768+0000","last_fullsized":"2023-12-22T09:14:32.499768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:44.670493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477408+0000","last_change":"2023-12-22T09:14:28.455447+0000","last_active":"2023-12-22T09:14:32.477408+0000","last_peered":"2023-12-22T09:14:32.477408+0000","last_clean":"2023-12-22T09:14:32.477408+0000","last_became_active":"2023-12-22T09:14:28.454567+0000","last_became_peered":"2023-12-22T09:14:28.454567+0000","last_unstale":"2023-12-22T09:14:32.477408+0000","last_undegraded":"2023-12-22T09:14:32.477408+0000","last_fullsized":"2023-12-22T09:14:32.477408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488568+0000","last_change":"2023-12-22T09:14:27.987747+0000","last_active":"2023-12-22T09:14:32.488568+0000","last_peered":"2023-12-22T09:14:32.488568+0000","last_clean":"2023-12-22T09:14:32.488568+0000","last_became_active":"2023-12-22T09:14:27.983166+0000","last_became_peered":"2023-12-22T09:14:27.983166+0000","last_unstale":"2023-12-22T09:14:32.488568+0000","last_undegraded":"2023-12-22T09:14:32.488568+0000","last_fullsized":"2023-12-22T09:14:32.488568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507955+0000","last_change":"2023-12-22T09:14:32.501586+0000","last_active":"2023-12-22T09:14:32.507955+0000","last_peered":"2023-12-22T09:14:32.507955+0000","last_clean":"2023-12-22T09:14:32.507955+0000","last_became_active":"2023-12-22T09:14:32.501007+0000","last_became_peered":"2023-12-22T09:14:32.501007+0000","last_unstale":"2023-12-22T09:14:32.507955+0000","last_undegraded":"2023-12-22T09:14:32.507955+0000","last_fullsized":"2023-12-22T09:14:32.507955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:18.752984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489906+0000","last_change":"2023-12-22T09:14:28.481869+0000","last_active":"2023-12-22T09:14:32.489906+0000","last_peered":"2023-12-22T09:14:32.489906+0000","last_clean":"2023-12-22T09:14:32.489906+0000","last_became_active":"2023-12-22T09:14:28.481649+0000","last_became_peered":"2023-12-22T09:14:28.481649+0000","last_unstale":"2023-12-22T09:14:32.489906+0000","last_undegraded":"2023-12-22T09:14:32.489906+0000","last_fullsized":"2023-12-22T09:14:32.489906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747355+0000","last_change":"2023-12-22T09:14:28.001413+0000","last_active":"2023-12-22T09:14:32.747355+0000","last_peered":"2023-12-22T09:14:32.747355+0000","last_clean":"2023-12-22T09:14:32.747355+0000","last_became_active":"2023-12-22T09:14:28.001068+0000","last_became_peered":"2023-12-22T09:14:28.001068+0000","last_unstale":"2023-12-22T09:14:32.747355+0000","last_undegraded":"2023-12-22T09:14:32.747355+0000","last_fullsized":"2023-12-22T09:14:32.747355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754573+0000","last_change":"2023-12-22T09:14:32.750326+0000","last_active":"2023-12-22T09:14:32.754573+0000","last_peered":"2023-12-22T09:14:32.754573+0000","last_clean":"2023-12-22T09:14:32.754573+0000","last_became_active":"2023-12-22T09:14:32.748190+0000","last_became_peered":"2023-12-22T09:14:32.748190+0000","last_unstale":"2023-12-22T09:14:32.754573+0000","last_undegraded":"2023-12-22T09:14:32.754573+0000","last_fullsized":"2023-12-22T09:14:32.754573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:33.308005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466660+0000","last_change":"2023-12-22T09:14:28.473067+0000","last_active":"2023-12-22T09:14:32.466660+0000","last_peered":"2023-12-22T09:14:32.466660+0000","last_clean":"2023-12-22T09:14:32.466660+0000","last_became_active":"2023-12-22T09:14:28.471735+0000","last_became_peered":"2023-12-22T09:14:28.471735+0000","last_unstale":"2023-12-22T09:14:32.466660+0000","last_undegraded":"2023-12-22T09:14:32.466660+0000","last_fullsized":"2023-12-22T09:14:32.466660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495258+0000","last_change":"2023-12-22T09:14:27.991666+0000","last_active":"2023-12-22T09:14:32.495258+0000","last_peered":"2023-12-22T09:14:32.495258+0000","last_clean":"2023-12-22T09:14:32.495258+0000","last_became_active":"2023-12-22T09:14:27.991399+0000","last_became_peered":"2023-12-22T09:14:27.991399+0000","last_unstale":"2023-12-22T09:14:32.495258+0000","last_undegraded":"2023-12-22T09:14:32.495258+0000","last_fullsized":"2023-12-22T09:14:32.495258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747364+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:14:32.747364+0000","last_peered":"2023-12-22T09:14:32.747364+0000","last_clean":"2023-12-22T09:14:32.747364+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:14:32.747364+0000","last_undegraded":"2023-12-22T09:14:32.747364+0000","last_fullsized":"2023-12-22T09:14:32.747364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.958460+0000","last_change":"2023-12-22T09:14:32.750023+0000","last_active":"2023-12-22T09:14:32.958460+0000","last_peered":"2023-12-22T09:14:32.958460+0000","last_clean":"2023-12-22T09:14:32.958460+0000","last_became_active":"2023-12-22T09:14:32.748764+0000","last_became_peered":"2023-12-22T09:14:32.748764+0000","last_unstale":"2023-12-22T09:14:32.958460+0000","last_undegraded":"2023-12-22T09:14:32.958460+0000","last_fullsized":"2023-12-22T09:14:32.958460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:42.444884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749613+0000","last_change":"2023-12-22T09:14:28.474500+0000","last_active":"2023-12-22T09:14:32.749613+0000","last_peered":"2023-12-22T09:14:32.749613+0000","last_clean":"2023-12-22T09:14:32.749613+0000","last_became_active":"2023-12-22T09:14:28.474257+0000","last_became_peered":"2023-12-22T09:14:28.474257+0000","last_unstale":"2023-12-22T09:14:32.749613+0000","last_undegraded":"2023-12-22T09:14:32.749613+0000","last_fullsized":"2023-12-22T09:14:32.749613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:14.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487370+0000","last_change":"2023-12-22T09:14:27.991242+0000","last_active":"2023-12-22T09:14:32.487370+0000","last_peered":"2023-12-22T09:14:32.487370+0000","last_clean":"2023-12-22T09:14:32.487370+0000","last_became_active":"2023-12-22T09:14:27.990742+0000","last_became_peered":"2023-12-22T09:14:27.990742+0000","last_unstale":"2023-12-22T09:14:32.487370+0000","last_undegraded":"2023-12-22T09:14:32.487370+0000","last_fullsized":"2023-12-22T09:14:32.487370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.957774+0000","last_change":"2023-12-22T09:14:32.749763+0000","last_active":"2023-12-22T09:14:32.957774+0000","last_peered":"2023-12-22T09:14:32.957774+0000","last_clean":"2023-12-22T09:14:32.957774+0000","last_became_active":"2023-12-22T09:14:32.748485+0000","last_became_peered":"2023-12-22T09:14:32.748485+0000","last_unstale":"2023-12-22T09:14:32.957774+0000","last_undegraded":"2023-12-22T09:14:32.957774+0000","last_fullsized":"2023-12-22T09:14:32.957774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:46:07.062719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494350+0000","last_change":"2023-12-22T09:14:28.477663+0000","last_active":"2023-12-22T09:14:32.494350+0000","last_peered":"2023-12-22T09:14:32.494350+0000","last_clean":"2023-12-22T09:14:32.494350+0000","last_became_active":"2023-12-22T09:14:28.477380+0000","last_became_peered":"2023-12-22T09:14:28.477380+0000","last_unstale":"2023-12-22T09:14:32.494350+0000","last_undegraded":"2023-12-22T09:14:32.494350+0000","last_fullsized":"2023-12-22T09:14:32.494350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.481313+0000","last_change":"2023-12-22T09:14:27.995562+0000","last_active":"2023-12-22T09:14:32.481313+0000","last_peered":"2023-12-22T09:14:32.481313+0000","last_clean":"2023-12-22T09:14:32.481313+0000","last_became_active":"2023-12-22T09:14:27.995251+0000","last_became_peered":"2023-12-22T09:14:27.995251+0000","last_unstale":"2023-12-22T09:14:32.481313+0000","last_undegraded":"2023-12-22T09:14:32.481313+0000","last_fullsized":"2023-12-22T09:14:32.481313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507091+0000","last_change":"2023-12-22T09:14:32.502846+0000","last_active":"2023-12-22T09:14:32.507091+0000","last_peered":"2023-12-22T09:14:32.507091+0000","last_clean":"2023-12-22T09:14:32.507091+0000","last_became_active":"2023-12-22T09:14:32.502395+0000","last_became_peered":"2023-12-22T09:14:32.502395+0000","last_unstale":"2023-12-22T09:14:32.507091+0000","last_undegraded":"2023-12-22T09:14:32.507091+0000","last_fullsized":"2023-12-22T09:14:32.507091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.758162+0000","last_change":"2023-12-22T09:14:28.482682+0000","last_active":"2023-12-22T09:14:32.758162+0000","last_peered":"2023-12-22T09:14:32.758162+0000","last_clean":"2023-12-22T09:14:32.758162+0000","last_became_active":"2023-12-22T09:14:28.475766+0000","last_became_peered":"2023-12-22T09:14:28.475766+0000","last_unstale":"2023-12-22T09:14:32.758162+0000","last_undegraded":"2023-12-22T09:14:32.758162+0000","last_fullsized":"2023-12-22T09:14:32.758162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:17.017778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486650+0000","last_change":"2023-12-22T09:14:27.982302+0000","last_active":"2023-12-22T09:14:32.486650+0000","last_peered":"2023-12-22T09:14:32.486650+0000","last_clean":"2023-12-22T09:14:32.486650+0000","last_became_active":"2023-12-22T09:14:27.982025+0000","last_became_peered":"2023-12-22T09:14:27.982025+0000","last_unstale":"2023-12-22T09:14:32.486650+0000","last_undegraded":"2023-12-22T09:14:32.486650+0000","last_fullsized":"2023-12-22T09:14:32.486650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757174+0000","last_change":"2023-12-22T09:14:32.754165+0000","last_active":"2023-12-22T09:14:32.757174+0000","last_peered":"2023-12-22T09:14:32.757174+0000","last_clean":"2023-12-22T09:14:32.757174+0000","last_became_active":"2023-12-22T09:14:32.753078+0000","last_became_peered":"2023-12-22T09:14:32.753078+0000","last_unstale":"2023-12-22T09:14:32.757174+0000","last_undegraded":"2023-12-22T09:14:32.757174+0000","last_fullsized":"2023-12-22T09:14:32.757174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.755255+0000","last_change":"2023-12-22T09:14:28.488566+0000","last_active":"2023-12-22T09:14:32.755255+0000","last_peered":"2023-12-22T09:14:32.755255+0000","last_clean":"2023-12-22T09:14:32.755255+0000","last_became_active":"2023-12-22T09:14:28.488216+0000","last_became_peered":"2023-12-22T09:14:28.488216+0000","last_unstale":"2023-12-22T09:14:32.755255+0000","last_undegraded":"2023-12-22T09:14:32.755255+0000","last_fullsized":"2023-12-22T09:14:32.755255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479697+0000","last_change":"2023-12-22T09:14:27.995501+0000","last_active":"2023-12-22T09:14:32.479697+0000","last_peered":"2023-12-22T09:14:32.479697+0000","last_clean":"2023-12-22T09:14:32.479697+0000","last_became_active":"2023-12-22T09:14:27.995234+0000","last_became_peered":"2023-12-22T09:14:27.995234+0000","last_unstale":"2023-12-22T09:14:32.479697+0000","last_undegraded":"2023-12-22T09:14:32.479697+0000","last_fullsized":"2023-12-22T09:14:32.479697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:23.399786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502467+0000","last_change":"2023-12-22T09:14:32.498587+0000","last_active":"2023-12-22T09:14:32.502467+0000","last_peered":"2023-12-22T09:14:32.502467+0000","last_clean":"2023-12-22T09:14:32.502467+0000","last_became_active":"2023-12-22T09:14:32.497206+0000","last_became_peered":"2023-12-22T09:14:32.497206+0000","last_unstale":"2023-12-22T09:14:32.502467+0000","last_undegraded":"2023-12-22T09:14:32.502467+0000","last_fullsized":"2023-12-22T09:14:32.502467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747037+0000","last_change":"2023-12-22T09:14:28.486764+0000","last_active":"2023-12-22T09:14:32.747037+0000","last_peered":"2023-12-22T09:14:32.747037+0000","last_clean":"2023-12-22T09:14:32.747037+0000","last_became_active":"2023-12-22T09:14:28.486496+0000","last_became_peered":"2023-12-22T09:14:28.486496+0000","last_unstale":"2023-12-22T09:14:32.747037+0000","last_undegraded":"2023-12-22T09:14:32.747037+0000","last_fullsized":"2023-12-22T09:14:32.747037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:50:41.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486193+0000","last_change":"2023-12-22T09:14:27.988914+0000","last_active":"2023-12-22T09:14:32.486193+0000","last_peered":"2023-12-22T09:14:32.486193+0000","last_clean":"2023-12-22T09:14:32.486193+0000","last_became_active":"2023-12-22T09:14:27.988557+0000","last_became_peered":"2023-12-22T09:14:27.988557+0000","last_unstale":"2023-12-22T09:14:32.486193+0000","last_undegraded":"2023-12-22T09:14:32.486193+0000","last_fullsized":"2023-12-22T09:14:32.486193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.509994+0000","last_change":"2023-12-22T09:14:32.504445+0000","last_active":"2023-12-22T09:14:32.509994+0000","last_peered":"2023-12-22T09:14:32.509994+0000","last_clean":"2023-12-22T09:14:32.509994+0000","last_became_active":"2023-12-22T09:14:32.504017+0000","last_became_peered":"2023-12-22T09:14:32.504017+0000","last_unstale":"2023-12-22T09:14:32.509994+0000","last_undegraded":"2023-12-22T09:14:32.509994+0000","last_fullsized":"2023-12-22T09:14:32.509994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:16.494365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486277+0000","last_change":"2023-12-22T09:14:28.471567+0000","last_active":"2023-12-22T09:14:32.486277+0000","last_peered":"2023-12-22T09:14:32.486277+0000","last_clean":"2023-12-22T09:14:32.486277+0000","last_became_active":"2023-12-22T09:14:28.471239+0000","last_became_peered":"2023-12-22T09:14:28.471239+0000","last_unstale":"2023-12-22T09:14:32.486277+0000","last_undegraded":"2023-12-22T09:14:32.486277+0000","last_fullsized":"2023-12-22T09:14:32.486277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:36.670203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487591+0000","last_change":"2023-12-22T09:14:27.997965+0000","last_active":"2023-12-22T09:14:32.487591+0000","last_peered":"2023-12-22T09:14:32.487591+0000","last_clean":"2023-12-22T09:14:32.487591+0000","last_became_active":"2023-12-22T09:14:27.995729+0000","last_became_peered":"2023-12-22T09:14:27.995729+0000","last_unstale":"2023-12-22T09:14:32.487591+0000","last_undegraded":"2023-12-22T09:14:32.487591+0000","last_fullsized":"2023-12-22T09:14:32.487591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:39.444798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.760822+0000","last_change":"2023-12-22T09:14:32.759895+0000","last_active":"2023-12-22T09:14:32.760822+0000","last_peered":"2023-12-22T09:14:32.760822+0000","last_clean":"2023-12-22T09:14:32.760822+0000","last_became_active":"2023-12-22T09:14:32.759468+0000","last_became_peered":"2023-12-22T09:14:32.759468+0000","last_unstale":"2023-12-22T09:14:32.760822+0000","last_undegraded":"2023-12-22T09:14:32.760822+0000","last_fullsized":"2023-12-22T09:14:32.760822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:50:22.096701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749005+0000","last_change":"2023-12-22T09:14:28.474331+0000","last_active":"2023-12-22T09:14:32.749005+0000","last_peered":"2023-12-22T09:14:32.749005+0000","last_clean":"2023-12-22T09:14:32.749005+0000","last_became_active":"2023-12-22T09:14:28.473856+0000","last_became_peered":"2023-12-22T09:14:28.473856+0000","last_unstale":"2023-12-22T09:14:32.749005+0000","last_undegraded":"2023-12-22T09:14:32.749005+0000","last_fullsized":"2023-12-22T09:14:32.749005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494464+0000","last_change":"2023-12-22T09:14:28.003970+0000","last_active":"2023-12-22T09:14:32.494464+0000","last_peered":"2023-12-22T09:14:32.494464+0000","last_clean":"2023-12-22T09:14:32.494464+0000","last_became_active":"2023-12-22T09:14:28.003627+0000","last_became_peered":"2023-12-22T09:14:28.003627+0000","last_unstale":"2023-12-22T09:14:32.494464+0000","last_undegraded":"2023-12-22T09:14:32.494464+0000","last_fullsized":"2023-12-22T09:14:32.494464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754851+0000","last_change":"2023-12-22T09:14:32.752183+0000","last_active":"2023-12-22T09:14:32.754851+0000","last_peered":"2023-12-22T09:14:32.754851+0000","last_clean":"2023-12-22T09:14:32.754851+0000","last_became_active":"2023-12-22T09:14:32.749483+0000","last_became_peered":"2023-12-22T09:14:32.749483+0000","last_unstale":"2023-12-22T09:14:32.754851+0000","last_undegraded":"2023-12-22T09:14:32.754851+0000","last_fullsized":"2023-12-22T09:14:32.754851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:09.047311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489001+0000","last_change":"2023-12-22T09:14:28.477740+0000","last_active":"2023-12-22T09:14:32.489001+0000","last_peered":"2023-12-22T09:14:32.489001+0000","last_clean":"2023-12-22T09:14:32.489001+0000","last_became_active":"2023-12-22T09:14:28.477495+0000","last_became_peered":"2023-12-22T09:14:28.477495+0000","last_unstale":"2023-12-22T09:14:32.489001+0000","last_undegraded":"2023-12-22T09:14:32.489001+0000","last_fullsized":"2023-12-22T09:14:32.489001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:28.625454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489565+0000","last_change":"2023-12-22T09:14:27.994572+0000","last_active":"2023-12-22T09:14:32.489565+0000","last_peered":"2023-12-22T09:14:32.489565+0000","last_clean":"2023-12-22T09:14:32.489565+0000","last_became_active":"2023-12-22T09:14:27.994200+0000","last_became_peered":"2023-12-22T09:14:27.994200+0000","last_unstale":"2023-12-22T09:14:32.489565+0000","last_undegraded":"2023-12-22T09:14:32.489565+0000","last_fullsized":"2023-12-22T09:14:32.489565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:50:40.407650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754400+0000","last_change":"2023-12-22T09:14:32.751024+0000","last_active":"2023-12-22T09:14:32.754400+0000","last_peered":"2023-12-22T09:14:32.754400+0000","last_clean":"2023-12-22T09:14:32.754400+0000","last_became_active":"2023-12-22T09:14:32.748055+0000","last_became_peered":"2023-12-22T09:14:32.748055+0000","last_unstale":"2023-12-22T09:14:32.754400+0000","last_undegraded":"2023-12-22T09:14:32.754400+0000","last_fullsized":"2023-12-22T09:14:32.754400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:18.069342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757751+0000","last_change":"2023-12-22T09:14:28.475564+0000","last_active":"2023-12-22T09:14:32.757751+0000","last_peered":"2023-12-22T09:14:32.757751+0000","last_clean":"2023-12-22T09:14:32.757751+0000","last_became_active":"2023-12-22T09:14:28.475209+0000","last_became_peered":"2023-12-22T09:14:28.475209+0000","last_unstale":"2023-12-22T09:14:32.757751+0000","last_undegraded":"2023-12-22T09:14:32.757751+0000","last_fullsized":"2023-12-22T09:14:32.757751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:46.880888+0000","last_change":"2023-12-22T09:14:27.986129+0000","last_active":"2023-12-22T09:14:46.880888+0000","last_peered":"2023-12-22T09:14:46.880888+0000","last_clean":"2023-12-22T09:14:46.880888+0000","last_became_active":"2023-12-22T09:14:27.984848+0000","last_became_peered":"2023-12-22T09:14:27.984848+0000","last_unstale":"2023-12-22T09:14:46.880888+0000","last_undegraded":"2023-12-22T09:14:46.880888+0000","last_fullsized":"2023-12-22T09:14:46.880888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:26:42.194176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505485+0000","last_change":"2023-12-22T09:14:32.496763+0000","last_active":"2023-12-22T09:14:32.505485+0000","last_peered":"2023-12-22T09:14:32.505485+0000","last_clean":"2023-12-22T09:14:32.505485+0000","last_became_active":"2023-12-22T09:14:32.495748+0000","last_became_peered":"2023-12-22T09:14:32.495748+0000","last_unstale":"2023-12-22T09:14:32.505485+0000","last_undegraded":"2023-12-22T09:14:32.505485+0000","last_fullsized":"2023-12-22T09:14:32.505485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479467+0000","last_change":"2023-12-22T09:14:28.479921+0000","last_active":"2023-12-22T09:14:32.479467+0000","last_peered":"2023-12-22T09:14:32.479467+0000","last_clean":"2023-12-22T09:14:32.479467+0000","last_became_active":"2023-12-22T09:14:28.479147+0000","last_became_peered":"2023-12-22T09:14:28.479147+0000","last_unstale":"2023-12-22T09:14:32.479467+0000","last_undegraded":"2023-12-22T09:14:32.479467+0000","last_fullsized":"2023-12-22T09:14:32.479467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:22.141418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.481162+0000","last_change":"2023-12-22T09:14:27.998821+0000","last_active":"2023-12-22T09:14:32.481162+0000","last_peered":"2023-12-22T09:14:32.481162+0000","last_clean":"2023-12-22T09:14:32.481162+0000","last_became_active":"2023-12-22T09:14:27.998503+0000","last_became_peered":"2023-12-22T09:14:27.998503+0000","last_unstale":"2023-12-22T09:14:32.481162+0000","last_undegraded":"2023-12-22T09:14:32.481162+0000","last_fullsized":"2023-12-22T09:14:32.481162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507446+0000","last_change":"2023-12-22T09:14:32.502980+0000","last_active":"2023-12-22T09:14:32.507446+0000","last_peered":"2023-12-22T09:14:32.507446+0000","last_clean":"2023-12-22T09:14:32.507446+0000","last_became_active":"2023-12-22T09:14:32.502553+0000","last_became_peered":"2023-12-22T09:14:32.502553+0000","last_unstale":"2023-12-22T09:14:32.507446+0000","last_undegraded":"2023-12-22T09:14:32.507446+0000","last_fullsized":"2023-12-22T09:14:32.507446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:45:19.291884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491688+0000","last_change":"2023-12-22T09:14:28.475888+0000","last_active":"2023-12-22T09:14:32.491688+0000","last_peered":"2023-12-22T09:14:32.491688+0000","last_clean":"2023-12-22T09:14:32.491688+0000","last_became_active":"2023-12-22T09:14:28.475647+0000","last_became_peered":"2023-12-22T09:14:28.475647+0000","last_unstale":"2023-12-22T09:14:32.491688+0000","last_undegraded":"2023-12-22T09:14:32.491688+0000","last_fullsized":"2023-12-22T09:14:32.491688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494265+0000","last_change":"2023-12-22T09:14:27.995374+0000","last_active":"2023-12-22T09:14:32.494265+0000","last_peered":"2023-12-22T09:14:32.494265+0000","last_clean":"2023-12-22T09:14:32.494265+0000","last_became_active":"2023-12-22T09:14:27.995047+0000","last_became_peered":"2023-12-22T09:14:27.995047+0000","last_unstale":"2023-12-22T09:14:32.494265+0000","last_undegraded":"2023-12-22T09:14:32.494265+0000","last_fullsized":"2023-12-22T09:14:32.494265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.497163+0000","last_change":"2023-12-22T09:14:32.493394+0000","last_active":"2023-12-22T09:14:32.497163+0000","last_peered":"2023-12-22T09:14:32.497163+0000","last_clean":"2023-12-22T09:14:32.497163+0000","last_became_active":"2023-12-22T09:14:32.492984+0000","last_became_peered":"2023-12-22T09:14:32.492984+0000","last_unstale":"2023-12-22T09:14:32.497163+0000","last_undegraded":"2023-12-22T09:14:32.497163+0000","last_fullsized":"2023-12-22T09:14:32.497163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:53:49.846745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494126+0000","last_change":"2023-12-22T09:14:28.486602+0000","last_active":"2023-12-22T09:14:32.494126+0000","last_peered":"2023-12-22T09:14:32.494126+0000","last_clean":"2023-12-22T09:14:32.494126+0000","last_became_active":"2023-12-22T09:14:28.485948+0000","last_became_peered":"2023-12-22T09:14:28.485948+0000","last_unstale":"2023-12-22T09:14:32.494126+0000","last_undegraded":"2023-12-22T09:14:32.494126+0000","last_fullsized":"2023-12-22T09:14:32.494126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:14.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489192+0000","last_change":"2023-12-22T09:14:28.000308+0000","last_active":"2023-12-22T09:14:32.489192+0000","last_peered":"2023-12-22T09:14:32.489192+0000","last_clean":"2023-12-22T09:14:32.489192+0000","last_became_active":"2023-12-22T09:14:28.000003+0000","last_became_peered":"2023-12-22T09:14:28.000003+0000","last_unstale":"2023-12-22T09:14:32.489192+0000","last_undegraded":"2023-12-22T09:14:32.489192+0000","last_fullsized":"2023-12-22T09:14:32.489192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:28:22.560684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.746514+0000","last_change":"2023-12-22T09:14:32.744415+0000","last_active":"2023-12-22T09:14:32.746514+0000","last_peered":"2023-12-22T09:14:32.746514+0000","last_clean":"2023-12-22T09:14:32.746514+0000","last_became_active":"2023-12-22T09:14:32.744068+0000","last_became_peered":"2023-12-22T09:14:32.744068+0000","last_unstale":"2023-12-22T09:14:32.746514+0000","last_undegraded":"2023-12-22T09:14:32.746514+0000","last_fullsized":"2023-12-22T09:14:32.746514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:57.666688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754553+0000","last_change":"2023-12-22T09:14:32.748417+0000","last_active":"2023-12-22T09:14:32.754553+0000","last_peered":"2023-12-22T09:14:32.754553+0000","last_clean":"2023-12-22T09:14:32.754553+0000","last_became_active":"2023-12-22T09:14:32.747730+0000","last_became_peered":"2023-12-22T09:14:32.747730+0000","last_unstale":"2023-12-22T09:14:32.754553+0000","last_undegraded":"2023-12-22T09:14:32.754553+0000","last_fullsized":"2023-12-22T09:14:32.754553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:18.069342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479643+0000","last_change":"2023-12-22T09:14:28.477761+0000","last_active":"2023-12-22T09:14:32.479643+0000","last_peered":"2023-12-22T09:14:32.479643+0000","last_clean":"2023-12-22T09:14:32.479643+0000","last_became_active":"2023-12-22T09:14:28.477515+0000","last_became_peered":"2023-12-22T09:14:28.477515+0000","last_unstale":"2023-12-22T09:14:32.479643+0000","last_undegraded":"2023-12-22T09:14:32.479643+0000","last_fullsized":"2023-12-22T09:14:32.479643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.493081+0000","last_change":"2023-12-22T09:14:27.997801+0000","last_active":"2023-12-22T09:14:32.493081+0000","last_peered":"2023-12-22T09:14:32.493081+0000","last_clean":"2023-12-22T09:14:32.493081+0000","last_became_active":"2023-12-22T09:14:27.995420+0000","last_became_peered":"2023-12-22T09:14:27.995420+0000","last_unstale":"2023-12-22T09:14:32.493081+0000","last_undegraded":"2023-12-22T09:14:32.493081+0000","last_fullsized":"2023-12-22T09:14:32.493081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.958796+0000","last_change":"2023-12-22T09:14:32.502003+0000","last_active":"2023-12-22T09:14:32.958796+0000","last_peered":"2023-12-22T09:14:32.958796+0000","last_clean":"2023-12-22T09:14:32.958796+0000","last_became_active":"2023-12-22T09:14:32.501565+0000","last_became_peered":"2023-12-22T09:14:32.501565+0000","last_unstale":"2023-12-22T09:14:32.958796+0000","last_undegraded":"2023-12-22T09:14:32.958796+0000","last_fullsized":"2023-12-22T09:14:32.958796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:53.560717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466430+0000","last_change":"2023-12-22T09:14:28.476695+0000","last_active":"2023-12-22T09:14:32.466430+0000","last_peered":"2023-12-22T09:14:32.466430+0000","last_clean":"2023-12-22T09:14:32.466430+0000","last_became_active":"2023-12-22T09:14:28.476418+0000","last_became_peered":"2023-12-22T09:14:28.476418+0000","last_unstale":"2023-12-22T09:14:32.466430+0000","last_undegraded":"2023-12-22T09:14:32.466430+0000","last_fullsized":"2023-12-22T09:14:32.466430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467174+0000","last_change":"2023-12-22T09:14:27.981491+0000","last_active":"2023-12-22T09:14:32.467174+0000","last_peered":"2023-12-22T09:14:32.467174+0000","last_clean":"2023-12-22T09:14:32.467174+0000","last_became_active":"2023-12-22T09:14:27.981149+0000","last_became_peered":"2023-12-22T09:14:27.981149+0000","last_unstale":"2023-12-22T09:14:32.467174+0000","last_undegraded":"2023-12-22T09:14:32.467174+0000","last_fullsized":"2023-12-22T09:14:32.467174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490549+0000","last_change":"2023-12-22T09:14:27.995250+0000","last_active":"2023-12-22T09:14:32.490549+0000","last_peered":"2023-12-22T09:14:32.490549+0000","last_clean":"2023-12-22T09:14:32.490549+0000","last_became_active":"2023-12-22T09:14:27.994964+0000","last_became_peered":"2023-12-22T09:14:27.994964+0000","last_unstale":"2023-12-22T09:14:32.490549+0000","last_undegraded":"2023-12-22T09:14:32.490549+0000","last_fullsized":"2023-12-22T09:14:32.490549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:08.238642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489470+0000","last_change":"2023-12-22T09:14:28.481744+0000","last_active":"2023-12-22T09:14:32.489470+0000","last_peered":"2023-12-22T09:14:32.489470+0000","last_clean":"2023-12-22T09:14:32.489470+0000","last_became_active":"2023-12-22T09:14:28.481329+0000","last_became_peered":"2023-12-22T09:14:28.481329+0000","last_unstale":"2023-12-22T09:14:32.489470+0000","last_undegraded":"2023-12-22T09:14:32.489470+0000","last_fullsized":"2023-12-22T09:14:32.489470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:18:59.454414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505339+0000","last_change":"2023-12-22T09:14:32.500565+0000","last_active":"2023-12-22T09:14:32.505339+0000","last_peered":"2023-12-22T09:14:32.505339+0000","last_clean":"2023-12-22T09:14:32.505339+0000","last_became_active":"2023-12-22T09:14:32.500063+0000","last_became_peered":"2023-12-22T09:14:32.500063+0000","last_unstale":"2023-12-22T09:14:32.505339+0000","last_undegraded":"2023-12-22T09:14:32.505339+0000","last_fullsized":"2023-12-22T09:14:32.505339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:19.878873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467700+0000","last_change":"2023-12-22T09:14:27.997689+0000","last_active":"2023-12-22T09:14:32.467700+0000","last_peered":"2023-12-22T09:14:32.467700+0000","last_clean":"2023-12-22T09:14:32.467700+0000","last_became_active":"2023-12-22T09:14:27.997332+0000","last_became_peered":"2023-12-22T09:14:27.997332+0000","last_unstale":"2023-12-22T09:14:32.467700+0000","last_undegraded":"2023-12-22T09:14:32.467700+0000","last_fullsized":"2023-12-22T09:14:32.467700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.478532+0000","last_change":"2023-12-22T09:14:28.466320+0000","last_active":"2023-12-22T09:14:32.478532+0000","last_peered":"2023-12-22T09:14:32.478532+0000","last_clean":"2023-12-22T09:14:32.478532+0000","last_became_active":"2023-12-22T09:14:28.465905+0000","last_became_peered":"2023-12-22T09:14:28.465905+0000","last_unstale":"2023-12-22T09:14:32.478532+0000","last_undegraded":"2023-12-22T09:14:32.478532+0000","last_fullsized":"2023-12-22T09:14:32.478532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:41.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.499215+0000","last_change":"2023-12-22T09:14:32.496695+0000","last_active":"2023-12-22T09:14:32.499215+0000","last_peered":"2023-12-22T09:14:32.499215+0000","last_clean":"2023-12-22T09:14:32.499215+0000","last_became_active":"2023-12-22T09:14:32.494463+0000","last_became_peered":"2023-12-22T09:14:32.494463+0000","last_unstale":"2023-12-22T09:14:32.499215+0000","last_undegraded":"2023-12-22T09:14:32.499215+0000","last_fullsized":"2023-12-22T09:14:32.499215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:05:19.971364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486096+0000","last_change":"2023-12-22T09:14:28.463582+0000","last_active":"2023-12-22T09:14:32.486096+0000","last_peered":"2023-12-22T09:14:32.486096+0000","last_clean":"2023-12-22T09:14:32.486096+0000","last_became_active":"2023-12-22T09:14:28.463247+0000","last_became_peered":"2023-12-22T09:14:28.463247+0000","last_unstale":"2023-12-22T09:14:32.486096+0000","last_undegraded":"2023-12-22T09:14:32.486096+0000","last_fullsized":"2023-12-22T09:14:32.486096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:52.250368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488481+0000","last_change":"2023-12-22T09:14:28.466146+0000","last_active":"2023-12-22T09:14:32.488481+0000","last_peered":"2023-12-22T09:14:32.488481+0000","last_clean":"2023-12-22T09:14:32.488481+0000","last_became_active":"2023-12-22T09:14:28.460909+0000","last_became_peered":"2023-12-22T09:14:28.460909+0000","last_unstale":"2023-12-22T09:14:32.488481+0000","last_undegraded":"2023-12-22T09:14:32.488481+0000","last_fullsized":"2023-12-22T09:14:32.488481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:13.826585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494360+0000","last_change":"2023-12-22T09:14:28.477080+0000","last_active":"2023-12-22T09:14:32.494360+0000","last_peered":"2023-12-22T09:14:32.494360+0000","last_clean":"2023-12-22T09:14:32.494360+0000","last_became_active":"2023-12-22T09:14:28.474190+0000","last_became_peered":"2023-12-22T09:14:28.474190+0000","last_unstale":"2023-12-22T09:14:32.494360+0000","last_undegraded":"2023-12-22T09:14:32.494360+0000","last_fullsized":"2023-12-22T09:14:32.494360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489372+0000","last_change":"2023-12-22T09:14:28.475187+0000","last_active":"2023-12-22T09:14:32.489372+0000","last_peered":"2023-12-22T09:14:32.489372+0000","last_clean":"2023-12-22T09:14:32.489372+0000","last_became_active":"2023-12-22T09:14:28.474944+0000","last_became_peered":"2023-12-22T09:14:28.474944+0000","last_unstale":"2023-12-22T09:14:32.489372+0000","last_undegraded":"2023-12-22T09:14:32.489372+0000","last_fullsized":"2023-12-22T09:14:32.489372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:54:29.516809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468613+0000","last_change":"2023-12-22T09:14:28.479990+0000","last_active":"2023-12-22T09:14:32.468613+0000","last_peered":"2023-12-22T09:14:32.468613+0000","last_clean":"2023-12-22T09:14:32.468613+0000","last_became_active":"2023-12-22T09:14:28.479746+0000","last_became_peered":"2023-12-22T09:14:28.479746+0000","last_unstale":"2023-12-22T09:14:32.468613+0000","last_undegraded":"2023-12-22T09:14:32.468613+0000","last_fullsized":"2023-12-22T09:14:32.468613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:26.849454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.480832+0000","last_change":"2023-12-22T09:14:28.472845+0000","last_active":"2023-12-22T09:14:32.480832+0000","last_peered":"2023-12-22T09:14:32.480832+0000","last_clean":"2023-12-22T09:14:32.480832+0000","last_became_active":"2023-12-22T09:14:28.472592+0000","last_became_peered":"2023-12-22T09:14:28.472592+0000","last_unstale":"2023-12-22T09:14:32.480832+0000","last_undegraded":"2023-12-22T09:14:32.480832+0000","last_fullsized":"2023-12-22T09:14:32.480832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:28.625454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489554+0000","last_change":"2023-12-22T09:14:28.476150+0000","last_active":"2023-12-22T09:14:32.489554+0000","last_peered":"2023-12-22T09:14:32.489554+0000","last_clean":"2023-12-22T09:14:32.489554+0000","last_became_active":"2023-12-22T09:14:28.475897+0000","last_became_peered":"2023-12-22T09:14:28.475897+0000","last_unstale":"2023-12-22T09:14:32.489554+0000","last_undegraded":"2023-12-22T09:14:32.489554+0000","last_fullsized":"2023-12-22T09:14:32.489554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:53:11.117313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.471112+0000","last_change":"2023-12-22T09:14:28.480478+0000","last_active":"2023-12-22T09:14:32.471112+0000","last_peered":"2023-12-22T09:14:32.471112+0000","last_clean":"2023-12-22T09:14:32.471112+0000","last_became_active":"2023-12-22T09:14:28.480143+0000","last_became_peered":"2023-12-22T09:14:28.480143+0000","last_unstale":"2023-12-22T09:14:32.471112+0000","last_undegraded":"2023-12-22T09:14:32.471112+0000","last_fullsized":"2023-12-22T09:14:32.471112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.492960+0000","last_change":"2023-12-22T09:14:28.478251+0000","last_active":"2023-12-22T09:14:32.492960+0000","last_peered":"2023-12-22T09:14:32.492960+0000","last_clean":"2023-12-22T09:14:32.492960+0000","last_became_active":"2023-12-22T09:14:28.477973+0000","last_became_peered":"2023-12-22T09:14:28.477973+0000","last_unstale":"2023-12-22T09:14:32.492960+0000","last_undegraded":"2023-12-22T09:14:32.492960+0000","last_fullsized":"2023-12-22T09:14:32.492960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467428+0000","last_change":"2023-12-22T09:14:28.479996+0000","last_active":"2023-12-22T09:14:32.467428+0000","last_peered":"2023-12-22T09:14:32.467428+0000","last_clean":"2023-12-22T09:14:32.467428+0000","last_became_active":"2023-12-22T09:14:28.479737+0000","last_became_peered":"2023-12-22T09:14:28.479737+0000","last_unstale":"2023-12-22T09:14:32.467428+0000","last_undegraded":"2023-12-22T09:14:32.467428+0000","last_fullsized":"2023-12-22T09:14:32.467428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494265+0000","last_change":"2023-12-22T09:14:28.479078+0000","last_active":"2023-12-22T09:14:32.494265+0000","last_peered":"2023-12-22T09:14:32.494265+0000","last_clean":"2023-12-22T09:14:32.494265+0000","last_became_active":"2023-12-22T09:14:28.478851+0000","last_became_peered":"2023-12-22T09:14:28.478851+0000","last_unstale":"2023-12-22T09:14:32.494265+0000","last_undegraded":"2023-12-22T09:14:32.494265+0000","last_fullsized":"2023-12-22T09:14:32.494265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:15.678969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489256+0000","last_change":"2023-12-22T09:14:28.480955+0000","last_active":"2023-12-22T09:14:32.489256+0000","last_peered":"2023-12-22T09:14:32.489256+0000","last_clean":"2023-12-22T09:14:32.489256+0000","last_became_active":"2023-12-22T09:14:28.479777+0000","last_became_peered":"2023-12-22T09:14:28.479777+0000","last_unstale":"2023-12-22T09:14:32.489256+0000","last_undegraded":"2023-12-22T09:14:32.489256+0000","last_fullsized":"2023-12-22T09:14:32.489256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488409+0000","last_change":"2023-12-22T09:14:28.477114+0000","last_active":"2023-12-22T09:14:32.488409+0000","last_peered":"2023-12-22T09:14:32.488409+0000","last_clean":"2023-12-22T09:14:32.488409+0000","last_became_active":"2023-12-22T09:14:28.476857+0000","last_became_peered":"2023-12-22T09:14:28.476857+0000","last_unstale":"2023-12-22T09:14:32.488409+0000","last_undegraded":"2023-12-22T09:14:32.488409+0000","last_fullsized":"2023-12-22T09:14:32.488409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:11:22.661582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.755992+0000","last_change":"2023-12-22T09:14:28.473400+0000","last_active":"2023-12-22T09:14:32.755992+0000","last_peered":"2023-12-22T09:14:32.755992+0000","last_clean":"2023-12-22T09:14:32.755992+0000","last_became_active":"2023-12-22T09:14:28.473079+0000","last_became_peered":"2023-12-22T09:14:28.473079+0000","last_unstale":"2023-12-22T09:14:32.755992+0000","last_undegraded":"2023-12-22T09:14:32.755992+0000","last_fullsized":"2023-12-22T09:14:32.755992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486749+0000","last_change":"2023-12-22T09:14:28.456928+0000","last_active":"2023-12-22T09:14:32.486749+0000","last_peered":"2023-12-22T09:14:32.486749+0000","last_clean":"2023-12-22T09:14:32.486749+0000","last_became_active":"2023-12-22T09:14:28.456756+0000","last_became_peered":"2023-12-22T09:14:28.456756+0000","last_unstale":"2023-12-22T09:14:32.486749+0000","last_undegraded":"2023-12-22T09:14:32.486749+0000","last_fullsized":"2023-12-22T09:14:32.486749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:42.031515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494912+0000","last_change":"2023-12-22T09:14:28.475388+0000","last_active":"2023-12-22T09:14:32.494912+0000","last_peered":"2023-12-22T09:14:32.494912+0000","last_clean":"2023-12-22T09:14:32.494912+0000","last_became_active":"2023-12-22T09:14:28.474472+0000","last_became_peered":"2023-12-22T09:14:28.474472+0000","last_unstale":"2023-12-22T09:14:32.494912+0000","last_undegraded":"2023-12-22T09:14:32.494912+0000","last_fullsized":"2023-12-22T09:14:32.494912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:17.017778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.492765+0000","last_change":"2023-12-22T09:14:28.471352+0000","last_active":"2023-12-22T09:14:32.492765+0000","last_peered":"2023-12-22T09:14:32.492765+0000","last_clean":"2023-12-22T09:14:32.492765+0000","last_became_active":"2023-12-22T09:14:28.471042+0000","last_became_peered":"2023-12-22T09:14:28.471042+0000","last_unstale":"2023-12-22T09:14:32.492765+0000","last_undegraded":"2023-12-22T09:14:32.492765+0000","last_fullsized":"2023-12-22T09:14:32.492765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479697+0000","last_change":"2023-12-22T09:14:28.470575+0000","last_active":"2023-12-22T09:14:32.479697+0000","last_peered":"2023-12-22T09:14:32.479697+0000","last_clean":"2023-12-22T09:14:32.479697+0000","last_became_active":"2023-12-22T09:14:28.470317+0000","last_became_peered":"2023-12-22T09:14:28.470317+0000","last_unstale":"2023-12-22T09:14:32.479697+0000","last_undegraded":"2023-12-22T09:14:32.479697+0000","last_fullsized":"2023-12-22T09:14:32.479697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488959+0000","last_change":"2023-12-22T09:14:28.471255+0000","last_active":"2023-12-22T09:14:32.488959+0000","last_peered":"2023-12-22T09:14:32.488959+0000","last_clean":"2023-12-22T09:14:32.488959+0000","last_became_active":"2023-12-22T09:14:28.470985+0000","last_became_peered":"2023-12-22T09:14:28.470985+0000","last_unstale":"2023-12-22T09:14:32.488959+0000","last_undegraded":"2023-12-22T09:14:32.488959+0000","last_fullsized":"2023-12-22T09:14:32.488959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:32:58.600762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467160+0000","last_change":"2023-12-22T09:14:28.474205+0000","last_active":"2023-12-22T09:14:32.467160+0000","last_peered":"2023-12-22T09:14:32.467160+0000","last_clean":"2023-12-22T09:14:32.467160+0000","last_became_active":"2023-12-22T09:14:28.473905+0000","last_became_peered":"2023-12-22T09:14:28.473905+0000","last_unstale":"2023-12-22T09:14:32.467160+0000","last_undegraded":"2023-12-22T09:14:32.467160+0000","last_fullsized":"2023-12-22T09:14:32.467160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479259+0000","last_change":"2023-12-22T09:14:28.469345+0000","last_active":"2023-12-22T09:14:32.479259+0000","last_peered":"2023-12-22T09:14:32.479259+0000","last_clean":"2023-12-22T09:14:32.479259+0000","last_became_active":"2023-12-22T09:14:28.469074+0000","last_became_peered":"2023-12-22T09:14:28.469074+0000","last_unstale":"2023-12-22T09:14:32.479259+0000","last_undegraded":"2023-12-22T09:14:32.479259+0000","last_fullsized":"2023-12-22T09:14:32.479259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:36.805116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487868+0000","last_change":"2023-12-22T09:14:28.465762+0000","last_active":"2023-12-22T09:14:32.487868+0000","last_peered":"2023-12-22T09:14:32.487868+0000","last_clean":"2023-12-22T09:14:32.487868+0000","last_became_active":"2023-12-22T09:14:28.465457+0000","last_became_peered":"2023-12-22T09:14:28.465457+0000","last_unstale":"2023-12-22T09:14:32.487868+0000","last_undegraded":"2023-12-22T09:14:32.487868+0000","last_fullsized":"2023-12-22T09:14:32.487868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:03.107378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489453+0000","last_change":"2023-12-22T09:14:28.464288+0000","last_active":"2023-12-22T09:14:32.489453+0000","last_peered":"2023-12-22T09:14:32.489453+0000","last_clean":"2023-12-22T09:14:32.489453+0000","last_became_active":"2023-12-22T09:14:28.463738+0000","last_became_peered":"2023-12-22T09:14:28.463738+0000","last_unstale":"2023-12-22T09:14:32.489453+0000","last_undegraded":"2023-12-22T09:14:32.489453+0000","last_fullsized":"2023-12-22T09:14:32.489453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:59:57.709549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757917+0000","last_change":"2023-12-22T09:14:28.474461+0000","last_active":"2023-12-22T09:14:32.757917+0000","last_peered":"2023-12-22T09:14:32.757917+0000","last_clean":"2023-12-22T09:14:32.757917+0000","last_became_active":"2023-12-22T09:14:28.474159+0000","last_became_peered":"2023-12-22T09:14:28.474159+0000","last_unstale":"2023-12-22T09:14:32.757917+0000","last_undegraded":"2023-12-22T09:14:32.757917+0000","last_fullsized":"2023-12-22T09:14:32.757917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:15.678969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.465111+0000","last_change":"2023-12-22T09:14:28.471807+0000","last_active":"2023-12-22T09:14:32.465111+0000","last_peered":"2023-12-22T09:14:32.465111+0000","last_clean":"2023-12-22T09:14:32.465111+0000","last_became_active":"2023-12-22T09:14:28.471516+0000","last_became_peered":"2023-12-22T09:14:28.471516+0000","last_unstale":"2023-12-22T09:14:32.465111+0000","last_undegraded":"2023-12-22T09:14:32.465111+0000","last_fullsized":"2023-12-22T09:14:32.465111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.746735+0000","last_change":"2023-12-22T09:14:28.472378+0000","last_active":"2023-12-22T09:14:32.746735+0000","last_peered":"2023-12-22T09:14:32.746735+0000","last_clean":"2023-12-22T09:14:32.746735+0000","last_became_active":"2023-12-22T09:14:28.472104+0000","last_became_peered":"2023-12-22T09:14:28.472104+0000","last_unstale":"2023-12-22T09:14:32.746735+0000","last_undegraded":"2023-12-22T09:14:32.746735+0000","last_fullsized":"2023-12-22T09:14:32.746735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494167+0000","last_change":"2023-12-22T09:14:28.465305+0000","last_active":"2023-12-22T09:14:32.494167+0000","last_peered":"2023-12-22T09:14:32.494167+0000","last_clean":"2023-12-22T09:14:32.494167+0000","last_became_active":"2023-12-22T09:14:28.464795+0000","last_became_peered":"2023-12-22T09:14:28.464795+0000","last_unstale":"2023-12-22T09:14:32.494167+0000","last_undegraded":"2023-12-22T09:14:32.494167+0000","last_fullsized":"2023-12-22T09:14:32.494167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:26.849454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754743+0000","last_change":"2023-12-22T09:14:28.471738+0000","last_active":"2023-12-22T09:14:32.754743+0000","last_peered":"2023-12-22T09:14:32.754743+0000","last_clean":"2023-12-22T09:14:32.754743+0000","last_became_active":"2023-12-22T09:14:28.470650+0000","last_became_peered":"2023-12-22T09:14:28.470650+0000","last_unstale":"2023-12-22T09:14:32.754743+0000","last_undegraded":"2023-12-22T09:14:32.754743+0000","last_fullsized":"2023-12-22T09:14:32.754743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494158+0000","last_change":"2023-12-22T09:14:28.477696+0000","last_active":"2023-12-22T09:14:32.494158+0000","last_peered":"2023-12-22T09:14:32.494158+0000","last_clean":"2023-12-22T09:14:32.494158+0000","last_became_active":"2023-12-22T09:14:28.477426+0000","last_became_peered":"2023-12-22T09:14:28.477426+0000","last_unstale":"2023-12-22T09:14:32.494158+0000","last_undegraded":"2023-12-22T09:14:32.494158+0000","last_fullsized":"2023-12-22T09:14:32.494158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:50:41.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490998+0000","last_change":"2023-12-22T09:14:28.467153+0000","last_active":"2023-12-22T09:14:32.490998+0000","last_peered":"2023-12-22T09:14:32.490998+0000","last_clean":"2023-12-22T09:14:32.490998+0000","last_became_active":"2023-12-22T09:14:28.466719+0000","last_became_peered":"2023-12-22T09:14:28.466719+0000","last_unstale":"2023-12-22T09:14:32.490998+0000","last_undegraded":"2023-12-22T09:14:32.490998+0000","last_fullsized":"2023-12-22T09:14:32.490998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:15:05.682773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.484628+0000","last_change":"2023-12-22T09:14:28.479238+0000","last_active":"2023-12-22T09:14:32.484628+0000","last_peered":"2023-12-22T09:14:32.484628+0000","last_clean":"2023-12-22T09:14:32.484628+0000","last_became_active":"2023-12-22T09:14:28.478984+0000","last_became_peered":"2023-12-22T09:14:28.478984+0000","last_unstale":"2023-12-22T09:14:32.484628+0000","last_undegraded":"2023-12-22T09:14:32.484628+0000","last_fullsized":"2023-12-22T09:14:32.484628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757917+0000","last_change":"2023-12-22T09:14:28.482492+0000","last_active":"2023-12-22T09:14:32.757917+0000","last_peered":"2023-12-22T09:14:32.757917+0000","last_clean":"2023-12-22T09:14:32.757917+0000","last_became_active":"2023-12-22T09:14:28.474439+0000","last_became_peered":"2023-12-22T09:14:28.474439+0000","last_unstale":"2023-12-22T09:14:32.757917+0000","last_undegraded":"2023-12-22T09:14:32.757917+0000","last_fullsized":"2023-12-22T09:14:32.757917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":694025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":106871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":106871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":103075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:14:57.892 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T09:14:57.893 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-22T09:14:57.893 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-22T09:14:57.893 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-22T09:14:57.893 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-22T09:14:58.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.146+0000 7f4de1aa1640 1 Processor -- start 2023-12-22T09:14:58.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.146+0000 7f4de1aa1640 1 -- start start 2023-12-22T09:14:58.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4de1aa1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ddc0aaca0 0x7f4ddc070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4de1aa1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ddc071e60 0x7f4ddc06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4de1aa1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0c1720 con 0x7f4ddc14d980 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4de1aa1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c1a00 con 0x7f4ddc0aaca0 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4de1aa1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc0706d0 con 0x7f4ddc071e60 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4dd2ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ddc0aaca0 0x7f4ddc070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4dd2ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ddc0aaca0 0x7f4ddc070bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40970/0 (socket says 172.21.15.106:40970) 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4dd2ffd640 1 -- 172.21.15.106:0/2537965793 learned_addr learned my addr 172.21.15.106:0/2537965793 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4dd2ffd640 1 -- 172.21.15.106:0/2537965793 >> v2:172.21.15.132:3300/0 conn(0x7f4ddc071e60 msgr2=0x7f4ddc06fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4dd2ffd640 1 --2- 172.21.15.106:0/2537965793 >> v2:172.21.15.132:3300/0 conn(0x7f4ddc071e60 0x7f4ddc06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4dd2ffd640 1 -- 172.21.15.106:0/2537965793 >> v1:172.21.15.132:6789/0 conn(0x7f4ddc14d980 legacy=0x7f4ddc1537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.147+0000 7f4dd2ffd640 1 -- 172.21.15.106:0/2537965793 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc06aac0 con 0x7f4ddc0aaca0 2023-12-22T09:14:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.148+0000 7f4dd2ffd640 1 --2- 172.21.15.106:0/2537965793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc0aaca0 0x7f4ddc070bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc06dca0 tx=0x7f4dc402dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547a86971e4b89e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:58.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4ddaffd640 1 -- 172.21.15.106:0/2537965793 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc402eb50 con 0x7f4ddc0aaca0 2023-12-22T09:14:58.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4ddaffd640 1 -- 172.21.15.106:0/2537965793 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4032070 con 0x7f4ddc0aaca0 2023-12-22T09:14:58.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4ddaffd640 1 -- 172.21.15.106:0/2537965793 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4038400 con 0x7f4ddc0aaca0 2023-12-22T09:14:58.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4de1aa1640 1 -- 172.21.15.106:0/2537965793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc0aaca0 msgr2=0x7f4ddc070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4de1aa1640 1 --2- 172.21.15.106:0/2537965793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc0aaca0 0x7f4ddc070bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc06dca0 tx=0x7f4dc402dda0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4de1aa1640 1 -- 172.21.15.106:0/2537965793 shutdown_connections 2023-12-22T09:14:58.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4de1aa1640 1 --2- 172.21.15.106:0/2537965793 >> v2:172.21.15.132:3300/0 conn(0x7f4ddc071e60 0x7f4ddc06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4de1aa1640 1 --2- 172.21.15.106:0/2537965793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc0aaca0 0x7f4ddc070bf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4de1aa1640 1 -- 172.21.15.106:0/2537965793 >> 172.21.15.106:0/2537965793 conn(0x7f4ddc0c5360 msgr2=0x7f4ddc0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:58.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4de1aa1640 1 -- 172.21.15.106:0/2537965793 shutdown_connections 2023-12-22T09:14:58.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.149+0000 7f4de1aa1640 1 -- 172.21.15.106:0/2537965793 wait complete. 2023-12-22T09:14:58.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.151+0000 7f4de1aa1640 1 Processor -- start 2023-12-22T09:14:58.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.151+0000 7f4de1aa1640 1 -- start start 2023-12-22T09:14:58.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4de1aa1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc071e60 0x7f4ddc146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4de1aa1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ddc0aaca0 0x7f4ddc1e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4de1aa1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ddc14d980 0x7f4ddc1ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4de1aa1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c3660 con 0x7f4ddc071e60 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4de1aa1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1e9700 con 0x7f4ddc14d980 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4de1aa1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1ecb40 con 0x7f4ddc0aaca0 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc071e60 0x7f4ddc146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc071e60 0x7f4ddc146eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40986/0 (socket says 172.21.15.106:40986) 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddb7fe640 1 -- 172.21.15.106:0/346310723 learned_addr learned my addr 172.21.15.106:0/346310723 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4dd2ffd640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ddc0aaca0 0x7f4ddc1e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddbfff640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ddc14d980 0x7f4ddc1ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddb7fe640 1 -- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ddc0aaca0 msgr2=0x7f4ddc1e91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddb7fe640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ddc0aaca0 0x7f4ddc1e91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddb7fe640 1 -- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ddc14d980 msgr2=0x7f4ddc1ecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddb7fe640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ddc14d980 0x7f4ddc1ecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddb7fe640 1 -- 172.21.15.106:0/346310723 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc400b760 con 0x7f4ddc071e60 2023-12-22T09:14:58.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddbfff640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ddc14d980 0x7f4ddc1ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:58.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4dd2ffd640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ddc0aaca0 0x7f4ddc1e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:58.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4ddb7fe640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc071e60 0x7f4ddc146eb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00ba50 tx=0x7f4dcc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:58.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4dd8ff9640 1 -- 172.21.15.106:0/346310723 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00cc10 con 0x7f4ddc071e60 2023-12-22T09:14:58.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4dd8ff9640 1 -- 172.21.15.106:0/346310723 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc00cd70 con 0x7f4ddc071e60 2023-12-22T09:14:58.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4dd8ff9640 1 -- 172.21.15.106:0/346310723 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc014680 con 0x7f4ddc071e60 2023-12-22T09:14:58.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc0c5140 con 0x7f4ddc071e60 2023-12-22T09:14:58.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.153+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc149470 con 0x7f4ddc071e60 2023-12-22T09:14:58.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.155+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc073f10 con 0x7f4ddc071e60 2023-12-22T09:14:58.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.155+0000 7f4dd8ff9640 1 -- 172.21.15.106:0/346310723 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4dcc007370 con 0x7f4ddc071e60 2023-12-22T09:14:58.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.156+0000 7f4dd8ff9640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4dbc06a430 0x7f4dbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.156+0000 7f4dd8ff9640 1 -- 172.21.15.106:0/346310723 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4dcc088a60 con 0x7f4ddc071e60 2023-12-22T09:14:58.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.157+0000 7f4dd2ffd640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4dbc06a430 0x7f4dbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.157+0000 7f4dd2ffd640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4dbc06a430 0x7f4dbc06c8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4039000 tx=0x7f4dc4034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:58.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.161+0000 7f4dd8ff9640 1 -- 172.21.15.106:0/346310723 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4dcc053df0 con 0x7f4ddc071e60 2023-12-22T09:14:58.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.399+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4ddc06dab0 con 0x7f4ddc071e60 2023-12-22T09:14:58.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.408+0000 7f4dd8ff9640 1 -- 172.21.15.106:0/346310723 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169969 (secure 0 0 0) 0x7f4dcc019070 con 0x7f4ddc071e60 2023-12-22T09:14:58.410 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:58.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.411+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4dbc06a430 msgr2=0x7f4dbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.411+0000 7f4de1aa1640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4dbc06a430 0x7f4dbc06c8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4039000 tx=0x7f4dc4034000 comp rx=0 tx=0).stop 2023-12-22T09:14:58.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.411+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc071e60 msgr2=0x7f4ddc146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.411+0000 7f4de1aa1640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc071e60 0x7f4ddc146eb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00ba50 tx=0x7f4dcc00bf10 comp rx=0 tx=0).stop 2023-12-22T09:14:58.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.412+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 shutdown_connections 2023-12-22T09:14:58.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.412+0000 7f4de1aa1640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4dbc06a430 0x7f4dbc06c8f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.412+0000 7f4de1aa1640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ddc14d980 0x7f4ddc1ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.412+0000 7f4de1aa1640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ddc0aaca0 0x7f4ddc1e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.412+0000 7f4de1aa1640 1 --2- 172.21.15.106:0/346310723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ddc071e60 0x7f4ddc146eb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.412+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 >> 172.21.15.106:0/346310723 conn(0x7f4ddc0c5360 msgr2=0x7f4ddc0bfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:58.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.412+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 shutdown_connections 2023-12-22T09:14:58.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.412+0000 7f4de1aa1640 1 -- 172.21.15.106:0/346310723 wait complete. 2023-12-22T09:14:58.431 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":88400},{"type":"v1","addr":"172.21.15.106:6833","nonce":88400}]},"active_addr":"172.21.15.106:6833/88400","active_change":"2023-12-22T09:14:08.678417+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":2236842461}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":590452370}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3082205841}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3505759257}]}]} 2023-12-22T09:14:58.434 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-22T09:14:58.434 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-22T09:14:58.434 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:58.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.642+0000 7efe95677640 1 Processor -- start 2023-12-22T09:14:58.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.642+0000 7efe95677640 1 -- start start 2023-12-22T09:14:58.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.644+0000 7efe95677640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe90069e60 0x7efe9014a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.644+0000 7efe95677640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900bfce0 con 0x7efe90150a80 2023-12-22T09:14:58.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.644+0000 7efe95677640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900bffc0 con 0x7efe90152680 2023-12-22T09:14:58.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.644+0000 7efe95677640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900c0960 con 0x7efe90069e60 2023-12-22T09:14:58.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.645+0000 7efe867fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efe90150a80 0x7efe90151f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51936/0 (socket says 172.21.15.106:51936) 2023-12-22T09:14:58.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.645+0000 7efe867fc640 1 -- 172.21.15.106:0/2280369412 learned_addr learned my addr 172.21.15.106:0/2280369412 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:58.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.645+0000 7efe8effd640 1 --2- 172.21.15.106:0/2280369412 >> v2:172.21.15.132:3300/0 conn(0x7efe90069e60 0x7efe9014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.645+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508321469 0 0) 0x7efe900bfce0 con 0x7efe90150a80 2023-12-22T09:14:58.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.645+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe7c005730 con 0x7efe90150a80 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2340938783 0 0) 0x7efe7c005730 con 0x7efe90150a80 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 >> v2:172.21.15.132:3300/0 conn(0x7efe90069e60 msgr2=0x7efe9014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 --2- 172.21.15.106:0/2280369412 >> v2:172.21.15.132:3300/0 conn(0x7efe90069e60 0x7efe9014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 >> v1:172.21.15.132:6789/0 conn(0x7efe90152680 legacy=0x7efe9015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900c02a0 con 0x7efe90150a80 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7efe78001670 con 0x7efe90150a80 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 >> v1:172.21.15.106:6789/0 conn(0x7efe90150a80 legacy=0x7efe90151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe7c005b80 0x7efe7c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0069d0 0x7efe7c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe7c0074b0 0x7efe7c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe900c0960 con 0x7efe7c0074b0 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c00e380 con 0x7efe7c0069d0 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c00e540 con 0x7efe7c005b80 2023-12-22T09:14:58.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8f7fe640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe7c0074b0 0x7efe7c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.646+0000 7efe8effd640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe7c005b80 0x7efe7c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.647+0000 7efe8f7fe640 1 -- 172.21.15.106:0/2280369412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe7c005b80 msgr2=0x7efe7c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:58.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.647+0000 7efe8f7fe640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe7c005b80 0x7efe7c005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.647+0000 7efe8f7fe640 1 -- 172.21.15.106:0/2280369412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0069d0 msgr2=0x7efe7c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:58.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.647+0000 7efe867fc640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0069d0 0x7efe7c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.647+0000 7efe8f7fe640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0069d0 0x7efe7c006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.647+0000 7efe8f7fe640 1 -- 172.21.15.106:0/2280369412 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c005730 con 0x7efe7c0074b0 2023-12-22T09:14:58.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.648+0000 7efe8f7fe640 1 -- 172.21.15.106:0/2280369412 reap_dead start 2023-12-22T09:14:58.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.648+0000 7efe8f7fe640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe7c0074b0 0x7efe7c00db90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe88001e20 tx=0x7efe7c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d126e4ba5c4cf470 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:58.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.648+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88003b70 con 0x7efe7c0074b0 2023-12-22T09:14:58.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.648+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe88003cd0 con 0x7efe7c0074b0 2023-12-22T09:14:58.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.648+0000 7efe8e7fc640 1 -- 172.21.15.106:0/2280369412 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe880052f0 con 0x7efe7c0074b0 2023-12-22T09:14:58.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.648+0000 7efe95677640 1 -- 172.21.15.106:0/2280369412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe7c0074b0 msgr2=0x7efe7c00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.649+0000 7efe95677640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe7c0074b0 0x7efe7c00db90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe88001e20 tx=0x7efe7c007a00 comp rx=0 tx=0).stop 2023-12-22T09:14:58.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.649+0000 7efe95677640 1 -- 172.21.15.106:0/2280369412 shutdown_connections 2023-12-22T09:14:58.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.649+0000 7efe95677640 1 --2- 172.21.15.106:0/2280369412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe7c0074b0 0x7efe7c00db90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.649+0000 7efe95677640 1 -- 172.21.15.106:0/2280369412 >> 172.21.15.106:0/2280369412 conn(0x7efe900c5360 msgr2=0x7efe900c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:58.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.649+0000 7efe95677640 1 -- 172.21.15.106:0/2280369412 shutdown_connections 2023-12-22T09:14:58.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.649+0000 7efe95677640 1 -- 172.21.15.106:0/2280369412 wait complete. 2023-12-22T09:14:58.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.650+0000 7efe95677640 1 Processor -- start 2023-12-22T09:14:58.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.651+0000 7efe95677640 1 -- start start 2023-12-22T09:14:58.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.651+0000 7efe95677640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0074b0 0x7efe90149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.651+0000 7efe95677640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe90152b10 0x7efe90142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.651+0000 7efe95677640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe901434d0 0x7efe901e8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.651+0000 7efe95677640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe90143950 con 0x7efe901434d0 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.651+0000 7efe95677640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe901ec2a0 con 0x7efe7c0074b0 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.651+0000 7efe95677640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe901ec560 con 0x7efe90152b10 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe901434d0 0x7efe901e8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe901434d0 0x7efe901e8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40998/0 (socket says 172.21.15.106:40998) 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8f7fe640 1 -- 172.21.15.106:0/3649614013 learned_addr learned my addr 172.21.15.106:0/3649614013 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8effd640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0074b0 0x7efe90149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe867fc640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe90152b10 0x7efe90142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8f7fe640 1 -- 172.21.15.106:0/3649614013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe90152b10 msgr2=0x7efe90142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8f7fe640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe90152b10 0x7efe90142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8f7fe640 1 -- 172.21.15.106:0/3649614013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0074b0 msgr2=0x7efe90149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8f7fe640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0074b0 0x7efe90149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8f7fe640 1 -- 172.21.15.106:0/3649614013 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe901ec840 con 0x7efe901434d0 2023-12-22T09:14:58.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8effd640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0074b0 0x7efe90149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:58.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.652+0000 7efe8f7fe640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe901434d0 0x7efe901e8dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efe88001f40 tx=0x7efe880014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:58.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.653+0000 7efe87fff640 1 -- 172.21.15.106:0/3649614013 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88039450 con 0x7efe901434d0 2023-12-22T09:14:58.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.653+0000 7efe87fff640 1 -- 172.21.15.106:0/3649614013 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8803d070 con 0x7efe901434d0 2023-12-22T09:14:58.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.653+0000 7efe87fff640 1 -- 172.21.15.106:0/3649614013 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88039810 con 0x7efe901434d0 2023-12-22T09:14:58.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.653+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe901ecb20 con 0x7efe901434d0 2023-12-22T09:14:58.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.653+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe90149fd0 con 0x7efe901434d0 2023-12-22T09:14:58.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.654+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe90073f10 con 0x7efe901434d0 2023-12-22T09:14:58.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.655+0000 7efe87fff640 1 -- 172.21.15.106:0/3649614013 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe8803f030 con 0x7efe901434d0 2023-12-22T09:14:58.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.656+0000 7efe87fff640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe7006a460 0x7efe7006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:58.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.656+0000 7efe87fff640 1 -- 172.21.15.106:0/3649614013 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe88003e40 con 0x7efe901434d0 2023-12-22T09:14:58.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.656+0000 7efe8effd640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe7006a460 0x7efe7006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:58.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.657+0000 7efe8effd640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe7006a460 0x7efe7006c920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe80009970 tx=0x7efe80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:58.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.661+0000 7efe87fff640 1 -- 172.21.15.106:0/3649614013 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe88075720 con 0x7efe901434d0 2023-12-22T09:14:58.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.852+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe901e8bb0 con 0x7efe901434d0 2023-12-22T09:14:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.854+0000 7efe87fff640 1 -- 172.21.15.106:0/3649614013 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7efe88078d40 con 0x7efe901434d0 2023-12-22T09:14:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:58.854 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe7006a460 msgr2=0x7efe7006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe7006a460 0x7efe7006c920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe80009970 tx=0x7efe80008040 comp rx=0 tx=0).stop 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe901434d0 msgr2=0x7efe901e8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe901434d0 0x7efe901e8dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efe88001f40 tx=0x7efe880014a0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 shutdown_connections 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe7006a460 0x7efe7006c920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe901434d0 0x7efe901e8dd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe90152b10 0x7efe90142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 --2- 172.21.15.106:0/3649614013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe7c0074b0 0x7efe90149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 >> 172.21.15.106:0/3649614013 conn(0x7efe900c5360 msgr2=0x7efe900aa400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 shutdown_connections 2023-12-22T09:14:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:58.857+0000 7efe95677640 1 -- 172.21.15.106:0/3649614013 wait complete. 2023-12-22T09:14:58.876 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-22T09:14:58.877 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:14:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.095+0000 7ff28d451640 1 Processor -- start 2023-12-22T09:14:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.095+0000 7ff28d451640 1 -- start start 2023-12-22T09:14:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.096+0000 7ff28d451640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 0x7ff2880c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.096+0000 7ff28d451640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff2880c4130 0x7ff288154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.096+0000 7ff28d451640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2880c4660 con 0x7ff288154a80 2023-12-22T09:14:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.096+0000 7ff28d451640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff288153d60 con 0x7ff2880c4130 2023-12-22T09:14:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.096+0000 7ff28d451640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28806b250 con 0x7ff2881514b0 2023-12-22T09:14:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.097+0000 7ff27ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff2880c4130 0x7ff288154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.097+0000 7ff27ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff2880c4130 0x7ff288154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41010/0 (socket says 172.21.15.106:41010) 2023-12-22T09:14:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.097+0000 7ff27ffff640 1 -- 172.21.15.106:0/2384446279 learned_addr learned my addr 172.21.15.106:0/2384446279 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.097+0000 7ff286ffd640 1 --2- 172.21.15.106:0/2384446279 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 0x7ff2880c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.097+0000 7ff27ffff640 1 -- 172.21.15.106:0/2384446279 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 msgr2=0x7ff2880c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.097+0000 7ff27ffff640 1 --2- 172.21.15.106:0/2384446279 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 0x7ff2880c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.097+0000 7ff27ffff640 1 -- 172.21.15.106:0/2384446279 >> v1:172.21.15.132:6789/0 conn(0x7ff288154a80 legacy=0x7ff2880c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.097+0000 7ff27ffff640 1 -- 172.21.15.106:0/2384446279 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28806b530 con 0x7ff2880c4130 2023-12-22T09:14:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.097+0000 7ff286ffd640 1 --2- 172.21.15.106:0/2384446279 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 0x7ff2880c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.099+0000 7ff27ffff640 1 --2- 172.21.15.106:0/2384446279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 0x7ff288154540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff270009870 tx=0x7ff27002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c0479f223c6128 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.099+0000 7ff2867fc640 1 -- 172.21.15.106:0/2384446279 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700317c0 con 0x7ff2880c4130 2023-12-22T09:14:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.099+0000 7ff2867fc640 1 -- 172.21.15.106:0/2384446279 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff270031920 con 0x7ff2880c4130 2023-12-22T09:14:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.099+0000 7ff2867fc640 1 -- 172.21.15.106:0/2384446279 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270031cb0 con 0x7ff2880c4130 2023-12-22T09:14:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.100+0000 7ff28d451640 1 -- 172.21.15.106:0/2384446279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 msgr2=0x7ff288154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.100+0000 7ff28d451640 1 --2- 172.21.15.106:0/2384446279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 0x7ff288154540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff270009870 tx=0x7ff27002b860 comp rx=0 tx=0).stop 2023-12-22T09:14:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.100+0000 7ff28d451640 1 -- 172.21.15.106:0/2384446279 shutdown_connections 2023-12-22T09:14:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.100+0000 7ff28d451640 1 --2- 172.21.15.106:0/2384446279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 0x7ff288154540 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.100+0000 7ff28d451640 1 --2- 172.21.15.106:0/2384446279 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 0x7ff2880c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.100+0000 7ff28d451640 1 -- 172.21.15.106:0/2384446279 >> 172.21.15.106:0/2384446279 conn(0x7ff2880ab1a0 msgr2=0x7ff2880ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.100+0000 7ff28d451640 1 -- 172.21.15.106:0/2384446279 shutdown_connections 2023-12-22T09:14:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.100+0000 7ff28d451640 1 -- 172.21.15.106:0/2384446279 wait complete. 2023-12-22T09:14:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.102+0000 7ff28d451640 1 Processor -- start 2023-12-22T09:14:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.102+0000 7ff28d451640 1 -- start start 2023-12-22T09:14:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff28d451640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 0x7ff2880c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff28d451640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 0x7ff288148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff28d451640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288149320 0x7ff288148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff28d451640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880c1c60 con 0x7ff2880c4130 2023-12-22T09:14:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff28d451640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880c38c0 con 0x7ff288149320 2023-12-22T09:14:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff28d451640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff288149110 con 0x7ff2881514b0 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff286ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 0x7ff2880c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff286ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 0x7ff2880c0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41016/0 (socket says 172.21.15.106:41016) 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff286ffd640 1 -- 172.21.15.106:0/1308179077 learned_addr learned my addr 172.21.15.106:0/1308179077 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff27ffff640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 0x7ff288148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.103+0000 7ff2877fe640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288149320 0x7ff288148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff286ffd640 1 -- 172.21.15.106:0/1308179077 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 msgr2=0x7ff288148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff286ffd640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 0x7ff288148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff286ffd640 1 -- 172.21.15.106:0/1308179077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288149320 msgr2=0x7ff288148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff286ffd640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288149320 0x7ff288148bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff286ffd640 1 -- 172.21.15.106:0/1308179077 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700094d0 con 0x7ff2880c4130 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff2877fe640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288149320 0x7ff288148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff286ffd640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 0x7ff2880c0d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c7f0 tx=0x7ff27800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff27f7fe640 1 -- 172.21.15.106:0/1308179077 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780079d0 con 0x7ff2880c4130 2023-12-22T09:14:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff27f7fe640 1 -- 172.21.15.106:0/1308179077 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff278007b30 con 0x7ff2880c4130 2023-12-22T09:14:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff27f7fe640 1 -- 172.21.15.106:0/1308179077 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800ce40 con 0x7ff2880c4130 2023-12-22T09:14:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2881e9130 con 0x7ff2880c4130 2023-12-22T09:14:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.104+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2881e96f0 con 0x7ff2880c4130 2023-12-22T09:14:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.106+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff288073f10 con 0x7ff2880c4130 2023-12-22T09:14:59.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.106+0000 7ff27f7fe640 1 -- 172.21.15.106:0/1308179077 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff2780113f0 con 0x7ff2880c4130 2023-12-22T09:14:59.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.107+0000 7ff27f7fe640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.107+0000 7ff27f7fe640 1 -- 172.21.15.106:0/1308179077 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff278088d80 con 0x7ff2880c4130 2023-12-22T09:14:59.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.108+0000 7ff27ffff640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.108+0000 7ff27ffff640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff270036000 tx=0x7ff27003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.112+0000 7ff27f7fe640 1 -- 172.21.15.106:0/1308179077 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff278054080 con 0x7ff2880c4130 2023-12-22T09:14:59.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.304+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2881ec250 con 0x7ff2880c4130 2023-12-22T09:14:59.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.307+0000 7ff27f7fe640 1 -- 172.21.15.106:0/1308179077 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7ff27801f090 con 0x7ff2880c4130 2023-12-22T09:14:59.307 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:14:59.307 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:14:59.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.309+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 msgr2=0x7ff26806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff270036000 tx=0x7ff27003d040 comp rx=0 tx=0).stop 2023-12-22T09:14:59.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 msgr2=0x7ff2880c0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 0x7ff2880c0d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c7f0 tx=0x7ff27800cbf0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 shutdown_connections 2023-12-22T09:14:59.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff288149320 0x7ff288148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2881514b0 0x7ff288148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 --2- 172.21.15.106:0/1308179077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2880c4130 0x7ff2880c0d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 >> 172.21.15.106:0/1308179077 conn(0x7ff2880ab1a0 msgr2=0x7ff288152350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 shutdown_connections 2023-12-22T09:14:59.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.310+0000 7ff28d451640 1 -- 172.21.15.106:0/1308179077 wait complete. 2023-12-22T09:14:59.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-22T09:14:59.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-22T09:14:59.330 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-22T09:14:59.330 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-22T09:14:59.330 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-22T09:14:59.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-22T09:14:59.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-22T09:14:59.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-22T09:14:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.629+0000 7fe72c410640 1 Processor -- start 2023-12-22T09:14:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.629+0000 7fe72c410640 1 -- start start 2023-12-22T09:14:59.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.631+0000 7fe72c410640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7240bfd70 0x7fe724071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.631+0000 7fe72c410640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe724155990 0x7fe72406caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.631+0000 7fe72c410640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72415c300 con 0x7fe7240c05c0 2023-12-22T09:14:59.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.631+0000 7fe72c410640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72415b6f0 con 0x7fe724155990 2023-12-22T09:14:59.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.631+0000 7fe72c410640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72415b9d0 con 0x7fe7240bfd70 2023-12-22T09:14:59.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.632+0000 7fe72a1ac640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7240bfd70 0x7fe724071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.632+0000 7fe72a9ad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe724155990 0x7fe72406caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.632+0000 7fe7299ab640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe7240c05c0 0x7fe724155280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51942/0 (socket says 172.21.15.106:51942) 2023-12-22T09:14:59.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.632+0000 7fe7299ab640 1 -- 172.21.15.106:0/3263345322 learned_addr learned my addr 172.21.15.106:0/3263345322 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:59.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.634+0000 7fe7291aa640 1 -- 172.21.15.106:0/3263345322 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552762232 0 0) 0x7fe72415c300 con 0x7fe7240c05c0 2023-12-22T09:14:59.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.634+0000 7fe7291aa640 1 -- 172.21.15.106:0/3263345322 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe714003520 con 0x7fe7240c05c0 2023-12-22T09:14:59.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.634+0000 7fe72a1ac640 1 -- 172.21.15.106:0/3263345322 >> v2:172.21.15.132:3300/0 conn(0x7fe724155990 msgr2=0x7fe72406caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.634+0000 7fe72a1ac640 1 --2- 172.21.15.106:0/3263345322 >> v2:172.21.15.132:3300/0 conn(0x7fe724155990 0x7fe72406caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.634+0000 7fe72a1ac640 1 -- 172.21.15.106:0/3263345322 >> v1:172.21.15.106:6789/0 conn(0x7fe7240c05c0 legacy=0x7fe724155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.634+0000 7fe72a1ac640 1 -- 172.21.15.106:0/3263345322 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72415bcb0 con 0x7fe7240bfd70 2023-12-22T09:14:59.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.636+0000 7fe72a1ac640 1 --2- 172.21.15.106:0/3263345322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7240bfd70 0x7fe724071c50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe718009d90 tx=0x7fe71802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f192cadcf24184d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.637+0000 7fe7291aa640 1 -- 172.21.15.106:0/3263345322 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71802cc60 con 0x7fe7240bfd70 2023-12-22T09:14:59.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.637+0000 7fe7291aa640 1 -- 172.21.15.106:0/3263345322 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71802cdc0 con 0x7fe7240bfd70 2023-12-22T09:14:59.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.637+0000 7fe7291aa640 1 -- 172.21.15.106:0/3263345322 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718034660 con 0x7fe7240bfd70 2023-12-22T09:14:59.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.641+0000 7fe72c410640 1 -- 172.21.15.106:0/3263345322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7240bfd70 msgr2=0x7fe724071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.641+0000 7fe72c410640 1 --2- 172.21.15.106:0/3263345322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7240bfd70 0x7fe724071c50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe718009d90 tx=0x7fe71802beb0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.641+0000 7fe72c410640 1 -- 172.21.15.106:0/3263345322 shutdown_connections 2023-12-22T09:14:59.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.642+0000 7fe72c410640 1 --2- 172.21.15.106:0/3263345322 >> v2:172.21.15.132:3300/0 conn(0x7fe724155990 0x7fe72406caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.642+0000 7fe72c410640 1 --2- 172.21.15.106:0/3263345322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7240bfd70 0x7fe724071c50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.642+0000 7fe72c410640 1 -- 172.21.15.106:0/3263345322 >> 172.21.15.106:0/3263345322 conn(0x7fe724069bf0 msgr2=0x7fe724069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.642+0000 7fe72c410640 1 -- 172.21.15.106:0/3263345322 shutdown_connections 2023-12-22T09:14:59.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.642+0000 7fe72c410640 1 -- 172.21.15.106:0/3263345322 wait complete. 2023-12-22T09:14:59.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.643+0000 7f1c9eb30640 1 Processor -- start 2023-12-22T09:14:59.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.643+0000 7f1c9eb30640 1 -- start start 2023-12-22T09:14:59.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.644+0000 7f1c9eb30640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c980ab3f0 0x7f1c980ae840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.644+0000 7f1c9eb30640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c98155830 0x7f1c9815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.644+0000 7f1c9eb30640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c98157c30 con 0x7f1c980bcd10 2023-12-22T09:14:59.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.644+0000 7f1c9eb30640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c98158160 con 0x7f1c980ab3f0 2023-12-22T09:14:59.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.644+0000 7f1c9eb30640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980c7720 con 0x7f1c98155830 2023-12-22T09:14:59.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.645+0000 7fbe1a7c4640 1 Processor -- start 2023-12-22T09:14:59.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.645+0000 7fe72c410640 1 Processor -- start 2023-12-22T09:14:59.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.645+0000 7fe72c410640 1 -- start start 2023-12-22T09:14:59.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.645+0000 7f1c9db2e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c980ab3f0 0x7f1c980ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.645+0000 7f1c9d32d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1c980bcd10 0x7f1c98155120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33246/0 (socket says 172.21.15.106:33246) 2023-12-22T09:14:59.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.645+0000 7f1c9d32d640 1 -- 172.21.15.106:0/274381420 learned_addr learned my addr 172.21.15.106:0/274381420 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:59.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.645+0000 7f1c9e32f640 1 --2- 172.21.15.106:0/274381420 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c98155830 0x7f1c9815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.646+0000 7f1db759e640 1 Processor -- start 2023-12-22T09:14:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.645+0000 7fbe1a7c4640 1 -- start start 2023-12-22T09:14:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.647+0000 7fe72c410640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7240bfd70 0x7fe7240c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.647+0000 7fe72c410640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7240c05c0 0x7fe7240a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.647+0000 7fe72c410640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe724155990 0x7fe7240a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.647+0000 7fe72c410640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240aa6c0 con 0x7fe7240bfd70 2023-12-22T09:14:59.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.647+0000 7fe72c410640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72415af40 con 0x7fe7240c05c0 2023-12-22T09:14:59.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.647+0000 7fe72c410640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe724152880 con 0x7fe724155990 2023-12-22T09:14:59.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.647+0000 7fbe1a7c4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbe0c04dbb0 0x7fbe0c04ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fbe1a7c4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbe0c04e0c0 0x7fbe0c04ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fe72a1ac640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7240bfd70 0x7fe7240c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fbe1a7c4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c010060 con 0x7fbe0c0d4750 2023-12-22T09:14:59.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fe7299ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7240c05c0 0x7fe7240a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fe72a9ad640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe724155990 0x7fe7240a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fbe1a7c4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0db470 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fe72a9ad640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe724155990 0x7fe7240a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:57022/0 (socket says 172.21.15.106:57022) 2023-12-22T09:14:59.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fe72a9ad640 1 -- 172.21.15.106:0/374150072 learned_addr learned my addr 172.21.15.106:0/374150072 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fe72a1ac640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7240bfd70 0x7fe7240c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41036/0 (socket says 172.21.15.106:41036) 2023-12-22T09:14:59.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fbe1a7c4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0da530 con 0x7fbe0c04e0c0 2023-12-22T09:14:59.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.646+0000 7f1c9db2e640 1 -- 172.21.15.106:0/274381420 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c98155830 msgr2=0x7f1c9815e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.646+0000 7f1c9db2e640 1 --2- 172.21.15.106:0/274381420 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c98155830 0x7f1c9815e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.646+0000 7f1c9db2e640 1 -- 172.21.15.106:0/274381420 >> v1:172.21.15.132:6789/0 conn(0x7f1c980bcd10 legacy=0x7f1c98155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.646+0000 7f1c9db2e640 1 -- 172.21.15.106:0/274381420 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98157e80 con 0x7f1c980ab3f0 2023-12-22T09:14:59.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7fbe197c2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbe0c0d4750 0x7fbe0c0072c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33250/0 (socket says 172.21.15.106:33250) 2023-12-22T09:14:59.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7fbe197c2640 1 -- 172.21.15.106:0/3648264572 learned_addr learned my addr 172.21.15.106:0/3648264572 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:59.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7fe72a1ac640 1 -- 172.21.15.106:0/374150072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe724155990 msgr2=0x7fe7240a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.646+0000 7f1db759e640 1 -- start start 2023-12-22T09:14:59.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7fe72a1ac640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe724155990 0x7fe7240a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7f1db759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1db80ab3f0 0x7f1db80ae840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7f1db759e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1db8155830 0x7f1db815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7f1db759e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db8157c30 con 0x7f1db80bcd10 2023-12-22T09:14:59.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7fe72a1ac640 1 -- 172.21.15.106:0/374150072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7240c05c0 msgr2=0x7fe7240a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7f1db759e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db8158160 con 0x7f1db8155830 2023-12-22T09:14:59.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7f1db759e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db80c7720 con 0x7f1db80ab3f0 2023-12-22T09:14:59.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7f1db659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1db80ab3f0 0x7f1db80ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.648+0000 7fe7299ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7240c05c0 0x7fe7240a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:39974/0 (socket says 172.21.15.106:39974) 2023-12-22T09:14:59.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7f1db659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1db80ab3f0 0x7f1db80ae840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:39992/0 (socket says 172.21.15.106:39992) 2023-12-22T09:14:59.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7f1db659c640 1 -- 172.21.15.106:0/3382436316 learned_addr learned my addr 172.21.15.106:0/3382436316 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7fbe19fc3640 1 --2- 172.21.15.106:0/3648264572 >> v2:172.21.15.132:3300/0 conn(0x7fbe0c04e0c0 0x7fbe0c04ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.649+0000 7fbe18fc1640 1 --2- 172.21.15.106:0/3648264572 >> v2:172.21.15.106:3300/0 conn(0x7fbe0c04dbb0 0x7fbe0c04ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7fe72a1ac640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7240c05c0 0x7fe7240a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7fe72a1ac640 1 -- 172.21.15.106:0/374150072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718009a70 con 0x7fe7240bfd70 2023-12-22T09:14:59.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7fe72a9ad640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe724155990 0x7fe7240a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:59.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7f1db6d9d640 1 --2- 172.21.15.106:0/3382436316 >> v2:172.21.15.106:3300/0 conn(0x7f1db8155830 0x7f1db815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7f1c9db2e640 1 --2- 172.21.15.106:0/274381420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c980ab3f0 0x7f1c980ae840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c900097a0 tx=0x7f1c9002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358750e03780fc9a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7fe7299ab640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7240c05c0 0x7fe7240a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:59.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7f1db659c640 1 -- 172.21.15.106:0/3382436316 >> v2:172.21.15.106:3300/0 conn(0x7f1db8155830 msgr2=0x7f1db815e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.651+0000 7f1db5d9b640 1 -- 172.21.15.106:0/3382436316 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778338539 0 0) 0x7f1db8157c30 con 0x7f1db80bcd10 2023-12-22T09:14:59.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.651+0000 7f1db659c640 1 --2- 172.21.15.106:0/3382436316 >> v2:172.21.15.106:3300/0 conn(0x7f1db8155830 0x7f1db815e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.651+0000 7f1db659c640 1 -- 172.21.15.106:0/3382436316 >> v1:172.21.15.106:6789/0 conn(0x7f1db80bcd10 legacy=0x7f1db8155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.651+0000 7f1db659c640 1 -- 172.21.15.106:0/3382436316 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db8157e80 con 0x7f1db80ab3f0 2023-12-22T09:14:59.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.651+0000 7f1db6d9d640 1 --2- 172.21.15.106:0/3382436316 >> v2:172.21.15.106:3300/0 conn(0x7f1db8155830 0x7f1db815e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:59.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.652+0000 7f1c9cb2c640 1 -- 172.21.15.106:0/274381420 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90031710 con 0x7f1c980ab3f0 2023-12-22T09:14:59.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.652+0000 7f1c9cb2c640 1 -- 172.21.15.106:0/274381420 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9002f050 con 0x7f1c980ab3f0 2023-12-22T09:14:59.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.652+0000 7f1c9cb2c640 1 -- 172.21.15.106:0/274381420 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90031ad0 con 0x7f1c980ab3f0 2023-12-22T09:14:59.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7fbe18fc1640 1 -- 172.21.15.106:0/3648264572 >> v2:172.21.15.132:3300/0 conn(0x7fbe0c04e0c0 msgr2=0x7fbe0c04ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7fbe18fc1640 1 --2- 172.21.15.106:0/3648264572 >> v2:172.21.15.132:3300/0 conn(0x7fbe0c04e0c0 0x7fbe0c04ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7fbe18fc1640 1 -- 172.21.15.106:0/3648264572 >> v1:172.21.15.132:6789/0 conn(0x7fbe0c0d4750 legacy=0x7fbe0c0072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.650+0000 7fbe18fc1640 1 -- 172.21.15.106:0/3648264572 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0da7f0 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.652+0000 7fbe18fc1640 1 --2- 172.21.15.106:0/3648264572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 0x7fbe0c04ea50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00f8b0 tx=0x7fbe1002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36843dfd6df4240 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.652+0000 7fe72a1ac640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7240bfd70 0x7fe7240c4220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe72415bb10 tx=0x7fe718004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.652+0000 7f1db659c640 1 --2- 172.21.15.106:0/3382436316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db80ab3f0 0x7f1db80ae840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1db80a8fc0 tx=0x7f1da802b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cd3e4b9a34c5f86 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.652+0000 7fbe0bfff640 1 -- 172.21.15.106:0/3648264572 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1002e070 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7fbe0bfff640 1 -- 172.21.15.106:0/3648264572 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe100315a0 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7fbe0bfff640 1 -- 172.21.15.106:0/3648264572 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10031930 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7fe722ffd640 1 -- 172.21.15.106:0/374150072 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71803e610 con 0x7fe7240bfd70 2023-12-22T09:14:59.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7fe722ffd640 1 -- 172.21.15.106:0/374150072 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71803e7b0 con 0x7fe7240bfd70 2023-12-22T09:14:59.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7fe722ffd640 1 -- 172.21.15.106:0/374150072 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71803eb60 con 0x7fe7240bfd70 2023-12-22T09:14:59.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7fe72c410640 1 -- 172.21.15.106:0/374150072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72415a610 con 0x7fe7240bfd70 2023-12-22T09:14:59.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1c9eb30640 1 -- 172.21.15.106:0/274381420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c980ab3f0 msgr2=0x7f1c980ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1c9eb30640 1 --2- 172.21.15.106:0/274381420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c980ab3f0 0x7f1c980ae840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c900097a0 tx=0x7f1c9002b7b0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7fe72c410640 1 -- 172.21.15.106:0/374150072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72415abd0 con 0x7fe7240bfd70 2023-12-22T09:14:59.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1db5d9b640 1 -- 172.21.15.106:0/3382436316 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80317f0 con 0x7f1db80ab3f0 2023-12-22T09:14:59.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1db5d9b640 1 -- 172.21.15.106:0/3382436316 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da8031950 con 0x7f1db80ab3f0 2023-12-22T09:14:59.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1db5d9b640 1 -- 172.21.15.106:0/3382436316 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8031ce0 con 0x7f1db80ab3f0 2023-12-22T09:14:59.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1c9eb30640 1 -- 172.21.15.106:0/274381420 shutdown_connections 2023-12-22T09:14:59.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1c9eb30640 1 --2- 172.21.15.106:0/274381420 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c98155830 0x7f1c9815e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1c9eb30640 1 --2- 172.21.15.106:0/274381420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c980ab3f0 0x7f1c980ae840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1c9eb30640 1 -- 172.21.15.106:0/274381420 >> 172.21.15.106:0/274381420 conn(0x7f1c98071320 msgr2=0x7f1c98071700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.653+0000 7f1c9eb30640 1 -- 172.21.15.106:0/274381420 shutdown_connections 2023-12-22T09:14:59.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.654+0000 7f1c9eb30640 1 -- 172.21.15.106:0/274381420 wait complete. 2023-12-22T09:14:59.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.654+0000 7f1db759e640 1 -- 172.21.15.106:0/3382436316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db80ab3f0 msgr2=0x7f1db80ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.654+0000 7f1db759e640 1 --2- 172.21.15.106:0/3382436316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db80ab3f0 0x7f1db80ae840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1db80a8fc0 tx=0x7f1da802b890 comp rx=0 tx=0).stop 2023-12-22T09:14:59.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.654+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/3648264572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 msgr2=0x7fbe0c04ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.654+0000 7fbe1a7c4640 1 --2- 172.21.15.106:0/3648264572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 0x7fbe0c04ea50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00f8b0 tx=0x7fbe1002b840 comp rx=0 tx=0).stop 2023-12-22T09:14:59.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.655+0000 7fe720ff9640 1 -- 172.21.15.106:0/374150072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe700000fc0 con 0x7fe7240bfd70 2023-12-22T09:14:59.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.655+0000 7f1db759e640 1 -- 172.21.15.106:0/3382436316 shutdown_connections 2023-12-22T09:14:59.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.655+0000 7f1db759e640 1 --2- 172.21.15.106:0/3382436316 >> v2:172.21.15.106:3300/0 conn(0x7f1db8155830 0x7f1db815e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.655+0000 7f1db759e640 1 --2- 172.21.15.106:0/3382436316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db80ab3f0 0x7f1db80ae840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.655+0000 7f1db759e640 1 -- 172.21.15.106:0/3382436316 >> 172.21.15.106:0/3382436316 conn(0x7f1db8071320 msgr2=0x7f1db8071700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.656+0000 7facac1b9640 1 Processor -- start 2023-12-22T09:14:59.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.656+0000 7facac1b9640 1 -- start start 2023-12-22T09:14:59.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.656+0000 7f1db759e640 1 -- 172.21.15.106:0/3382436316 shutdown_connections 2023-12-22T09:14:59.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.656+0000 7f1db759e640 1 -- 172.21.15.106:0/3382436316 wait complete. 2023-12-22T09:14:59.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.656+0000 7f1c9eb30640 1 Processor -- start 2023-12-22T09:14:59.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.656+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/3648264572 shutdown_connections 2023-12-22T09:14:59.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.656+0000 7fbe1a7c4640 1 --2- 172.21.15.106:0/3648264572 >> v2:172.21.15.132:3300/0 conn(0x7fbe0c04e0c0 0x7fbe0c04ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.656+0000 7fbe1a7c4640 1 --2- 172.21.15.106:0/3648264572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 0x7fbe0c04ea50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.656+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/3648264572 >> 172.21.15.106:0/3648264572 conn(0x7fbe0c04c730 msgr2=0x7fbe0c04cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.657+0000 7f1c9eb30640 1 -- start start 2023-12-22T09:14:59.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.657+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/3648264572 shutdown_connections 2023-12-22T09:14:59.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.657+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/3648264572 wait complete. 2023-12-22T09:14:59.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.658+0000 7facac1b9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faca41547c0 0x7faca4157310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.658+0000 7facac1b9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca40c7870 con 0x7faca406c9f0 2023-12-22T09:14:59.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.658+0000 7facac1b9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca40c4260 con 0x7faca40aed10 2023-12-22T09:14:59.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.658+0000 7facac1b9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca40c47e0 con 0x7faca41547c0 2023-12-22T09:14:59.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.658+0000 7faca9754640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faca41547c0 0x7faca4157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.658+0000 7faca9754640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faca41547c0 0x7faca4157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41050/0 (socket says 172.21.15.106:41050) 2023-12-22T09:14:59.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.658+0000 7facaa756640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faca406c9f0 0x7faca4157850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51962/0 (socket says 172.21.15.106:51962) 2023-12-22T09:14:59.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.658+0000 7faca9754640 1 -- 172.21.15.106:0/719269428 learned_addr learned my addr 172.21.15.106:0/719269428 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7f1db759e640 1 Processor -- start 2023-12-22T09:14:59.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7f1db759e640 1 -- start start 2023-12-22T09:14:59.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169772 0 0) 0x7faca40c7870 con 0x7faca406c9f0 2023-12-22T09:14:59.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac90003520 con 0x7faca406c9f0 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2587701297 0 0) 0x7fac90003520 con 0x7faca406c9f0 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 >> v2:172.21.15.106:3300/0 conn(0x7faca41547c0 msgr2=0x7faca4157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7faca8f53640 1 --2- 172.21.15.106:0/719269428 >> v2:172.21.15.106:3300/0 conn(0x7faca41547c0 0x7faca4157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 >> v1:172.21.15.132:6789/0 conn(0x7faca40aed10 legacy=0x7faca40c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40c7d00 con 0x7faca406c9f0 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fac94001670 con 0x7faca406c9f0 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 >> v1:172.21.15.106:6789/0 conn(0x7faca406c9f0 legacy=0x7faca4157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7faca8f53640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac900039c0 0x7fac90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7faca8f53640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac900047c0 0x7fac90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7faca8f53640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac900051d0 0x7fac9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca40c47e0 con 0x7fac900051d0 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9000c120 con 0x7fac900039c0 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9000c2e0 con 0x7fac900047c0 2023-12-22T09:14:59.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7faca9f55640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac900039c0 0x7fac90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7fbe1a7c4640 1 Processor -- start 2023-12-22T09:14:59.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7facaa756640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac900051d0 0x7fac9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7faca9754640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac900047c0 0x7fac90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7f1db759e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1db80ab3f0 0x7f1db80c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7f1db759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db80bcd10 0x7f1db814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7f1db759e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1db8155830 0x7f1db814d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7f1db759e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db8154920 con 0x7f1db8155830 2023-12-22T09:14:59.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7f1db759e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db8154640 con 0x7f1db80bcd10 2023-12-22T09:14:59.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7f1db759e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80c0f00 con 0x7f1db80ab3f0 2023-12-22T09:14:59.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7f1c9eb30640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c980ab3f0 0x7f1c980acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7f1c9eb30640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c980bcd10 0x7f1c981ede20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7fbe1a7c4640 1 -- start start 2023-12-22T09:14:59.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7faca9f55640 1 -- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac900047c0 msgr2=0x7fac90004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7faca9f55640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac900047c0 0x7fac90004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7faca9f55640 1 -- 172.21.15.106:0/719269428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac900051d0 msgr2=0x7fac9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7faca9f55640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac900051d0 0x7fac9000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7faca9f55640 1 -- 172.21.15.106:0/719269428 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40c7d00 con 0x7fac900039c0 2023-12-22T09:14:59.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7f1c9eb30640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c98155830 0x7f1c981ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7f1c9eb30640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c981ee8a0 con 0x7f1c980ab3f0 2023-12-22T09:14:59.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7f1c9eb30640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c981ed920 con 0x7f1c980bcd10 2023-12-22T09:14:59.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7f1c9eb30640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c981f1320 con 0x7f1c98155830 2023-12-22T09:14:59.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7facaa756640 1 -- 172.21.15.106:0/719269428 reap_dead start 2023-12-22T09:14:59.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.662+0000 7f1db659c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1db80ab3f0 0x7f1db80c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.662+0000 7f1db659c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1db80ab3f0 0x7f1db80c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:57036/0 (socket says 172.21.15.106:57036) 2023-12-22T09:14:59.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.662+0000 7f1db659c640 1 -- 172.21.15.106:0/2294681571 learned_addr learned my addr 172.21.15.106:0/2294681571 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.662+0000 7f1db6d9d640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1db8155830 0x7f1db814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.659+0000 7fe722ffd640 1 -- 172.21.15.106:0/374150072 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe71803b050 con 0x7fe7240bfd70 2023-12-22T09:14:59.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7fe722ffd640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe70806a500 0x7fe70806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7fe722ffd640 1 -- 172.21.15.106:0/374150072 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7180aaec0 con 0x7fe7240bfd70 2023-12-22T09:14:59.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7fe722ffd640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6800/88650,v1:172.21.15.106:6801/88650] conn(0x7fe708073b40 0x7fe708075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7fe722ffd640 1 -- 172.21.15.106:0/374150072 --> [v2:172.21.15.106:6800/88650,v1:172.21.15.106:6801/88650] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe708076650 con 0x7fe708073b40 2023-12-22T09:14:59.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.660+0000 7fe722ffd640 1 -- 172.21.15.106:0/374150072 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7180ad4e0 con 0x7fe7240bfd70 2023-12-22T09:14:59.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.661+0000 7fe7299ab640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe70806a500 0x7fe70806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1db6d9d640 1 -- 172.21.15.106:0/2294681571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1db80ab3f0 msgr2=0x7f1db80c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1db6d9d640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1db80ab3f0 0x7f1db80c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1db6d9d640 1 -- 172.21.15.106:0/2294681571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db80bcd10 msgr2=0x7f1db814cbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-22T09:14:59.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1db6d9d640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db80bcd10 0x7f1db814cbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.662+0000 7f1c9d32d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c980bcd10 0x7f1c981ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.662+0000 7f1c9d32d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c980bcd10 0x7f1c981ede20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40010/0 (socket says 172.21.15.106:40010) 2023-12-22T09:14:59.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.662+0000 7f1c9d32d640 1 -- 172.21.15.106:0/946098729 learned_addr learned my addr 172.21.15.106:0/946098729 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1db6d9d640 1 -- 172.21.15.106:0/2294681571 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80094d0 con 0x7f1db8155830 2023-12-22T09:14:59.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.662+0000 7f1c9e32f640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c98155830 0x7f1c981ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1c9d32d640 1 -- 172.21.15.106:0/946098729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c98155830 msgr2=0x7f1c981ee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1c9d32d640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c98155830 0x7f1c981ee360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1c9d32d640 1 -- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c980ab3f0 msgr2=0x7f1c980acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1c9d32d640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c980ab3f0 0x7f1c980acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1c9d32d640 1 -- 172.21.15.106:0/946098729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90009400 con 0x7f1c980bcd10 2023-12-22T09:14:59.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7fe72a9ad640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6800/88650,v1:172.21.15.106:6801/88650] conn(0x7fe708073b40 0x7fe708075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1c9d32d640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c980bcd10 0x7f1c981ede20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00cbc0 tx=0x7f1c8c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7f1db6d9d640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1db8155830 0x7f1db814d130 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1db000cdf0 tx=0x7f1db000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.663+0000 7faca9f55640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac900039c0 0x7fac90003de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac9c001d80 tx=0x7fac900057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=959a62193ed756d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7f1c8a7fc640 1 -- 172.21.15.106:0/946098729 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00ad40 con 0x7f1c980bcd10 2023-12-22T09:14:59.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7f1c8a7fc640 1 -- 172.21.15.106:0/946098729 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c012400 con 0x7f1c980bcd10 2023-12-22T09:14:59.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7f1c8a7fc640 1 -- 172.21.15.106:0/946098729 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00aea0 con 0x7f1c980bcd10 2023-12-22T09:14:59.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7fe72a9ad640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6800/88650,v1:172.21.15.106:6801/88650] conn(0x7fe708073b40 0x7fe708075f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7f1daeffd640 1 -- 172.21.15.106:0/2294681571 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db000d840 con 0x7f1db8155830 2023-12-22T09:14:59.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7fe7299ab640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe70806a500 0x7fe70806c9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe7240bf230 tx=0x7fe710009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7f1daeffd640 1 -- 172.21.15.106:0/2294681571 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db000d9a0 con 0x7f1db8155830 2023-12-22T09:14:59.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7f1daeffd640 1 -- 172.21.15.106:0/2294681571 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db000dd90 con 0x7f1db8155830 2023-12-22T09:14:59.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c981f1600 con 0x7f1c980bcd10 2023-12-22T09:14:59.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.665+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c981f1bc0 con 0x7f1c980bcd10 2023-12-22T09:14:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7fbe1a7c4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 0x7fbe0c16f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7fbe1a7c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe0c04e0c0 0x7fbe0c047420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7fbe1a7c4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe0c0d4750 0x7fbe0c0dde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7fbe1a7c4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0db920 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7fbe1a7c4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0dbb70 con 0x7fbe0c04e0c0 2023-12-22T09:14:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.664+0000 7fbe1a7c4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0dbe50 con 0x7fbe0c0d4750 2023-12-22T09:14:59.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.665+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c003b70 con 0x7fac900039c0 2023-12-22T09:14:59.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.665+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c003cd0 con 0x7fac900039c0 2023-12-22T09:14:59.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.665+0000 7faca8f53640 1 -- 172.21.15.106:0/719269428 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c005310 con 0x7fac900039c0 2023-12-22T09:14:59.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.665+0000 7fbe197c2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 0x7fbe0c16f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.665+0000 7fbe197c2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 0x7fbe0c16f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41076/0 (socket says 172.21.15.106:41076) 2023-12-22T09:14:59.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.665+0000 7fbe197c2640 1 -- 172.21.15.106:0/2387935320 learned_addr learned my addr 172.21.15.106:0/2387935320 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7fbe19fc3640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe0c0d4750 0x7fbe0c0dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7fbe18fc1640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe0c04e0c0 0x7fbe0c047420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c980c6f50 con 0x7f1c980bcd10 2023-12-22T09:14:59.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7f2b91638640 1 Processor -- start 2023-12-22T09:14:59.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7f2b91638640 1 -- start start 2023-12-22T09:14:59.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.665+0000 7f7f6a39f640 1 Processor -- start 2023-12-22T09:14:59.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7f7f6a39f640 1 -- start start 2023-12-22T09:14:59.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7fe722ffd640 1 -- 172.21.15.106:0/374150072 <== osd.0 v2:172.21.15.106:6800/88650 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe708076650 con 0x7fe708073b40 2023-12-22T09:14:59.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7facac1b9640 1 -- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac900039c0 msgr2=0x7fac90003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7facac1b9640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac900039c0 0x7fac90003de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac9c001d80 tx=0x7fac900057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7facac1b9640 1 -- 172.21.15.106:0/719269428 shutdown_connections 2023-12-22T09:14:59.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7facac1b9640 1 --2- 172.21.15.106:0/719269428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac900039c0 0x7fac90003de0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac9c001d80 tx=0x7fac900057f0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.666+0000 7facac1b9640 1 -- 172.21.15.106:0/719269428 >> 172.21.15.106:0/719269428 conn(0x7faca40ab330 msgr2=0x7faca40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7facac1b9640 1 -- 172.21.15.106:0/719269428 shutdown_connections 2023-12-22T09:14:59.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7fbe197c2640 1 -- 172.21.15.106:0/2387935320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe0c0d4750 msgr2=0x7fbe0c0dde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7fbe197c2640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe0c0d4750 0x7fbe0c0dde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7fbe197c2640 1 -- 172.21.15.106:0/2387935320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe0c04e0c0 msgr2=0x7fbe0c047420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7fbe197c2640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe0c04e0c0 0x7fbe0c047420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7fbe197c2640 1 -- 172.21.15.106:0/2387935320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe10009400 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7fbe197c2640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 0x7fbe0c16f650 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe140682a0 tx=0x7fbe14067150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db80c11e0 con 0x7f1db8155830 2023-12-22T09:14:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db80c0830 con 0x7f1db8155830 2023-12-22T09:14:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7f2b91638640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b8c14f450 0x7f2b8c0c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7f2b91638640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2b8c06fca0 0x7f2b8c155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.667+0000 7f2b91638640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c0ad150 con 0x7f2b8c0c56e0 2023-12-22T09:14:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7f2b91638640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c0a6f60 con 0x7f2b8c06fca0 2023-12-22T09:14:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7f2b91638640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c14f830 con 0x7f2b8c14f450 2023-12-22T09:14:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1db80c6f50 con 0x7f1db8155830 2023-12-22T09:14:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7f2b8affd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b8c14f450 0x7f2b8c0c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7fbe09ffb640 1 -- 172.21.15.106:0/2387935320 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140734a0 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7fbe09ffb640 1 -- 172.21.15.106:0/2387935320 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe14073620 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7fbe09ffb640 1 -- 172.21.15.106:0/2387935320 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1406b110 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c0dc130 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7facac1b9640 1 -- 172.21.15.106:0/719269428 wait complete. 2023-12-22T09:14:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7f2b8affd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b8c14f450 0x7f2b8c0c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40028/0 (socket says 172.21.15.106:40028) 2023-12-22T09:14:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7f2b8affd640 1 -- 172.21.15.106:0/760562038 learned_addr learned my addr 172.21.15.106:0/760562038 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7f2b8b7fe640 1 --2- 172.21.15.106:0/760562038 >> v2:172.21.15.106:3300/0 conn(0x7f2b8c06fca0 0x7f2b8c155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.670+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c0dc6f0 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.670+0000 7f2b8affd640 1 -- 172.21.15.106:0/760562038 >> v2:172.21.15.106:3300/0 conn(0x7f2b8c06fca0 msgr2=0x7f2b8c155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7f7f6a39f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f6406fab0 0x7f7f640bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7f7f6a39f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 0x7f7f64149f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7f7f6a39f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f64070560 con 0x7f7f6406de50 2023-12-22T09:14:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7f7f6a39f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f64071390 con 0x7f7f6406fab0 2023-12-22T09:14:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7f7f6a39f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f64070840 con 0x7f7f64149ab0 2023-12-22T09:14:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.668+0000 7f7f637fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f6406fab0 0x7f7f640bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7f7f63fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7f6406de50 0x7f7f64069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51970/0 (socket says 172.21.15.106:51970) 2023-12-22T09:14:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7f7f63fff640 1 -- 172.21.15.106:0/1835423078 learned_addr learned my addr 172.21.15.106:0/1835423078 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:14:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.669+0000 7f7f6893c640 1 --2- 172.21.15.106:0/1835423078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 0x7f7f64149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.670+0000 7f7f6893c640 1 -- 172.21.15.106:0/1835423078 >> v2:172.21.15.132:3300/0 conn(0x7f7f6406fab0 msgr2=0x7f7f640bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.671+0000 7f1266a23640 1 Processor -- start 2023-12-22T09:14:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.670+0000 7f7f6893c640 1 --2- 172.21.15.106:0/1835423078 >> v2:172.21.15.132:3300/0 conn(0x7f7f6406fab0 0x7f7f640bfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.670+0000 7f7f6893c640 1 -- 172.21.15.106:0/1835423078 >> v1:172.21.15.106:6789/0 conn(0x7f7f6406de50 legacy=0x7f7f64069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.670+0000 7f7f6893c640 1 -- 172.21.15.106:0/1835423078 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64070b20 con 0x7f7f64149ab0 2023-12-22T09:14:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.671+0000 7f1c8a7fc640 1 -- 172.21.15.106:0/946098729 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c8c0127b0 con 0x7f1c980bcd10 2023-12-22T09:14:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.671+0000 7f1daeffd640 1 -- 172.21.15.106:0/2294681571 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1db001e3b0 con 0x7f1db8155830 2023-12-22T09:14:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.672+0000 7facac1b9640 1 Processor -- start 2023-12-22T09:14:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.672+0000 7facac1b9640 1 -- start start 2023-12-22T09:14:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.670+0000 7f2b8affd640 1 --2- 172.21.15.106:0/760562038 >> v2:172.21.15.106:3300/0 conn(0x7f2b8c06fca0 0x7f2b8c155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.670+0000 7f2b8affd640 1 -- 172.21.15.106:0/760562038 >> v1:172.21.15.132:6789/0 conn(0x7f2b8c0c56e0 legacy=0x7f2b8c0c3fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-22T09:14:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.670+0000 7f2b8affd640 1 -- 172.21.15.106:0/760562038 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c0a6c80 con 0x7f2b8c14f450 2023-12-22T09:14:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.671+0000 7f2b8b7fe640 1 --2- 172.21.15.106:0/760562038 >> v2:172.21.15.106:3300/0 conn(0x7f2b8c06fca0 0x7f2b8c155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:14:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.671+0000 7f1266a23640 1 -- start start 2023-12-22T09:14:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.672+0000 7f7f6893c640 1 --2- 172.21.15.106:0/1835423078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 0x7f7f64149f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f540097a0 tx=0x7f7f5402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b0484adbf33d213 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.672+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe0c0dadb0 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1266a23640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12601514b0 0x7f12600c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1266a23640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126006aad0 0x7f12600c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1266a23640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12600c4660 con 0x7f12600c4130 2023-12-22T09:14:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1266a23640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1260153d60 con 0x7f12601514b0 2023-12-22T09:14:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1266a23640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1260154c50 con 0x7f126006aad0 2023-12-22T09:14:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1daeffd640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1d9806a430 0x7f1d9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f7f62ffd640 1 -- 172.21.15.106:0/1835423078 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54030840 con 0x7f7f64149ab0 2023-12-22T09:14:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1c8a7fc640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c7c06a500 0x7f1c7c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1c8a7fc640 1 -- 172.21.15.106:0/946098729 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c8c089630 con 0x7f1c980bcd10 2023-12-22T09:14:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1c8a7fc640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6808/88652,v1:172.21.15.106:6809/88652] conn(0x7f1c7c073b40 0x7f1c7c075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1c8a7fc640 1 -- 172.21.15.106:0/946098729 --> [v2:172.21.15.106:6808/88652,v1:172.21.15.106:6809/88652] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c7c076650 con 0x7f1c7c073b40 2023-12-22T09:14:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f1c8a7fc640 1 -- 172.21.15.106:0/946098729 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c8c0899e0 con 0x7f1c980bcd10 2023-12-22T09:14:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f1c9e32f640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6808/88652,v1:172.21.15.106:6809/88652] conn(0x7f1c7c073b40 0x7f1c7c075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f1daeffd640 1 -- 172.21.15.106:0/2294681571 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1db0089c60 con 0x7f1db8155830 2023-12-22T09:14:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f7f62ffd640 1 -- 172.21.15.106:0/1835423078 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540309a0 con 0x7f7f64149ab0 2023-12-22T09:14:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f7f62ffd640 1 -- 172.21.15.106:0/1835423078 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54030d70 con 0x7f7f64149ab0 2023-12-22T09:14:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1835423078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 msgr2=0x7f7f64149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f7f6a39f640 1 --2- 172.21.15.106:0/1835423078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 0x7f7f64149f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f540097a0 tx=0x7f7f5402b980 comp rx=0 tx=0).stop 2023-12-22T09:14:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f125ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12601514b0 0x7f12600c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f125ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12601514b0 0x7f12600c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40036/0 (socket says 172.21.15.106:40036) 2023-12-22T09:14:59.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f125ffff640 1 -- 172.21.15.106:0/968151713 learned_addr learned my addr 172.21.15.106:0/968151713 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f1264fc0640 1 --2- 172.21.15.106:0/968151713 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126006aad0 0x7f12600c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7fbe09ffb640 1 -- 172.21.15.106:0/2387935320 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbe1406b290 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7facac1b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faca41edbd0 0x7faca4156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1835423078 shutdown_connections 2023-12-22T09:14:59.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f7f6a39f640 1 --2- 172.21.15.106:0/1835423078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 0x7f7f64149f40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f7f6a39f640 1 --2- 172.21.15.106:0/1835423078 >> v2:172.21.15.132:3300/0 conn(0x7f7f6406fab0 0x7f7f640bfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1835423078 >> 172.21.15.106:0/1835423078 conn(0x7f7f640c5360 msgr2=0x7f7f640c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7facac1b9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faca40c1c30 0x7faca40c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1835423078 shutdown_connections 2023-12-22T09:14:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1835423078 wait complete. 2023-12-22T09:14:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7facac1b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4156fe0 0x7faca4155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7f1c9e32f640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6808/88652,v1:172.21.15.106:6809/88652] conn(0x7f1c7c073b40 0x7f1c7c075f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.674+0000 7f1daeffd640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6820/88666,v1:172.21.15.106:6822/88666] conn(0x7f1d98073a70 0x7f1d98075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7f125ffff640 1 -- 172.21.15.106:0/968151713 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126006aad0 msgr2=0x7f12600c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7f125ffff640 1 --2- 172.21.15.106:0/968151713 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126006aad0 0x7f12600c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7f125ffff640 1 -- 172.21.15.106:0/968151713 >> v1:172.21.15.106:6789/0 conn(0x7f12600c4130 legacy=0x7f1260154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:14:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7faca9f55640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faca41edbd0 0x7faca4156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7faca9f55640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faca41edbd0 0x7faca4156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40046/0 (socket says 172.21.15.106:40046) 2023-12-22T09:14:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7f1c8a7fc640 1 -- 172.21.15.106:0/946098729 <== osd.1 v2:172.21.15.106:6808/88652 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1c7c076650 con 0x7f1c7c073b40 2023-12-22T09:14:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7f1daeffd640 1 -- 172.21.15.106:0/2294681571 --> [v2:172.21.15.106:6820/88666,v1:172.21.15.106:6822/88666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d98076580 con 0x7f1d98073a70 2023-12-22T09:14:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7f1daeffd640 1 -- 172.21.15.106:0/2294681571 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1db008a010 con 0x7f1db8155830 2023-12-22T09:14:59.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7faca9f55640 1 -- 172.21.15.106:0/3400525231 learned_addr learned my addr 172.21.15.106:0/3400525231 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7faca9754640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faca40c1c30 0x7faca40c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca40c3490 con 0x7faca4156fe0 2023-12-22T09:14:59.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca4157d70 con 0x7faca41edbd0 2023-12-22T09:14:59.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.675+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca4157a40 con 0x7faca40c1c30 2023-12-22T09:14:59.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7fbe09ffb640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbdf806a500 0x7fbdf806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7f1daffff640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6820/88666,v1:172.21.15.106:6822/88666] conn(0x7f1d98073a70 0x7f1d98075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7f7f6a39f640 1 Processor -- start 2023-12-22T09:14:59.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7fbe09ffb640 1 -- 172.21.15.106:0/2387935320 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe141022e0 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7fbe18fc1640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbdf806a500 0x7fbdf806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7f1db659c640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1d9806a430 0x7f1d9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7f1c9db2e640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c7c06a500 0x7f1c7c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.673+0000 7f2b8affd640 1 --2- 172.21.15.106:0/760562038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b8c14f450 0x7f2b8c0c3a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c071ac0 tx=0x7f2b8402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c91ccc87df18311 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7f7f6a39f640 1 -- start start 2023-12-22T09:14:59.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7f2b89ffb640 1 -- 172.21.15.106:0/760562038 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8402c9c0 con 0x7f2b8c14f450 2023-12-22T09:14:59.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7f2b89ffb640 1 -- 172.21.15.106:0/760562038 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8402cb20 con 0x7f2b8c14f450 2023-12-22T09:14:59.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7f2b89ffb640 1 -- 172.21.15.106:0/760562038 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840343f0 con 0x7f2b8c14f450 2023-12-22T09:14:59.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7facaa756640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4156fe0 0x7faca4155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7facaa756640 1 -- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faca40c1c30 msgr2=0x7faca40c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7facaa756640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faca40c1c30 0x7faca40c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7facaa756640 1 -- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faca41edbd0 msgr2=0x7faca4156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7facaa756640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faca41edbd0 0x7faca4156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7f125ffff640 1 -- 172.21.15.106:0/968151713 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126006b250 con 0x7f12601514b0 2023-12-22T09:14:59.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.676+0000 7facaa756640 1 -- 172.21.15.106:0/3400525231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40c36a0 con 0x7faca4156fe0 2023-12-22T09:14:59.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7facaa756640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4156fe0 0x7faca4155110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faca40ac1c0 tx=0x7fac94004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7fac9a7fc640 1 -- 172.21.15.106:0/3400525231 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9400f8b0 con 0x7faca4156fe0 2023-12-22T09:14:59.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.678+0000 7fac9a7fc640 1 -- 172.21.15.106:0/3400525231 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9400fa10 con 0x7faca4156fe0 2023-12-22T09:14:59.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.678+0000 7fac9a7fc640 1 -- 172.21.15.106:0/3400525231 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9400fdc0 con 0x7faca4156fe0 2023-12-22T09:14:59.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7f1daffff640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6820/88666,v1:172.21.15.106:6822/88666] conn(0x7f1d98073a70 0x7f1d98075eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.677+0000 7fbe09ffb640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6816/88655,v1:172.21.15.106:6817/88655] conn(0x7fbdf8073ac0 0x7fbdf8075f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.678+0000 7fbe09ffb640 1 -- 172.21.15.106:0/2387935320 --> [v2:172.21.15.106:6816/88655,v1:172.21.15.106:6817/88655] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdf80765d0 con 0x7fbdf8073ac0 2023-12-22T09:14:59.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.678+0000 7fbe09ffb640 1 -- 172.21.15.106:0/2387935320 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe140cd700 con 0x7fbe0c04dbb0 2023-12-22T09:14:59.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.678+0000 7faca9f55640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faca41edbd0 0x7faca4156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:59.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7faca9754640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faca40c1c30 0x7faca40c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:59.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.678+0000 7fbe19fc3640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6816/88655,v1:172.21.15.106:6817/88655] conn(0x7fbdf8073ac0 0x7fbdf8075f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca40c3980 con 0x7faca4156fe0 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f7f6a39f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f6406de50 0x7f7f640c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f7f6a39f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f6406fab0 0x7f7f640c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f7f6a39f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 0x7f7f641e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f7f6a39f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f641e6210 con 0x7f7f6406de50 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f7f6a39f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f64140d90 con 0x7f7f6406fab0 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f7f6a39f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f640c31b0 con 0x7f7f64149ab0 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f7f637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f6406fab0 0x7f7f640c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f7f637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f6406fab0 0x7f7f640c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40050/0 (socket says 172.21.15.106:40050) 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f7f637fe640 1 -- 172.21.15.106:0/1514360286 learned_addr learned my addr 172.21.15.106:0/1514360286 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7f7f6893c640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 0x7f7f641e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7f2b91638640 1 -- 172.21.15.106:0/760562038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b8c14f450 msgr2=0x7f2b8c0c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7f2b91638640 1 --2- 172.21.15.106:0/760562038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b8c14f450 0x7f2b8c0c3a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c071ac0 tx=0x7f2b8402be20 comp rx=0 tx=0).stop 2023-12-22T09:14:59.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7fbe19fc3640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6816/88655,v1:172.21.15.106:6817/88655] conn(0x7fbdf8073ac0 0x7fbdf8075f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.679+0000 7f1daeffd640 1 -- 172.21.15.106:0/2294681571 <== osd.3 v2:172.21.15.106:6820/88666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1d98076580 con 0x7f1d98073a70 2023-12-22T09:14:59.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7f7f63fff640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f6406de50 0x7f7f640c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7f2b91638640 1 -- 172.21.15.106:0/760562038 shutdown_connections 2023-12-22T09:14:59.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7f2b91638640 1 --2- 172.21.15.106:0/760562038 >> v2:172.21.15.106:3300/0 conn(0x7f2b8c06fca0 0x7f2b8c155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7f2b91638640 1 --2- 172.21.15.106:0/760562038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b8c14f450 0x7f2b8c0c3a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7f2b91638640 1 -- 172.21.15.106:0/760562038 >> 172.21.15.106:0/760562038 conn(0x7f2b8c0a9160 msgr2=0x7f2b8c0a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f7f637fe640 1 -- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 msgr2=0x7f7f641e4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f7f637fe640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 0x7f7f641e4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f7f637fe640 1 -- 172.21.15.106:0/1514360286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f6406de50 msgr2=0x7f7f640c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f7f637fe640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f6406de50 0x7f7f640c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f7f637fe640 1 -- 172.21.15.106:0/1514360286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f54009400 con 0x7f7f6406fab0 2023-12-22T09:14:59.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f7f6893c640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f64149ab0 0x7f7f641e4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:14:59.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7fbe18fc1640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbdf806a500 0x7fbdf806c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe10036000 tx=0x7fbe1003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7fbe09ffb640 1 -- 172.21.15.106:0/2387935320 <== osd.2 v2:172.21.15.106:6816/88655 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbdf80765d0 con 0x7fbdf8073ac0 2023-12-22T09:14:59.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f7f63fff640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f6406de50 0x7f7f640c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:14:59.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f2b91638640 1 -- 172.21.15.106:0/760562038 shutdown_connections 2023-12-22T09:14:59.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f1db659c640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1d9806a430 0x7f1d9806c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1db8156de0 tx=0x7f1da803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.680+0000 7f125ffff640 1 --2- 172.21.15.106:0/968151713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12601514b0 0x7f12600c75b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1250009870 tx=0x7f125002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbaae424f2285382 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f125effd640 1 -- 172.21.15.106:0/968151713 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250031640 con 0x7f12601514b0 2023-12-22T09:14:59.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f125effd640 1 -- 172.21.15.106:0/968151713 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12500317a0 con 0x7f12601514b0 2023-12-22T09:14:59.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.681+0000 7f125effd640 1 -- 172.21.15.106:0/968151713 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250031b30 con 0x7f12601514b0 2023-12-22T09:14:59.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.682+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca40c0cd0 con 0x7faca4156fe0 2023-12-22T09:14:59.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.682+0000 7f1c9db2e640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c7c06a500 0x7f1c7c06c9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1c90035000 tx=0x7f1c90030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.683+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faca40c4500 con 0x7faca4156fe0 2023-12-22T09:14:59.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.683+0000 7fac9a7fc640 1 -- 172.21.15.106:0/3400525231 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fac9401d460 con 0x7faca4156fe0 2023-12-22T09:14:59.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.683+0000 7f2b91638640 1 -- 172.21.15.106:0/760562038 wait complete. 2023-12-22T09:14:59.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.684+0000 7f1266a23640 1 -- 172.21.15.106:0/968151713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12601514b0 msgr2=0x7f12600c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.684+0000 7f1266a23640 1 --2- 172.21.15.106:0/968151713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12601514b0 0x7f12600c75b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1250009870 tx=0x7f125002b8f0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.682+0000 7f7f637fe640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f6406fab0 0x7f7f640c3bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f5801f8b0 tx=0x7f7f5801fd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.683+0000 7f7f60ff9640 1 -- 172.21.15.106:0/1514360286 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f58009670 con 0x7f7f6406fab0 2023-12-22T09:14:59.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.683+0000 7f7f60ff9640 1 -- 172.21.15.106:0/1514360286 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f58009e90 con 0x7f7f6406fab0 2023-12-22T09:14:59.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.683+0000 7f7f60ff9640 1 -- 172.21.15.106:0/1514360286 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5801dd90 con 0x7f7f6406fab0 2023-12-22T09:14:59.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.684+0000 7f1266a23640 1 -- 172.21.15.106:0/968151713 shutdown_connections 2023-12-22T09:14:59.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.684+0000 7f1266a23640 1 --2- 172.21.15.106:0/968151713 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126006aad0 0x7f12600c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.684+0000 7f1266a23640 1 --2- 172.21.15.106:0/968151713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12601514b0 0x7f12600c75b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.684+0000 7f1266a23640 1 -- 172.21.15.106:0/968151713 >> 172.21.15.106:0/968151713 conn(0x7f12600ab1a0 msgr2=0x7f12600ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.684+0000 7f1266a23640 1 -- 172.21.15.106:0/968151713 shutdown_connections 2023-12-22T09:14:59.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.685+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f64140f40 con 0x7f7f6406fab0 2023-12-22T09:14:59.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.685+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f641e8dc0 con 0x7f7f6406fab0 2023-12-22T09:14:59.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.685+0000 7f1266a23640 1 -- 172.21.15.106:0/968151713 wait complete. 2023-12-22T09:14:59.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.685+0000 7f2b91638640 1 Processor -- start 2023-12-22T09:14:59.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.684+0000 7fac9a7fc640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fac8806a4b0 0x7fac8806c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.684+0000 7fac9a7fc640 1 -- 172.21.15.106:0/3400525231 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac94088240 con 0x7faca4156fe0 2023-12-22T09:14:59.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.685+0000 7fac9a7fc640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:6817/89139,v1:172.21.15.132:6819/89139] conn(0x7fac88073af0 0x7fac88075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.685+0000 7fac9a7fc640 1 -- 172.21.15.106:0/3400525231 --> [v2:172.21.15.132:6817/89139,v1:172.21.15.132:6819/89139] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac88076600 con 0x7fac88073af0 2023-12-22T09:14:59.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.685+0000 7fac9a7fc640 1 -- 172.21.15.106:0/3400525231 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac94088600 con 0x7faca4156fe0 2023-12-22T09:14:59.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.686+0000 7faca9754640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:6817/89139,v1:172.21.15.132:6819/89139] conn(0x7fac88073af0 0x7fac88075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.686+0000 7f2b91638640 1 -- start start 2023-12-22T09:14:59.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.686+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f6414fe20 con 0x7f7f6406fab0 2023-12-22T09:14:59.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.687+0000 7faca9f55640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fac8806a4b0 0x7fac8806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.687+0000 7f2b91638640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b8c06fca0 0x7f2b8c0a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.687+0000 7f2b91638640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b8c0c56e0 0x7f2b8c0ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.687+0000 7f2b91638640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b8c14f450 0x7f2b8c0ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.687+0000 7f2b91638640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c145300 con 0x7f2b8c06fca0 2023-12-22T09:14:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.687+0000 7f2b91638640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c144d40 con 0x7f2b8c0c56e0 2023-12-22T09:14:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.687+0000 7f2b91638640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c145020 con 0x7f2b8c14f450 2023-12-22T09:14:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.688+0000 7f1266a23640 1 Processor -- start 2023-12-22T09:14:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.688+0000 7f2b8affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b8c06fca0 0x7f2b8c0a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.688+0000 7f2b8affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b8c06fca0 0x7f2b8c0a7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41124/0 (socket says 172.21.15.106:41124) 2023-12-22T09:14:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.688+0000 7f2b8affd640 1 -- 172.21.15.106:0/2611872450 learned_addr learned my addr 172.21.15.106:0/2611872450 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.688+0000 7f1266a23640 1 -- start start 2023-12-22T09:14:59.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.688+0000 7f2b8b7fe640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b8c14f450 0x7f2b8c0ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.689+0000 7f2b8affd640 1 -- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b8c14f450 msgr2=0x7f2b8c0ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.689+0000 7f2b8affd640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b8c14f450 0x7f2b8c0ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.689+0000 7f2b8affd640 1 -- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b8c0c56e0 msgr2=0x7f2b8c0ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.689+0000 7f2b8affd640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b8c0c56e0 0x7f2b8c0ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.689+0000 7f2b8affd640 1 -- 172.21.15.106:0/2611872450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84009b30 con 0x7f2b8c06fca0 2023-12-22T09:14:59.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.690+0000 7f7f60ff9640 1 -- 172.21.15.106:0/1514360286 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f58024480 con 0x7f7f6406fab0 2023-12-22T09:14:59.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.690+0000 7f2b8affd640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b8c06fca0 0x7f2b8c0a7ab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b84000f80 tx=0x7f2b84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.690+0000 7f1266a23640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f126006aad0 0x7f12601deb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.688+0000 7faca9754640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:6817/89139,v1:172.21.15.132:6819/89139] conn(0x7fac88073af0 0x7fac88075f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.688+0000 7faca9f55640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fac8806a4b0 0x7fac8806c970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac9c001d80 tx=0x7fac9c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.690+0000 7fac9a7fc640 1 -- 172.21.15.106:0/3400525231 <== osd.4 v2:172.21.15.132:6817/89139 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fac88076600 con 0x7fac88073af0 2023-12-22T09:14:59.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f1266a23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12600c4130 0x7f12601f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f1266a23640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12601514b0 0x7f12601f1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f2b737fe640 1 -- 172.21.15.106:0/2611872450 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8403e450 con 0x7f2b8c06fca0 2023-12-22T09:14:59.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f2b737fe640 1 -- 172.21.15.106:0/2611872450 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8403e5b0 con 0x7f2b8c06fca0 2023-12-22T09:14:59.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f2b737fe640 1 -- 172.21.15.106:0/2611872450 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8403e940 con 0x7f2b8c06fca0 2023-12-22T09:14:59.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f7f60ff9640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7f5006a500 0x7f7f5006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c144570 con 0x7f2b8c06fca0 2023-12-22T09:14:59.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c152490 con 0x7f2b8c06fca0 2023-12-22T09:14:59.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.692+0000 7f7f60ff9640 1 -- 172.21.15.106:0/1514360286 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f5809a0a0 con 0x7f7f6406fab0 2023-12-22T09:14:59.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.692+0000 7f7f60ff9640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:6808/89138,v1:172.21.15.132:6809/89138] conn(0x7f7f50073b40 0x7f7f50075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f1266a23640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126014f070 con 0x7f126006aad0 2023-12-22T09:14:59.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f1266a23640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600aaf90 con 0x7f12600c4130 2023-12-22T09:14:59.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f1266a23640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12600bc190 con 0x7f12601514b0 2023-12-22T09:14:59.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f1264fc0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12601514b0 0x7f12601f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f1264fc0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12601514b0 0x7f12601f1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:57110/0 (socket says 172.21.15.106:57110) 2023-12-22T09:14:59.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.691+0000 7f1264fc0640 1 -- 172.21.15.106:0/3305752054 learned_addr learned my addr 172.21.15.106:0/3305752054 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:14:59.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.692+0000 7f7f60ff9640 1 -- 172.21.15.106:0/1514360286 --> [v2:172.21.15.132:6808/89138,v1:172.21.15.132:6809/89138] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f50076650 con 0x7f7f50073b40 2023-12-22T09:14:59.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.692+0000 7f7f60ff9640 1 -- 172.21.15.106:0/1514360286 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f5809a450 con 0x7f7f6406fab0 2023-12-22T09:14:59.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.692+0000 7f1264fc0640 1 -- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12600c4130 msgr2=0x7f12601f0bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-22T09:14:59.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.692+0000 7f125ffff640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f126006aad0 0x7f12601deb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.692+0000 7f125f7fe640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12600c4130 0x7f12601f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.693+0000 7f1264fc0640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12600c4130 0x7f12601f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.693+0000 7f1264fc0640 1 -- 172.21.15.106:0/3305752054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f126006aad0 msgr2=0x7f12601deb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.693+0000 7f1264fc0640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f126006aad0 0x7f12601deb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.693+0000 7f1264fc0640 1 -- 172.21.15.106:0/3305752054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12500094d0 con 0x7f12601514b0 2023-12-22T09:14:59.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.694+0000 7f7f63fff640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7f5006a500 0x7f7f5006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.693+0000 7f125ffff640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f126006aad0 0x7f12601deb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:59.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.694+0000 7f1264fc0640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12601514b0 0x7f12601f1110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1258009cb0 tx=0x7f125800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.694+0000 7f125f7fe640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12600c4130 0x7f12601f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:14:59.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.695+0000 7f2b737fe640 1 -- 172.21.15.106:0/2611872450 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b8403eaa0 con 0x7f2b8c06fca0 2023-12-22T09:14:59.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.696+0000 7f7f6893c640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:6808/89138,v1:172.21.15.132:6809/89138] conn(0x7f7f50073b40 0x7f7f50075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.694+0000 7f125cff9640 1 -- 172.21.15.106:0/3305752054 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258014480 con 0x7f12601514b0 2023-12-22T09:14:59.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.695+0000 7f125cff9640 1 -- 172.21.15.106:0/3305752054 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125800f040 con 0x7f12601514b0 2023-12-22T09:14:59.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.696+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12601f1650 con 0x7f12601514b0 2023-12-22T09:14:59.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.696+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12600aa1d0 con 0x7f12601514b0 2023-12-22T09:14:59.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.696+0000 7f125cff9640 1 -- 172.21.15.106:0/3305752054 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258014820 con 0x7f12601514b0 2023-12-22T09:14:59.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.696+0000 7f7f63fff640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7f5006a500 0x7f7f5006c9c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0017d0 tx=0x7f7f5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.696+0000 7f2b737fe640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2b7806a500 0x7f2b7806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.696+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b8c0c6eb0 con 0x7f2b8c06fca0 2023-12-22T09:14:59.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.697+0000 7f2b737fe640 1 -- 172.21.15.106:0/2611872450 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b840ab980 con 0x7f2b8c06fca0 2023-12-22T09:14:59.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.697+0000 7f2b737fe640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:6800/89137,v1:172.21.15.132:6801/89137] conn(0x7f2b78073ac0 0x7f2b78075f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.697+0000 7f2b737fe640 1 -- 172.21.15.106:0/2611872450 --> [v2:172.21.15.132:6800/89137,v1:172.21.15.132:6801/89137] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b780765d0 con 0x7f2b78073ac0 2023-12-22T09:14:59.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.697+0000 7f2b737fe640 1 -- 172.21.15.106:0/2611872450 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b84076b20 con 0x7f2b8c06fca0 2023-12-22T09:14:59.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.697+0000 7f2b8a7fc640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2b7806a500 0x7f2b7806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.697+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1260154020 con 0x7f12601514b0 2023-12-22T09:14:59.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.698+0000 7f7f6893c640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:6808/89138,v1:172.21.15.132:6809/89138] conn(0x7f7f50073b40 0x7f7f50075f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.698+0000 7f2b8b7fe640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:6800/89137,v1:172.21.15.132:6801/89137] conn(0x7f2b78073ac0 0x7f2b78075f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.699+0000 7f2b8a7fc640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2b7806a500 0x7f2b7806c9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0c4540 tx=0x7f2b7c006ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.699+0000 7f125cff9640 1 -- 172.21.15.106:0/3305752054 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1258014980 con 0x7f12601514b0 2023-12-22T09:14:59.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.700+0000 7f2b8b7fe640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:6800/89137,v1:172.21.15.132:6801/89137] conn(0x7f2b78073ac0 0x7f2b78075f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.700+0000 7f7f60ff9640 1 -- 172.21.15.106:0/1514360286 <== osd.6 v2:172.21.15.132:6808/89138 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7f50076650 con 0x7f7f50073b40 2023-12-22T09:14:59.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.701+0000 7fe720ff9640 1 -- 172.21.15.106:0/374150072 --> [v2:172.21.15.106:6800/88650,v1:172.21.15.106:6801/88650] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe700002cb0 con 0x7fe708073b40 2023-12-22T09:14:59.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.701+0000 7fe722ffd640 1 -- 172.21.15.106:0/374150072 <== osd.0 v2:172.21.15.106:6800/88650 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe700002cb0 con 0x7fe708073b40 2023-12-22T09:14:59.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.701+0000 7f125cff9640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f124c06a460 0x7f124c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.701+0000 7f125cff9640 1 -- 172.21.15.106:0/3305752054 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f125808a220 con 0x7f12601514b0 2023-12-22T09:14:59.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.701+0000 7f125cff9640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:6816/89142,v1:172.21.15.132:6818/89142] conn(0x7f124c0738b0 0x7f124c075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:14:59.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.701+0000 7f125cff9640 1 -- 172.21.15.106:0/3305752054 --> [v2:172.21.15.132:6816/89142,v1:172.21.15.132:6818/89142] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f124c0763c0 con 0x7f124c0738b0 2023-12-22T09:14:59.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.701+0000 7f125cff9640 1 -- 172.21.15.106:0/3305752054 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f125808a670 con 0x7f12601514b0 2023-12-22T09:14:59.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.701+0000 7f125ffff640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f124c06a460 0x7f124c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.702+0000 7f2b737fe640 1 -- 172.21.15.106:0/2611872450 <== osd.5 v2:172.21.15.132:6800/89137 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2b780765d0 con 0x7f2b78073ac0 2023-12-22T09:14:59.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.702+0000 7fe720ff9640 1 -- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6800/88650,v1:172.21.15.106:6801/88650] conn(0x7fe708073b40 msgr2=0x7fe708075f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.702+0000 7fe720ff9640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6800/88650,v1:172.21.15.106:6801/88650] conn(0x7fe708073b40 0x7fe708075f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.703+0000 7f125f7fe640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:6816/89142,v1:172.21.15.132:6818/89142] conn(0x7f124c0738b0 0x7f124c075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:14:59.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.703+0000 7f125ffff640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f124c06a460 0x7f124c06c920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1250036000 tx=0x7f125003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.705+0000 7fe720ff9640 1 -- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe70806a500 msgr2=0x7fe70806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.705+0000 7fe720ff9640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe70806a500 0x7fe70806c9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe7240bf230 tx=0x7fe710009040 comp rx=0 tx=0).stop 2023-12-22T09:14:59.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.705+0000 7fe720ff9640 1 -- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7240bfd70 msgr2=0x7fe7240c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.705+0000 7f125f7fe640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:6816/89142,v1:172.21.15.132:6818/89142] conn(0x7f124c0738b0 0x7f124c075cf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:14:59.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.705+0000 7fe720ff9640 1 --2- 172.21.15.106:0/374150072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7240bfd70 0x7fe7240c4220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe72415bb10 tx=0x7fe718004a40 comp rx=0 tx=0).stop 2023-12-22T09:14:59.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.705+0000 7fe72a9ad640 1 -- 172.21.15.106:0/374150072 reap_dead start 2023-12-22T09:14:59.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.705+0000 7fe720ff9640 1 -- 172.21.15.106:0/374150072 shutdown_connections 2023-12-22T09:14:59.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.705+0000 7fe720ff9640 1 -- 172.21.15.106:0/374150072 >> 172.21.15.106:0/374150072 conn(0x7fe724069bf0 msgr2=0x7fe7240c17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.706+0000 7fe720ff9640 1 -- 172.21.15.106:0/374150072 shutdown_connections 2023-12-22T09:14:59.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.706+0000 7fe720ff9640 1 -- 172.21.15.106:0/374150072 wait complete. 2023-12-22T09:14:59.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.708+0000 7f125cff9640 1 -- 172.21.15.106:0/3305752054 <== osd.7 v2:172.21.15.132:6816/89142 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f124c0763c0 con 0x7f124c0738b0 2023-12-22T09:14:59.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.710+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 --> [v2:172.21.15.106:6816/88655,v1:172.21.15.106:6817/88655] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe0c0daad0 con 0x7fbdf8073ac0 2023-12-22T09:14:59.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.710+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 --> [v2:172.21.15.106:6808/88652,v1:172.21.15.106:6809/88652] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c980c4130 con 0x7f1c7c073b40 2023-12-22T09:14:59.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.711+0000 7f1c8a7fc640 1 -- 172.21.15.106:0/946098729 <== osd.1 v2:172.21.15.106:6808/88652 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c94009870 con 0x7f1c7c073b40 2023-12-22T09:14:59.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.712+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6808/88652,v1:172.21.15.106:6809/88652] conn(0x7f1c7c073b40 msgr2=0x7f1c7c075f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.712+0000 7f1c9eb30640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6808/88652,v1:172.21.15.106:6809/88652] conn(0x7f1c7c073b40 0x7f1c7c075f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.712+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c7c06a500 msgr2=0x7f1c7c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.712+0000 7f1c9eb30640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c7c06a500 0x7f1c7c06c9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1c90035000 tx=0x7f1c90030000 comp rx=0 tx=0).stop 2023-12-22T09:14:59.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.712+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c980bcd10 msgr2=0x7f1c981ede20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.712+0000 7f1c9eb30640 1 --2- 172.21.15.106:0/946098729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c980bcd10 0x7f1c981ede20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00cbc0 tx=0x7f1c8c00a430 comp rx=0 tx=0).stop 2023-12-22T09:14:59.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.713+0000 7fbe09ffb640 1 -- 172.21.15.106:0/2387935320 <== osd.2 v2:172.21.15.106:6816/88655 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe04009870 con 0x7fbdf8073ac0 2023-12-22T09:14:59.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 --> [v2:172.21.15.132:6817/89139,v1:172.21.15.132:6819/89139] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faca4154d60 con 0x7fac88073af0 2023-12-22T09:14:59.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7f1c9e32f640 1 -- 172.21.15.106:0/946098729 reap_dead start 2023-12-22T09:14:59.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 shutdown_connections 2023-12-22T09:14:59.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 >> 172.21.15.106:0/946098729 conn(0x7f1c98071320 msgr2=0x7f1c980c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6816/88655,v1:172.21.15.106:6817/88655] conn(0x7fbdf8073ac0 msgr2=0x7fbdf8075f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7fbe1a7c4640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6816/88655,v1:172.21.15.106:6817/88655] conn(0x7fbdf8073ac0 0x7fbdf8075f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 shutdown_connections 2023-12-22T09:14:59.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbdf806a500 msgr2=0x7fbdf806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7fbe1a7c4640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbdf806a500 0x7fbdf806c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbe10036000 tx=0x7fbe1003d040 comp rx=0 tx=0).stop 2023-12-22T09:14:59.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 msgr2=0x7fbe0c16f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.714+0000 7fbe1a7c4640 1 --2- 172.21.15.106:0/2387935320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe0c04dbb0 0x7fbe0c16f650 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe140682a0 tx=0x7fbe14067150 comp rx=0 tx=0).stop 2023-12-22T09:14:59.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.715+0000 7fbe19fc3640 1 -- 172.21.15.106:0/2387935320 reap_dead start 2023-12-22T09:14:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.715+0000 7f1c9eb30640 1 -- 172.21.15.106:0/946098729 wait complete. 2023-12-22T09:14:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.715+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 --> [v2:172.21.15.106:6820/88666,v1:172.21.15.106:6822/88666] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1db80c4130 con 0x7f1d98073a70 2023-12-22T09:14:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.715+0000 7fac9a7fc640 1 -- 172.21.15.106:0/3400525231 <== osd.4 v2:172.21.15.132:6817/89139 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faca00094e0 con 0x7fac88073af0 2023-12-22T09:14:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.715+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 shutdown_connections 2023-12-22T09:14:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.715+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 >> 172.21.15.106:0/2387935320 conn(0x7fbe0c04c730 msgr2=0x7fbe0c0cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.716+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 shutdown_connections 2023-12-22T09:14:59.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.716+0000 7fbe1a7c4640 1 -- 172.21.15.106:0/2387935320 wait complete. 2023-12-22T09:14:59.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.716+0000 7f1daeffd640 1 -- 172.21.15.106:0/2294681571 <== osd.3 v2:172.21.15.106:6820/88666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1da00050b0 con 0x7f1d98073a70 2023-12-22T09:14:59.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6820/88666,v1:172.21.15.106:6822/88666] conn(0x7f1d98073a70 msgr2=0x7f1d98075eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7f1db759e640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6820/88666,v1:172.21.15.106:6822/88666] conn(0x7f1d98073a70 0x7f1d98075eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:6817/89139,v1:172.21.15.132:6819/89139] conn(0x7fac88073af0 msgr2=0x7fac88075f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7facac1b9640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.132:6817/89139,v1:172.21.15.132:6819/89139] conn(0x7fac88073af0 0x7fac88075f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fac8806a4b0 msgr2=0x7fac8806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7facac1b9640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fac8806a4b0 0x7fac8806c970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac9c001d80 tx=0x7fac9c009030 comp rx=0 tx=0).stop 2023-12-22T09:14:59.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4156fe0 msgr2=0x7faca4155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7facac1b9640 1 --2- 172.21.15.106:0/3400525231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4156fe0 0x7faca4155110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faca40ac1c0 tx=0x7fac94004bb0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7facaa756640 1 -- 172.21.15.106:0/3400525231 reap_dead start 2023-12-22T09:14:59.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 shutdown_connections 2023-12-22T09:14:59.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 >> 172.21.15.106:0/3400525231 conn(0x7faca40ab330 msgr2=0x7faca40adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1d9806a430 msgr2=0x7f1d9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7f1db759e640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1d9806a430 0x7f1d9806c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1db8156de0 tx=0x7f1da803d040 comp rx=0 tx=0).stop 2023-12-22T09:14:59.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.719+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1db8155830 msgr2=0x7f1db814d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.720+0000 7f1db759e640 1 --2- 172.21.15.106:0/2294681571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1db8155830 0x7f1db814d130 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1db000cdf0 tx=0x7f1db000a710 comp rx=0 tx=0).stop 2023-12-22T09:14:59.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.720+0000 7f1db6d9d640 1 -- 172.21.15.106:0/2294681571 reap_dead start 2023-12-22T09:14:59.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.720+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 shutdown_connections 2023-12-22T09:14:59.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.720+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 >> 172.21.15.106:0/2294681571 conn(0x7f1db8071320 msgr2=0x7f1db8157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.720+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 shutdown_connections 2023-12-22T09:14:59.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.720+0000 7f1db759e640 1 -- 172.21.15.106:0/2294681571 wait complete. 2023-12-22T09:14:59.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.720+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 shutdown_connections 2023-12-22T09:14:59.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.720+0000 7facac1b9640 1 -- 172.21.15.106:0/3400525231 wait complete. 2023-12-22T09:14:59.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.734+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 --> [v2:172.21.15.132:6800/89137,v1:172.21.15.132:6801/89137] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b8c0c2080 con 0x7f2b78073ac0 2023-12-22T09:14:59.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.735+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 --> [v2:172.21.15.132:6808/89138,v1:172.21.15.132:6809/89138] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f64153410 con 0x7f7f50073b40 2023-12-22T09:14:59.768 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:14:59.768 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-22T09:14:59.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.736+0000 7f2b737fe640 1 -- 172.21.15.106:0/2611872450 <== osd.5 v2:172.21.15.132:6800/89137 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b8000bac0 con 0x7f2b78073ac0 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.736+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:6800/89137,v1:172.21.15.132:6801/89137] conn(0x7f2b78073ac0 msgr2=0x7f2b78075f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.736+0000 7f2b91638640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.132:6800/89137,v1:172.21.15.132:6801/89137] conn(0x7f2b78073ac0 0x7f2b78075f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.736+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2b7806a500 msgr2=0x7f2b7806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.736+0000 7f2b91638640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2b7806a500 0x7f2b7806c9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0c4540 tx=0x7f2b7c006ba0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.736+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b8c06fca0 msgr2=0x7f2b8c0a7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.736+0000 7f2b91638640 1 --2- 172.21.15.106:0/2611872450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b8c06fca0 0x7f2b8c0a7ab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b84000f80 tx=0x7f2b84004a40 comp rx=0 tx=0).stop 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.737+0000 7f2b8b7fe640 1 -- 172.21.15.106:0/2611872450 reap_dead start 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.737+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 shutdown_connections 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.737+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 >> 172.21.15.106:0/2611872450 conn(0x7f2b8c0a9160 msgr2=0x7f2b8c1517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.737+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 shutdown_connections 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.737+0000 7f2b91638640 1 -- 172.21.15.106:0/2611872450 wait complete. 2023-12-22T09:14:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.738+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 --> [v2:172.21.15.132:6816/89142,v1:172.21.15.132:6818/89142] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f126006b530 con 0x7f124c0738b0 2023-12-22T09:14:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.738+0000 7f7f60ff9640 1 -- 172.21.15.106:0/1514360286 <== osd.6 v2:172.21.15.132:6808/89138 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f5403f040 con 0x7f7f50073b40 2023-12-22T09:14:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.738+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:6808/89138,v1:172.21.15.132:6809/89138] conn(0x7f7f50073b40 msgr2=0x7f7f50075f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.738+0000 7f7f6a39f640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:6808/89138,v1:172.21.15.132:6809/89138] conn(0x7f7f50073b40 0x7f7f50075f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7f5006a500 msgr2=0x7f7f5006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f7f6a39f640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7f5006a500 0x7f7f5006c9c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0017d0 tx=0x7f7f5c009040 comp rx=0 tx=0).stop 2023-12-22T09:14:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f6406fab0 msgr2=0x7f7f640c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f7f6a39f640 1 --2- 172.21.15.106:0/1514360286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f6406fab0 0x7f7f640c3bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f5801f8b0 tx=0x7f7f5801fd70 comp rx=0 tx=0).stop 2023-12-22T09:14:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f7f6893c640 1 -- 172.21.15.106:0/1514360286 reap_dead start 2023-12-22T09:14:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f125cff9640 1 -- 172.21.15.106:0/3305752054 <== osd.7 v2:172.21.15.132:6816/89142 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f12540013e0 con 0x7f124c0738b0 2023-12-22T09:14:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 shutdown_connections 2023-12-22T09:14:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 >> 172.21.15.106:0/1514360286 conn(0x7f7f640c5360 msgr2=0x7f7f64148db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:6816/89142,v1:172.21.15.132:6818/89142] conn(0x7f124c0738b0 msgr2=0x7f124c075cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f1266a23640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:6816/89142,v1:172.21.15.132:6818/89142] conn(0x7f124c0738b0 0x7f124c075cf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:14:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f124c06a460 msgr2=0x7f124c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f1266a23640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f124c06a460 0x7f124c06c920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1250036000 tx=0x7f125003c040 comp rx=0 tx=0).stop 2023-12-22T09:14:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12601514b0 msgr2=0x7f12601f1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:14:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.739+0000 7f1266a23640 1 --2- 172.21.15.106:0/3305752054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12601514b0 0x7f12601f1110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1258009cb0 tx=0x7f125800c490 comp rx=0 tx=0).stop 2023-12-22T09:14:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.740+0000 7f1264fc0640 1 -- 172.21.15.106:0/3305752054 reap_dead start 2023-12-22T09:14:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.740+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 shutdown_connections 2023-12-22T09:14:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.740+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 >> 172.21.15.106:0/3305752054 conn(0x7f12600ab1a0 msgr2=0x7f1260151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:14:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.740+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 shutdown_connections 2023-12-22T09:14:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.740+0000 7f7f6a39f640 1 -- 172.21.15.106:0/1514360286 wait complete. 2023-12-22T09:14:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.740+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 shutdown_connections 2023-12-22T09:14:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:14:59.740+0000 7f1266a23640 1 -- 172.21.15.106:0/3305752054 wait complete. 2023-12-22T09:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:14:59.776 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-22T09:14:59.776 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-22T09:14:59.777 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:14:59.777 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-22T09:14:59.778 INFO:teuthology.orchestra.run.smithi106.stdout:60129542156 2023-12-22T09:14:59.778 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-22T09:14:59.779 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:14:59.779 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-22T09:14:59.780 INFO:teuthology.orchestra.run.smithi106.stdout:60129542154 2023-12-22T09:14:59.780 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-22T09:14:59.781 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:14:59.781 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-22T09:15:00.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.117+0000 7f1f5872e640 1 Processor -- start 2023-12-22T09:15:00.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.117+0000 7f02ecd2e640 1 Processor -- start 2023-12-22T09:15:00.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.117+0000 7f02ecd2e640 1 -- start start 2023-12-22T09:15:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.118+0000 7f1f5872e640 1 -- start start 2023-12-22T09:15:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.119+0000 7f1f5872e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1f480d3af0 0x7f1f480069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.119+0000 7f1f5872e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f480d3ed0 con 0x7f1f4800b7c0 2023-12-22T09:15:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.119+0000 7f1f5872e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f48046e60 con 0x7f1f4802aed0 2023-12-22T09:15:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.119+0000 7f1f5872e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f48046510 con 0x7f1f480d3af0 2023-12-22T09:15:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.119+0000 7f02ecd2e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f02e814d2e0 0x7f02e806f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.119+0000 7f02ecd2e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e806fd40 con 0x7f02e806c940 2023-12-22T09:15:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.119+0000 7f02ecd2e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8150660 con 0x7f02e80c0b70 2023-12-22T09:15:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.119+0000 7f02ecd2e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80c0380 con 0x7f02e814d2e0 2023-12-22T09:15:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.120+0000 7f02e6d9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f02e806c940 0x7f02e806cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51976/0 (socket says 172.21.15.106:51976) 2023-12-22T09:15:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.120+0000 7f02ddd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f02e80c0b70 0x7f02e80c0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33276/0 (socket says 172.21.15.106:33276) 2023-12-22T09:15:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.120+0000 7f02e6d9d640 1 -- 172.21.15.106:0/176208441 learned_addr learned my addr 172.21.15.106:0/176208441 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.120+0000 7f02e659c640 1 --2- 172.21.15.106:0/176208441 >> v2:172.21.15.132:3300/0 conn(0x7f02e814d2e0 0x7f02e806f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.121+0000 7f1f55cc9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1f4802aed0 0x7f1f480d6620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33290/0 (socket says 172.21.15.106:33290) 2023-12-22T09:15:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.121+0000 7f1f55cc9640 1 -- 172.21.15.106:0/74673316 learned_addr learned my addr 172.21.15.106:0/74673316 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.121+0000 7f1f564ca640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1f480d3af0 0x7f1f480069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.121+0000 7f02e5d9b640 1 -- 172.21.15.106:0/176208441 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760242314 0 0) 0x7f02e8150660 con 0x7f02e80c0b70 2023-12-22T09:15:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.121+0000 7f02e5d9b640 1 -- 172.21.15.106:0/176208441 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02d4003520 con 0x7f02e80c0b70 2023-12-22T09:15:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.122+0000 7f02e659c640 1 -- 172.21.15.106:0/176208441 >> v1:172.21.15.132:6789/0 conn(0x7f02e80c0b70 legacy=0x7f02e80c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.122+0000 7f02e659c640 1 -- 172.21.15.106:0/176208441 >> v1:172.21.15.106:6789/0 conn(0x7f02e806c940 legacy=0x7f02e806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.122+0000 7f02e659c640 1 -- 172.21.15.106:0/176208441 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8150900 con 0x7f02e814d2e0 2023-12-22T09:15:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.122+0000 7f1f564ca640 1 -- 172.21.15.106:0/74673316 >> v1:172.21.15.132:6789/0 conn(0x7f1f4802aed0 legacy=0x7f1f480d6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.123+0000 7f1f554c8640 1 -- 172.21.15.106:0/74673316 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540258795 0 0) 0x7f1f48046e60 con 0x7f1f4802aed0 2023-12-22T09:15:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.123+0000 7f1f564ca640 1 -- 172.21.15.106:0/74673316 >> v1:172.21.15.106:6789/0 conn(0x7f1f4800b7c0 legacy=0x7f1f480d6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.123+0000 7f1f564ca640 1 -- 172.21.15.106:0/74673316 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48046230 con 0x7f1f480d3af0 2023-12-22T09:15:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.124+0000 7f02e659c640 1 --2- 172.21.15.106:0/176208441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e814d2e0 0x7f02e806f800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02d000ba40 tx=0x7f02d002dcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74894de0728c242d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.125+0000 7f02e5d9b640 1 -- 172.21.15.106:0/176208441 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d002e9e0 con 0x7f02e814d2e0 2023-12-22T09:15:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.125+0000 7f02e5d9b640 1 -- 172.21.15.106:0/176208441 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d0032070 con 0x7f02e814d2e0 2023-12-22T09:15:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.125+0000 7f02e5d9b640 1 -- 172.21.15.106:0/176208441 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d002e9e0 con 0x7f02e814d2e0 2023-12-22T09:15:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.125+0000 7f1f564ca640 1 --2- 172.21.15.106:0/74673316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f480d3af0 0x7f1f480069f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0071d0 tx=0x7f1f4c02c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c34abfa733b13415 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.126+0000 7f1f554c8640 1 -- 172.21.15.106:0/74673316 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c008df0 con 0x7f1f480d3af0 2023-12-22T09:15:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.126+0000 7f1f554c8640 1 -- 172.21.15.106:0/74673316 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c02f050 con 0x7f1f480d3af0 2023-12-22T09:15:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.126+0000 7f1f554c8640 1 -- 172.21.15.106:0/74673316 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00a2f0 con 0x7f1f480d3af0 2023-12-22T09:15:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.126+0000 7f02ecd2e640 1 -- 172.21.15.106:0/176208441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e814d2e0 msgr2=0x7f02e806f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.126+0000 7f02ecd2e640 1 --2- 172.21.15.106:0/176208441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e814d2e0 0x7f02e806f800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02d000ba40 tx=0x7f02d002dcb0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.127+0000 7f02ecd2e640 1 -- 172.21.15.106:0/176208441 shutdown_connections 2023-12-22T09:15:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.127+0000 7f02ecd2e640 1 --2- 172.21.15.106:0/176208441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e814d2e0 0x7f02e806f800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.127+0000 7f02ecd2e640 1 -- 172.21.15.106:0/176208441 >> 172.21.15.106:0/176208441 conn(0x7f02e8069bf0 msgr2=0x7f02e8069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.127+0000 7f02ecd2e640 1 -- 172.21.15.106:0/176208441 shutdown_connections 2023-12-22T09:15:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.127+0000 7f1f5872e640 1 -- 172.21.15.106:0/74673316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f480d3af0 msgr2=0x7f1f480069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.127+0000 7f1f5872e640 1 --2- 172.21.15.106:0/74673316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f480d3af0 0x7f1f480069f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0071d0 tx=0x7f1f4c02c780 comp rx=0 tx=0).stop 2023-12-22T09:15:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.127+0000 7f34999cf640 1 Processor -- start 2023-12-22T09:15:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.127+0000 7f02ecd2e640 1 -- 172.21.15.106:0/176208441 wait complete. 2023-12-22T09:15:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.128+0000 7f34999cf640 1 -- start start 2023-12-22T09:15:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.128+0000 7f1f5872e640 1 -- 172.21.15.106:0/74673316 shutdown_connections 2023-12-22T09:15:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.128+0000 7f1f5872e640 1 --2- 172.21.15.106:0/74673316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f480d3af0 0x7f1f480069f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.128+0000 7f1f5872e640 1 -- 172.21.15.106:0/74673316 >> 172.21.15.106:0/74673316 conn(0x7f1f48005ed0 msgr2=0x7f1f480062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.128+0000 7f1f5872e640 1 -- 172.21.15.106:0/74673316 shutdown_connections 2023-12-22T09:15:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.128+0000 7f1f5872e640 1 -- 172.21.15.106:0/74673316 wait complete. 2023-12-22T09:15:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.128+0000 7f3eda6d6640 1 Processor -- start 2023-12-22T09:15:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.130+0000 7f02ecd2e640 1 Processor -- start 2023-12-22T09:15:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.130+0000 7f34999cf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c04e0c0 0x7f348c04f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.130+0000 7f02ecd2e640 1 -- start start 2023-12-22T09:15:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.128+0000 7f3eda6d6640 1 -- start start 2023-12-22T09:15:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.130+0000 7f3eda6d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc00b910 0x7f3ecc0e2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.131+0000 7f1f5872e640 1 Processor -- start 2023-12-22T09:15:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.130+0000 7f3eda6d6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc0df6f0 con 0x7f3ecc0e2580 2023-12-22T09:15:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.130+0000 7f3eda6d6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc0deae0 con 0x7f3ecc04b440 2023-12-22T09:15:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.130+0000 7f3eda6d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0dedc0 con 0x7f3ecc00b910 2023-12-22T09:15:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.130+0000 7f34999cf640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c010060 con 0x7f348c0d4750 2023-12-22T09:15:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.131+0000 7f34999cf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0da530 con 0x7f348c04dbb0 2023-12-22T09:15:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.131+0000 7f3493fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f348c04dbb0 0x7f348c04ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33300/0 (socket says 172.21.15.106:33300) 2023-12-22T09:15:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.131+0000 7f3493fff640 1 -- 172.21.15.106:0/778690766 learned_addr learned my addr 172.21.15.106:0/778690766 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.131+0000 7f34999cf640 1 -- 172.21.15.106:0/778690766 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0db470 con 0x7f348c04e0c0 2023-12-22T09:15:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.131+0000 7f1f5872e640 1 -- start start 2023-12-22T09:15:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f34991ce640 1 --2- 172.21.15.106:0/778690766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c04e0c0 0x7f348c04f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.131+0000 7f3ed9ed5640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3ecc0e2580 0x7f3ecc0e9130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51986/0 (socket says 172.21.15.106:51986) 2023-12-22T09:15:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.131+0000 7f3ed9ed5640 1 -- 172.21.15.106:0/1592633922 learned_addr learned my addr 172.21.15.106:0/1592633922 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f3ed8ed3640 1 --2- 172.21.15.106:0/1592633922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc00b910 0x7f3ecc0e2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f1f5872e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f4800b7c0 0x7f1f48173470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f1f5872e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f4802aed0 0x7f1f4802c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f1f5872e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f480d3af0 0x7f1f480caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f1f5872e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4802fa10 con 0x7f1f4802aed0 2023-12-22T09:15:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f1f5872e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480d5a80 con 0x7f1f4800b7c0 2023-12-22T09:15:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f1f5872e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4802ee00 con 0x7f1f480d3af0 2023-12-22T09:15:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f34991ce640 1 -- 172.21.15.106:0/778690766 >> v1:172.21.15.132:6789/0 conn(0x7f348c04dbb0 legacy=0x7f348c04ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f3ecbfff640 1 -- 172.21.15.106:0/1592633922 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225578975 0 0) 0x7f3ecc0deae0 con 0x7f3ecc04b440 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f3ecbfff640 1 -- 172.21.15.106:0/1592633922 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec0003520 con 0x7f3ecc04b440 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f3ecbfff640 1 -- 172.21.15.106:0/1592633922 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861922887 0 0) 0x7f3ecc0df6f0 con 0x7f3ecc0e2580 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.133+0000 7f3ecbfff640 1 -- 172.21.15.106:0/1592633922 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ecc0deae0 con 0x7f3ecc0e2580 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.133+0000 7f3ed8ed3640 1 -- 172.21.15.106:0/1592633922 >> v1:172.21.15.132:6789/0 conn(0x7f3ecc04b440 legacy=0x7f3ecc03e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.133+0000 7f3ed8ed3640 1 -- 172.21.15.106:0/1592633922 >> v1:172.21.15.106:6789/0 conn(0x7f3ecc0e2580 legacy=0x7f3ecc0e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.133+0000 7f3ed8ed3640 1 -- 172.21.15.106:0/1592633922 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0df0a0 con 0x7f3ecc00b910 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.133+0000 7f1f55cc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f4802aed0 0x7f1f4802c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.133+0000 7f1f564ca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f4800b7c0 0x7f1f48173470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.133+0000 7f1f564ca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f4800b7c0 0x7f1f48173470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40112/0 (socket says 172.21.15.106:40112) 2023-12-22T09:15:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.133+0000 7f1f564ca640 1 -- 172.21.15.106:0/467131207 learned_addr learned my addr 172.21.15.106:0/467131207 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.134+0000 7f1f56ccb640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f480d3af0 0x7f1f480caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f34991ce640 1 -- 172.21.15.106:0/778690766 >> v1:172.21.15.106:6789/0 conn(0x7f348c0d4750 legacy=0x7f348c0072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.132+0000 7f34937fe640 1 -- 172.21.15.106:0/778690766 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916990927 0 0) 0x7f348c0da530 con 0x7f348c04dbb0 2023-12-22T09:15:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.133+0000 7f34991ce640 1 -- 172.21.15.106:0/778690766 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0da7f0 con 0x7f348c04e0c0 2023-12-22T09:15:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.134+0000 7f34991ce640 1 --2- 172.21.15.106:0/778690766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c04e0c0 0x7f348c04f160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34800097d0 tx=0x7f348002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f42425ff120bea7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.134+0000 7f02ecd2e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806c940 0x7f02e81dfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.134+0000 7f02ecd2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e80c0b70 0x7f02e814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.134+0000 7f02ecd2e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02e814d2e0 0x7f02e814b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f02ecd2e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8145a80 con 0x7f02e806c940 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f02ecd2e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e814aba0 con 0x7f02e80c0b70 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f02ecd2e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8145cf0 con 0x7f02e814d2e0 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f02e659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806c940 0x7f02e81dfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f02e659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806c940 0x7f02e81dfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41134/0 (socket says 172.21.15.106:41134) 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f02e659c640 1 -- 172.21.15.106:0/2318604137 learned_addr learned my addr 172.21.15.106:0/2318604137 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f02ddd9b640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e80c0b70 0x7f02e814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f34937fe640 1 -- 172.21.15.106:0/778690766 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348002d040 con 0x7f348c04e0c0 2023-12-22T09:15:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f02e6d9d640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02e814d2e0 0x7f02e814b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f34937fe640 1 -- 172.21.15.106:0/778690766 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3480031810 con 0x7f348c04e0c0 2023-12-22T09:15:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f34937fe640 1 -- 172.21.15.106:0/778690766 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480031ba0 con 0x7f348c04e0c0 2023-12-22T09:15:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f1f55cc9640 1 -- 172.21.15.106:0/467131207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f480d3af0 msgr2=0x7f1f480caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f1f55cc9640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f480d3af0 0x7f1f480caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f1f55cc9640 1 -- 172.21.15.106:0/467131207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f4800b7c0 msgr2=0x7f1f48173470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f1f55cc9640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f4800b7c0 0x7f1f48173470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.135+0000 7f1f55cc9640 1 -- 172.21.15.106:0/467131207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c00ae30 con 0x7f1f4802aed0 2023-12-22T09:15:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f02e659c640 1 -- 172.21.15.106:0/2318604137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02e814d2e0 msgr2=0x7f02e814b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f02e659c640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02e814d2e0 0x7f02e814b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f02e659c640 1 -- 172.21.15.106:0/2318604137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e80c0b70 msgr2=0x7f02e814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f34999cf640 1 -- 172.21.15.106:0/778690766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c04e0c0 msgr2=0x7f348c04f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f34999cf640 1 --2- 172.21.15.106:0/778690766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c04e0c0 0x7f348c04f160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34800097d0 tx=0x7f348002b8b0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f1f55cc9640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f4802aed0 0x7f1f4802c570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c750 tx=0x7f1f4000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f34999cf640 1 -- 172.21.15.106:0/778690766 shutdown_connections 2023-12-22T09:15:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f34999cf640 1 --2- 172.21.15.106:0/778690766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c04e0c0 0x7f348c04f160 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f34999cf640 1 -- 172.21.15.106:0/778690766 >> 172.21.15.106:0/778690766 conn(0x7f348c04c730 msgr2=0x7f348c04cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.136+0000 7f02e659c640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e80c0b70 0x7f02e814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f34999cf640 1 -- 172.21.15.106:0/778690766 shutdown_connections 2023-12-22T09:15:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f02e659c640 1 -- 172.21.15.106:0/2318604137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d000b6a0 con 0x7f02e806c940 2023-12-22T09:15:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f3ed8ed3640 1 --2- 172.21.15.106:0/1592633922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc00b910 0x7f3ecc0e2040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097d0 tx=0x7f3ed002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bcbeca06309eca7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f34999cf640 1 -- 172.21.15.106:0/778690766 wait complete. 2023-12-22T09:15:00.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f02ddd9b640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e80c0b70 0x7f02e814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:15:00.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f1f46ffd640 1 -- 172.21.15.106:0/467131207 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400070d0 con 0x7f1f4802aed0 2023-12-22T09:15:00.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f3ecbfff640 1 -- 172.21.15.106:0/1592633922 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed002d040 con 0x7f3ecc00b910 2023-12-22T09:15:00.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f3ecbfff640 1 -- 172.21.15.106:0/1592633922 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0031810 con 0x7f3ecc00b910 2023-12-22T09:15:00.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f3ecbfff640 1 -- 172.21.15.106:0/1592633922 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0031b80 con 0x7f3ecc00b910 2023-12-22T09:15:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f1f46ffd640 1 -- 172.21.15.106:0/467131207 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40007230 con 0x7f1f4802aed0 2023-12-22T09:15:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f1f46ffd640 1 -- 172.21.15.106:0/467131207 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40007620 con 0x7f1f4802aed0 2023-12-22T09:15:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.137+0000 7f02e659c640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806c940 0x7f02e81dfde0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f02d003a040 tx=0x7f02d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.138+0000 7f02df7fe640 1 -- 172.21.15.106:0/2318604137 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0006d10 con 0x7f02e806c940 2023-12-22T09:15:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.138+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4802f0e0 con 0x7f1f4802aed0 2023-12-22T09:15:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.138+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4802f6a0 con 0x7f1f4802aed0 2023-12-22T09:15:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f02df7fe640 1 -- 172.21.15.106:0/2318604137 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d000b240 con 0x7f02e806c940 2023-12-22T09:15:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f02df7fe640 1 -- 172.21.15.106:0/2318604137 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0003a60 con 0x7f02e806c940 2023-12-22T09:15:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f3eda6d6640 1 -- 172.21.15.106:0/1592633922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc00b910 msgr2=0x7f3ecc0e2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f3eda6d6640 1 --2- 172.21.15.106:0/1592633922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc00b910 0x7f3ecc0e2040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097d0 tx=0x7f3ed002b8b0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f34999cf640 1 Processor -- start 2023-12-22T09:15:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f48005340 con 0x7f1f4802aed0 2023-12-22T09:15:00.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f69985f0640 1 Processor -- start 2023-12-22T09:15:00.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f3eda6d6640 1 -- 172.21.15.106:0/1592633922 shutdown_connections 2023-12-22T09:15:00.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f3eda6d6640 1 --2- 172.21.15.106:0/1592633922 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc00b910 0x7f3ecc0e2040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.139+0000 7f3eda6d6640 1 -- 172.21.15.106:0/1592633922 >> 172.21.15.106:0/1592633922 conn(0x7f3ecc0483a0 msgr2=0x7f3ecc0487b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.140+0000 7f69985f0640 1 -- start start 2023-12-22T09:15:00.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.140+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e81de490 con 0x7f02e806c940 2023-12-22T09:15:00.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.140+0000 7f34999cf640 1 -- start start 2023-12-22T09:15:00.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.140+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e8148a00 con 0x7f02e806c940 2023-12-22T09:15:00.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.140+0000 7fbfc5473640 1 Processor -- start 2023-12-22T09:15:00.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.140+0000 7f3eda6d6640 1 -- 172.21.15.106:0/1592633922 shutdown_connections 2023-12-22T09:15:00.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.141+0000 7f34999cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c04dbb0 0x7f348c0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.141+0000 7f34999cf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f348c04e0c0 0x7f348c02f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f34999cf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0d4750 0x7f348c02fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f34999cf640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c030ce0 con 0x7f348c04e0c0 2023-12-22T09:15:00.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f34999cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c170200 con 0x7f348c04dbb0 2023-12-22T09:15:00.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e804e8d0 con 0x7f02e806c940 2023-12-22T09:15:00.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f69985f0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990069e60 0x7f69901551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f69985f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f699015c070 0x7f6990155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f34999cf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c1704e0 con 0x7f348c0d4750 2023-12-22T09:15:00.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f69985f0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699006fe60 con 0x7f6990070480 2023-12-22T09:15:00.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f69985f0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699015c5e0 con 0x7f699015c070 2023-12-22T09:15:00.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f69985f0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6990070140 con 0x7f6990069e60 2023-12-22T09:15:00.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.141+0000 7f3eda6d6640 1 -- 172.21.15.106:0/1592633922 wait complete. 2023-12-22T09:15:00.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.141+0000 7fbfc5473640 1 -- start start 2023-12-22T09:15:00.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f1f46ffd640 1 -- 172.21.15.106:0/467131207 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1f400047e0 con 0x7f1f4802aed0 2023-12-22T09:15:00.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7f6996b8d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6990070480 0x7f69900bfce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33324/0 (socket says 172.21.15.106:33324) 2023-12-22T09:15:00.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7f6996b8d640 1 -- 172.21.15.106:0/3553893842 learned_addr learned my addr 172.21.15.106:0/3553893842 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:00.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.142+0000 7f34989cd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c04dbb0 0x7f348c0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7f34989cd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c04dbb0 0x7f348c0c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40142/0 (socket says 172.21.15.106:40142) 2023-12-22T09:15:00.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7f34989cd640 1 -- 172.21.15.106:0/3484327831 learned_addr learned my addr 172.21.15.106:0/3484327831 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:00.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7f699638c640 1 --2- 172.21.15.106:0/3553893842 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990069e60 0x7f69901551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7f3eda6d6640 1 Processor -- start 2023-12-22T09:15:00.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7fbfc5473640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbfb80dbfe0 0x7fbfb80df1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7fbfc5473640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb800e200 con 0x7fbfb804db10 2023-12-22T09:15:00.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7fbfc5473640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb804a520 con 0x7fbfb800e9c0 2023-12-22T09:15:00.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7fbfc5473640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb80df720 con 0x7fbfb80dbfe0 2023-12-22T09:15:00.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.143+0000 7f6995b8b640 1 --2- 172.21.15.106:0/3553893842 >> v2:172.21.15.132:3300/0 conn(0x7f699015c070 0x7f6990155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7f3493fff640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f348c04e0c0 0x7f348c02f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7f34991ce640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0d4750 0x7f348c02fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7f3eda6d6640 1 -- start start 2023-12-22T09:15:00.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7f1f46ffd640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1f3406a430 0x7f1f3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7f1f46ffd640 1 -- 172.21.15.106:0/467131207 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f40087e50 con 0x7f1f4802aed0 2023-12-22T09:15:00.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7fbfc4c72640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbfb800e9c0 0x7fbfb80e90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33328/0 (socket says 172.21.15.106:33328) 2023-12-22T09:15:00.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7fbfc4c72640 1 -- 172.21.15.106:0/1039856678 learned_addr learned my addr 172.21.15.106:0/1039856678 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:00.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7f699638c640 1 -- 172.21.15.106:0/3553893842 >> v2:172.21.15.132:3300/0 conn(0x7f699015c070 msgr2=0x7f6990155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:00.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7f699638c640 1 --2- 172.21.15.106:0/3553893842 >> v2:172.21.15.132:3300/0 conn(0x7f699015c070 0x7f6990155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7f699638c640 1 -- 172.21.15.106:0/3553893842 >> v1:172.21.15.132:6789/0 conn(0x7f6990070480 legacy=0x7f69900bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.144+0000 7f699638c640 1 -- 172.21.15.106:0/3553893842 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900c1440 con 0x7f6990069e60 2023-12-22T09:15:00.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f1f564ca640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1f3406a430 0x7f1f3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f34989cd640 1 -- 172.21.15.106:0/3484327831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0d4750 msgr2=0x7f348c02fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f34989cd640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0d4750 0x7f348c02fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f34989cd640 1 -- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f348c04e0c0 msgr2=0x7f348c02f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f34989cd640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f348c04e0c0 0x7f348c02f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f34989cd640 1 -- 172.21.15.106:0/3484327831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3480009400 con 0x7f348c04dbb0 2023-12-22T09:15:00.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f3eda6d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ecc00b910 0x7f3ecc02f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f3eda6d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc04b440 0x7f3ecc0db220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f3eda6d6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ecc0e2580 0x7f3ecc174110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f3eda6d6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc02f970 con 0x7f3ecc0e2580 2023-12-22T09:15:00.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f3eda6d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc030f00 con 0x7f3ecc00b910 2023-12-22T09:15:00.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f3eda6d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc031760 con 0x7f3ecc04b440 2023-12-22T09:15:00.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682932081 0 0) 0x7fbfb804a520 con 0x7fbfb800e9c0 2023-12-22T09:15:00.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb0003520 con 0x7fbfb800e9c0 2023-12-22T09:15:00.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.145+0000 7f34989cd640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c04dbb0 0x7f348c0c9070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3494069350 tx=0x7f3494067010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f3ed9ed5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ecc0e2580 0x7f3ecc174110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f3ed96d4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ecc00b910 0x7f3ecc02f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f1f564ca640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1f3406a430 0x7f1f3406c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00ab70 tx=0x7f1f4c00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f34917fa640 1 -- 172.21.15.106:0/3484327831 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34940734a0 con 0x7f348c04dbb0 2023-12-22T09:15:00.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f3ed9ed5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ecc0e2580 0x7f3ecc174110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41166/0 (socket says 172.21.15.106:41166) 2023-12-22T09:15:00.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f34917fa640 1 -- 172.21.15.106:0/3484327831 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494073640 con 0x7f348c04dbb0 2023-12-22T09:15:00.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f34917fa640 1 -- 172.21.15.106:0/3484327831 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494091640 con 0x7f348c04dbb0 2023-12-22T09:15:00.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f3ed9ed5640 1 -- 172.21.15.106:0/3231390487 learned_addr learned my addr 172.21.15.106:0/3231390487 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:00.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c0070a0 con 0x7f348c04dbb0 2023-12-22T09:15:00.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f3ed9ed5640 1 -- 172.21.15.106:0/3231390487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc04b440 msgr2=0x7f3ecc0db220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-22T09:15:00.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f3ed9ed5640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc04b440 0x7f3ecc0db220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f3ed9ed5640 1 -- 172.21.15.106:0/3231390487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ecc00b910 msgr2=0x7f3ecc02f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f3ed9ed5640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ecc00b910 0x7f3ecc02f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7f3ed9ed5640 1 -- 172.21.15.106:0/3231390487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0009400 con 0x7f3ecc0e2580 2023-12-22T09:15:00.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.146+0000 7fbfbffff640 1 --2- 172.21.15.106:0/1039856678 >> v2:172.21.15.106:3300/0 conn(0x7fbfb80dbfe0 0x7fbfb80df1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 312266785 0 0) 0x7fbfb0003520 con 0x7fbfb800e9c0 2023-12-22T09:15:00.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 >> v2:172.21.15.106:3300/0 conn(0x7fbfb80dbfe0 msgr2=0x7fbfb80df1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:00.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 --2- 172.21.15.106:0/1039856678 >> v2:172.21.15.106:3300/0 conn(0x7fbfb80dbfe0 0x7fbfb80df1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 >> v1:172.21.15.106:6789/0 conn(0x7fbfb804db10 legacy=0x7fbfb8007170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb804a7e0 con 0x7fbfb800e9c0 2023-12-22T09:15:00.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fbfc0072b30 con 0x7fbfb800e9c0 2023-12-22T09:15:00.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7f3ed9ed5640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ecc0e2580 0x7f3ecc174110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400c340 tx=0x7f3ec400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c0c95b0 con 0x7f348c04dbb0 2023-12-22T09:15:00.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 >> v1:172.21.15.132:6789/0 conn(0x7fbfb800e9c0 legacy=0x7fbfb80e90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbfb0003970 0x7fbfb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 0x7fbfb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb0005180 0x7fbfb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80df720 con 0x7fbfb0005180 2023-12-22T09:15:00.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb000bfa0 con 0x7fbfb00047c0 2023-12-22T09:15:00.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7f699638c640 1 --2- 172.21.15.106:0/3553893842 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990069e60 0x7f69901551f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6980009790 tx=0x7f698002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a3ccd83f2bfb9c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7f699538a640 1 -- 172.21.15.106:0/3553893842 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698002d040 con 0x7f6990069e60 2023-12-22T09:15:00.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7f699538a640 1 -- 172.21.15.106:0/3553893842 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6980031810 con 0x7f6990069e60 2023-12-22T09:15:00.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7f699538a640 1 -- 172.21.15.106:0/3553893842 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980031ba0 con 0x7f6990069e60 2023-12-22T09:15:00.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbf7fe640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 0x7fbfb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.147+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb000c160 con 0x7fbfb0003970 2023-12-22T09:15:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.148+0000 7fbfc4c72640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb0005180 0x7fbfb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c170620 con 0x7f348c04dbb0 2023-12-22T09:15:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.148+0000 7f69985f0640 1 -- 172.21.15.106:0/3553893842 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990069e60 msgr2=0x7f69901551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.148+0000 7f69985f0640 1 --2- 172.21.15.106:0/3553893842 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990069e60 0x7f69901551f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6980009790 tx=0x7f698002b8b0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7f69985f0640 1 -- 172.21.15.106:0/3553893842 shutdown_connections 2023-12-22T09:15:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7f69985f0640 1 --2- 172.21.15.106:0/3553893842 >> v2:172.21.15.132:3300/0 conn(0x7f699015c070 0x7f6990155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7f69985f0640 1 --2- 172.21.15.106:0/3553893842 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990069e60 0x7f69901551f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7f69985f0640 1 -- 172.21.15.106:0/3553893842 >> 172.21.15.106:0/3553893842 conn(0x7f69900c5360 msgr2=0x7f69900c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7f69985f0640 1 -- 172.21.15.106:0/3553893842 shutdown_connections 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7f69985f0640 1 -- 172.21.15.106:0/3553893842 wait complete. 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f69985f0640 1 Processor -- start 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f69985f0640 1 -- start start 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7f3d705c9640 1 Processor -- start 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7f3d705c9640 1 -- start start 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f3d705c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d68069e60 0x7f3d681551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f3d705c9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d6815c070 0x7f3d68155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f3d705c9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6806fe60 con 0x7f3d68070480 2023-12-22T09:15:00.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f3d705c9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6815c5e0 con 0x7f3d6815c070 2023-12-22T09:15:00.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f3d705c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d68070140 con 0x7f3d68069e60 2023-12-22T09:15:00.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f3d6db64640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d6815c070 0x7f3d68155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f3d6db64640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d6815c070 0x7f3d68155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41186/0 (socket says 172.21.15.106:41186) 2023-12-22T09:15:00.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f3d6db64640 1 -- 172.21.15.106:0/1396198240 learned_addr learned my addr 172.21.15.106:0/1396198240 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:00.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f3d6e365640 1 --2- 172.21.15.106:0/1396198240 >> v2:172.21.15.132:3300/0 conn(0x7f3d68069e60 0x7f3d681551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.148+0000 7fbfbffff640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbfb0003970 0x7fbfb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f3d6db64640 1 -- 172.21.15.106:0/1396198240 >> v2:172.21.15.132:3300/0 conn(0x7f3d68069e60 msgr2=0x7f3d681551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:00.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f3d6db64640 1 --2- 172.21.15.106:0/1396198240 >> v2:172.21.15.132:3300/0 conn(0x7f3d68069e60 0x7f3d681551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f3d6db64640 1 -- 172.21.15.106:0/1396198240 >> v1:172.21.15.106:6789/0 conn(0x7f3d68070480 legacy=0x7f3d680bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:00.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7fbfbf7fe640 1 -- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbfb0003970 msgr2=0x7fbfb0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:00.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7fbfbf7fe640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbfb0003970 0x7fbfb0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7fbfbf7fe640 1 -- 172.21.15.106:0/1039856678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb0005180 msgr2=0x7fbfb000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:00.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7fbfbf7fe640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb0005180 0x7fbfb000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7fbfbf7fe640 1 -- 172.21.15.106:0/1039856678 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb804a7e0 con 0x7fbfb00047c0 2023-12-22T09:15:00.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.149+0000 7fbfc4c72640 1 -- 172.21.15.106:0/1039856678 reap_dead start 2023-12-22T09:15:00.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.150+0000 7fbfbf7fe640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 0x7fbfb0004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbfac001750 tx=0x7fbfb00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb9299341d0047f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f69985f0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6990069e60 0x7f699015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f69985f0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990070480 0x7f6990154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f69985f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f699015c070 0x7f69900c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f69985f0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699015ae40 con 0x7f6990069e60 2023-12-22T09:15:00.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f69985f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990158c10 con 0x7f699015c070 2023-12-22T09:15:00.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f69985f0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699015b070 con 0x7f6990070480 2023-12-22T09:15:00.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.151+0000 7f34917fa640 1 -- 172.21.15.106:0/3484327831 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f34940917a0 con 0x7f348c04dbb0 2023-12-22T09:15:00.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f699638c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6990069e60 0x7f699015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f699638c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6990069e60 0x7f699015a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41196/0 (socket says 172.21.15.106:41196) 2023-12-22T09:15:00.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f699638c640 1 -- 172.21.15.106:0/568092204 learned_addr learned my addr 172.21.15.106:0/568092204 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:00.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f6996b8d640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f699015c070 0x7f69900c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7f3d6db64640 1 -- 172.21.15.106:0/1396198240 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d680c1440 con 0x7f3d6815c070 2023-12-22T09:15:00.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0052d0 con 0x7fbfb00047c0 2023-12-22T09:15:00.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac02e050 con 0x7fbfb00047c0 2023-12-22T09:15:00.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.152+0000 7fbfbeffd640 1 -- 172.21.15.106:0/1039856678 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac003830 con 0x7fbfb00047c0 2023-12-22T09:15:00.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7fbfc5473640 1 -- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 msgr2=0x7fbfb0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7f6995b8b640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990070480 0x7f6990154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7fbfc5473640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 0x7fbfb0004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbfac001750 tx=0x7fbfb00057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7fbfc5473640 1 -- 172.21.15.106:0/1039856678 shutdown_connections 2023-12-22T09:15:00.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7fbfc5473640 1 --2- 172.21.15.106:0/1039856678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 0x7fbfb0004c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7fbfc5473640 1 -- 172.21.15.106:0/1039856678 >> 172.21.15.106:0/1039856678 conn(0x7fbfb804c620 msgr2=0x7fbfb804ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7f6996b8d640 1 -- 172.21.15.106:0/568092204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990070480 msgr2=0x7f6990154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7f6996b8d640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990070480 0x7f6990154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7f6996b8d640 1 -- 172.21.15.106:0/568092204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6990069e60 msgr2=0x7f699015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7f6996b8d640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6990069e60 0x7f699015a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7f6996b8d640 1 -- 172.21.15.106:0/568092204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800093a0 con 0x7f699015c070 2023-12-22T09:15:00.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7fbfc5473640 1 -- 172.21.15.106:0/1039856678 shutdown_connections 2023-12-22T09:15:00.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.153+0000 7fbfc5473640 1 -- 172.21.15.106:0/1039856678 wait complete. 2023-12-22T09:15:00.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f34917fa640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f347806a460 0x7f347806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f3d6db64640 1 --2- 172.21.15.106:0/1396198240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d6815c070 0x7f3d68155730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009870 tx=0x7f3d5802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7baae88fb46ab0b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f34917fa640 1 -- 172.21.15.106:0/3484327831 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3494102290 con 0x7f348c04dbb0 2023-12-22T09:15:00.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f3ec9ffb640 1 -- 172.21.15.106:0/3231390487 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4005ce0 con 0x7f3ecc0e2580 2023-12-22T09:15:00.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f3ec9ffb640 1 -- 172.21.15.106:0/3231390487 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4005e40 con 0x7f3ecc0e2580 2023-12-22T09:15:00.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f3ec9ffb640 1 -- 172.21.15.106:0/3231390487 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40072d0 con 0x7f3ecc0e2580 2023-12-22T09:15:00.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f6996b8d640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f699015c070 0x7f69900c36b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f698800cad0 tx=0x7f698800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f3d6d363640 1 -- 172.21.15.106:0/1396198240 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58030860 con 0x7f3d6815c070 2023-12-22T09:15:00.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f3d6d363640 1 -- 172.21.15.106:0/1396198240 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580309c0 con 0x7f3d6815c070 2023-12-22T09:15:00.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f3493fff640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f347806a460 0x7f347806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc0311a0 con 0x7f3ecc0e2580 2023-12-22T09:15:00.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.155+0000 7f1f46ffd640 1 -- 172.21.15.106:0/467131207 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1f40053160 con 0x7f1f4802aed0 2023-12-22T09:15:00.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.155+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc173bf0 con 0x7f3ecc0e2580 2023-12-22T09:15:00.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.154+0000 7f3d6d363640 1 -- 172.21.15.106:0/1396198240 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58030860 con 0x7f3d6815c070 2023-12-22T09:15:00.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.156+0000 7f3493fff640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f347806a460 0x7f347806c920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f348c030a00 tx=0x7f3488007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.156+0000 7f3d705c9640 1 -- 172.21.15.106:0/1396198240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d6815c070 msgr2=0x7f3d68155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.156+0000 7f3d705c9640 1 --2- 172.21.15.106:0/1396198240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d6815c070 0x7f3d68155730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009870 tx=0x7f3d5802b9a0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.156+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc173de0 con 0x7f3ecc0e2580 2023-12-22T09:15:00.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.156+0000 7fbfc5473640 1 Processor -- start 2023-12-22T09:15:00.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.156+0000 7f3d705c9640 1 -- 172.21.15.106:0/1396198240 shutdown_connections 2023-12-22T09:15:00.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.156+0000 7f3d705c9640 1 --2- 172.21.15.106:0/1396198240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d6815c070 0x7f3d68155730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.156+0000 7f3d705c9640 1 --2- 172.21.15.106:0/1396198240 >> v2:172.21.15.132:3300/0 conn(0x7f3d68069e60 0x7f3d681551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.156+0000 7f3d705c9640 1 -- 172.21.15.106:0/1396198240 >> 172.21.15.106:0/1396198240 conn(0x7f3d680c5360 msgr2=0x7f3d680c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.157+0000 7f3d705c9640 1 -- 172.21.15.106:0/1396198240 shutdown_connections 2023-12-22T09:15:00.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.157+0000 7f3d705c9640 1 -- 172.21.15.106:0/1396198240 wait complete. 2023-12-22T09:15:00.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.157+0000 7fbfc5473640 1 -- start start 2023-12-22T09:15:00.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.157+0000 7fbfc5473640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 0x7fbfb8034b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.158+0000 7fbfc5473640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbfb800ee60 0x7fbfb8047460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.158+0000 7fbfc5473640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb80479a0 0x7fbfb8174040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.158+0000 7fbfc5473640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8047e20 con 0x7fbfb80479a0 2023-12-22T09:15:00.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.158+0000 7fbfc5473640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8173a20 con 0x7fbfb00047c0 2023-12-22T09:15:00.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.158+0000 7fbfc5473640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8049280 con 0x7fbfb800ee60 2023-12-22T09:15:00.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.158+0000 7fbfc4c72640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb80479a0 0x7fbfb8174040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.158+0000 7fbfc4c72640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb80479a0 0x7fbfb8174040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41212/0 (socket says 172.21.15.106:41212) 2023-12-22T09:15:00.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.158+0000 7fbfc4c72640 1 -- 172.21.15.106:0/3041693736 learned_addr learned my addr 172.21.15.106:0/3041693736 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:00.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7fbfbf7fe640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbfb800ee60 0x7fbfb8047460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7fbfc4c72640 1 -- 172.21.15.106:0/3041693736 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbfb800ee60 msgr2=0x7fbfb8047460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7fbfc4c72640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbfb800ee60 0x7fbfb8047460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7fbfc4c72640 1 -- 172.21.15.106:0/3041693736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 msgr2=0x7fbfb8034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-22T09:15:00.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7fbfc4c72640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 0x7fbfb8034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7fbfc4c72640 1 -- 172.21.15.106:0/3041693736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb8049da0 con 0x7fbfb80479a0 2023-12-22T09:15:00.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7f3d705c9640 1 Processor -- start 2023-12-22T09:15:00.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7fbfc4c72640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb80479a0 0x7fbfb8174040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0063d60 tx=0x7fbfc006b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.158+0000 7f02df7fe640 1 -- 172.21.15.106:0/2318604137 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02d0003bc0 con 0x7f02e806c940 2023-12-22T09:15:00.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7f02df7fe640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f02c806a430 0x7f02c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7f02df7fe640 1 -- 172.21.15.106:0/2318604137 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02d00ab8e0 con 0x7f02e806c940 2023-12-22T09:15:00.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.159+0000 7f02ddd9b640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f02c806a430 0x7f02c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.160+0000 7f3d705c9640 1 -- start start 2023-12-22T09:15:00.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f02ddd9b640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f02c806a430 0x7f02c806c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02e806aac0 tx=0x7f02d8004ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d705c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d68069e60 0x7f3d6814f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d705c9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d68070480 0x7f3d681edd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d705c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d6815c070 0x7f3d68152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d6db64640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d68070480 0x7f3d681edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d6db64640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d68070480 0x7f3d681edd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41224/0 (socket says 172.21.15.106:41224) 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d6db64640 1 -- 172.21.15.106:0/3065071433 learned_addr learned my addr 172.21.15.106:0/3065071433 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68151b00 con 0x7f3d68070480 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d681ee2a0 con 0x7f3d68069e60 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680c4430 con 0x7f3d6815c070 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.162+0000 7f3d6e365640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d68069e60 0x7f3d6814f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.163+0000 7f3d6eb66640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d6815c070 0x7f3d68152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.163+0000 7f3d6db64640 1 -- 172.21.15.106:0/3065071433 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d6815c070 msgr2=0x7f3d68152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.163+0000 7f3d6db64640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d6815c070 0x7f3d68152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.163+0000 7f3d6db64640 1 -- 172.21.15.106:0/3065071433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d68069e60 msgr2=0x7f3d6814f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.163+0000 7f3d6db64640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d68069e60 0x7f3d6814f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.163+0000 7f3d6db64640 1 -- 172.21.15.106:0/3065071433 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d580094d0 con 0x7f3d68070480 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.163+0000 7f3d6eb66640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d6815c070 0x7f3d68152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:00.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.163+0000 7f3d6db64640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d68070480 0x7f3d681edd60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d5802b9e0 tx=0x7f3d580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.165+0000 7f02df7fe640 1 -- 172.21.15.106:0/2318604137 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02d0076c90 con 0x7f02e806c940 2023-12-22T09:15:00.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.165+0000 7f3d5effd640 1 -- 172.21.15.106:0/3065071433 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5803e070 con 0x7f3d68070480 2023-12-22T09:15:00.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.165+0000 7f3d5effd640 1 -- 172.21.15.106:0/3065071433 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580044c0 con 0x7f3d68070480 2023-12-22T09:15:00.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.165+0000 7f3d5effd640 1 -- 172.21.15.106:0/3065071433 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58003850 con 0x7f3d68070480 2023-12-22T09:15:00.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.166+0000 7fbfbcff9640 1 -- 172.21.15.106:0/3041693736 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc004ef70 con 0x7fbfb80479a0 2023-12-22T09:15:00.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.166+0000 7fbfbcff9640 1 -- 172.21.15.106:0/3041693736 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc0066fb0 con 0x7fbfb80479a0 2023-12-22T09:15:00.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.166+0000 7fbfbcff9640 1 -- 172.21.15.106:0/3041693736 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0073160 con 0x7fbfb80479a0 2023-12-22T09:15:00.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.165+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d680c4710 con 0x7f3d68070480 2023-12-22T09:15:00.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.166+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d680a86e0 con 0x7f3d68070480 2023-12-22T09:15:00.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.166+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb8049500 con 0x7fbfb80479a0 2023-12-22T09:15:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.166+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb8049ac0 con 0x7fbfb80479a0 2023-12-22T09:15:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.167+0000 7f504759e640 1 Processor -- start 2023-12-22T09:15:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.167+0000 7f504759e640 1 -- start start 2023-12-22T09:15:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.167+0000 7f3ec9ffb640 1 -- 172.21.15.106:0/3231390487 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ec4007430 con 0x7f3ecc0e2580 2023-12-22T09:15:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.167+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d680a8900 con 0x7f3d68070480 2023-12-22T09:15:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.168+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb80e0ff0 con 0x7fbfb80479a0 2023-12-22T09:15:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.168+0000 7f3ec9ffb640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3eb806a430 0x7f3eb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.168+0000 7f3ec9ffb640 1 -- 172.21.15.106:0/3231390487 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ec4088800 con 0x7f3ecc0e2580 2023-12-22T09:15:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f3ed96d4640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3eb806a430 0x7f3eb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f504759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f504806e390 0x7f5048151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f504759e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 0x7f5048152010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f504759e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5048154ea0 con 0x7f504814f160 2023-12-22T09:15:00.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f504759e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50480c2120 con 0x7f504806e390 2023-12-22T09:15:00.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f504759e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5048155d00 con 0x7f50480c6e90 2023-12-22T09:15:00.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f6986ffd640 1 -- 172.21.15.106:0/568092204 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800ab70 con 0x7f699015c070 2023-12-22T09:15:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f6986ffd640 1 -- 172.21.15.106:0/568092204 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698800acd0 con 0x7f699015c070 2023-12-22T09:15:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f6986ffd640 1 -- 172.21.15.106:0/568092204 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988012600 con 0x7f699015c070 2023-12-22T09:15:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f504659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f504814f160 0x7f50480c0e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52024/0 (socket says 172.21.15.106:52024) 2023-12-22T09:15:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f504659c640 1 -- 172.21.15.106:0/4213539817 learned_addr learned my addr 172.21.15.106:0/4213539817 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.169+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699015b350 con 0x7f699015c070 2023-12-22T09:15:00.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.170+0000 7f5046d9d640 1 --2- 172.21.15.106:0/4213539817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 0x7f5048152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.170+0000 7f3ed96d4640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3eb806a430 0x7f3eb806c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ed404f2f0 tx=0x7f3ed4061770 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.170+0000 7f5045d9b640 1 --2- 172.21.15.106:0/4213539817 >> v2:172.21.15.132:3300/0 conn(0x7f504806e390 0x7f5048151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.170+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69901588a0 con 0x7f699015c070 2023-12-22T09:15:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.170+0000 7f5046d9d640 1 -- 172.21.15.106:0/4213539817 >> v2:172.21.15.132:3300/0 conn(0x7f504806e390 msgr2=0x7f5048151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.170+0000 7f5046d9d640 1 --2- 172.21.15.106:0/4213539817 >> v2:172.21.15.132:3300/0 conn(0x7f504806e390 0x7f5048151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.170+0000 7f5046d9d640 1 -- 172.21.15.106:0/4213539817 >> v1:172.21.15.106:6789/0 conn(0x7f504814f160 legacy=0x7f50480c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.171+0000 7f5046d9d640 1 -- 172.21.15.106:0/4213539817 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504806e1a0 con 0x7f50480c6e90 2023-12-22T09:15:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.171+0000 7f5045d9b640 1 --2- 172.21.15.106:0/4213539817 >> v2:172.21.15.132:3300/0 conn(0x7f504806e390 0x7f5048151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.171+0000 7f34917fa640 1 -- 172.21.15.106:0/3484327831 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f348c170620 con 0x7f348c04dbb0 2023-12-22T09:15:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.171+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6990073f10 con 0x7f699015c070 2023-12-22T09:15:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.172+0000 7f5046d9d640 1 --2- 172.21.15.106:0/4213539817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 0x7f5048152010 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f50300097a0 tx=0x7f503002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eed22240906567e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.173+0000 7f504559a640 1 -- 172.21.15.106:0/4213539817 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030031780 con 0x7f50480c6e90 2023-12-22T09:15:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.173+0000 7f504559a640 1 -- 172.21.15.106:0/4213539817 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50300318e0 con 0x7f50480c6e90 2023-12-22T09:15:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.173+0000 7f504559a640 1 -- 172.21.15.106:0/4213539817 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030031c70 con 0x7f50480c6e90 2023-12-22T09:15:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.174+0000 7f6986ffd640 1 -- 172.21.15.106:0/568092204 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6988012760 con 0x7f699015c070 2023-12-22T09:15:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.174+0000 7f504759e640 1 -- 172.21.15.106:0/4213539817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 msgr2=0x7f5048152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.174+0000 7f504759e640 1 --2- 172.21.15.106:0/4213539817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 0x7f5048152010 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f50300097a0 tx=0x7f503002b820 comp rx=0 tx=0).stop 2023-12-22T09:15:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.174+0000 7f504759e640 1 -- 172.21.15.106:0/4213539817 shutdown_connections 2023-12-22T09:15:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.174+0000 7f504759e640 1 --2- 172.21.15.106:0/4213539817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 0x7f5048152010 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.174+0000 7f504759e640 1 --2- 172.21.15.106:0/4213539817 >> v2:172.21.15.132:3300/0 conn(0x7f504806e390 0x7f5048151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.174+0000 7f504759e640 1 -- 172.21.15.106:0/4213539817 >> 172.21.15.106:0/4213539817 conn(0x7f50480a7b80 msgr2=0x7f504806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.174+0000 7f504759e640 1 -- 172.21.15.106:0/4213539817 shutdown_connections 2023-12-22T09:15:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.174+0000 7f504759e640 1 -- 172.21.15.106:0/4213539817 wait complete. 2023-12-22T09:15:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.175+0000 7f6986ffd640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f697406a480 0x7f697406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.176+0000 7f6986ffd640 1 -- 172.21.15.106:0/568092204 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69880889d0 con 0x7f699015c070 2023-12-22T09:15:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.176+0000 7f3ec9ffb640 1 -- 172.21.15.106:0/3231390487 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ec4053c20 con 0x7f3ecc0e2580 2023-12-22T09:15:00.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.176+0000 7f699638c640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f697406a480 0x7f697406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.177+0000 7f504759e640 1 Processor -- start 2023-12-22T09:15:00.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.177+0000 7f504759e640 1 -- start start 2023-12-22T09:15:00.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.178+0000 7f699638c640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f697406a480 0x7f697406c940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6980009150 tx=0x7f698003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.179+0000 7f504759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504806e390 0x7f5048151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.180+0000 7f504759e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 0x7f504806b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.180+0000 7f504759e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f504814f160 0x7f5048154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.180+0000 7f504659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504806e390 0x7f5048151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.180+0000 7f3d5effd640 1 -- 172.21.15.106:0/3065071433 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3d58042070 con 0x7f3d68070480 2023-12-22T09:15:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.180+0000 7f504659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504806e390 0x7f5048151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40198/0 (socket says 172.21.15.106:40198) 2023-12-22T09:15:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.180+0000 7f504659c640 1 -- 172.21.15.106:0/1587141556 learned_addr learned my addr 172.21.15.106:0/1587141556 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.180+0000 7fbfbcff9640 1 -- 172.21.15.106:0/3041693736 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfc00732c0 con 0x7fbfb80479a0 2023-12-22T09:15:00.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.180+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481e7340 con 0x7f504814f160 2023-12-22T09:15:00.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.181+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50481e7620 con 0x7f504806e390 2023-12-22T09:15:00.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.181+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504806aca0 con 0x7f50480c6e90 2023-12-22T09:15:00.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.182+0000 7f5046d9d640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f504814f160 0x7f5048154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.182+0000 7f3d5effd640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d4c06a500 0x7f3d4c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.182+0000 7fbfbcff9640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbfa406a500 0x7fbfa406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.182+0000 7f504659c640 1 -- 172.21.15.106:0/1587141556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 msgr2=0x7f504806b780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-22T09:15:00.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.182+0000 7f504659c640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 0x7f504806b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.182+0000 7f504659c640 1 -- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f504814f160 msgr2=0x7f5048154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.183+0000 7f504659c640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f504814f160 0x7f5048154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.182+0000 7fbfbcff9640 1 -- 172.21.15.106:0/3041693736 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbfc0102840 con 0x7fbfb80479a0 2023-12-22T09:15:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.182+0000 7f3d5effd640 1 -- 172.21.15.106:0/3065071433 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d580ab070 con 0x7f3d68070480 2023-12-22T09:15:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.183+0000 7f3d6e365640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d4c06a500 0x7f3d4c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.183+0000 7f504659c640 1 -- 172.21.15.106:0/1587141556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038009400 con 0x7f504806e390 2023-12-22T09:15:00.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.184+0000 7fbfbffff640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbfa406a500 0x7fbfa406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.184+0000 7f504659c640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504806e390 0x7f5048151200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f504000cb10 tx=0x7f504000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.184+0000 7f3d6e365640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d4c06a500 0x7f3d4c06c9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400ba40 tx=0x7f3d64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.185+0000 7fbfbffff640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbfa406a500 0x7fbfa406c9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4006fd0 tx=0x7fbfb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.186+0000 7f3d5effd640 1 -- 172.21.15.106:0/3065071433 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3d580763e0 con 0x7f3d68070480 2023-12-22T09:15:00.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.188+0000 7f503effd640 1 -- 172.21.15.106:0/1587141556 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000ac70 con 0x7f504806e390 2023-12-22T09:15:00.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.188+0000 7f503effd640 1 -- 172.21.15.106:0/1587141556 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504000add0 con 0x7f504806e390 2023-12-22T09:15:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.188+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5030009400 con 0x7f504806e390 2023-12-22T09:15:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.188+0000 7f503effd640 1 -- 172.21.15.106:0/1587141556 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040012620 con 0x7f504806e390 2023-12-22T09:15:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.188+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504806b260 con 0x7f504806e390 2023-12-22T09:15:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.190+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502c005250 con 0x7f504806e390 2023-12-22T09:15:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.193+0000 7f503effd640 1 -- 172.21.15.106:0/1587141556 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5040035be0 con 0x7f504806e390 2023-12-22T09:15:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.193+0000 7f6986ffd640 1 -- 172.21.15.106:0/568092204 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6988053d60 con 0x7f699015c070 2023-12-22T09:15:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.194+0000 7fbfbcff9640 1 -- 172.21.15.106:0/3041693736 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbfc00cdbb0 con 0x7fbfb80479a0 2023-12-22T09:15:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.194+0000 7f503effd640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f502806a500 0x7f502806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.194+0000 7f503effd640 1 -- 172.21.15.106:0/1587141556 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5040088bb0 con 0x7f504806e390 2023-12-22T09:15:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.195+0000 7f5045d9b640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f502806a500 0x7f502806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.199+0000 7f5045d9b640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f502806a500 0x7f502806c9c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f50480c3b70 tx=0x7f5038009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.204+0000 7f503effd640 1 -- 172.21.15.106:0/1587141556 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5040053fd0 con 0x7f504806e390 2023-12-22T09:15:00.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.570+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f4802f830 con 0x7f1f4802aed0 2023-12-22T09:15:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.571+0000 7f1f46ffd640 1 -- 172.21.15.106:0/467131207 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f40018070 con 0x7f1f4802aed0 2023-12-22T09:15:00.574 INFO:teuthology.orchestra.run.smithi106.stdout:60129542154 2023-12-22T09:15:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.575+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f02e804e8d0 con 0x7f02e806c940 2023-12-22T09:15:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.575+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1f3406a430 msgr2=0x7f1f3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.575+0000 7f1f5872e640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1f3406a430 0x7f1f3406c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00ab70 tx=0x7f1f4c00a000 comp rx=0 tx=0).stop 2023-12-22T09:15:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.575+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f4802aed0 msgr2=0x7f1f4802c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.575+0000 7f1f5872e640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f4802aed0 0x7f1f4802c570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c750 tx=0x7f1f4000cc10 comp rx=0 tx=0).stop 2023-12-22T09:15:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.576+0000 7f02df7fe640 1 -- 172.21.15.106:0/2318604137 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f02d007a270 con 0x7f02e806c940 2023-12-22T09:15:00.576 INFO:teuthology.orchestra.run.smithi106.stdout:60129542154 2023-12-22T09:15:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.577+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 shutdown_connections 2023-12-22T09:15:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.577+0000 7f1f5872e640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1f3406a430 0x7f1f3406c8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.577+0000 7f1f5872e640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f480d3af0 0x7f1f480caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.577+0000 7f1f5872e640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f4802aed0 0x7f1f4802c570 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.577+0000 7f1f5872e640 1 --2- 172.21.15.106:0/467131207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f4800b7c0 0x7f1f48173470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.577+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 >> 172.21.15.106:0/467131207 conn(0x7f1f48005ed0 msgr2=0x7f1f48005550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.577+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 shutdown_connections 2023-12-22T09:15:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.578+0000 7f1f5872e640 1 -- 172.21.15.106:0/467131207 wait complete. 2023-12-22T09:15:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.579+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f02c806a430 msgr2=0x7f02c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.579+0000 7f02ecd2e640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f02c806a430 0x7f02c806c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02e806aac0 tx=0x7f02d8004ec0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.579+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806c940 msgr2=0x7f02e81dfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.579+0000 7f02ecd2e640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806c940 0x7f02e81dfde0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f02d003a040 tx=0x7f02d00046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.580+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 shutdown_connections 2023-12-22T09:15:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.580+0000 7f02ecd2e640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f02c806a430 0x7f02c806c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.580+0000 7f02ecd2e640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02e814d2e0 0x7f02e814b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.580+0000 7f02ecd2e640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02e80c0b70 0x7f02e814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.580+0000 7f02ecd2e640 1 --2- 172.21.15.106:0/2318604137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806c940 0x7f02e81dfde0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.580+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 >> 172.21.15.106:0/2318604137 conn(0x7f02e8069bf0 msgr2=0x7f02e80c1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.581+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 shutdown_connections 2023-12-22T09:15:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.581+0000 7f02ecd2e640 1 -- 172.21.15.106:0/2318604137 wait complete. 2023-12-22T09:15:00.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.590+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f348c170620 con 0x7f348c04dbb0 2023-12-22T09:15:00.591 INFO:teuthology.orchestra.run.smithi106.stdout:60129542154 2023-12-22T09:15:00.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.591+0000 7f34917fa640 1 -- 172.21.15.106:0/3484327831 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f348c170620 con 0x7f348c04dbb0 2023-12-22T09:15:00.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.594+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f347806a460 msgr2=0x7f347806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.595+0000 7f34999cf640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f347806a460 0x7f347806c920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f348c030a00 tx=0x7f3488007c00 comp rx=0 tx=0).stop 2023-12-22T09:15:00.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.595+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c04dbb0 msgr2=0x7f348c0c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.595+0000 7f34999cf640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c04dbb0 0x7f348c0c9070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3494069350 tx=0x7f3494067010 comp rx=0 tx=0).stop 2023-12-22T09:15:00.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.598+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 shutdown_connections 2023-12-22T09:15:00.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.598+0000 7f34999cf640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f347806a460 0x7f347806c920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.598+0000 7f34999cf640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0d4750 0x7f348c02fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.598+0000 7f34999cf640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f348c04e0c0 0x7f348c02f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.598+0000 7f34999cf640 1 --2- 172.21.15.106:0/3484327831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c04dbb0 0x7f348c0c9070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.598+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 >> 172.21.15.106:0/3484327831 conn(0x7f348c04c730 msgr2=0x7f348c0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.598+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 shutdown_connections 2023-12-22T09:15:00.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.598+0000 7f34999cf640 1 -- 172.21.15.106:0/3484327831 wait complete. 2023-12-22T09:15:00.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.600+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3ecc005490 con 0x7f3ecc0e2580 2023-12-22T09:15:00.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.601+0000 7f3ec9ffb640 1 -- 172.21.15.106:0/3231390487 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ec4021020 con 0x7f3ecc0e2580 2023-12-22T09:15:00.602 INFO:teuthology.orchestra.run.smithi106.stdout:60129542154 2023-12-22T09:15:00.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.606+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3eb806a430 msgr2=0x7f3eb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.0 2023-12-22T09:15:00.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.606+0000 7f3eda6d6640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3eb806a430 0x7f3eb806c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ed404f2f0 tx=0x7f3ed4061770 comp rx=0 tx=0).stop 2023-12-22T09:15:00.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.606+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ecc0e2580 msgr2=0x7f3ecc174110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.606+0000 7f3eda6d6640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ecc0e2580 0x7f3ecc174110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400c340 tx=0x7f3ec400c800 comp rx=0 tx=0).stop 2023-12-22T09:15:00.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.607+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 shutdown_connections 2023-12-22T09:15:00.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.607+0000 7f3eda6d6640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3eb806a430 0x7f3eb806c8f0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ed404f2f0 tx=0x7f3ed4061770 comp rx=0 tx=0).stop 2023-12-22T09:15:00.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.607+0000 7f3eda6d6640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3ecc0e2580 0x7f3ecc174110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.607+0000 7f3eda6d6640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ecc04b440 0x7f3ecc0db220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.607+0000 7f3eda6d6640 1 --2- 172.21.15.106:0/3231390487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ecc00b910 0x7f3ecc02f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.607+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 >> 172.21.15.106:0/3231390487 conn(0x7f3ecc0483a0 msgr2=0x7f3ecc0056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.608+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 shutdown_connections 2023-12-22T09:15:00.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.608+0000 7f3eda6d6640 1 -- 172.21.15.106:0/3231390487 wait complete. 2023-12-22T09:15:00.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.1 2023-12-22T09:15:00.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.610+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbfb80e0ff0 con 0x7fbfb80479a0 2023-12-22T09:15:00.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.611+0000 7fbfbcff9640 1 -- 172.21.15.106:0/3041693736 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbfb80e0ff0 con 0x7fbfb80479a0 2023-12-22T09:15:00.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.611+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3d68073f10 con 0x7f3d68070480 2023-12-22T09:15:00.611 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:15:00.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.612+0000 7f3d5effd640 1 -- 172.21.15.106:0/3065071433 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d58079a00 con 0x7f3d68070480 2023-12-22T09:15:00.612 INFO:teuthology.orchestra.run.smithi106.stdout:60129542154 2023-12-22T09:15:00.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.612+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6990157cb0 con 0x7f699015c070 2023-12-22T09:15:00.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.613+0000 7f6986ffd640 1 -- 172.21.15.106:0/568092204 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6988057380 con 0x7f699015c070 2023-12-22T09:15:00.613 INFO:teuthology.orchestra.run.smithi106.stdout:60129542154 2023-12-22T09:15:00.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbfa406a500 msgr2=0x7fbfa406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbfa406a500 0x7fbfa406c9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4006fd0 tx=0x7fbfb4008040 comp rx=0 tx=0).stop 2023-12-22T09:15:00.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb80479a0 msgr2=0x7fbfb8174040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb80479a0 0x7fbfb8174040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0063d60 tx=0x7fbfc006b710 comp rx=0 tx=0).stop 2023-12-22T09:15:00.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 shutdown_connections 2023-12-22T09:15:00.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbfa406a500 0x7fbfa406c9c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb80479a0 0x7fbfb8174040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbfb800ee60 0x7fbfb8047460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 --2- 172.21.15.106:0/3041693736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfb00047c0 0x7fbfb8034b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.614+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 >> 172.21.15.106:0/3041693736 conn(0x7fbfb804c620 msgr2=0x7fbfb80deed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.615+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 shutdown_connections 2023-12-22T09:15:00.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.615+0000 7fbfc5473640 1 -- 172.21.15.106:0/3041693736 wait complete. 2023-12-22T09:15:00.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d4c06a500 msgr2=0x7f3d4c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d4c06a500 0x7f3d4c06c9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400ba40 tx=0x7f3d64008040 comp rx=0 tx=0).stop 2023-12-22T09:15:00.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d68070480 msgr2=0x7f3d681edd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d68070480 0x7f3d681edd60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d5802b9e0 tx=0x7f3d580046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 shutdown_connections 2023-12-22T09:15:00.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d4c06a500 0x7f3d4c06c9c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d6815c070 0x7f3d68152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d68070480 0x7f3d681edd60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 --2- 172.21.15.106:0/3065071433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d68069e60 0x7f3d6814f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 >> 172.21.15.106:0/3065071433 conn(0x7f3d680c5360 msgr2=0x7f3d68154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 shutdown_connections 2023-12-22T09:15:00.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f697406a480 msgr2=0x7f697406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f69985f0640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f697406a480 0x7f697406c940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6980009150 tx=0x7f698003c040 comp rx=0 tx=0).stop 2023-12-22T09:15:00.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f699015c070 msgr2=0x7f69900c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f69985f0640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f699015c070 0x7f69900c36b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f698800cad0 tx=0x7f698800cf90 comp rx=0 tx=0).stop 2023-12-22T09:15:00.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 shutdown_connections 2023-12-22T09:15:00.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f69985f0640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f697406a480 0x7f697406c940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f69985f0640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f699015c070 0x7f69900c36b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f69985f0640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6990070480 0x7f6990154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.616+0000 7f69985f0640 1 --2- 172.21.15.106:0/568092204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6990069e60 0x7f699015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.617+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 >> 172.21.15.106:0/568092204 conn(0x7f69900c5360 msgr2=0x7f6990151bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.617+0000 7f3d705c9640 1 -- 172.21.15.106:0/3065071433 wait complete. 2023-12-22T09:15:00.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.617+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 shutdown_connections 2023-12-22T09:15:00.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.617+0000 7f69985f0640 1 -- 172.21.15.106:0/568092204 wait complete. 2023-12-22T09:15:00.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.618+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f502c0057d0 con 0x7f504806e390 2023-12-22T09:15:00.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.619+0000 7f503effd640 1 -- 172.21.15.106:0/1587141556 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5040086e60 con 0x7f504806e390 2023-12-22T09:15:00.621 INFO:teuthology.orchestra.run.smithi106.stdout:60129542153 2023-12-22T09:15:00.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.2 2023-12-22T09:15:00.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.623+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f502806a500 msgr2=0x7f502806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.623+0000 7f504759e640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f502806a500 0x7f502806c9c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f50480c3b70 tx=0x7f5038009190 comp rx=0 tx=0).stop 2023-12-22T09:15:00.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.623+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504806e390 msgr2=0x7f5048151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:00.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.623+0000 7f504759e640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504806e390 0x7f5048151200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f504000cb10 tx=0x7f504000a060 comp rx=0 tx=0).stop 2023-12-22T09:15:00.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.624+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 shutdown_connections 2023-12-22T09:15:00.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.624+0000 7f504759e640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f502806a500 0x7f502806c9c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.624+0000 7f504759e640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f504814f160 0x7f5048154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.624+0000 7f504759e640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50480c6e90 0x7f504806b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.624+0000 7f504759e640 1 --2- 172.21.15.106:0/1587141556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f504806e390 0x7f5048151200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:00.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.624+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 >> 172.21.15.106:0/1587141556 conn(0x7f50480a7b80 msgr2=0x7f504814cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:00.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.624+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 shutdown_connections 2023-12-22T09:15:00.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:00.624+0000 7f504759e640 1 -- 172.21.15.106:0/1587141556 wait complete. 2023-12-22T09:15:00.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.4 2023-12-22T09:15:00.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.7 2023-12-22T09:15:00.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.5 2023-12-22T09:15:00.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.3 2023-12-22T09:15:00.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2023-12-22T09:15:01.607 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-22T09:15:01.611 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-22T09:15:01.624 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-22T09:15:01.634 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-22T09:15:01.638 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-22T09:15:01.640 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-22T09:15:01.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-22T09:15:01.647 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-22T09:15:01.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.889+0000 7fd4db58e640 1 Processor -- start 2023-12-22T09:15:01.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.890+0000 7fd4db58e640 1 -- start start 2023-12-22T09:15:01.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.892+0000 7fd4db58e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd4cc031680 0x7fd4cc007490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.892+0000 7fd4db58e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4cc030be0 con 0x7fd4cc00b160 2023-12-22T09:15:01.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.892+0000 7fd4db58e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4cc00bbf0 con 0x7fd4cc03eb60 2023-12-22T09:15:01.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.892+0000 7fd4db58e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4cc0e07f0 con 0x7fd4cc031680 2023-12-22T09:15:01.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.893+0000 7fd4da58c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd4cc03eb60 0x7fd4cc0e00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33340/0 (socket says 172.21.15.106:33340) 2023-12-22T09:15:01.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.893+0000 7fd4da58c640 1 -- 172.21.15.106:0/347839211 learned_addr learned my addr 172.21.15.106:0/347839211 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:01.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.893+0000 7fd4d9d8b640 1 --2- 172.21.15.106:0/347839211 >> v2:172.21.15.106:3300/0 conn(0x7fd4cc031680 0x7fd4cc007490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.895+0000 7fd4d958a640 1 -- 172.21.15.106:0/347839211 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925923653 0 0) 0x7fd4cc00bbf0 con 0x7fd4cc03eb60 2023-12-22T09:15:01.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.895+0000 7fd4d958a640 1 -- 172.21.15.106:0/347839211 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c0003520 con 0x7fd4cc03eb60 2023-12-22T09:15:01.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.895+0000 7fd4d958a640 1 -- 172.21.15.106:0/347839211 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728318152 0 0) 0x7fd4cc030be0 con 0x7fd4cc00b160 2023-12-22T09:15:01.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.895+0000 7fd4d958a640 1 -- 172.21.15.106:0/347839211 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4cc00bbf0 con 0x7fd4cc00b160 2023-12-22T09:15:01.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.895+0000 7fd4d958a640 1 -- 172.21.15.106:0/347839211 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2260952695 0 0) 0x7fd4cc00bbf0 con 0x7fd4cc00b160 2023-12-22T09:15:01.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.895+0000 7fd4d9d8b640 1 -- 172.21.15.106:0/347839211 >> v1:172.21.15.132:6789/0 conn(0x7fd4cc03eb60 legacy=0x7fd4cc0e00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.895+0000 7fd4d9d8b640 1 -- 172.21.15.106:0/347839211 >> v1:172.21.15.106:6789/0 conn(0x7fd4cc00b160 legacy=0x7fd4cc0dbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.895+0000 7fd4d9d8b640 1 -- 172.21.15.106:0/347839211 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc0312d0 con 0x7fd4cc031680 2023-12-22T09:15:01.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.897+0000 7fd4d9d8b640 1 --2- 172.21.15.106:0/347839211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4cc031680 0x7fd4cc007490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40097a0 tx=0x7fd4c402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92790e27c93ef15a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.898+0000 7fa4b1629640 1 Processor -- start 2023-12-22T09:15:01.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.898+0000 7fd4d958a640 1 -- 172.21.15.106:0/347839211 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d404e8d0 con 0x7fd4cc031680 2023-12-22T09:15:01.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.898+0000 7fd4d958a640 1 -- 172.21.15.106:0/347839211 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c402e050 con 0x7fd4cc031680 2023-12-22T09:15:01.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.898+0000 7fd4d958a640 1 -- 172.21.15.106:0/347839211 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4030730 con 0x7fd4cc031680 2023-12-22T09:15:01.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.898+0000 7fa4b1629640 1 -- start start 2023-12-22T09:15:01.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.900+0000 7fa4b1629640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4ac0c4100 0x7fa4ac1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.901+0000 7fd4db58e640 1 -- 172.21.15.106:0/347839211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4cc031680 msgr2=0x7fd4cc007490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.901+0000 7fd4db58e640 1 --2- 172.21.15.106:0/347839211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4cc031680 0x7fd4cc007490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40097a0 tx=0x7fd4c402b790 comp rx=0 tx=0).stop 2023-12-22T09:15:01.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.901+0000 7fa4b1629640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa4ac0c7410 0x7fa4ac0c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.902+0000 7fa4abfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4ac0c4100 0x7fa4ac1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.902+0000 7fa4abfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4ac0c4100 0x7fa4ac1571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40206/0 (socket says 172.21.15.106:40206) 2023-12-22T09:15:01.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.902+0000 7fa4abfff640 1 -- 172.21.15.106:0/1155224191 learned_addr learned my addr 172.21.15.106:0/1155224191 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:01.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.902+0000 7fa4b1629640 1 --2- 172.21.15.106:0/1155224191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 0x7fa4ac154790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.903+0000 7fa4b1629640 1 -- 172.21.15.106:0/1155224191 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac0c5e20 con 0x7fa4ac0c7410 2023-12-22T09:15:01.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.903+0000 7fa4b1629640 1 -- 172.21.15.106:0/1155224191 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac153c30 con 0x7fa4ac0c4100 2023-12-22T09:15:01.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.903+0000 7fa4b1629640 1 -- 172.21.15.106:0/1155224191 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac1576e0 con 0x7fa4ac154360 2023-12-22T09:15:01.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.903+0000 7fa4ab7fe640 1 --2- 172.21.15.106:0/1155224191 >> v2:172.21.15.106:3300/0 conn(0x7fa4ac0c7410 0x7fa4ac0c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.903+0000 7fd4db58e640 1 -- 172.21.15.106:0/347839211 shutdown_connections 2023-12-22T09:15:01.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.903+0000 7fd4db58e640 1 --2- 172.21.15.106:0/347839211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4cc031680 0x7fd4cc007490 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.904+0000 7fd4db58e640 1 -- 172.21.15.106:0/347839211 >> 172.21.15.106:0/347839211 conn(0x7fd4cc005fe0 msgr2=0x7fd4cc0063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:01.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.904+0000 7fd4db58e640 1 -- 172.21.15.106:0/347839211 shutdown_connections 2023-12-22T09:15:01.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.904+0000 7fd4db58e640 1 -- 172.21.15.106:0/347839211 wait complete. 2023-12-22T09:15:01.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.904+0000 7fa4b0e28640 1 --2- 172.21.15.106:0/1155224191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 0x7fa4ac154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.904+0000 7fa4ab7fe640 1 -- 172.21.15.106:0/1155224191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 msgr2=0x7fa4ac154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:01.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.904+0000 7fa4ab7fe640 1 --2- 172.21.15.106:0/1155224191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 0x7fa4ac154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.904+0000 7fa4ab7fe640 1 -- 172.21.15.106:0/1155224191 >> v2:172.21.15.132:3300/0 conn(0x7fa4ac0c4100 msgr2=0x7fa4ac1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:01.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.904+0000 7fa4ab7fe640 1 --2- 172.21.15.106:0/1155224191 >> v2:172.21.15.132:3300/0 conn(0x7fa4ac0c4100 0x7fa4ac1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.904+0000 7fa4ab7fe640 1 -- 172.21.15.106:0/1155224191 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac153ed0 con 0x7fa4ac0c7410 2023-12-22T09:15:01.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.906+0000 7fa4ab7fe640 1 --2- 172.21.15.106:0/1155224191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 0x7fa4ac0c44e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0677b0 tx=0x7fa4a002b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a1f0f55d1f5d83 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.907+0000 7fa4aaffd640 1 -- 172.21.15.106:0/1155224191 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0033640 con 0x7fa4ac0c7410 2023-12-22T09:15:01.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.908+0000 7fa4aaffd640 1 -- 172.21.15.106:0/1155224191 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a00337a0 con 0x7fa4ac0c7410 2023-12-22T09:15:01.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.908+0000 7fa4aaffd640 1 -- 172.21.15.106:0/1155224191 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0033b30 con 0x7fa4ac0c7410 2023-12-22T09:15:01.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.908+0000 7fd4db58e640 1 Processor -- start 2023-12-22T09:15:01.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.908+0000 7fd4db58e640 1 -- start start 2023-12-22T09:15:01.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.909+0000 7fa4b1629640 1 -- 172.21.15.106:0/1155224191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 msgr2=0x7fa4ac0c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.909+0000 7fa4b1629640 1 --2- 172.21.15.106:0/1155224191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 0x7fa4ac0c44e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0677b0 tx=0x7fa4a002b720 comp rx=0 tx=0).stop 2023-12-22T09:15:01.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.910+0000 7fa4b1629640 1 -- 172.21.15.106:0/1155224191 shutdown_connections 2023-12-22T09:15:01.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.910+0000 7fa4b1629640 1 --2- 172.21.15.106:0/1155224191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 0x7fa4ac154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.910+0000 7fa4b1629640 1 --2- 172.21.15.106:0/1155224191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 0x7fa4ac0c44e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.910+0000 7fa4b1629640 1 --2- 172.21.15.106:0/1155224191 >> v2:172.21.15.132:3300/0 conn(0x7fa4ac0c4100 0x7fa4ac1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.910+0000 7fa4b1629640 1 -- 172.21.15.106:0/1155224191 >> 172.21.15.106:0/1155224191 conn(0x7fa4ac0c5f90 msgr2=0x7fa4ac0c63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:01.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.911+0000 7fd4db58e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4cc00b160 0x7fd4cc02fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.911+0000 7fa4b1629640 1 -- 172.21.15.106:0/1155224191 shutdown_connections 2023-12-22T09:15:01.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.911+0000 7fa4b1629640 1 -- 172.21.15.106:0/1155224191 wait complete. 2023-12-22T09:15:01.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.911+0000 7fd4db58e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4cc031680 0x7fd4cc0de1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.911+0000 7fd4db58e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4cc03eb60 0x7fd4cc0d70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.912+0000 7fd4db58e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc045950 con 0x7fd4cc031680 2023-12-22T09:15:01.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.912+0000 7fd4db58e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc0443f0 con 0x7fd4cc00b160 2023-12-22T09:15:01.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.912+0000 7fd4da58c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4cc00b160 0x7fd4cc02fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.912+0000 7fd4da58c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4cc00b160 0x7fd4cc02fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40210/0 (socket says 172.21.15.106:40210) 2023-12-22T09:15:01.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.912+0000 7fd4da58c640 1 -- 172.21.15.106:0/3266852278 learned_addr learned my addr 172.21.15.106:0/3266852278 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:01.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.913+0000 7fd4db58e640 1 -- 172.21.15.106:0/3266852278 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc042f80 con 0x7fd4cc03eb60 2023-12-22T09:15:01.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.913+0000 7fd4d9d8b640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4cc031680 0x7fd4cc0de1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.913+0000 7fd4dad8d640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4cc03eb60 0x7fd4cc0d70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.914+0000 7fa4b1629640 1 Processor -- start 2023-12-22T09:15:01.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.915+0000 7fa4b1629640 1 -- start start 2023-12-22T09:15:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.916+0000 7fd4da58c640 1 -- 172.21.15.106:0/3266852278 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4cc03eb60 msgr2=0x7fd4cc0d70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.916+0000 7fd4da58c640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4cc03eb60 0x7fd4cc0d70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.916+0000 7fd4da58c640 1 -- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4cc031680 msgr2=0x7fd4cc0de1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.916+0000 7fd4da58c640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4cc031680 0x7fd4cc0de1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.916+0000 7fd4da58c640 1 -- 172.21.15.106:0/3266852278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c4009400 con 0x7fd4cc00b160 2023-12-22T09:15:01.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.917+0000 7fa4b1629640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ac0c4100 0x7fa4ac1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.917+0000 7fa4b1629640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 0x7fa4ac14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fd4da58c640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4cc00b160 0x7fd4cc02fa10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000c3f0 tx=0x7fd4d000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fa4b1629640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 0x7fa4ac156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fa4b1629640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0ad540 con 0x7fa4ac0c7410 2023-12-22T09:15:01.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fa4b1629640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac1566f0 con 0x7fa4ac0c4100 2023-12-22T09:15:01.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fa4b1629640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0accf0 con 0x7fa4ac154360 2023-12-22T09:15:01.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fa4abfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ac0c4100 0x7fa4ac1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fa4abfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ac0c4100 0x7fa4ac1561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40214/0 (socket says 172.21.15.106:40214) 2023-12-22T09:15:01.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fa4ab7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 0x7fa4ac14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fa4ab7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 0x7fa4ac14e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41242/0 (socket says 172.21.15.106:41242) 2023-12-22T09:15:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.918+0000 7fa4ab7fe640 1 -- 172.21.15.106:0/3777025064 learned_addr learned my addr 172.21.15.106:0/3777025064 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.919+0000 7fa4b0e28640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 0x7fa4ac156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.919+0000 7fd4caffd640 1 -- 172.21.15.106:0/3266852278 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0005ce0 con 0x7fd4cc00b160 2023-12-22T09:15:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.919+0000 7fd4db58e640 1 -- 172.21.15.106:0/3266852278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc030bd0 con 0x7fd4cc00b160 2023-12-22T09:15:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fa4b0e28640 1 -- 172.21.15.106:0/3777025064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ac0c4100 msgr2=0x7fa4ac1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fd4db58e640 1 -- 172.21.15.106:0/3266852278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4cc0df5b0 con 0x7fd4cc00b160 2023-12-22T09:15:01.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fd4caffd640 1 -- 172.21.15.106:0/3266852278 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d0005e40 con 0x7fd4cc00b160 2023-12-22T09:15:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fd4caffd640 1 -- 172.21.15.106:0/3266852278 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0005ce0 con 0x7fd4cc00b160 2023-12-22T09:15:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fa4b0e28640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ac0c4100 0x7fa4ac1561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fa4b0e28640 1 -- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 msgr2=0x7fa4ac14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fa4b0e28640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 0x7fa4ac14e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fa4b0e28640 1 -- 172.21.15.106:0/3777025064 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0009400 con 0x7fa4ac154360 2023-12-22T09:15:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fa4ab7fe640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 0x7fa4ac14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.920+0000 7fa4abfff640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ac0c4100 0x7fa4ac1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.922+0000 7fa4b0e28640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 0x7fa4ac156b60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4007df0 tx=0x7fa4a400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.922+0000 7fd4db58e640 1 -- 172.21.15.106:0/3266852278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc005250 con 0x7fd4cc00b160 2023-12-22T09:15:01.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.922+0000 7fa4a8ff9640 1 -- 172.21.15.106:0/3777025064 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4018070 con 0x7fa4ac154360 2023-12-22T09:15:01.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.922+0000 7fa4a8ff9640 1 -- 172.21.15.106:0/3777025064 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a400edd0 con 0x7fa4ac154360 2023-12-22T09:15:01.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.922+0000 7fa4a8ff9640 1 -- 172.21.15.106:0/3777025064 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4003bb0 con 0x7fa4ac154360 2023-12-22T09:15:01.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.922+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ac1556d0 con 0x7fa4ac154360 2023-12-22T09:15:01.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.924+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac155c90 con 0x7fa4ac154360 2023-12-22T09:15:01.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.925+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ac04e8d0 con 0x7fa4ac154360 2023-12-22T09:15:01.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.926+0000 7fd4caffd640 1 -- 172.21.15.106:0/3266852278 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd4d0007070 con 0x7fd4cc00b160 2023-12-22T09:15:01.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.927+0000 7fd4caffd640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd4b806a490 0x7fd4b806c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.928+0000 7fd4caffd640 1 -- 172.21.15.106:0/3266852278 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4d0087a80 con 0x7fd4cc00b160 2023-12-22T09:15:01.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.928+0000 7fa4a8ff9640 1 -- 172.21.15.106:0/3777025064 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa4a4014420 con 0x7fa4ac154360 2023-12-22T09:15:01.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.929+0000 7fd4d9d8b640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd4b806a490 0x7fd4b806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.930+0000 7fa4a8ff9640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa49806a530 0x7fa49806c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.930+0000 7fd4d9d8b640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd4b806a490 0x7fd4b806c950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4034000 tx=0x7fd4c402f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.930+0000 7fa4a8ff9640 1 -- 172.21.15.106:0/3777025064 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4a4088c40 con 0x7fa4ac154360 2023-12-22T09:15:01.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.931+0000 7fa4abfff640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa49806a530 0x7fa49806c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.932+0000 7fa4abfff640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa49806a530 0x7fa49806c9f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009f70 tx=0x7fa49c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.955+0000 7fd4caffd640 1 -- 172.21.15.106:0/3266852278 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd4d0052ec0 con 0x7fd4cc00b160 2023-12-22T09:15:01.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.958+0000 7f2782ce7640 1 Processor -- start 2023-12-22T09:15:01.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.958+0000 7f2782ce7640 1 -- start start 2023-12-22T09:15:01.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.960+0000 7fa4a8ff9640 1 -- 172.21.15.106:0/3777025064 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa4a4053fd0 con 0x7fa4ac154360 2023-12-22T09:15:01.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.960+0000 7f2782ce7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f277c1514b0 0x7f277c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.960+0000 7f2782ce7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c0c4660 con 0x7f277c06aad0 2023-12-22T09:15:01.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.960+0000 7f2782ce7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c153d60 con 0x7f277c0c4130 2023-12-22T09:15:01.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.960+0000 7f2782ce7640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c154c50 con 0x7f277c1514b0 2023-12-22T09:15:01.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.961+0000 7f2781284640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f277c06aad0 0x7f277c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52052/0 (socket says 172.21.15.106:52052) 2023-12-22T09:15:01.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.961+0000 7f2781284640 1 -- 172.21.15.106:0/2737943741 learned_addr learned my addr 172.21.15.106:0/2737943741 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:01.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.961+0000 7f2780a83640 1 --2- 172.21.15.106:0/2737943741 >> v2:172.21.15.106:3300/0 conn(0x7f277c1514b0 0x7f277c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.963+0000 7f2780a83640 1 -- 172.21.15.106:0/2737943741 >> v1:172.21.15.132:6789/0 conn(0x7f277c0c4130 legacy=0x7f277c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.963+0000 7f2780a83640 1 -- 172.21.15.106:0/2737943741 >> v1:172.21.15.106:6789/0 conn(0x7f277c06aad0 legacy=0x7f277c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.963+0000 7f2780a83640 1 -- 172.21.15.106:0/2737943741 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c06b250 con 0x7f277c1514b0 2023-12-22T09:15:01.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.965+0000 7f2780a83640 1 --2- 172.21.15.106:0/2737943741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 0x7f277c0c75b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27700097a0 tx=0x7f277002b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10098f4787416ed server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.964+0000 7f42fdc57640 1 Processor -- start 2023-12-22T09:15:01.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.964+0000 7f42fdc57640 1 -- start start 2023-12-22T09:15:01.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.966+0000 7f277b7fe640 1 -- 172.21.15.106:0/2737943741 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770030710 con 0x7f277c1514b0 2023-12-22T09:15:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.966+0000 7f277b7fe640 1 -- 172.21.15.106:0/2737943741 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277002e050 con 0x7f277c1514b0 2023-12-22T09:15:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.966+0000 7f277b7fe640 1 -- 172.21.15.106:0/2737943741 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770030710 con 0x7f277c1514b0 2023-12-22T09:15:01.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.966+0000 7f42fdc57640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f81514b0 0x7f42f80c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.966+0000 7f42fdc57640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42f80c4130 0x7f42f8154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.967+0000 7f42fdc57640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f80c4660 con 0x7f42f8154a80 2023-12-22T09:15:01.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.967+0000 7f42fdc57640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f8153d60 con 0x7f42f80c4130 2023-12-22T09:15:01.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.967+0000 7f42fdc57640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f806b250 con 0x7f42f81514b0 2023-12-22T09:15:01.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.967+0000 7f42f6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42f80c4130 0x7f42f8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.967+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f81514b0 0x7f42f80c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.967+0000 7f42f6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42f80c4130 0x7f42f8154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40224/0 (socket says 172.21.15.106:40224) 2023-12-22T09:15:01.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.967+0000 7f42f6ffd640 1 -- 172.21.15.106:0/1502755606 learned_addr learned my addr 172.21.15.106:0/1502755606 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:01.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.968+0000 7f2782ce7640 1 -- 172.21.15.106:0/2737943741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 msgr2=0x7f277c0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.968+0000 7f2782ce7640 1 --2- 172.21.15.106:0/2737943741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 0x7f277c0c75b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27700097a0 tx=0x7f277002b570 comp rx=0 tx=0).stop 2023-12-22T09:15:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.968+0000 7f2782ce7640 1 -- 172.21.15.106:0/2737943741 shutdown_connections 2023-12-22T09:15:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.968+0000 7f2782ce7640 1 --2- 172.21.15.106:0/2737943741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 0x7f277c0c75b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.968+0000 7f2782ce7640 1 -- 172.21.15.106:0/2737943741 >> 172.21.15.106:0/2737943741 conn(0x7f277c0ab1a0 msgr2=0x7f277c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.968+0000 7f235e595640 1 Processor -- start 2023-12-22T09:15:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.969+0000 7f235e595640 1 -- start start 2023-12-22T09:15:01.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.969+0000 7f42f6ffd640 1 -- 172.21.15.106:0/1502755606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f81514b0 msgr2=0x7f42f80c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:01.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.969+0000 7f2782ce7640 1 -- 172.21.15.106:0/2737943741 shutdown_connections 2023-12-22T09:15:01.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.969+0000 7f2782ce7640 1 -- 172.21.15.106:0/2737943741 wait complete. 2023-12-22T09:15:01.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.969+0000 7f42f6ffd640 1 --2- 172.21.15.106:0/1502755606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f81514b0 0x7f42f80c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.969+0000 7f42f6ffd640 1 -- 172.21.15.106:0/1502755606 >> v1:172.21.15.132:6789/0 conn(0x7f42f8154a80 legacy=0x7f42f80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.970+0000 7f42f6ffd640 1 -- 172.21.15.106:0/1502755606 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f806b530 con 0x7f42f80c4130 2023-12-22T09:15:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.970+0000 7fc293fff640 1 Processor -- start 2023-12-22T09:15:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.971+0000 7f235e595640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f235806aad0 0x7f23580c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.971+0000 7f235e595640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23580c4660 con 0x7f23581514b0 2023-12-22T09:15:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.971+0000 7f235e595640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2358153d60 con 0x7f23580c4130 2023-12-22T09:15:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.971+0000 7f235e595640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2358154c50 con 0x7f235806aad0 2023-12-22T09:15:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.970+0000 7fc293fff640 1 -- start start 2023-12-22T09:15:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.971+0000 7f42f6ffd640 1 --2- 172.21.15.106:0/1502755606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80c4130 0x7f42f8154540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009870 tx=0x7f42e802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b79a65d514c03817 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7f235cb32640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f235806aad0 0x7f23580c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7f2782ce7640 1 Processor -- start 2023-12-22T09:15:01.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7f2782ce7640 1 -- start start 2023-12-22T09:15:01.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7fc293fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc29406c7e0 0x7fc29406b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7fc293fff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2940c43b0 con 0x7fc2940aeb90 2023-12-22T09:15:01.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7fc293fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc294154650 con 0x7fc2940c7500 2023-12-22T09:15:01.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7fc293fff640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2940aef70 con 0x7fc29406c7e0 2023-12-22T09:15:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7f235cb32640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f235806aad0 0x7f23580c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41258/0 (socket says 172.21.15.106:41258) 2023-12-22T09:15:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7f235cb32640 1 -- 172.21.15.106:0/607505621 learned_addr learned my addr 172.21.15.106:0/607505621 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.972+0000 7f42f67fc640 1 -- 172.21.15.106:0/1502755606 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8031640 con 0x7f42f80c4130 2023-12-22T09:15:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.973+0000 7f42f67fc640 1 -- 172.21.15.106:0/1502755606 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e80317a0 con 0x7f42f80c4130 2023-12-22T09:15:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.973+0000 7f42f67fc640 1 -- 172.21.15.106:0/1502755606 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8031b30 con 0x7f42f80c4130 2023-12-22T09:15:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.973+0000 7fc2927fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc2940c7500 0x7fc29406af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33376/0 (socket says 172.21.15.106:33376) 2023-12-22T09:15:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.973+0000 7fc2927fc640 1 -- 172.21.15.106:0/2084194669 learned_addr learned my addr 172.21.15.106:0/2084194669 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.973+0000 7f2782ce7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f277c06aad0 0x7f277c148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.973+0000 7f2782ce7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f277c0c4130 0x7f277c1ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.973+0000 7f23577fe640 1 -- 172.21.15.106:0/607505621 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005831838 0 0) 0x7f2358153d60 con 0x7f23580c4130 2023-12-22T09:15:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.973+0000 7f23577fe640 1 -- 172.21.15.106:0/607505621 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2344003520 con 0x7f23580c4130 2023-12-22T09:15:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7fc2937fe640 1 --2- 172.21.15.106:0/2084194669 >> v2:172.21.15.106:3300/0 conn(0x7fc29406c7e0 0x7fc29406b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f42fdc57640 1 -- 172.21.15.106:0/1502755606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80c4130 msgr2=0x7f42f8154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f42fdc57640 1 --2- 172.21.15.106:0/1502755606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80c4130 0x7f42f8154540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009870 tx=0x7f42e802b8f0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f2782ce7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 0x7f277c0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f2782ce7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c14d770 con 0x7f277c1514b0 2023-12-22T09:15:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f2782ce7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c149360 con 0x7f277c06aad0 2023-12-22T09:15:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f2782ce7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c1ea8a0 con 0x7f277c0c4130 2023-12-22T09:15:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f42fdc57640 1 -- 172.21.15.106:0/1502755606 shutdown_connections 2023-12-22T09:15:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f42fdc57640 1 --2- 172.21.15.106:0/1502755606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80c4130 0x7f42f8154540 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009870 tx=0x7f42e802b8f0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f42fdc57640 1 --2- 172.21.15.106:0/1502755606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f81514b0 0x7f42f80c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f42fdc57640 1 -- 172.21.15.106:0/1502755606 >> 172.21.15.106:0/1502755606 conn(0x7f42f80ab1a0 msgr2=0x7f42f80ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7fc2937fe640 1 -- 172.21.15.106:0/2084194669 >> v1:172.21.15.132:6789/0 conn(0x7fc2940c7500 legacy=0x7fc29406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7fc2937fe640 1 -- 172.21.15.106:0/2084194669 >> v1:172.21.15.106:6789/0 conn(0x7fc2940aeb90 legacy=0x7fc2940c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7fc2937fe640 1 -- 172.21.15.106:0/2084194669 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc294154b80 con 0x7fc29406c7e0 2023-12-22T09:15:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f2780a83640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f277c06aad0 0x7f277c148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f277bfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f277c0c4130 0x7f277c1ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f277bfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f277c0c4130 0x7f277c1ea360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:57278/0 (socket says 172.21.15.106:57278) 2023-12-22T09:15:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f277bfff640 1 -- 172.21.15.106:0/3187312511 learned_addr learned my addr 172.21.15.106:0/3187312511 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f2781284640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 0x7f277c0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f235cb32640 1 -- 172.21.15.106:0/607505621 >> v1:172.21.15.132:6789/0 conn(0x7f23580c4130 legacy=0x7f23580c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f235cb32640 1 -- 172.21.15.106:0/607505621 >> v1:172.21.15.106:6789/0 conn(0x7f23581514b0 legacy=0x7f2358154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.974+0000 7f235cb32640 1 -- 172.21.15.106:0/607505621 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235806b250 con 0x7f235806aad0 2023-12-22T09:15:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.976+0000 7f42fdc57640 1 -- 172.21.15.106:0/1502755606 shutdown_connections 2023-12-22T09:15:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f2781284640 1 -- 172.21.15.106:0/3187312511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f277c0c4130 msgr2=0x7f277c1ea360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f2781284640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f277c0c4130 0x7f277c1ea360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f2781284640 1 -- 172.21.15.106:0/3187312511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f277c06aad0 msgr2=0x7f277c148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f2781284640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f277c06aad0 0x7f277c148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f2781284640 1 -- 172.21.15.106:0/3187312511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009400 con 0x7f277c1514b0 2023-12-22T09:15:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.975+0000 7f2780a83640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f277c06aad0 0x7f277c148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.976+0000 7f2781284640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 0x7f277c0c7e80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7d0 tx=0x7f277400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.976+0000 7fc2937fe640 1 --2- 172.21.15.106:0/2084194669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29406c7e0 0x7fc29406b620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c02bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea231883a3d4729 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.976+0000 7f42fdc57640 1 -- 172.21.15.106:0/1502755606 wait complete. 2023-12-22T09:15:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.976+0000 7f235cb32640 1 --2- 172.21.15.106:0/607505621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f235806aad0 0x7f23580c75b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2350009e50 tx=0x7f235002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a2674679cbab45 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.976+0000 7f23577fe640 1 -- 172.21.15.106:0/607505621 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235002c9f0 con 0x7f235806aad0 2023-12-22T09:15:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.976+0000 7f23577fe640 1 -- 172.21.15.106:0/607505621 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235002cb50 con 0x7f235806aad0 2023-12-22T09:15:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.976+0000 7f23577fe640 1 -- 172.21.15.106:0/607505621 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500343f0 con 0x7f235806aad0 2023-12-22T09:15:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.977+0000 7f27797fa640 1 -- 172.21.15.106:0/3187312511 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400a640 con 0x7f277c1514b0 2023-12-22T09:15:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.977+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c14c350 con 0x7f277c1514b0 2023-12-22T09:15:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.977+0000 7fc291ffb640 1 -- 172.21.15.106:0/2084194669 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c02cab0 con 0x7fc29406c7e0 2023-12-22T09:15:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.977+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c148620 con 0x7f277c1514b0 2023-12-22T09:15:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.977+0000 7fc291ffb640 1 -- 172.21.15.106:0/2084194669 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c02cc10 con 0x7fc29406c7e0 2023-12-22T09:15:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.977+0000 7fc291ffb640 1 -- 172.21.15.106:0/2084194669 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c034440 con 0x7fc29406c7e0 2023-12-22T09:15:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.977+0000 7f27797fa640 1 -- 172.21.15.106:0/3187312511 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400a7c0 con 0x7f277c1514b0 2023-12-22T09:15:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.977+0000 7f27797fa640 1 -- 172.21.15.106:0/3187312511 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400ab70 con 0x7f277c1514b0 2023-12-22T09:15:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.978+0000 7fc293fff640 1 -- 172.21.15.106:0/2084194669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29406c7e0 msgr2=0x7fc29406b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.978+0000 7fc293fff640 1 --2- 172.21.15.106:0/2084194669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29406c7e0 0x7fc29406b620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c02bd00 comp rx=0 tx=0).stop 2023-12-22T09:15:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.978+0000 7fc293fff640 1 -- 172.21.15.106:0/2084194669 shutdown_connections 2023-12-22T09:15:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.978+0000 7fc293fff640 1 --2- 172.21.15.106:0/2084194669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc29406c7e0 0x7fc29406b620 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.978+0000 7fc293fff640 1 -- 172.21.15.106:0/2084194669 >> 172.21.15.106:0/2084194669 conn(0x7fc2940ab120 msgr2=0x7fc2940ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.978+0000 7f42fdc57640 1 Processor -- start 2023-12-22T09:15:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.979+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275c005250 con 0x7f277c1514b0 2023-12-22T09:15:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.979+0000 7f42fdc57640 1 -- start start 2023-12-22T09:15:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.979+0000 7fc293fff640 1 -- 172.21.15.106:0/2084194669 shutdown_connections 2023-12-22T09:15:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.979+0000 7fc293fff640 1 -- 172.21.15.106:0/2084194669 wait complete. 2023-12-22T09:15:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.979+0000 7f235e595640 1 -- 172.21.15.106:0/607505621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f235806aad0 msgr2=0x7f23580c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.980+0000 7f235e595640 1 --2- 172.21.15.106:0/607505621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f235806aad0 0x7f23580c75b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2350009e50 tx=0x7f235002be50 comp rx=0 tx=0).stop 2023-12-22T09:15:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.980+0000 7f235e595640 1 -- 172.21.15.106:0/607505621 shutdown_connections 2023-12-22T09:15:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.980+0000 7f235e595640 1 --2- 172.21.15.106:0/607505621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f235806aad0 0x7f23580c75b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.980+0000 7f235e595640 1 -- 172.21.15.106:0/607505621 >> 172.21.15.106:0/607505621 conn(0x7f23580ab1a0 msgr2=0x7f23580ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.981+0000 7f235e595640 1 -- 172.21.15.106:0/607505621 shutdown_connections 2023-12-22T09:15:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.981+0000 7f235e595640 1 -- 172.21.15.106:0/607505621 wait complete. 2023-12-22T09:15:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.981+0000 7f42fdc57640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81514b0 0x7f42f80be340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.981+0000 7fc293fff640 1 Processor -- start 2023-12-22T09:15:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.981+0000 7f42fdc57640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80bff00 0x7f42f80c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.982+0000 7f42fdc57640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f80c0380 0x7f42f80c1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.982+0000 7f42fdc57640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80c08b0 con 0x7f42f81514b0 2023-12-22T09:15:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.982+0000 7f42fdc57640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81e0e20 con 0x7f42f80bff00 2023-12-22T09:15:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.982+0000 7f42f7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f80c0380 0x7f42f80c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.982+0000 7f42f7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f80c0380 0x7f42f80c1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:57290/0 (socket says 172.21.15.106:57290) 2023-12-22T09:15:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.982+0000 7f42f7fff640 1 -- 172.21.15.106:0/3259164659 learned_addr learned my addr 172.21.15.106:0/3259164659 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80bd5a0 con 0x7f42f80c0380 2023-12-22T09:15:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.981+0000 7fc293fff640 1 -- start start 2023-12-22T09:15:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7fc293fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29406c7e0 0x7fc2940c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7fc293fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2940aeb90 0x7fc2940bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7fc293fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2940c7500 0x7fc29414cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7fc293fff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940c1c60 con 0x7fc2940aeb90 2023-12-22T09:15:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7fc293fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940c3000 con 0x7fc2940c7500 2023-12-22T09:15:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7fc293fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2940c1eb0 con 0x7fc29406c7e0 2023-12-22T09:15:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7fe793a69640 1 Processor -- start 2023-12-22T09:15:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7f235e595640 1 Processor -- start 2023-12-22T09:15:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7fe793a69640 1 -- start start 2023-12-22T09:15:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7f42f6ffd640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80bff00 0x7f42f80c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7f235e595640 1 -- start start 2023-12-22T09:15:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.983+0000 7fc292ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29406c7e0 0x7fc2940c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.984+0000 7f42f77fe640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81514b0 0x7f42f80be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.984+0000 7fc2927fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2940aeb90 0x7fc2940bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.984+0000 7fc2937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2940c7500 0x7fc29414cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.984+0000 7f27797fa640 1 -- 172.21.15.106:0/3187312511 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f277400acd0 con 0x7f277c1514b0 2023-12-22T09:15:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.984+0000 7fc2937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2940c7500 0x7fc29414cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40244/0 (socket says 172.21.15.106:40244) 2023-12-22T09:15:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.984+0000 7fc2937fe640 1 -- 172.21.15.106:0/3931747093 learned_addr learned my addr 172.21.15.106:0/3931747093 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fc2937fe640 1 -- 172.21.15.106:0/3931747093 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29406c7e0 msgr2=0x7fc2940c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7f235e595640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f235806aad0 0x7f23581498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7f235e595640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23580c4130 0x7f23580c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fc2937fe640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29406c7e0 0x7fc2940c2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fe793a69640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe78400b800 0x7fe7840e1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fe793a69640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7840e2470 0x7fe7840e9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fe793a69640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7840df5e0 con 0x7fe78404b330 2023-12-22T09:15:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fe793a69640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840de9d0 con 0x7fe78400b800 2023-12-22T09:15:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fe793a69640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840decb0 con 0x7fe7840e2470 2023-12-22T09:15:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fc2937fe640 1 -- 172.21.15.106:0/3931747093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2940aeb90 msgr2=0x7fc2940bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7f235e595640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23581514b0 0x7f23580c1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fc2937fe640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2940aeb90 0x7fc2940bfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fc2937fe640 1 -- 172.21.15.106:0/3931747093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c009a70 con 0x7fc2940c7500 2023-12-22T09:15:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7fc2937fe640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2940c7500 0x7fc29414cec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7fc27b7fe640 1 -- 172.21.15.106:0/3931747093 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c03e610 con 0x7fc2940c7500 2023-12-22T09:15:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7fe791805640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe78404b330 0x7fe78403e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:33392/0 (socket says 172.21.15.106:33392) 2023-12-22T09:15:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7fe791805640 1 -- 172.21.15.106:0/3957574907 learned_addr learned my addr 172.21.15.106:0/3957574907 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f42f6ffd640 1 -- 172.21.15.106:0/3259164659 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f80c0380 msgr2=0x7f42f80c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f42f6ffd640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f80c0380 0x7f42f80c1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f42f6ffd640 1 -- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81514b0 msgr2=0x7f42f80be340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7fc27b7fe640 1 -- 172.21.15.106:0/3931747093 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c03e790 con 0x7fc2940c7500 2023-12-22T09:15:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7fc27b7fe640 1 -- 172.21.15.106:0/3931747093 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c03eb40 con 0x7fc2940c7500 2023-12-22T09:15:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f42f6ffd640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81514b0 0x7f42f80be340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7f235e595640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c0920 con 0x7f23581514b0 2023-12-22T09:15:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2940c2190 con 0x7fc2940c7500 2023-12-22T09:15:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.987+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2940c01f0 con 0x7fc2940c7500 2023-12-22T09:15:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.987+0000 7f42f6ffd640 1 -- 172.21.15.106:0/3259164659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e80094d0 con 0x7f42f80bff00 2023-12-22T09:15:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7f235e595640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23581f0a40 con 0x7f235806aad0 2023-12-22T09:15:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7f235e595640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23581f0d20 con 0x7f23580c4130 2023-12-22T09:15:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7f235cb32640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23581514b0 0x7f23580c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7f235cb32640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23581514b0 0x7f23580c1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41304/0 (socket says 172.21.15.106:41304) 2023-12-22T09:15:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.985+0000 7f235cb32640 1 -- 172.21.15.106:0/1959630879 learned_addr learned my addr 172.21.15.106:0/1959630879 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.987+0000 7fe791004640 1 --2- 172.21.15.106:0/3957574907 >> v2:172.21.15.106:3300/0 conn(0x7fe78400b800 0x7fe7840e1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f2357fff640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f235806aad0 0x7f23581498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f235cb32640 1 -- 172.21.15.106:0/1959630879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23580c4130 msgr2=0x7f23580c0d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-22T09:15:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f235cb32640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23580c4130 0x7f23580c0d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f235cb32640 1 -- 172.21.15.106:0/1959630879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f235806aad0 msgr2=0x7f23581498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f235cb32640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f235806aad0 0x7f23581498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.986+0000 7f235cb32640 1 -- 172.21.15.106:0/1959630879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350009b30 con 0x7f23581514b0 2023-12-22T09:15:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.987+0000 7f2357fff640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f235806aad0 0x7f23581498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295971290 0 0) 0x7fe7840df5e0 con 0x7fe78404b330 2023-12-22T09:15:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe778003520 con 0x7fe78404b330 2023-12-22T09:15:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7f42f6ffd640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80bff00 0x7f42f80c0d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f42e8033000 tx=0x7f42e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7f235cb32640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23581514b0 0x7f23580c1280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2350036040 tx=0x7f2350004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2112674625 0 0) 0x7fe778003520 con 0x7fe78404b330 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7840e2470 msgr2=0x7fe7840e9020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7fe790803640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7840e2470 0x7fe7840e9020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 >> v2:172.21.15.106:3300/0 conn(0x7fe78400b800 msgr2=0x7fe7840e1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7fe790803640 1 --2- 172.21.15.106:0/3957574907 >> v2:172.21.15.106:3300/0 conn(0x7fe78400b800 0x7fe7840e1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840def90 con 0x7fe78404b330 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.988+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fe788001670 con 0x7fe78404b330 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 >> v1:172.21.15.132:6789/0 conn(0x7fe78404b330 legacy=0x7fe78403e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7fe790803640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778003970 0x7fe778003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7fe790803640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7780047c0 0x7fe778004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7fe790803640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe778005180 0x7fe77800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7f27797fa640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f276006a430 0x7f276006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840de9d0 con 0x7fe778003970 2023-12-22T09:15:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840decb0 con 0x7fe778005180 2023-12-22T09:15:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77800c070 con 0x7fe7780047c0 2023-12-22T09:15:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7f27797fa640 1 -- 172.21.15.106:0/3187312511 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27740884f0 con 0x7f277c1514b0 2023-12-22T09:15:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7fe791004640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7780047c0 0x7fe778004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7fe792006640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe778005180 0x7fe77800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7f3dc8c31640 1 Processor -- start 2023-12-22T09:15:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.990+0000 7f3dc8c31640 1 -- start start 2023-12-22T09:15:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.991+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29404e8d0 con 0x7fc2940c7500 2023-12-22T09:15:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.989+0000 7f42dffff640 1 -- 172.21.15.106:0/3259164659 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e803a9b0 con 0x7f42f80bff00 2023-12-22T09:15:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.991+0000 7f2780a83640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f276006a430 0x7f276006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.990+0000 7f42dffff640 1 -- 172.21.15.106:0/3259164659 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e803ab30 con 0x7f42f80bff00 2023-12-22T09:15:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.990+0000 7f42dffff640 1 -- 172.21.15.106:0/3259164659 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e80443f0 con 0x7f42f80bff00 2023-12-22T09:15:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.990+0000 7fe791805640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778003970 0x7fe778003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.990+0000 7fe792006640 1 -- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7780047c0 msgr2=0x7fe778004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.990+0000 7fe792006640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe7780047c0 0x7fe778004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.990+0000 7fe792006640 1 -- 172.21.15.106:0/3957574907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778003970 msgr2=0x7fe778003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.990+0000 7fe792006640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778003970 0x7fe778003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.990+0000 7fe792006640 1 -- 172.21.15.106:0/3957574907 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840def90 con 0x7fe778005180 2023-12-22T09:15:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f80bd880 con 0x7f42f80bff00 2023-12-22T09:15:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f80bde40 con 0x7f42f80bff00 2023-12-22T09:15:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7f2780a83640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f276006a430 0x7f276006c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2770034000 tx=0x7f2770008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.991+0000 7fc27b7fe640 1 -- 172.21.15.106:0/3931747093 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc28c03b050 con 0x7fc2940c7500 2023-12-22T09:15:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7f3dc8c31640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3dc415c070 0x7f3dc4155900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7f3dc8c31640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7f3dc8c31640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc406fe60 con 0x7f3dc4069e60 2023-12-22T09:15:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7f3dc8c31640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc415c5e0 con 0x7f3dc415c070 2023-12-22T09:15:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7f3dc8c31640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc4070140 con 0x7f3dc4070480 2023-12-22T09:15:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7fe792006640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe778005180 0x7fe77800b980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0696f0 tx=0x7fe7780057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c698ff7332f50c71 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7f23557fa640 1 -- 172.21.15.106:0/1959630879 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350009510 con 0x7f23581514b0 2023-12-22T09:15:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.992+0000 7fc27b7fe640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc28006a480 0x7fc28006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7fc27b7fe640 1 -- 172.21.15.106:0/3931747093 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc28c0aae80 con 0x7fc2940c7500 2023-12-22T09:15:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7f3dc2d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7f3dc2d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:57354/0 (socket says 172.21.15.106:57354) 2023-12-22T09:15:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7f3dc2d9d640 1 -- 172.21.15.106:0/3589002349 learned_addr learned my addr 172.21.15.106:0/3589002349 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7f3db9d9b640 1 --2- 172.21.15.106:0/3589002349 >> v2:172.21.15.106:3300/0 conn(0x7f3dc415c070 0x7f3dc4155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7f23557fa640 1 -- 172.21.15.106:0/1959630879 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235003e450 con 0x7f23581514b0 2023-12-22T09:15:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7f23557fa640 1 -- 172.21.15.106:0/1959630879 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235003e7e0 con 0x7f23581514b0 2023-12-22T09:15:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7f27797fa640 1 -- 172.21.15.106:0/3187312511 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2774053800 con 0x7f277c1514b0 2023-12-22T09:15:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7fc292ffd640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc28006a480 0x7fc28006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.993+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f80c0a20 con 0x7f42f80bff00 2023-12-22T09:15:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.994+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23581f1000 con 0x7f23581514b0 2023-12-22T09:15:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.994+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2358149e10 con 0x7f23581514b0 2023-12-22T09:15:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.994+0000 7fc292ffd640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc28006a480 0x7fc28006c940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc294153990 tx=0x7fc284009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.994+0000 7f3dc2d9d640 1 -- 172.21.15.106:0/3589002349 >> v2:172.21.15.106:3300/0 conn(0x7f3dc415c070 msgr2=0x7f3dc4155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.994+0000 7f3dc2d9d640 1 --2- 172.21.15.106:0/3589002349 >> v2:172.21.15.106:3300/0 conn(0x7f3dc415c070 0x7f3dc4155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.994+0000 7f3dc1d9b640 1 -- 172.21.15.106:0/3589002349 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643814748 0 0) 0x7f3dc406fe60 con 0x7f3dc4069e60 2023-12-22T09:15:02.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.994+0000 7f3dc2d9d640 1 -- 172.21.15.106:0/3589002349 >> v1:172.21.15.106:6789/0 conn(0x7f3dc4069e60 legacy=0x7f3dc41551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.994+0000 7f3dc2d9d640 1 -- 172.21.15.106:0/3589002349 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40c1440 con 0x7f3dc4070480 2023-12-22T09:15:02.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.994+0000 7f3db9d9b640 1 --2- 172.21.15.106:0/3589002349 >> v2:172.21.15.106:3300/0 conn(0x7f3dc415c070 0x7f3dc4155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:02.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.995+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2358073f10 con 0x7f23581514b0 2023-12-22T09:15:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.996+0000 7f3dc2d9d640 1 --2- 172.21.15.106:0/3589002349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40bfce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009e80 tx=0x7f3dbc02bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=873e7b57112f826b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.996+0000 7f3dc1d9b640 1 -- 172.21.15.106:0/3589002349 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc02cae0 con 0x7f3dc4070480 2023-12-22T09:15:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.996+0000 7f3dc1d9b640 1 -- 172.21.15.106:0/3589002349 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc02cc40 con 0x7f3dc4070480 2023-12-22T09:15:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.996+0000 7f3dc1d9b640 1 -- 172.21.15.106:0/3589002349 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0343f0 con 0x7f3dc4070480 2023-12-22T09:15:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.997+0000 7f3dc8c31640 1 -- 172.21.15.106:0/3589002349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 msgr2=0x7f3dc40bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.997+0000 7f3dc8c31640 1 --2- 172.21.15.106:0/3589002349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40bfce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009e80 tx=0x7f3dbc02bf40 comp rx=0 tx=0).stop 2023-12-22T09:15:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.997+0000 7f3dc8c31640 1 -- 172.21.15.106:0/3589002349 shutdown_connections 2023-12-22T09:15:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.997+0000 7f3dc8c31640 1 --2- 172.21.15.106:0/3589002349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40bfce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.997+0000 7f3dc8c31640 1 --2- 172.21.15.106:0/3589002349 >> v2:172.21.15.106:3300/0 conn(0x7f3dc415c070 0x7f3dc4155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.997+0000 7f3dc8c31640 1 -- 172.21.15.106:0/3589002349 >> 172.21.15.106:0/3589002349 conn(0x7f3dc40c5360 msgr2=0x7f3dc40c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.997+0000 7f23557fa640 1 -- 172.21.15.106:0/1959630879 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f235003e940 con 0x7f23581514b0 2023-12-22T09:15:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.998+0000 7f3dc8c31640 1 -- 172.21.15.106:0/3589002349 shutdown_connections 2023-12-22T09:15:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.998+0000 7f3dc8c31640 1 -- 172.21.15.106:0/3589002349 wait complete. 2023-12-22T09:15:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.999+0000 7f23557fa640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f233806a480 0x7f233806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.999+0000 7f23557fa640 1 -- 172.21.15.106:0/1959630879 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f23500ab8b0 con 0x7f23581514b0 2023-12-22T09:15:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:01.999+0000 7f2357fff640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f233806a480 0x7f233806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.000+0000 7f3dc8c31640 1 Processor -- start 2023-12-22T09:15:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.000+0000 7f3dc8c31640 1 -- start start 2023-12-22T09:15:02.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.000+0000 7f2357fff640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f233806a480 0x7f233806c940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2348007fd0 tx=0x7f2348009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.001+0000 7f3dc8c31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dc4069e60 0x7f3dc41ee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.001+0000 7f3dc8c31640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.001+0000 7f3dc8c31640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dc415c070 0x7f3dc41ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.001+0000 7f3dc8c31640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc4152a50 con 0x7f3dc415c070 2023-12-22T09:15:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.001+0000 7f3dc8c31640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40a9010 con 0x7f3dc4069e60 2023-12-22T09:15:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.001+0000 7f3dc8c31640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40a92f0 con 0x7f3dc4070480 2023-12-22T09:15:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3dc2d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dc415c070 0x7f3dc41ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3dc2d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dc415c070 0x7f3dc41ea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41334/0 (socket says 172.21.15.106:41334) 2023-12-22T09:15:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3dc2d9d640 1 -- 172.21.15.106:0/2593327501 learned_addr learned my addr 172.21.15.106:0/2593327501 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:02.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3dc259c640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dc4069e60 0x7f3dc41ee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3db9d9b640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3dc2d9d640 1 -- 172.21.15.106:0/2593327501 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 msgr2=0x7f3dc40a9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3dc2d9d640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40a9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3dc2d9d640 1 -- 172.21.15.106:0/2593327501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dc4069e60 msgr2=0x7f3dc41ee7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3dc2d9d640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dc4069e60 0x7f3dc41ee7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.002+0000 7f3dc2d9d640 1 -- 172.21.15.106:0/2593327501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db4009400 con 0x7f3dc415c070 2023-12-22T09:15:02.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.003+0000 7f3dc2d9d640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dc415c070 0x7f3dc41ea6f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009fa0 tx=0x7f3dbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.007+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0a9070 con 0x7fe778005180 2023-12-22T09:15:02.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.007+0000 7fc27b7fe640 1 -- 172.21.15.106:0/3931747093 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc28c076360 con 0x7fc2940c7500 2023-12-22T09:15:02.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.007+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c065a60 con 0x7fe778005180 2023-12-22T09:15:02.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.007+0000 7fe790803640 1 -- 172.21.15.106:0/3957574907 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c065e70 con 0x7fe778005180 2023-12-22T09:15:02.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.007+0000 7f3dbb7fe640 1 -- 172.21.15.106:0/2593327501 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc009510 con 0x7f3dc415c070 2023-12-22T09:15:02.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.007+0000 7f3dbb7fe640 1 -- 172.21.15.106:0/2593327501 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc03e450 con 0x7f3dc415c070 2023-12-22T09:15:02.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.007+0000 7f3dbb7fe640 1 -- 172.21.15.106:0/2593327501 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc03e5e0 con 0x7f3dc415c070 2023-12-22T09:15:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.007+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc009b30 con 0x7f3dc415c070 2023-12-22T09:15:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.007+0000 7f23557fa640 1 -- 172.21.15.106:0/1959630879 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2350076c20 con 0x7f23581514b0 2023-12-22T09:15:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.008+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc414fba0 con 0x7f3dc415c070 2023-12-22T09:15:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.008+0000 7fe793a69640 1 -- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe778005180 msgr2=0x7fe77800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.008+0000 7fe793a69640 1 --2- 172.21.15.106:0/3957574907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe778005180 0x7fe77800b980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0696f0 tx=0x7fe7780057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.008+0000 7fe792006640 1 -- 172.21.15.106:0/3957574907 reap_dead start 2023-12-22T09:15:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.009+0000 7fe793a69640 1 -- 172.21.15.106:0/3957574907 shutdown_connections 2023-12-22T09:15:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.009+0000 7fe793a69640 1 -- 172.21.15.106:0/3957574907 >> 172.21.15.106:0/3957574907 conn(0x7fe784048290 msgr2=0x7fe7840486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.009+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc40a9460 con 0x7f3dc415c070 2023-12-22T09:15:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.010+0000 7fe793a69640 1 -- 172.21.15.106:0/3957574907 shutdown_connections 2023-12-22T09:15:02.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.010+0000 7f42dffff640 1 -- 172.21.15.106:0/3259164659 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f42e802f050 con 0x7f42f80bff00 2023-12-22T09:15:02.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.010+0000 7fe793a69640 1 -- 172.21.15.106:0/3957574907 wait complete. 2023-12-22T09:15:02.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.013+0000 7fe793a69640 1 Processor -- start 2023-12-22T09:15:02.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.013+0000 7fe793a69640 1 -- start start 2023-12-22T09:15:02.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.011+0000 7f42dffff640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42e406a430 0x7f42e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.012+0000 7f42dffff640 1 -- 172.21.15.106:0/3259164659 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42e80aa4f0 con 0x7f42f80bff00 2023-12-22T09:15:02.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.013+0000 7f42f77fe640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42e406a430 0x7f42e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.014+0000 7f42f77fe640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42e406a430 0x7f42e406c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009b40 tx=0x7f42ec009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.014+0000 7f3dbb7fe640 1 -- 172.21.15.106:0/2593327501 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3dbc03e740 con 0x7f3dc415c070 2023-12-22T09:15:02.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.015+0000 7fe793a69640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778005180 0x7fe7840d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.015+0000 7fe793a69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe78402b510 0x7fe78402ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.015+0000 7fe793a69640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe784044c70 0x7fe7840450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.016+0000 7f3dbb7fe640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3da406a460 0x7f3da406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.016+0000 7fe793a69640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840314d0 con 0x7fe778005180 2023-12-22T09:15:02.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.016+0000 7fe791004640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe78402b510 0x7fe78402ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.016+0000 7fe791004640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe78402b510 0x7fe78402ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:40294/0 (socket says 172.21.15.106:40294) 2023-12-22T09:15:02.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.016+0000 7f3dc259c640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3da406a460 0x7f3da406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.016+0000 7f3dbb7fe640 1 -- 172.21.15.106:0/2593327501 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3dbc07b210 con 0x7f3dc415c070 2023-12-22T09:15:02.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.016+0000 7fe791004640 1 -- 172.21.15.106:0/1419284135 learned_addr learned my addr 172.21.15.106:0/1419284135 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:02.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.016+0000 7fe791805640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778005180 0x7fe7840d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.017+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe784030c30 con 0x7fe78402b510 2023-12-22T09:15:02.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.017+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe784030f10 con 0x7fe784044c70 2023-12-22T09:15:02.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.017+0000 7f3dc259c640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3da406a460 0x7f3da406c920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3dac000fd0 tx=0x7f3dac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.018+0000 7fe792006640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe784044c70 0x7fe7840450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.018+0000 7fe791805640 1 -- 172.21.15.106:0/1419284135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe784044c70 msgr2=0x7fe7840450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.018+0000 7fe791805640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe784044c70 0x7fe7840450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.018+0000 7fe791805640 1 -- 172.21.15.106:0/1419284135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe78402b510 msgr2=0x7fe78402ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.018+0000 7fe791805640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe78402b510 0x7fe78402ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.018+0000 7fe791805640 1 -- 172.21.15.106:0/1419284135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840311f0 con 0x7fe778005180 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.018+0000 7fe791805640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778005180 0x7fe7840d1d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe788000c00 tx=0x7fe7880077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.021+0000 7fe7827fc640 1 -- 172.21.15.106:0/1419284135 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800f910 con 0x7fe778005180 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.021+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe784044750 con 0x7fe778005180 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.021+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78402f2d0 con 0x7fe778005180 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.021+0000 7fe7827fc640 1 -- 172.21.15.106:0/1419284135 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78800fa70 con 0x7fe778005180 2023-12-22T09:15:02.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.021+0000 7fe7827fc640 1 -- 172.21.15.106:0/1419284135 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800fe20 con 0x7fe778005180 2023-12-22T09:15:02.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.021+0000 7f42dffff640 1 -- 172.21.15.106:0/3259164659 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f42e8075880 con 0x7f42f80bff00 2023-12-22T09:15:02.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.023+0000 7f3dbb7fe640 1 -- 172.21.15.106:0/2593327501 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3dbc076e50 con 0x7f3dc415c070 2023-12-22T09:15:02.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.024+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe774005250 con 0x7fe778005180 2023-12-22T09:15:02.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.025+0000 7fe7827fc640 1 -- 172.21.15.106:0/1419284135 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe78801d460 con 0x7fe778005180 2023-12-22T09:15:02.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.026+0000 7fe7827fc640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe77006a460 0x7fe77006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.026+0000 7fe7827fc640 1 -- 172.21.15.106:0/1419284135 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe788088d30 con 0x7fe778005180 2023-12-22T09:15:02.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.027+0000 7fe791004640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe77006a460 0x7fe77006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.028+0000 7fe791004640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe77006a460 0x7fe77006c920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe78403ee60 tx=0x7fe77c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.036+0000 7fe7827fc640 1 -- 172.21.15.106:0/1419284135 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe788053f90 con 0x7fe778005180 2023-12-22T09:15:02.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.367+0000 7fd4db58e640 1 -- 172.21.15.106:0/3266852278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd4bc0057d0 con 0x7fd4cc00b160 2023-12-22T09:15:02.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.367+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4ac0c6e10 con 0x7fa4ac154360 2023-12-22T09:15:02.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.368+0000 7fd4caffd640 1 -- 172.21.15.106:0/3266852278 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4d0017020 con 0x7fd4cc00b160 2023-12-22T09:15:02.368 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:15:02.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.368+0000 7fa4a8ff9640 1 -- 172.21.15.106:0/3777025064 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4a40575f0 con 0x7fa4ac154360 2023-12-22T09:15:02.370 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:15:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.371+0000 7fd4c8ff9640 1 -- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd4b806a490 msgr2=0x7fd4b806c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.371+0000 7fd4c8ff9640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd4b806a490 0x7fd4b806c950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4034000 tx=0x7fd4c402f000 comp rx=0 tx=0).stop 2023-12-22T09:15:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.371+0000 7fd4c8ff9640 1 -- 172.21.15.106:0/3266852278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4cc00b160 msgr2=0x7fd4cc02fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.371+0000 7fd4c8ff9640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4cc00b160 0x7fd4cc02fa10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000c3f0 tx=0x7fd4d000c8b0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.372+0000 7fd4c8ff9640 1 -- 172.21.15.106:0/3266852278 shutdown_connections 2023-12-22T09:15:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.372+0000 7fd4c8ff9640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd4b806a490 0x7fd4b806c950 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.372+0000 7fd4c8ff9640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4cc03eb60 0x7fd4cc0d70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.372+0000 7fd4c8ff9640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4cc031680 0x7fd4cc0de1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.372+0000 7fd4c8ff9640 1 --2- 172.21.15.106:0/3266852278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4cc00b160 0x7fd4cc02fa10 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000c3f0 tx=0x7fd4d000c8b0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.372+0000 7fd4c8ff9640 1 -- 172.21.15.106:0/3266852278 >> 172.21.15.106:0/3266852278 conn(0x7fd4cc005fe0 msgr2=0x7fd4cc0dffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.373+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa49806a530 msgr2=0x7fa49806c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.373+0000 7fd4c8ff9640 1 -- 172.21.15.106:0/3266852278 shutdown_connections 2023-12-22T09:15:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.373+0000 7fd4c8ff9640 1 -- 172.21.15.106:0/3266852278 wait complete. 2023-12-22T09:15:02.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.373+0000 7fa4b1629640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa49806a530 0x7fa49806c9f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009f70 tx=0x7fa49c009240 comp rx=0 tx=0).stop 2023-12-22T09:15:02.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.373+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 msgr2=0x7fa4ac156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.374+0000 7fa4b1629640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 0x7fa4ac156b60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4007df0 tx=0x7fa4a400e4b0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.374+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 shutdown_connections 2023-12-22T09:15:02.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.374+0000 7fa4b1629640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa49806a530 0x7fa49806c9f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.374+0000 7fa4b1629640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ac154360 0x7fa4ac156b60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.374+0000 7fa4b1629640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ac0c7410 0x7fa4ac14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.374+0000 7fa4b1629640 1 --2- 172.21.15.106:0/3777025064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ac0c4100 0x7fa4ac1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.374+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 >> 172.21.15.106:0/3777025064 conn(0x7fa4ac0c5f90 msgr2=0x7fa4ac0c8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.375+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 shutdown_connections 2023-12-22T09:15:02.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.375+0000 7fa4b1629640 1 -- 172.21.15.106:0/3777025064 wait complete. 2023-12-22T09:15:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.401+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f275c005500 con 0x7f277c1514b0 2023-12-22T09:15:02.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.0 2023-12-22T09:15:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.401+0000 7f27797fa640 1 -- 172.21.15.106:0/3187312511 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2774018020 con 0x7f277c1514b0 2023-12-22T09:15:02.401 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:02.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.1 2023-12-22T09:15:02.402 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:15:02.403 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.406+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f276006a430 msgr2=0x7f276006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.406+0000 7f2782ce7640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f276006a430 0x7f276006c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2770034000 tx=0x7f2770008030 comp rx=0 tx=0).stop 2023-12-22T09:15:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.406+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 msgr2=0x7f277c0c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.406+0000 7f2782ce7640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 0x7f277c0c7e80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7d0 tx=0x7f277400cc90 comp rx=0 tx=0).stop 2023-12-22T09:15:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.407+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 shutdown_connections 2023-12-22T09:15:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.407+0000 7f2782ce7640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f276006a430 0x7f276006c8f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.407+0000 7f2782ce7640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f277c1514b0 0x7f277c0c7e80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.407+0000 7f2782ce7640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f277c0c4130 0x7f277c1ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.407+0000 7f2782ce7640 1 --2- 172.21.15.106:0/3187312511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f277c06aad0 0x7f277c148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.407+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 >> 172.21.15.106:0/3187312511 conn(0x7f277c0ab1a0 msgr2=0x7f277c154540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.407+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 shutdown_connections 2023-12-22T09:15:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.407+0000 7f2782ce7640 1 -- 172.21.15.106:0/3187312511 wait complete. 2023-12-22T09:15:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.413+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc29404e8d0 con 0x7fc2940c7500 2023-12-22T09:15:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.414+0000 7fc27b7fe640 1 -- 172.21.15.106:0/3931747093 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc28c04d090 con 0x7fc2940c7500 2023-12-22T09:15:02.414 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:15:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.416+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42f8073f10 con 0x7f42f80bff00 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.416+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc28006a480 msgr2=0x7fc28006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.416+0000 7fc293fff640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc28006a480 0x7fc28006c940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc294153990 tx=0x7fc284009060 comp rx=0 tx=0).stop 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.416+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2940c7500 msgr2=0x7fc29414cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.416+0000 7fc293fff640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2940c7500 0x7fc29414cec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c004a40 comp rx=0 tx=0).stop 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.417+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 shutdown_connections 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.417+0000 7fc293fff640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc28006a480 0x7fc28006c940 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.417+0000 7fc293fff640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2940c7500 0x7fc29414cec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.417+0000 7fc293fff640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2940aeb90 0x7fc2940bfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.417+0000 7fc293fff640 1 --2- 172.21.15.106:0/3931747093 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc29406c7e0 0x7fc2940c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.417+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 >> 172.21.15.106:0/3931747093 conn(0x7fc2940ab120 msgr2=0x7fc2940ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.417+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 shutdown_connections 2023-12-22T09:15:02.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.417+0000 7fc293fff640 1 -- 172.21.15.106:0/3931747093 wait complete. 2023-12-22T09:15:02.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.417+0000 7f42dffff640 1 -- 172.21.15.106:0/3259164659 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42e8078ea0 con 0x7f42f80bff00 2023-12-22T09:15:02.417 INFO:teuthology.orchestra.run.smithi106.stdout:60129542156 2023-12-22T09:15:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42e406a430 msgr2=0x7f42e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42e406a430 0x7f42e406c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009b40 tx=0x7f42ec009190 comp rx=0 tx=0).stop 2023-12-22T09:15:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80bff00 msgr2=0x7f42f80c0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80bff00 0x7f42f80c0d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f42e8033000 tx=0x7f42e80046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 shutdown_connections 2023-12-22T09:15:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42e406a430 0x7f42e406c8f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42f80c0380 0x7f42f80c1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80bff00 0x7f42f80c0d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 --2- 172.21.15.106:0/3259164659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81514b0 0x7f42f80be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.420+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 >> 172.21.15.106:0/3259164659 conn(0x7f42f80ab1a0 msgr2=0x7f42f80ab580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.421+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 shutdown_connections 2023-12-22T09:15:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.421+0000 7f42fdc57640 1 -- 172.21.15.106:0/3259164659 wait complete. 2023-12-22T09:15:02.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.423+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f235806bc20 con 0x7f23581514b0 2023-12-22T09:15:02.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.423+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3dc4073f10 con 0x7f3dc415c070 2023-12-22T09:15:02.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.426+0000 7f3dbb7fe640 1 -- 172.21.15.106:0/2593327501 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3dbc043020 con 0x7f3dc415c070 2023-12-22T09:15:02.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.426+0000 7f23557fa640 1 -- 172.21.15.106:0/1959630879 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f235007a240 con 0x7f23581514b0 2023-12-22T09:15:02.426 INFO:teuthology.orchestra.run.smithi106.stdout:60129542154 2023-12-22T09:15:02.426 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:15:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.429+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3da406a460 msgr2=0x7f3da406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.429+0000 7f3dc8c31640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3da406a460 0x7f3da406c920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3dac000fd0 tx=0x7f3dac009040 comp rx=0 tx=0).stop 2023-12-22T09:15:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.429+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dc415c070 msgr2=0x7f3dc41ea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.429+0000 7f3dc8c31640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dc415c070 0x7f3dc41ea6f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009fa0 tx=0x7f3dbc004a40 comp rx=0 tx=0).stop 2023-12-22T09:15:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 shutdown_connections 2023-12-22T09:15:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f3dc8c31640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3da406a460 0x7f3da406c920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f3dc8c31640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dc415c070 0x7f3dc41ea6f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f3dc8c31640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3dc4070480 0x7f3dc40a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f3dc8c31640 1 --2- 172.21.15.106:0/2593327501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3dc4069e60 0x7f3dc41ee7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 >> 172.21.15.106:0/2593327501 conn(0x7f3dc40c5360 msgr2=0x7f3dc40c1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 shutdown_connections 2023-12-22T09:15:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f3dc8c31640 1 -- 172.21.15.106:0/2593327501 wait complete. 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f233806a480 msgr2=0x7f233806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f235e595640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f233806a480 0x7f233806c940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2348007fd0 tx=0x7f2348009040 comp rx=0 tx=0).stop 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23581514b0 msgr2=0x7f23580c1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.430+0000 7f235e595640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23581514b0 0x7f23580c1280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2350036040 tx=0x7f2350004a40 comp rx=0 tx=0).stop 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.431+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 shutdown_connections 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.431+0000 7f235e595640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f233806a480 0x7f233806c940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.431+0000 7f235e595640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23581514b0 0x7f23580c1280 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.431+0000 7f235e595640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23580c4130 0x7f23580c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.431+0000 7f235e595640 1 --2- 172.21.15.106:0/1959630879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f235806aad0 0x7f23581498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.431+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 >> 172.21.15.106:0/1959630879 conn(0x7f23580ab1a0 msgr2=0x7f23580c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.431+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 shutdown_connections 2023-12-22T09:15:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.431+0000 7f235e595640 1 -- 172.21.15.106:0/1959630879 wait complete. 2023-12-22T09:15:02.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.4 2023-12-22T09:15:02.432 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:02.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.7 2023-12-22T09:15:02.439 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:02.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.3 2023-12-22T09:15:02.441 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:02.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2023-12-22T09:15:02.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.449+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe774005500 con 0x7fe778005180 2023-12-22T09:15:02.448 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:02.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.449+0000 7fe7827fc640 1 -- 172.21.15.106:0/1419284135 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7880575b0 con 0x7fe778005180 2023-12-22T09:15:02.449 INFO:teuthology.orchestra.run.smithi106.stdout:60129542155 2023-12-22T09:15:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe77006a460 msgr2=0x7fe77006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe77006a460 0x7fe77006c920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe78403ee60 tx=0x7fe77c009190 comp rx=0 tx=0).stop 2023-12-22T09:15:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778005180 msgr2=0x7fe7840d1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778005180 0x7fe7840d1d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe788000c00 tx=0x7fe7880077f0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 shutdown_connections 2023-12-22T09:15:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe77006a460 0x7fe77006c920 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe784044c70 0x7fe7840450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe78402b510 0x7fe78402ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 --2- 172.21.15.106:0/1419284135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe778005180 0x7fe7840d1d80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.452+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 >> 172.21.15.106:0/1419284135 conn(0x7fe784048290 msgr2=0x7fe7840dbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.453+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 shutdown_connections 2023-12-22T09:15:02.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.453+0000 7fe793a69640 1 -- 172.21.15.106:0/1419284135 wait complete. 2023-12-22T09:15:02.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.2 2023-12-22T09:15:02.455 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:02.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.5 2023-12-22T09:15:02.468 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:02.468 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-22T09:15:02.468 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:15:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.713+0000 7f4b63826640 1 Processor -- start 2023-12-22T09:15:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.713+0000 7f4b63826640 1 -- start start 2023-12-22T09:15:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.714+0000 7f4b63826640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.714+0000 7f4b63826640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b5c06aad0 0x7f4b5c0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.714+0000 7f4b63826640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c0c4660 con 0x7f4b5c1514b0 2023-12-22T09:15:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.714+0000 7f4b63826640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c153d60 con 0x7f4b5c06aad0 2023-12-22T09:15:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.714+0000 7f4b63826640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c154c50 con 0x7f4b5c0c4130 2023-12-22T09:15:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.715+0000 7f4b60dc1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.715+0000 7f4b60dc1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c0c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:57382/0 (socket says 172.21.15.106:57382) 2023-12-22T09:15:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.715+0000 7f4b60dc1640 1 -- 172.21.15.106:0/3145382565 learned_addr learned my addr 172.21.15.106:0/3145382565 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.716+0000 7f4b61dc3640 1 --2- 172.21.15.106:0/3145382565 >> v2:172.21.15.132:3300/0 conn(0x7f4b5c06aad0 0x7f4b5c0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.716+0000 7f4b60dc1640 1 -- 172.21.15.106:0/3145382565 >> v2:172.21.15.132:3300/0 conn(0x7f4b5c06aad0 msgr2=0x7f4b5c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.716+0000 7f4b60dc1640 1 --2- 172.21.15.106:0/3145382565 >> v2:172.21.15.132:3300/0 conn(0x7f4b5c06aad0 0x7f4b5c0c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.716+0000 7f4b60dc1640 1 -- 172.21.15.106:0/3145382565 >> v1:172.21.15.132:6789/0 conn(0x7f4b5c1514b0 legacy=0x7f4b5c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.716+0000 7f4b60dc1640 1 -- 172.21.15.106:0/3145382565 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c06b250 con 0x7f4b5c0c4130 2023-12-22T09:15:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.718+0000 7f4b60dc1640 1 --2- 172.21.15.106:0/3145382565 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c0c75b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c009870 tx=0x7f4b4c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12a277cd86451eab server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.718+0000 7f4b53fff640 1 -- 172.21.15.106:0/3145382565 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c031640 con 0x7f4b5c0c4130 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.718+0000 7f4b53fff640 1 -- 172.21.15.106:0/3145382565 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c0317a0 con 0x7f4b5c0c4130 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.718+0000 7f4b53fff640 1 -- 172.21.15.106:0/3145382565 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c031b30 con 0x7f4b5c0c4130 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.719+0000 7f4b63826640 1 -- 172.21.15.106:0/3145382565 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 msgr2=0x7f4b5c0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.719+0000 7f4b63826640 1 --2- 172.21.15.106:0/3145382565 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c0c75b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c009870 tx=0x7f4b4c02b8f0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.719+0000 7f4b63826640 1 -- 172.21.15.106:0/3145382565 shutdown_connections 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.719+0000 7f4b63826640 1 --2- 172.21.15.106:0/3145382565 >> v2:172.21.15.132:3300/0 conn(0x7f4b5c06aad0 0x7f4b5c0c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.719+0000 7f4b63826640 1 --2- 172.21.15.106:0/3145382565 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c0c75b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.719+0000 7f4b63826640 1 -- 172.21.15.106:0/3145382565 >> 172.21.15.106:0/3145382565 conn(0x7f4b5c0ab1a0 msgr2=0x7f4b5c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.719+0000 7f4b63826640 1 -- 172.21.15.106:0/3145382565 shutdown_connections 2023-12-22T09:15:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.719+0000 7f4b63826640 1 -- 172.21.15.106:0/3145382565 wait complete. 2023-12-22T09:15:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.721+0000 7f4b63826640 1 Processor -- start 2023-12-22T09:15:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.721+0000 7f4b63826640 1 -- start start 2023-12-22T09:15:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.722+0000 7f4b63826640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5c06aad0 0x7f4b5c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.722+0000 7f4b63826640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c1ec240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.722+0000 7f4b63826640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b5c1514b0 0x7f4b5c1ec780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.722+0000 7f4b63826640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c3910 con 0x7f4b5c1514b0 2023-12-22T09:15:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.722+0000 7f4b63826640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0bd7d0 con 0x7f4b5c06aad0 2023-12-22T09:15:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.722+0000 7f4b63826640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c11d0 con 0x7f4b5c0c4130 2023-12-22T09:15:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b61dc3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b5c1514b0 0x7f4b5c1ec780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b61dc3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b5c1514b0 0x7f4b5c1ec780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50632/0 (socket says 172.21.15.106:50632) 2023-12-22T09:15:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b61dc3640 1 -- 172.21.15.106:0/346069295 learned_addr learned my addr 172.21.15.106:0/346069295 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b615c2640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5c06aad0 0x7f4b5c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b60dc1640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c1ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b61dc3640 1 -- 172.21.15.106:0/346069295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 msgr2=0x7f4b5c1ec240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b61dc3640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c1ec240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b61dc3640 1 -- 172.21.15.106:0/346069295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5c06aad0 msgr2=0x7f4b5c149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b61dc3640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5c06aad0 0x7f4b5c149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b61dc3640 1 -- 172.21.15.106:0/346069295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0094d0 con 0x7f4b5c1514b0 2023-12-22T09:15:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.723+0000 7f4b61dc3640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b5c1514b0 0x7f4b5c1ec780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400efc0 tx=0x7f4b5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.724+0000 7f4b51ffb640 1 -- 172.21.15.106:0/346069295 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54009ba0 con 0x7f4b5c1514b0 2023-12-22T09:15:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.724+0000 7f4b51ffb640 1 -- 172.21.15.106:0/346069295 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400f040 con 0x7f4b5c1514b0 2023-12-22T09:15:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.724+0000 7f4b51ffb640 1 -- 172.21.15.106:0/346069295 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540146c0 con 0x7f4b5c1514b0 2023-12-22T09:15:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.724+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c14d340 con 0x7f4b5c1514b0 2023-12-22T09:15:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.724+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c1ecdd0 con 0x7f4b5c1514b0 2023-12-22T09:15:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.725+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c0be580 con 0x7f4b5c1514b0 2023-12-22T09:15:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.726+0000 7f4b51ffb640 1 -- 172.21.15.106:0/346069295 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b54014820 con 0x7f4b5c1514b0 2023-12-22T09:15:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.727+0000 7f4b51ffb640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4b4006a430 0x7f4b4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.727+0000 7f4b51ffb640 1 -- 172.21.15.106:0/346069295 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b540899d0 con 0x7f4b5c1514b0 2023-12-22T09:15:02.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.727+0000 7f4b615c2640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4b4006a430 0x7f4b4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:02.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.728+0000 7f4b615c2640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4b4006a430 0x7f4b4006c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b58001780 tx=0x7f4b58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.731+0000 7f4b51ffb640 1 -- 172.21.15.106:0/346069295 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b5c0be580 con 0x7f4b5c1514b0 2023-12-22T09:15:02.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.903+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b5c06b530 con 0x7f4b4006a430 2023-12-22T09:15:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.929+0000 7f4b51ffb640 1 -- 172.21.15.106:0/346069295 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345000 (secure 0 0 0) 0x7f4b58001420 con 0x7f4b4006a430 2023-12-22T09:15:02.930 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:02.935 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:15:02.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4b4006a430 msgr2=0x7f4b4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4b4006a430 0x7f4b4006c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b58001780 tx=0x7f4b58009040 comp rx=0 tx=0).stop 2023-12-22T09:15:02.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b5c1514b0 msgr2=0x7f4b5c1ec780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:02.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b5c1514b0 0x7f4b5c1ec780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400efc0 tx=0x7f4b5400c490 comp rx=0 tx=0).stop 2023-12-22T09:15:02.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 shutdown_connections 2023-12-22T09:15:02.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4b4006a430 0x7f4b4006c8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b5c1514b0 0x7f4b5c1ec780 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b5c0c4130 0x7f4b5c1ec240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 --2- 172.21.15.106:0/346069295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5c06aad0 0x7f4b5c149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:02.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 >> 172.21.15.106:0/346069295 conn(0x7f4b5c0ab1a0 msgr2=0x7f4b5c152260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:02.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 shutdown_connections 2023-12-22T09:15:02.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:02.937+0000 7f4b63826640 1 -- 172.21.15.106:0/346069295 wait complete. 2023-12-22T09:15:02.957 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-12-22T09:15:02.707239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218888,"kb_used_data":3272,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755832,"statfs":{"total":773094113280,"available":772869971968,"internally_reserved":0,"allocated":3350528,"data_stored":2014524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005650"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491770+0000","last_change":"2023-12-22T09:14:27.999590+0000","last_active":"2023-12-22T09:14:32.491770+0000","last_peered":"2023-12-22T09:14:32.491770+0000","last_clean":"2023-12-22T09:14:32.491770+0000","last_became_active":"2023-12-22T09:14:27.999168+0000","last_became_peered":"2023-12-22T09:14:27.999168+0000","last_unstale":"2023-12-22T09:14:32.491770+0000","last_undegraded":"2023-12-22T09:14:32.491770+0000","last_fullsized":"2023-12-22T09:14:32.491770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:55.319959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468195+0000","last_change":"2023-12-22T09:14:28.471978+0000","last_active":"2023-12-22T09:14:32.468195+0000","last_peered":"2023-12-22T09:14:32.468195+0000","last_clean":"2023-12-22T09:14:32.468195+0000","last_became_active":"2023-12-22T09:14:28.471551+0000","last_became_peered":"2023-12-22T09:14:28.471551+0000","last_unstale":"2023-12-22T09:14:32.468195+0000","last_undegraded":"2023-12-22T09:14:32.468195+0000","last_fullsized":"2023-12-22T09:14:32.468195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.753370+0000","last_change":"2023-12-22T09:14:32.750885+0000","last_active":"2023-12-22T09:14:32.753370+0000","last_peered":"2023-12-22T09:14:32.753370+0000","last_clean":"2023-12-22T09:14:32.753370+0000","last_became_active":"2023-12-22T09:14:32.750410+0000","last_became_peered":"2023-12-22T09:14:32.750410+0000","last_unstale":"2023-12-22T09:14:32.753370+0000","last_undegraded":"2023-12-22T09:14:32.753370+0000","last_fullsized":"2023-12-22T09:14:32.753370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:03:15.507458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468717+0000","last_change":"2023-12-22T09:14:27.993421+0000","last_active":"2023-12-22T09:14:32.468717+0000","last_peered":"2023-12-22T09:14:32.468717+0000","last_clean":"2023-12-22T09:14:32.468717+0000","last_became_active":"2023-12-22T09:14:27.993088+0000","last_became_peered":"2023-12-22T09:14:27.993088+0000","last_unstale":"2023-12-22T09:14:32.468717+0000","last_undegraded":"2023-12-22T09:14:32.468717+0000","last_fullsized":"2023-12-22T09:14:32.468717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491593+0000","last_change":"2023-12-22T09:14:28.475345+0000","last_active":"2023-12-22T09:14:32.491593+0000","last_peered":"2023-12-22T09:14:32.491593+0000","last_clean":"2023-12-22T09:14:32.491593+0000","last_became_active":"2023-12-22T09:14:28.473015+0000","last_became_peered":"2023-12-22T09:14:28.473015+0000","last_unstale":"2023-12-22T09:14:32.491593+0000","last_undegraded":"2023-12-22T09:14:32.491593+0000","last_fullsized":"2023-12-22T09:14:32.491593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502282+0000","last_change":"2023-12-22T09:14:32.497444+0000","last_active":"2023-12-22T09:14:32.502282+0000","last_peered":"2023-12-22T09:14:32.502282+0000","last_clean":"2023-12-22T09:14:32.502282+0000","last_became_active":"2023-12-22T09:14:32.494648+0000","last_became_peered":"2023-12-22T09:14:32.494648+0000","last_unstale":"2023-12-22T09:14:32.502282+0000","last_undegraded":"2023-12-22T09:14:32.502282+0000","last_fullsized":"2023-12-22T09:14:32.502282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:47:30.609572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749932+0000","last_change":"2023-12-22T09:14:28.004480+0000","last_active":"2023-12-22T09:14:32.749932+0000","last_peered":"2023-12-22T09:14:32.749932+0000","last_clean":"2023-12-22T09:14:32.749932+0000","last_became_active":"2023-12-22T09:14:28.004122+0000","last_became_peered":"2023-12-22T09:14:28.004122+0000","last_unstale":"2023-12-22T09:14:32.749932+0000","last_undegraded":"2023-12-22T09:14:32.749932+0000","last_fullsized":"2023-12-22T09:14:32.749932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:21.127787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494251+0000","last_change":"2023-12-22T09:14:28.476757+0000","last_active":"2023-12-22T09:14:32.494251+0000","last_peered":"2023-12-22T09:14:32.494251+0000","last_clean":"2023-12-22T09:14:32.494251+0000","last_became_active":"2023-12-22T09:14:28.476378+0000","last_became_peered":"2023-12-22T09:14:28.476378+0000","last_unstale":"2023-12-22T09:14:32.494251+0000","last_undegraded":"2023-12-22T09:14:32.494251+0000","last_fullsized":"2023-12-22T09:14:32.494251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507391+0000","last_change":"2023-12-22T09:14:32.502471+0000","last_active":"2023-12-22T09:14:32.507391+0000","last_peered":"2023-12-22T09:14:32.507391+0000","last_clean":"2023-12-22T09:14:32.507391+0000","last_became_active":"2023-12-22T09:14:32.501880+0000","last_became_peered":"2023-12-22T09:14:32.501880+0000","last_unstale":"2023-12-22T09:14:32.507391+0000","last_undegraded":"2023-12-22T09:14:32.507391+0000","last_fullsized":"2023-12-22T09:14:32.507391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:16.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749172+0000","last_change":"2023-12-22T09:14:28.005371+0000","last_active":"2023-12-22T09:14:32.749172+0000","last_peered":"2023-12-22T09:14:32.749172+0000","last_clean":"2023-12-22T09:14:32.749172+0000","last_became_active":"2023-12-22T09:14:28.005096+0000","last_became_peered":"2023-12-22T09:14:28.005096+0000","last_unstale":"2023-12-22T09:14:32.749172+0000","last_undegraded":"2023-12-22T09:14:32.749172+0000","last_fullsized":"2023-12-22T09:14:32.749172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495790+0000","last_change":"2023-12-22T09:14:28.481890+0000","last_active":"2023-12-22T09:14:32.495790+0000","last_peered":"2023-12-22T09:14:32.495790+0000","last_clean":"2023-12-22T09:14:32.495790+0000","last_became_active":"2023-12-22T09:14:28.480455+0000","last_became_peered":"2023-12-22T09:14:28.480455+0000","last_unstale":"2023-12-22T09:14:32.495790+0000","last_undegraded":"2023-12-22T09:14:32.495790+0000","last_fullsized":"2023-12-22T09:14:32.495790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:34.191893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502319+0000","last_change":"2023-12-22T09:14:32.497995+0000","last_active":"2023-12-22T09:14:32.502319+0000","last_peered":"2023-12-22T09:14:32.502319+0000","last_clean":"2023-12-22T09:14:32.502319+0000","last_became_active":"2023-12-22T09:14:32.497136+0000","last_became_peered":"2023-12-22T09:14:32.497136+0000","last_unstale":"2023-12-22T09:14:32.502319+0000","last_undegraded":"2023-12-22T09:14:32.502319+0000","last_fullsized":"2023-12-22T09:14:32.502319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:02.042832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490410+0000","last_change":"2023-12-22T09:14:28.467962+0000","last_active":"2023-12-22T09:14:32.490410+0000","last_peered":"2023-12-22T09:14:32.490410+0000","last_clean":"2023-12-22T09:14:32.490410+0000","last_became_active":"2023-12-22T09:14:28.467669+0000","last_became_peered":"2023-12-22T09:14:28.467669+0000","last_unstale":"2023-12-22T09:14:32.490410+0000","last_undegraded":"2023-12-22T09:14:32.490410+0000","last_fullsized":"2023-12-22T09:14:32.490410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:14:12.211157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749464+0000","last_change":"2023-12-22T09:14:28.003252+0000","last_active":"2023-12-22T09:14:32.749464+0000","last_peered":"2023-12-22T09:14:32.749464+0000","last_clean":"2023-12-22T09:14:32.749464+0000","last_became_active":"2023-12-22T09:14:28.002818+0000","last_became_peered":"2023-12-22T09:14:28.002818+0000","last_unstale":"2023-12-22T09:14:32.749464+0000","last_undegraded":"2023-12-22T09:14:32.749464+0000","last_fullsized":"2023-12-22T09:14:32.749464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:41.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502344+0000","last_change":"2023-12-22T09:14:32.498105+0000","last_active":"2023-12-22T09:14:32.502344+0000","last_peered":"2023-12-22T09:14:32.502344+0000","last_clean":"2023-12-22T09:14:32.502344+0000","last_became_active":"2023-12-22T09:14:32.497287+0000","last_became_peered":"2023-12-22T09:14:32.497287+0000","last_unstale":"2023-12-22T09:14:32.502344+0000","last_undegraded":"2023-12-22T09:14:32.502344+0000","last_fullsized":"2023-12-22T09:14:32.502344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:20.526932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467458+0000","last_change":"2023-12-22T09:14:28.481525+0000","last_active":"2023-12-22T09:14:32.467458+0000","last_peered":"2023-12-22T09:14:32.467458+0000","last_clean":"2023-12-22T09:14:32.467458+0000","last_became_active":"2023-12-22T09:14:28.480895+0000","last_became_peered":"2023-12-22T09:14:28.480895+0000","last_unstale":"2023-12-22T09:14:32.467458+0000","last_undegraded":"2023-12-22T09:14:32.467458+0000","last_fullsized":"2023-12-22T09:14:32.467458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477412+0000","last_change":"2023-12-22T09:14:27.988542+0000","last_active":"2023-12-22T09:14:32.477412+0000","last_peered":"2023-12-22T09:14:32.477412+0000","last_clean":"2023-12-22T09:14:32.477412+0000","last_became_active":"2023-12-22T09:14:27.988286+0000","last_became_peered":"2023-12-22T09:14:27.988286+0000","last_unstale":"2023-12-22T09:14:32.477412+0000","last_undegraded":"2023-12-22T09:14:32.477412+0000","last_fullsized":"2023-12-22T09:14:32.477412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.496996+0000","last_change":"2023-12-22T09:14:32.489874+0000","last_active":"2023-12-22T09:14:32.496996+0000","last_peered":"2023-12-22T09:14:32.496996+0000","last_clean":"2023-12-22T09:14:32.496996+0000","last_became_active":"2023-12-22T09:14:32.489424+0000","last_became_peered":"2023-12-22T09:14:32.489424+0000","last_unstale":"2023-12-22T09:14:32.496996+0000","last_undegraded":"2023-12-22T09:14:32.496996+0000","last_fullsized":"2023-12-22T09:14:32.496996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:16.494365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466677+0000","last_change":"2023-12-22T09:14:28.479495+0000","last_active":"2023-12-22T09:14:32.466677+0000","last_peered":"2023-12-22T09:14:32.466677+0000","last_clean":"2023-12-22T09:14:32.466677+0000","last_became_active":"2023-12-22T09:14:28.479219+0000","last_became_peered":"2023-12-22T09:14:28.479219+0000","last_unstale":"2023-12-22T09:14:32.466677+0000","last_undegraded":"2023-12-22T09:14:32.466677+0000","last_fullsized":"2023-12-22T09:14:32.466677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:34.191893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479772+0000","last_change":"2023-12-22T09:14:27.998498+0000","last_active":"2023-12-22T09:14:32.479772+0000","last_peered":"2023-12-22T09:14:32.479772+0000","last_clean":"2023-12-22T09:14:32.479772+0000","last_became_active":"2023-12-22T09:14:27.998184+0000","last_became_peered":"2023-12-22T09:14:27.998184+0000","last_unstale":"2023-12-22T09:14:32.479772+0000","last_undegraded":"2023-12-22T09:14:32.479772+0000","last_fullsized":"2023-12-22T09:14:32.479772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:21.127787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.761912+0000","last_change":"2023-12-22T09:14:32.760763+0000","last_active":"2023-12-22T09:14:32.761912+0000","last_peered":"2023-12-22T09:14:32.761912+0000","last_clean":"2023-12-22T09:14:32.761912+0000","last_became_active":"2023-12-22T09:14:32.760138+0000","last_became_peered":"2023-12-22T09:14:32.760138+0000","last_unstale":"2023-12-22T09:14:32.761912+0000","last_undegraded":"2023-12-22T09:14:32.761912+0000","last_fullsized":"2023-12-22T09:14:32.761912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:16.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.478893+0000","last_change":"2023-12-22T09:14:28.467496+0000","last_active":"2023-12-22T09:14:32.478893+0000","last_peered":"2023-12-22T09:14:32.478893+0000","last_clean":"2023-12-22T09:14:32.478893+0000","last_became_active":"2023-12-22T09:14:28.463616+0000","last_became_peered":"2023-12-22T09:14:28.463616+0000","last_unstale":"2023-12-22T09:14:32.478893+0000","last_undegraded":"2023-12-22T09:14:32.478893+0000","last_fullsized":"2023-12-22T09:14:32.478893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:26.247244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.745036+0000","last_change":"2023-12-22T09:14:28.000212+0000","last_active":"2023-12-22T09:14:32.745036+0000","last_peered":"2023-12-22T09:14:32.745036+0000","last_clean":"2023-12-22T09:14:32.745036+0000","last_became_active":"2023-12-22T09:14:27.999905+0000","last_became_peered":"2023-12-22T09:14:27.999905+0000","last_unstale":"2023-12-22T09:14:32.745036+0000","last_undegraded":"2023-12-22T09:14:32.745036+0000","last_fullsized":"2023-12-22T09:14:32.745036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.504899+0000","last_change":"2023-12-22T09:14:32.502188+0000","last_active":"2023-12-22T09:14:32.504899+0000","last_peered":"2023-12-22T09:14:32.504899+0000","last_clean":"2023-12-22T09:14:32.504899+0000","last_became_active":"2023-12-22T09:14:32.501764+0000","last_became_peered":"2023-12-22T09:14:32.501764+0000","last_unstale":"2023-12-22T09:14:32.504899+0000","last_undegraded":"2023-12-22T09:14:32.504899+0000","last_fullsized":"2023-12-22T09:14:32.504899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:38.035204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491844+0000","last_change":"2023-12-22T09:14:28.463499+0000","last_active":"2023-12-22T09:14:32.491844+0000","last_peered":"2023-12-22T09:14:32.491844+0000","last_clean":"2023-12-22T09:14:32.491844+0000","last_became_active":"2023-12-22T09:14:28.463220+0000","last_became_peered":"2023-12-22T09:14:28.463220+0000","last_unstale":"2023-12-22T09:14:32.491844+0000","last_undegraded":"2023-12-22T09:14:32.491844+0000","last_fullsized":"2023-12-22T09:14:32.491844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489384+0000","last_change":"2023-12-22T09:14:27.999099+0000","last_active":"2023-12-22T09:14:32.489384+0000","last_peered":"2023-12-22T09:14:32.489384+0000","last_clean":"2023-12-22T09:14:32.489384+0000","last_became_active":"2023-12-22T09:14:27.998803+0000","last_became_peered":"2023-12-22T09:14:27.998803+0000","last_unstale":"2023-12-22T09:14:32.489384+0000","last_undegraded":"2023-12-22T09:14:32.489384+0000","last_fullsized":"2023-12-22T09:14:32.489384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:15:18.285741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.766019+0000","last_change":"2023-12-22T09:14:32.764135+0000","last_active":"2023-12-22T09:14:32.766019+0000","last_peered":"2023-12-22T09:14:32.766019+0000","last_clean":"2023-12-22T09:14:32.766019+0000","last_became_active":"2023-12-22T09:14:32.761760+0000","last_became_peered":"2023-12-22T09:14:32.761760+0000","last_unstale":"2023-12-22T09:14:32.766019+0000","last_undegraded":"2023-12-22T09:14:32.766019+0000","last_fullsized":"2023-12-22T09:14:32.766019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.471279+0000","last_change":"2023-12-22T09:14:28.475255+0000","last_active":"2023-12-22T09:14:32.471279+0000","last_peered":"2023-12-22T09:14:32.471279+0000","last_clean":"2023-12-22T09:14:32.471279+0000","last_became_active":"2023-12-22T09:14:28.475002+0000","last_became_peered":"2023-12-22T09:14:28.475002+0000","last_unstale":"2023-12-22T09:14:32.471279+0000","last_undegraded":"2023-12-22T09:14:32.471279+0000","last_fullsized":"2023-12-22T09:14:32.471279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:33.410634+0000","last_change":"2023-12-22T09:14:27.992093+0000","last_active":"2023-12-22T09:14:33.410634+0000","last_peered":"2023-12-22T09:14:33.410634+0000","last_clean":"2023-12-22T09:14:33.410634+0000","last_became_active":"2023-12-22T09:14:27.991810+0000","last_became_peered":"2023-12-22T09:14:27.991810+0000","last_unstale":"2023-12-22T09:14:33.410634+0000","last_undegraded":"2023-12-22T09:14:33.410634+0000","last_fullsized":"2023-12-22T09:14:33.410634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.753349+0000","last_change":"2023-12-22T09:14:32.750234+0000","last_active":"2023-12-22T09:14:32.753349+0000","last_peered":"2023-12-22T09:14:32.753349+0000","last_clean":"2023-12-22T09:14:32.753349+0000","last_became_active":"2023-12-22T09:14:32.749801+0000","last_became_peered":"2023-12-22T09:14:32.749801+0000","last_unstale":"2023-12-22T09:14:32.753349+0000","last_undegraded":"2023-12-22T09:14:32.753349+0000","last_fullsized":"2023-12-22T09:14:32.753349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:14:08.228677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477551+0000","last_change":"2023-12-22T09:14:28.454337+0000","last_active":"2023-12-22T09:14:32.477551+0000","last_peered":"2023-12-22T09:14:32.477551+0000","last_clean":"2023-12-22T09:14:32.477551+0000","last_became_active":"2023-12-22T09:14:28.454047+0000","last_became_peered":"2023-12-22T09:14:28.454047+0000","last_unstale":"2023-12-22T09:14:32.477551+0000","last_undegraded":"2023-12-22T09:14:32.477551+0000","last_fullsized":"2023-12-22T09:14:32.477551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.756169+0000","last_change":"2023-12-22T09:14:28.001870+0000","last_active":"2023-12-22T09:14:32.756169+0000","last_peered":"2023-12-22T09:14:32.756169+0000","last_clean":"2023-12-22T09:14:32.756169+0000","last_became_active":"2023-12-22T09:14:28.001090+0000","last_became_peered":"2023-12-22T09:14:28.001090+0000","last_unstale":"2023-12-22T09:14:32.756169+0000","last_undegraded":"2023-12-22T09:14:32.756169+0000","last_fullsized":"2023-12-22T09:14:32.756169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.752284+0000","last_change":"2023-12-22T09:14:32.748035+0000","last_active":"2023-12-22T09:14:32.752284+0000","last_peered":"2023-12-22T09:14:32.752284+0000","last_clean":"2023-12-22T09:14:32.752284+0000","last_became_active":"2023-12-22T09:14:32.747593+0000","last_became_peered":"2023-12-22T09:14:32.747593+0000","last_unstale":"2023-12-22T09:14:32.752284+0000","last_undegraded":"2023-12-22T09:14:32.752284+0000","last_fullsized":"2023-12-22T09:14:32.752284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495880+0000","last_change":"2023-12-22T09:14:28.478893+0000","last_active":"2023-12-22T09:14:32.495880+0000","last_peered":"2023-12-22T09:14:32.495880+0000","last_clean":"2023-12-22T09:14:32.495880+0000","last_became_active":"2023-12-22T09:14:28.478270+0000","last_became_peered":"2023-12-22T09:14:28.478270+0000","last_unstale":"2023-12-22T09:14:32.495880+0000","last_undegraded":"2023-12-22T09:14:32.495880+0000","last_fullsized":"2023-12-22T09:14:32.495880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477626+0000","last_change":"2023-12-22T09:14:27.993596+0000","last_active":"2023-12-22T09:14:32.477626+0000","last_peered":"2023-12-22T09:14:32.477626+0000","last_clean":"2023-12-22T09:14:32.477626+0000","last_became_active":"2023-12-22T09:14:27.993333+0000","last_became_peered":"2023-12-22T09:14:27.993333+0000","last_unstale":"2023-12-22T09:14:32.477626+0000","last_undegraded":"2023-12-22T09:14:32.477626+0000","last_fullsized":"2023-12-22T09:14:32.477626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505508+0000","last_change":"2023-12-22T09:14:32.497013+0000","last_active":"2023-12-22T09:14:32.505508+0000","last_peered":"2023-12-22T09:14:32.505508+0000","last_clean":"2023-12-22T09:14:32.505508+0000","last_became_active":"2023-12-22T09:14:32.496344+0000","last_became_peered":"2023-12-22T09:14:32.496344+0000","last_unstale":"2023-12-22T09:14:32.505508+0000","last_undegraded":"2023-12-22T09:14:32.505508+0000","last_fullsized":"2023-12-22T09:14:32.505508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479912+0000","last_change":"2023-12-22T09:14:28.467982+0000","last_active":"2023-12-22T09:14:32.479912+0000","last_peered":"2023-12-22T09:14:32.479912+0000","last_clean":"2023-12-22T09:14:32.479912+0000","last_became_active":"2023-12-22T09:14:28.467733+0000","last_became_peered":"2023-12-22T09:14:28.467733+0000","last_unstale":"2023-12-22T09:14:32.479912+0000","last_undegraded":"2023-12-22T09:14:32.479912+0000","last_fullsized":"2023-12-22T09:14:32.479912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:42.586936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494566+0000","last_change":"2023-12-22T09:14:27.992541+0000","last_active":"2023-12-22T09:14:32.494566+0000","last_peered":"2023-12-22T09:14:32.494566+0000","last_clean":"2023-12-22T09:14:32.494566+0000","last_became_active":"2023-12-22T09:14:27.988045+0000","last_became_peered":"2023-12-22T09:14:27.988045+0000","last_unstale":"2023-12-22T09:14:32.494566+0000","last_undegraded":"2023-12-22T09:14:32.494566+0000","last_fullsized":"2023-12-22T09:14:32.494566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.499768+0000","last_change":"2023-12-22T09:14:32.496063+0000","last_active":"2023-12-22T09:14:32.499768+0000","last_peered":"2023-12-22T09:14:32.499768+0000","last_clean":"2023-12-22T09:14:32.499768+0000","last_became_active":"2023-12-22T09:14:32.495488+0000","last_became_peered":"2023-12-22T09:14:32.495488+0000","last_unstale":"2023-12-22T09:14:32.499768+0000","last_undegraded":"2023-12-22T09:14:32.499768+0000","last_fullsized":"2023-12-22T09:14:32.499768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:44.670493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477408+0000","last_change":"2023-12-22T09:14:28.455447+0000","last_active":"2023-12-22T09:14:32.477408+0000","last_peered":"2023-12-22T09:14:32.477408+0000","last_clean":"2023-12-22T09:14:32.477408+0000","last_became_active":"2023-12-22T09:14:28.454567+0000","last_became_peered":"2023-12-22T09:14:28.454567+0000","last_unstale":"2023-12-22T09:14:32.477408+0000","last_undegraded":"2023-12-22T09:14:32.477408+0000","last_fullsized":"2023-12-22T09:14:32.477408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488568+0000","last_change":"2023-12-22T09:14:27.987747+0000","last_active":"2023-12-22T09:14:32.488568+0000","last_peered":"2023-12-22T09:14:32.488568+0000","last_clean":"2023-12-22T09:14:32.488568+0000","last_became_active":"2023-12-22T09:14:27.983166+0000","last_became_peered":"2023-12-22T09:14:27.983166+0000","last_unstale":"2023-12-22T09:14:32.488568+0000","last_undegraded":"2023-12-22T09:14:32.488568+0000","last_fullsized":"2023-12-22T09:14:32.488568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507955+0000","last_change":"2023-12-22T09:14:32.501586+0000","last_active":"2023-12-22T09:14:32.507955+0000","last_peered":"2023-12-22T09:14:32.507955+0000","last_clean":"2023-12-22T09:14:32.507955+0000","last_became_active":"2023-12-22T09:14:32.501007+0000","last_became_peered":"2023-12-22T09:14:32.501007+0000","last_unstale":"2023-12-22T09:14:32.507955+0000","last_undegraded":"2023-12-22T09:14:32.507955+0000","last_fullsized":"2023-12-22T09:14:32.507955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:18.752984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489906+0000","last_change":"2023-12-22T09:14:28.481869+0000","last_active":"2023-12-22T09:14:32.489906+0000","last_peered":"2023-12-22T09:14:32.489906+0000","last_clean":"2023-12-22T09:14:32.489906+0000","last_became_active":"2023-12-22T09:14:28.481649+0000","last_became_peered":"2023-12-22T09:14:28.481649+0000","last_unstale":"2023-12-22T09:14:32.489906+0000","last_undegraded":"2023-12-22T09:14:32.489906+0000","last_fullsized":"2023-12-22T09:14:32.489906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747355+0000","last_change":"2023-12-22T09:14:28.001413+0000","last_active":"2023-12-22T09:14:32.747355+0000","last_peered":"2023-12-22T09:14:32.747355+0000","last_clean":"2023-12-22T09:14:32.747355+0000","last_became_active":"2023-12-22T09:14:28.001068+0000","last_became_peered":"2023-12-22T09:14:28.001068+0000","last_unstale":"2023-12-22T09:14:32.747355+0000","last_undegraded":"2023-12-22T09:14:32.747355+0000","last_fullsized":"2023-12-22T09:14:32.747355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754573+0000","last_change":"2023-12-22T09:14:32.750326+0000","last_active":"2023-12-22T09:14:32.754573+0000","last_peered":"2023-12-22T09:14:32.754573+0000","last_clean":"2023-12-22T09:14:32.754573+0000","last_became_active":"2023-12-22T09:14:32.748190+0000","last_became_peered":"2023-12-22T09:14:32.748190+0000","last_unstale":"2023-12-22T09:14:32.754573+0000","last_undegraded":"2023-12-22T09:14:32.754573+0000","last_fullsized":"2023-12-22T09:14:32.754573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:33.308005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466660+0000","last_change":"2023-12-22T09:14:28.473067+0000","last_active":"2023-12-22T09:14:32.466660+0000","last_peered":"2023-12-22T09:14:32.466660+0000","last_clean":"2023-12-22T09:14:32.466660+0000","last_became_active":"2023-12-22T09:14:28.471735+0000","last_became_peered":"2023-12-22T09:14:28.471735+0000","last_unstale":"2023-12-22T09:14:32.466660+0000","last_undegraded":"2023-12-22T09:14:32.466660+0000","last_fullsized":"2023-12-22T09:14:32.466660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495258+0000","last_change":"2023-12-22T09:14:27.991666+0000","last_active":"2023-12-22T09:14:32.495258+0000","last_peered":"2023-12-22T09:14:32.495258+0000","last_clean":"2023-12-22T09:14:32.495258+0000","last_became_active":"2023-12-22T09:14:27.991399+0000","last_became_peered":"2023-12-22T09:14:27.991399+0000","last_unstale":"2023-12-22T09:14:32.495258+0000","last_undegraded":"2023-12-22T09:14:32.495258+0000","last_fullsized":"2023-12-22T09:14:32.495258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747364+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:14:32.747364+0000","last_peered":"2023-12-22T09:14:32.747364+0000","last_clean":"2023-12-22T09:14:32.747364+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:14:32.747364+0000","last_undegraded":"2023-12-22T09:14:32.747364+0000","last_fullsized":"2023-12-22T09:14:32.747364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.958460+0000","last_change":"2023-12-22T09:14:32.750023+0000","last_active":"2023-12-22T09:14:32.958460+0000","last_peered":"2023-12-22T09:14:32.958460+0000","last_clean":"2023-12-22T09:14:32.958460+0000","last_became_active":"2023-12-22T09:14:32.748764+0000","last_became_peered":"2023-12-22T09:14:32.748764+0000","last_unstale":"2023-12-22T09:14:32.958460+0000","last_undegraded":"2023-12-22T09:14:32.958460+0000","last_fullsized":"2023-12-22T09:14:32.958460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:42.444884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749613+0000","last_change":"2023-12-22T09:14:28.474500+0000","last_active":"2023-12-22T09:14:32.749613+0000","last_peered":"2023-12-22T09:14:32.749613+0000","last_clean":"2023-12-22T09:14:32.749613+0000","last_became_active":"2023-12-22T09:14:28.474257+0000","last_became_peered":"2023-12-22T09:14:28.474257+0000","last_unstale":"2023-12-22T09:14:32.749613+0000","last_undegraded":"2023-12-22T09:14:32.749613+0000","last_fullsized":"2023-12-22T09:14:32.749613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:14.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487370+0000","last_change":"2023-12-22T09:14:27.991242+0000","last_active":"2023-12-22T09:14:32.487370+0000","last_peered":"2023-12-22T09:14:32.487370+0000","last_clean":"2023-12-22T09:14:32.487370+0000","last_became_active":"2023-12-22T09:14:27.990742+0000","last_became_peered":"2023-12-22T09:14:27.990742+0000","last_unstale":"2023-12-22T09:14:32.487370+0000","last_undegraded":"2023-12-22T09:14:32.487370+0000","last_fullsized":"2023-12-22T09:14:32.487370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.957774+0000","last_change":"2023-12-22T09:14:32.749763+0000","last_active":"2023-12-22T09:14:32.957774+0000","last_peered":"2023-12-22T09:14:32.957774+0000","last_clean":"2023-12-22T09:14:32.957774+0000","last_became_active":"2023-12-22T09:14:32.748485+0000","last_became_peered":"2023-12-22T09:14:32.748485+0000","last_unstale":"2023-12-22T09:14:32.957774+0000","last_undegraded":"2023-12-22T09:14:32.957774+0000","last_fullsized":"2023-12-22T09:14:32.957774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:46:07.062719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494350+0000","last_change":"2023-12-22T09:14:28.477663+0000","last_active":"2023-12-22T09:14:32.494350+0000","last_peered":"2023-12-22T09:14:32.494350+0000","last_clean":"2023-12-22T09:14:32.494350+0000","last_became_active":"2023-12-22T09:14:28.477380+0000","last_became_peered":"2023-12-22T09:14:28.477380+0000","last_unstale":"2023-12-22T09:14:32.494350+0000","last_undegraded":"2023-12-22T09:14:32.494350+0000","last_fullsized":"2023-12-22T09:14:32.494350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.481313+0000","last_change":"2023-12-22T09:14:27.995562+0000","last_active":"2023-12-22T09:14:32.481313+0000","last_peered":"2023-12-22T09:14:32.481313+0000","last_clean":"2023-12-22T09:14:32.481313+0000","last_became_active":"2023-12-22T09:14:27.995251+0000","last_became_peered":"2023-12-22T09:14:27.995251+0000","last_unstale":"2023-12-22T09:14:32.481313+0000","last_undegraded":"2023-12-22T09:14:32.481313+0000","last_fullsized":"2023-12-22T09:14:32.481313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507091+0000","last_change":"2023-12-22T09:14:32.502846+0000","last_active":"2023-12-22T09:14:32.507091+0000","last_peered":"2023-12-22T09:14:32.507091+0000","last_clean":"2023-12-22T09:14:32.507091+0000","last_became_active":"2023-12-22T09:14:32.502395+0000","last_became_peered":"2023-12-22T09:14:32.502395+0000","last_unstale":"2023-12-22T09:14:32.507091+0000","last_undegraded":"2023-12-22T09:14:32.507091+0000","last_fullsized":"2023-12-22T09:14:32.507091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.758162+0000","last_change":"2023-12-22T09:14:28.482682+0000","last_active":"2023-12-22T09:14:32.758162+0000","last_peered":"2023-12-22T09:14:32.758162+0000","last_clean":"2023-12-22T09:14:32.758162+0000","last_became_active":"2023-12-22T09:14:28.475766+0000","last_became_peered":"2023-12-22T09:14:28.475766+0000","last_unstale":"2023-12-22T09:14:32.758162+0000","last_undegraded":"2023-12-22T09:14:32.758162+0000","last_fullsized":"2023-12-22T09:14:32.758162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:17.017778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486650+0000","last_change":"2023-12-22T09:14:27.982302+0000","last_active":"2023-12-22T09:14:32.486650+0000","last_peered":"2023-12-22T09:14:32.486650+0000","last_clean":"2023-12-22T09:14:32.486650+0000","last_became_active":"2023-12-22T09:14:27.982025+0000","last_became_peered":"2023-12-22T09:14:27.982025+0000","last_unstale":"2023-12-22T09:14:32.486650+0000","last_undegraded":"2023-12-22T09:14:32.486650+0000","last_fullsized":"2023-12-22T09:14:32.486650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757174+0000","last_change":"2023-12-22T09:14:32.754165+0000","last_active":"2023-12-22T09:14:32.757174+0000","last_peered":"2023-12-22T09:14:32.757174+0000","last_clean":"2023-12-22T09:14:32.757174+0000","last_became_active":"2023-12-22T09:14:32.753078+0000","last_became_peered":"2023-12-22T09:14:32.753078+0000","last_unstale":"2023-12-22T09:14:32.757174+0000","last_undegraded":"2023-12-22T09:14:32.757174+0000","last_fullsized":"2023-12-22T09:14:32.757174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.755255+0000","last_change":"2023-12-22T09:14:28.488566+0000","last_active":"2023-12-22T09:14:32.755255+0000","last_peered":"2023-12-22T09:14:32.755255+0000","last_clean":"2023-12-22T09:14:32.755255+0000","last_became_active":"2023-12-22T09:14:28.488216+0000","last_became_peered":"2023-12-22T09:14:28.488216+0000","last_unstale":"2023-12-22T09:14:32.755255+0000","last_undegraded":"2023-12-22T09:14:32.755255+0000","last_fullsized":"2023-12-22T09:14:32.755255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479697+0000","last_change":"2023-12-22T09:14:27.995501+0000","last_active":"2023-12-22T09:14:32.479697+0000","last_peered":"2023-12-22T09:14:32.479697+0000","last_clean":"2023-12-22T09:14:32.479697+0000","last_became_active":"2023-12-22T09:14:27.995234+0000","last_became_peered":"2023-12-22T09:14:27.995234+0000","last_unstale":"2023-12-22T09:14:32.479697+0000","last_undegraded":"2023-12-22T09:14:32.479697+0000","last_fullsized":"2023-12-22T09:14:32.479697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:23.399786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502467+0000","last_change":"2023-12-22T09:14:32.498587+0000","last_active":"2023-12-22T09:14:32.502467+0000","last_peered":"2023-12-22T09:14:32.502467+0000","last_clean":"2023-12-22T09:14:32.502467+0000","last_became_active":"2023-12-22T09:14:32.497206+0000","last_became_peered":"2023-12-22T09:14:32.497206+0000","last_unstale":"2023-12-22T09:14:32.502467+0000","last_undegraded":"2023-12-22T09:14:32.502467+0000","last_fullsized":"2023-12-22T09:14:32.502467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747037+0000","last_change":"2023-12-22T09:14:28.486764+0000","last_active":"2023-12-22T09:14:32.747037+0000","last_peered":"2023-12-22T09:14:32.747037+0000","last_clean":"2023-12-22T09:14:32.747037+0000","last_became_active":"2023-12-22T09:14:28.486496+0000","last_became_peered":"2023-12-22T09:14:28.486496+0000","last_unstale":"2023-12-22T09:14:32.747037+0000","last_undegraded":"2023-12-22T09:14:32.747037+0000","last_fullsized":"2023-12-22T09:14:32.747037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:50:41.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486193+0000","last_change":"2023-12-22T09:14:27.988914+0000","last_active":"2023-12-22T09:14:32.486193+0000","last_peered":"2023-12-22T09:14:32.486193+0000","last_clean":"2023-12-22T09:14:32.486193+0000","last_became_active":"2023-12-22T09:14:27.988557+0000","last_became_peered":"2023-12-22T09:14:27.988557+0000","last_unstale":"2023-12-22T09:14:32.486193+0000","last_undegraded":"2023-12-22T09:14:32.486193+0000","last_fullsized":"2023-12-22T09:14:32.486193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.509994+0000","last_change":"2023-12-22T09:14:32.504445+0000","last_active":"2023-12-22T09:14:32.509994+0000","last_peered":"2023-12-22T09:14:32.509994+0000","last_clean":"2023-12-22T09:14:32.509994+0000","last_became_active":"2023-12-22T09:14:32.504017+0000","last_became_peered":"2023-12-22T09:14:32.504017+0000","last_unstale":"2023-12-22T09:14:32.509994+0000","last_undegraded":"2023-12-22T09:14:32.509994+0000","last_fullsized":"2023-12-22T09:14:32.509994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:16.494365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486277+0000","last_change":"2023-12-22T09:14:28.471567+0000","last_active":"2023-12-22T09:14:32.486277+0000","last_peered":"2023-12-22T09:14:32.486277+0000","last_clean":"2023-12-22T09:14:32.486277+0000","last_became_active":"2023-12-22T09:14:28.471239+0000","last_became_peered":"2023-12-22T09:14:28.471239+0000","last_unstale":"2023-12-22T09:14:32.486277+0000","last_undegraded":"2023-12-22T09:14:32.486277+0000","last_fullsized":"2023-12-22T09:14:32.486277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:36.670203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487591+0000","last_change":"2023-12-22T09:14:27.997965+0000","last_active":"2023-12-22T09:14:32.487591+0000","last_peered":"2023-12-22T09:14:32.487591+0000","last_clean":"2023-12-22T09:14:32.487591+0000","last_became_active":"2023-12-22T09:14:27.995729+0000","last_became_peered":"2023-12-22T09:14:27.995729+0000","last_unstale":"2023-12-22T09:14:32.487591+0000","last_undegraded":"2023-12-22T09:14:32.487591+0000","last_fullsized":"2023-12-22T09:14:32.487591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:39.444798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.760822+0000","last_change":"2023-12-22T09:14:32.759895+0000","last_active":"2023-12-22T09:14:32.760822+0000","last_peered":"2023-12-22T09:14:32.760822+0000","last_clean":"2023-12-22T09:14:32.760822+0000","last_became_active":"2023-12-22T09:14:32.759468+0000","last_became_peered":"2023-12-22T09:14:32.759468+0000","last_unstale":"2023-12-22T09:14:32.760822+0000","last_undegraded":"2023-12-22T09:14:32.760822+0000","last_fullsized":"2023-12-22T09:14:32.760822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:50:22.096701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749005+0000","last_change":"2023-12-22T09:14:28.474331+0000","last_active":"2023-12-22T09:14:32.749005+0000","last_peered":"2023-12-22T09:14:32.749005+0000","last_clean":"2023-12-22T09:14:32.749005+0000","last_became_active":"2023-12-22T09:14:28.473856+0000","last_became_peered":"2023-12-22T09:14:28.473856+0000","last_unstale":"2023-12-22T09:14:32.749005+0000","last_undegraded":"2023-12-22T09:14:32.749005+0000","last_fullsized":"2023-12-22T09:14:32.749005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494464+0000","last_change":"2023-12-22T09:14:28.003970+0000","last_active":"2023-12-22T09:14:32.494464+0000","last_peered":"2023-12-22T09:14:32.494464+0000","last_clean":"2023-12-22T09:14:32.494464+0000","last_became_active":"2023-12-22T09:14:28.003627+0000","last_became_peered":"2023-12-22T09:14:28.003627+0000","last_unstale":"2023-12-22T09:14:32.494464+0000","last_undegraded":"2023-12-22T09:14:32.494464+0000","last_fullsized":"2023-12-22T09:14:32.494464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754851+0000","last_change":"2023-12-22T09:14:32.752183+0000","last_active":"2023-12-22T09:14:32.754851+0000","last_peered":"2023-12-22T09:14:32.754851+0000","last_clean":"2023-12-22T09:14:32.754851+0000","last_became_active":"2023-12-22T09:14:32.749483+0000","last_became_peered":"2023-12-22T09:14:32.749483+0000","last_unstale":"2023-12-22T09:14:32.754851+0000","last_undegraded":"2023-12-22T09:14:32.754851+0000","last_fullsized":"2023-12-22T09:14:32.754851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:09.047311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489001+0000","last_change":"2023-12-22T09:14:28.477740+0000","last_active":"2023-12-22T09:14:32.489001+0000","last_peered":"2023-12-22T09:14:32.489001+0000","last_clean":"2023-12-22T09:14:32.489001+0000","last_became_active":"2023-12-22T09:14:28.477495+0000","last_became_peered":"2023-12-22T09:14:28.477495+0000","last_unstale":"2023-12-22T09:14:32.489001+0000","last_undegraded":"2023-12-22T09:14:32.489001+0000","last_fullsized":"2023-12-22T09:14:32.489001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:28.625454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489565+0000","last_change":"2023-12-22T09:14:27.994572+0000","last_active":"2023-12-22T09:14:32.489565+0000","last_peered":"2023-12-22T09:14:32.489565+0000","last_clean":"2023-12-22T09:14:32.489565+0000","last_became_active":"2023-12-22T09:14:27.994200+0000","last_became_peered":"2023-12-22T09:14:27.994200+0000","last_unstale":"2023-12-22T09:14:32.489565+0000","last_undegraded":"2023-12-22T09:14:32.489565+0000","last_fullsized":"2023-12-22T09:14:32.489565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:50:40.407650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754400+0000","last_change":"2023-12-22T09:14:32.751024+0000","last_active":"2023-12-22T09:14:32.754400+0000","last_peered":"2023-12-22T09:14:32.754400+0000","last_clean":"2023-12-22T09:14:32.754400+0000","last_became_active":"2023-12-22T09:14:32.748055+0000","last_became_peered":"2023-12-22T09:14:32.748055+0000","last_unstale":"2023-12-22T09:14:32.754400+0000","last_undegraded":"2023-12-22T09:14:32.754400+0000","last_fullsized":"2023-12-22T09:14:32.754400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:18.069342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757751+0000","last_change":"2023-12-22T09:14:28.475564+0000","last_active":"2023-12-22T09:14:32.757751+0000","last_peered":"2023-12-22T09:14:32.757751+0000","last_clean":"2023-12-22T09:14:32.757751+0000","last_became_active":"2023-12-22T09:14:28.475209+0000","last_became_peered":"2023-12-22T09:14:28.475209+0000","last_unstale":"2023-12-22T09:14:32.757751+0000","last_undegraded":"2023-12-22T09:14:32.757751+0000","last_fullsized":"2023-12-22T09:14:32.757751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:46.880888+0000","last_change":"2023-12-22T09:14:27.986129+0000","last_active":"2023-12-22T09:14:46.880888+0000","last_peered":"2023-12-22T09:14:46.880888+0000","last_clean":"2023-12-22T09:14:46.880888+0000","last_became_active":"2023-12-22T09:14:27.984848+0000","last_became_peered":"2023-12-22T09:14:27.984848+0000","last_unstale":"2023-12-22T09:14:46.880888+0000","last_undegraded":"2023-12-22T09:14:46.880888+0000","last_fullsized":"2023-12-22T09:14:46.880888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:26:42.194176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505485+0000","last_change":"2023-12-22T09:14:32.496763+0000","last_active":"2023-12-22T09:14:32.505485+0000","last_peered":"2023-12-22T09:14:32.505485+0000","last_clean":"2023-12-22T09:14:32.505485+0000","last_became_active":"2023-12-22T09:14:32.495748+0000","last_became_peered":"2023-12-22T09:14:32.495748+0000","last_unstale":"2023-12-22T09:14:32.505485+0000","last_undegraded":"2023-12-22T09:14:32.505485+0000","last_fullsized":"2023-12-22T09:14:32.505485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479467+0000","last_change":"2023-12-22T09:14:28.479921+0000","last_active":"2023-12-22T09:14:32.479467+0000","last_peered":"2023-12-22T09:14:32.479467+0000","last_clean":"2023-12-22T09:14:32.479467+0000","last_became_active":"2023-12-22T09:14:28.479147+0000","last_became_peered":"2023-12-22T09:14:28.479147+0000","last_unstale":"2023-12-22T09:14:32.479467+0000","last_undegraded":"2023-12-22T09:14:32.479467+0000","last_fullsized":"2023-12-22T09:14:32.479467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:22.141418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.481162+0000","last_change":"2023-12-22T09:14:27.998821+0000","last_active":"2023-12-22T09:14:32.481162+0000","last_peered":"2023-12-22T09:14:32.481162+0000","last_clean":"2023-12-22T09:14:32.481162+0000","last_became_active":"2023-12-22T09:14:27.998503+0000","last_became_peered":"2023-12-22T09:14:27.998503+0000","last_unstale":"2023-12-22T09:14:32.481162+0000","last_undegraded":"2023-12-22T09:14:32.481162+0000","last_fullsized":"2023-12-22T09:14:32.481162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507446+0000","last_change":"2023-12-22T09:14:32.502980+0000","last_active":"2023-12-22T09:14:32.507446+0000","last_peered":"2023-12-22T09:14:32.507446+0000","last_clean":"2023-12-22T09:14:32.507446+0000","last_became_active":"2023-12-22T09:14:32.502553+0000","last_became_peered":"2023-12-22T09:14:32.502553+0000","last_unstale":"2023-12-22T09:14:32.507446+0000","last_undegraded":"2023-12-22T09:14:32.507446+0000","last_fullsized":"2023-12-22T09:14:32.507446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:45:19.291884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491688+0000","last_change":"2023-12-22T09:14:28.475888+0000","last_active":"2023-12-22T09:14:32.491688+0000","last_peered":"2023-12-22T09:14:32.491688+0000","last_clean":"2023-12-22T09:14:32.491688+0000","last_became_active":"2023-12-22T09:14:28.475647+0000","last_became_peered":"2023-12-22T09:14:28.475647+0000","last_unstale":"2023-12-22T09:14:32.491688+0000","last_undegraded":"2023-12-22T09:14:32.491688+0000","last_fullsized":"2023-12-22T09:14:32.491688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494265+0000","last_change":"2023-12-22T09:14:27.995374+0000","last_active":"2023-12-22T09:14:32.494265+0000","last_peered":"2023-12-22T09:14:32.494265+0000","last_clean":"2023-12-22T09:14:32.494265+0000","last_became_active":"2023-12-22T09:14:27.995047+0000","last_became_peered":"2023-12-22T09:14:27.995047+0000","last_unstale":"2023-12-22T09:14:32.494265+0000","last_undegraded":"2023-12-22T09:14:32.494265+0000","last_fullsized":"2023-12-22T09:14:32.494265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.497163+0000","last_change":"2023-12-22T09:14:32.493394+0000","last_active":"2023-12-22T09:14:32.497163+0000","last_peered":"2023-12-22T09:14:32.497163+0000","last_clean":"2023-12-22T09:14:32.497163+0000","last_became_active":"2023-12-22T09:14:32.492984+0000","last_became_peered":"2023-12-22T09:14:32.492984+0000","last_unstale":"2023-12-22T09:14:32.497163+0000","last_undegraded":"2023-12-22T09:14:32.497163+0000","last_fullsized":"2023-12-22T09:14:32.497163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:53:49.846745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494126+0000","last_change":"2023-12-22T09:14:28.486602+0000","last_active":"2023-12-22T09:14:32.494126+0000","last_peered":"2023-12-22T09:14:32.494126+0000","last_clean":"2023-12-22T09:14:32.494126+0000","last_became_active":"2023-12-22T09:14:28.485948+0000","last_became_peered":"2023-12-22T09:14:28.485948+0000","last_unstale":"2023-12-22T09:14:32.494126+0000","last_undegraded":"2023-12-22T09:14:32.494126+0000","last_fullsized":"2023-12-22T09:14:32.494126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:14.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489192+0000","last_change":"2023-12-22T09:14:28.000308+0000","last_active":"2023-12-22T09:14:32.489192+0000","last_peered":"2023-12-22T09:14:32.489192+0000","last_clean":"2023-12-22T09:14:32.489192+0000","last_became_active":"2023-12-22T09:14:28.000003+0000","last_became_peered":"2023-12-22T09:14:28.000003+0000","last_unstale":"2023-12-22T09:14:32.489192+0000","last_undegraded":"2023-12-22T09:14:32.489192+0000","last_fullsized":"2023-12-22T09:14:32.489192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:28:22.560684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.746514+0000","last_change":"2023-12-22T09:14:32.744415+0000","last_active":"2023-12-22T09:14:32.746514+0000","last_peered":"2023-12-22T09:14:32.746514+0000","last_clean":"2023-12-22T09:14:32.746514+0000","last_became_active":"2023-12-22T09:14:32.744068+0000","last_became_peered":"2023-12-22T09:14:32.744068+0000","last_unstale":"2023-12-22T09:14:32.746514+0000","last_undegraded":"2023-12-22T09:14:32.746514+0000","last_fullsized":"2023-12-22T09:14:32.746514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:57.666688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754553+0000","last_change":"2023-12-22T09:14:32.748417+0000","last_active":"2023-12-22T09:14:32.754553+0000","last_peered":"2023-12-22T09:14:32.754553+0000","last_clean":"2023-12-22T09:14:32.754553+0000","last_became_active":"2023-12-22T09:14:32.747730+0000","last_became_peered":"2023-12-22T09:14:32.747730+0000","last_unstale":"2023-12-22T09:14:32.754553+0000","last_undegraded":"2023-12-22T09:14:32.754553+0000","last_fullsized":"2023-12-22T09:14:32.754553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:18.069342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479643+0000","last_change":"2023-12-22T09:14:28.477761+0000","last_active":"2023-12-22T09:14:32.479643+0000","last_peered":"2023-12-22T09:14:32.479643+0000","last_clean":"2023-12-22T09:14:32.479643+0000","last_became_active":"2023-12-22T09:14:28.477515+0000","last_became_peered":"2023-12-22T09:14:28.477515+0000","last_unstale":"2023-12-22T09:14:32.479643+0000","last_undegraded":"2023-12-22T09:14:32.479643+0000","last_fullsized":"2023-12-22T09:14:32.479643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.493081+0000","last_change":"2023-12-22T09:14:27.997801+0000","last_active":"2023-12-22T09:14:32.493081+0000","last_peered":"2023-12-22T09:14:32.493081+0000","last_clean":"2023-12-22T09:14:32.493081+0000","last_became_active":"2023-12-22T09:14:27.995420+0000","last_became_peered":"2023-12-22T09:14:27.995420+0000","last_unstale":"2023-12-22T09:14:32.493081+0000","last_undegraded":"2023-12-22T09:14:32.493081+0000","last_fullsized":"2023-12-22T09:14:32.493081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.958796+0000","last_change":"2023-12-22T09:14:32.502003+0000","last_active":"2023-12-22T09:14:32.958796+0000","last_peered":"2023-12-22T09:14:32.958796+0000","last_clean":"2023-12-22T09:14:32.958796+0000","last_became_active":"2023-12-22T09:14:32.501565+0000","last_became_peered":"2023-12-22T09:14:32.501565+0000","last_unstale":"2023-12-22T09:14:32.958796+0000","last_undegraded":"2023-12-22T09:14:32.958796+0000","last_fullsized":"2023-12-22T09:14:32.958796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:53.560717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466430+0000","last_change":"2023-12-22T09:14:28.476695+0000","last_active":"2023-12-22T09:14:32.466430+0000","last_peered":"2023-12-22T09:14:32.466430+0000","last_clean":"2023-12-22T09:14:32.466430+0000","last_became_active":"2023-12-22T09:14:28.476418+0000","last_became_peered":"2023-12-22T09:14:28.476418+0000","last_unstale":"2023-12-22T09:14:32.466430+0000","last_undegraded":"2023-12-22T09:14:32.466430+0000","last_fullsized":"2023-12-22T09:14:32.466430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467174+0000","last_change":"2023-12-22T09:14:27.981491+0000","last_active":"2023-12-22T09:14:32.467174+0000","last_peered":"2023-12-22T09:14:32.467174+0000","last_clean":"2023-12-22T09:14:32.467174+0000","last_became_active":"2023-12-22T09:14:27.981149+0000","last_became_peered":"2023-12-22T09:14:27.981149+0000","last_unstale":"2023-12-22T09:14:32.467174+0000","last_undegraded":"2023-12-22T09:14:32.467174+0000","last_fullsized":"2023-12-22T09:14:32.467174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490549+0000","last_change":"2023-12-22T09:14:27.995250+0000","last_active":"2023-12-22T09:14:32.490549+0000","last_peered":"2023-12-22T09:14:32.490549+0000","last_clean":"2023-12-22T09:14:32.490549+0000","last_became_active":"2023-12-22T09:14:27.994964+0000","last_became_peered":"2023-12-22T09:14:27.994964+0000","last_unstale":"2023-12-22T09:14:32.490549+0000","last_undegraded":"2023-12-22T09:14:32.490549+0000","last_fullsized":"2023-12-22T09:14:32.490549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:08.238642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489470+0000","last_change":"2023-12-22T09:14:28.481744+0000","last_active":"2023-12-22T09:14:32.489470+0000","last_peered":"2023-12-22T09:14:32.489470+0000","last_clean":"2023-12-22T09:14:32.489470+0000","last_became_active":"2023-12-22T09:14:28.481329+0000","last_became_peered":"2023-12-22T09:14:28.481329+0000","last_unstale":"2023-12-22T09:14:32.489470+0000","last_undegraded":"2023-12-22T09:14:32.489470+0000","last_fullsized":"2023-12-22T09:14:32.489470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:18:59.454414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505339+0000","last_change":"2023-12-22T09:14:32.500565+0000","last_active":"2023-12-22T09:14:32.505339+0000","last_peered":"2023-12-22T09:14:32.505339+0000","last_clean":"2023-12-22T09:14:32.505339+0000","last_became_active":"2023-12-22T09:14:32.500063+0000","last_became_peered":"2023-12-22T09:14:32.500063+0000","last_unstale":"2023-12-22T09:14:32.505339+0000","last_undegraded":"2023-12-22T09:14:32.505339+0000","last_fullsized":"2023-12-22T09:14:32.505339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:19.878873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467700+0000","last_change":"2023-12-22T09:14:27.997689+0000","last_active":"2023-12-22T09:14:32.467700+0000","last_peered":"2023-12-22T09:14:32.467700+0000","last_clean":"2023-12-22T09:14:32.467700+0000","last_became_active":"2023-12-22T09:14:27.997332+0000","last_became_peered":"2023-12-22T09:14:27.997332+0000","last_unstale":"2023-12-22T09:14:32.467700+0000","last_undegraded":"2023-12-22T09:14:32.467700+0000","last_fullsized":"2023-12-22T09:14:32.467700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.478532+0000","last_change":"2023-12-22T09:14:28.466320+0000","last_active":"2023-12-22T09:14:32.478532+0000","last_peered":"2023-12-22T09:14:32.478532+0000","last_clean":"2023-12-22T09:14:32.478532+0000","last_became_active":"2023-12-22T09:14:28.465905+0000","last_became_peered":"2023-12-22T09:14:28.465905+0000","last_unstale":"2023-12-22T09:14:32.478532+0000","last_undegraded":"2023-12-22T09:14:32.478532+0000","last_fullsized":"2023-12-22T09:14:32.478532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:41.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.499215+0000","last_change":"2023-12-22T09:14:32.496695+0000","last_active":"2023-12-22T09:14:32.499215+0000","last_peered":"2023-12-22T09:14:32.499215+0000","last_clean":"2023-12-22T09:14:32.499215+0000","last_became_active":"2023-12-22T09:14:32.494463+0000","last_became_peered":"2023-12-22T09:14:32.494463+0000","last_unstale":"2023-12-22T09:14:32.499215+0000","last_undegraded":"2023-12-22T09:14:32.499215+0000","last_fullsized":"2023-12-22T09:14:32.499215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:05:19.971364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486096+0000","last_change":"2023-12-22T09:14:28.463582+0000","last_active":"2023-12-22T09:14:32.486096+0000","last_peered":"2023-12-22T09:14:32.486096+0000","last_clean":"2023-12-22T09:14:32.486096+0000","last_became_active":"2023-12-22T09:14:28.463247+0000","last_became_peered":"2023-12-22T09:14:28.463247+0000","last_unstale":"2023-12-22T09:14:32.486096+0000","last_undegraded":"2023-12-22T09:14:32.486096+0000","last_fullsized":"2023-12-22T09:14:32.486096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:52.250368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488481+0000","last_change":"2023-12-22T09:14:28.466146+0000","last_active":"2023-12-22T09:14:32.488481+0000","last_peered":"2023-12-22T09:14:32.488481+0000","last_clean":"2023-12-22T09:14:32.488481+0000","last_became_active":"2023-12-22T09:14:28.460909+0000","last_became_peered":"2023-12-22T09:14:28.460909+0000","last_unstale":"2023-12-22T09:14:32.488481+0000","last_undegraded":"2023-12-22T09:14:32.488481+0000","last_fullsized":"2023-12-22T09:14:32.488481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:13.826585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494360+0000","last_change":"2023-12-22T09:14:28.477080+0000","last_active":"2023-12-22T09:14:32.494360+0000","last_peered":"2023-12-22T09:14:32.494360+0000","last_clean":"2023-12-22T09:14:32.494360+0000","last_became_active":"2023-12-22T09:14:28.474190+0000","last_became_peered":"2023-12-22T09:14:28.474190+0000","last_unstale":"2023-12-22T09:14:32.494360+0000","last_undegraded":"2023-12-22T09:14:32.494360+0000","last_fullsized":"2023-12-22T09:14:32.494360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489372+0000","last_change":"2023-12-22T09:14:28.475187+0000","last_active":"2023-12-22T09:14:32.489372+0000","last_peered":"2023-12-22T09:14:32.489372+0000","last_clean":"2023-12-22T09:14:32.489372+0000","last_became_active":"2023-12-22T09:14:28.474944+0000","last_became_peered":"2023-12-22T09:14:28.474944+0000","last_unstale":"2023-12-22T09:14:32.489372+0000","last_undegraded":"2023-12-22T09:14:32.489372+0000","last_fullsized":"2023-12-22T09:14:32.489372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:54:29.516809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468613+0000","last_change":"2023-12-22T09:14:28.479990+0000","last_active":"2023-12-22T09:14:32.468613+0000","last_peered":"2023-12-22T09:14:32.468613+0000","last_clean":"2023-12-22T09:14:32.468613+0000","last_became_active":"2023-12-22T09:14:28.479746+0000","last_became_peered":"2023-12-22T09:14:28.479746+0000","last_unstale":"2023-12-22T09:14:32.468613+0000","last_undegraded":"2023-12-22T09:14:32.468613+0000","last_fullsized":"2023-12-22T09:14:32.468613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:26.849454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.480832+0000","last_change":"2023-12-22T09:14:28.472845+0000","last_active":"2023-12-22T09:14:32.480832+0000","last_peered":"2023-12-22T09:14:32.480832+0000","last_clean":"2023-12-22T09:14:32.480832+0000","last_became_active":"2023-12-22T09:14:28.472592+0000","last_became_peered":"2023-12-22T09:14:28.472592+0000","last_unstale":"2023-12-22T09:14:32.480832+0000","last_undegraded":"2023-12-22T09:14:32.480832+0000","last_fullsized":"2023-12-22T09:14:32.480832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:28.625454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489554+0000","last_change":"2023-12-22T09:14:28.476150+0000","last_active":"2023-12-22T09:14:32.489554+0000","last_peered":"2023-12-22T09:14:32.489554+0000","last_clean":"2023-12-22T09:14:32.489554+0000","last_became_active":"2023-12-22T09:14:28.475897+0000","last_became_peered":"2023-12-22T09:14:28.475897+0000","last_unstale":"2023-12-22T09:14:32.489554+0000","last_undegraded":"2023-12-22T09:14:32.489554+0000","last_fullsized":"2023-12-22T09:14:32.489554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:53:11.117313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.471112+0000","last_change":"2023-12-22T09:14:28.480478+0000","last_active":"2023-12-22T09:14:32.471112+0000","last_peered":"2023-12-22T09:14:32.471112+0000","last_clean":"2023-12-22T09:14:32.471112+0000","last_became_active":"2023-12-22T09:14:28.480143+0000","last_became_peered":"2023-12-22T09:14:28.480143+0000","last_unstale":"2023-12-22T09:14:32.471112+0000","last_undegraded":"2023-12-22T09:14:32.471112+0000","last_fullsized":"2023-12-22T09:14:32.471112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.492960+0000","last_change":"2023-12-22T09:14:28.478251+0000","last_active":"2023-12-22T09:14:32.492960+0000","last_peered":"2023-12-22T09:14:32.492960+0000","last_clean":"2023-12-22T09:14:32.492960+0000","last_became_active":"2023-12-22T09:14:28.477973+0000","last_became_peered":"2023-12-22T09:14:28.477973+0000","last_unstale":"2023-12-22T09:14:32.492960+0000","last_undegraded":"2023-12-22T09:14:32.492960+0000","last_fullsized":"2023-12-22T09:14:32.492960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467428+0000","last_change":"2023-12-22T09:14:28.479996+0000","last_active":"2023-12-22T09:14:32.467428+0000","last_peered":"2023-12-22T09:14:32.467428+0000","last_clean":"2023-12-22T09:14:32.467428+0000","last_became_active":"2023-12-22T09:14:28.479737+0000","last_became_peered":"2023-12-22T09:14:28.479737+0000","last_unstale":"2023-12-22T09:14:32.467428+0000","last_undegraded":"2023-12-22T09:14:32.467428+0000","last_fullsized":"2023-12-22T09:14:32.467428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494265+0000","last_change":"2023-12-22T09:14:28.479078+0000","last_active":"2023-12-22T09:14:32.494265+0000","last_peered":"2023-12-22T09:14:32.494265+0000","last_clean":"2023-12-22T09:14:32.494265+0000","last_became_active":"2023-12-22T09:14:28.478851+0000","last_became_peered":"2023-12-22T09:14:28.478851+0000","last_unstale":"2023-12-22T09:14:32.494265+0000","last_undegraded":"2023-12-22T09:14:32.494265+0000","last_fullsized":"2023-12-22T09:14:32.494265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:15.678969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489256+0000","last_change":"2023-12-22T09:14:28.480955+0000","last_active":"2023-12-22T09:14:32.489256+0000","last_peered":"2023-12-22T09:14:32.489256+0000","last_clean":"2023-12-22T09:14:32.489256+0000","last_became_active":"2023-12-22T09:14:28.479777+0000","last_became_peered":"2023-12-22T09:14:28.479777+0000","last_unstale":"2023-12-22T09:14:32.489256+0000","last_undegraded":"2023-12-22T09:14:32.489256+0000","last_fullsized":"2023-12-22T09:14:32.489256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488409+0000","last_change":"2023-12-22T09:14:28.477114+0000","last_active":"2023-12-22T09:14:32.488409+0000","last_peered":"2023-12-22T09:14:32.488409+0000","last_clean":"2023-12-22T09:14:32.488409+0000","last_became_active":"2023-12-22T09:14:28.476857+0000","last_became_peered":"2023-12-22T09:14:28.476857+0000","last_unstale":"2023-12-22T09:14:32.488409+0000","last_undegraded":"2023-12-22T09:14:32.488409+0000","last_fullsized":"2023-12-22T09:14:32.488409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:11:22.661582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.755992+0000","last_change":"2023-12-22T09:14:28.473400+0000","last_active":"2023-12-22T09:14:32.755992+0000","last_peered":"2023-12-22T09:14:32.755992+0000","last_clean":"2023-12-22T09:14:32.755992+0000","last_became_active":"2023-12-22T09:14:28.473079+0000","last_became_peered":"2023-12-22T09:14:28.473079+0000","last_unstale":"2023-12-22T09:14:32.755992+0000","last_undegraded":"2023-12-22T09:14:32.755992+0000","last_fullsized":"2023-12-22T09:14:32.755992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486749+0000","last_change":"2023-12-22T09:14:28.456928+0000","last_active":"2023-12-22T09:14:32.486749+0000","last_peered":"2023-12-22T09:14:32.486749+0000","last_clean":"2023-12-22T09:14:32.486749+0000","last_became_active":"2023-12-22T09:14:28.456756+0000","last_became_peered":"2023-12-22T09:14:28.456756+0000","last_unstale":"2023-12-22T09:14:32.486749+0000","last_undegraded":"2023-12-22T09:14:32.486749+0000","last_fullsized":"2023-12-22T09:14:32.486749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:42.031515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494912+0000","last_change":"2023-12-22T09:14:28.475388+0000","last_active":"2023-12-22T09:14:32.494912+0000","last_peered":"2023-12-22T09:14:32.494912+0000","last_clean":"2023-12-22T09:14:32.494912+0000","last_became_active":"2023-12-22T09:14:28.474472+0000","last_became_peered":"2023-12-22T09:14:28.474472+0000","last_unstale":"2023-12-22T09:14:32.494912+0000","last_undegraded":"2023-12-22T09:14:32.494912+0000","last_fullsized":"2023-12-22T09:14:32.494912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:17.017778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.492765+0000","last_change":"2023-12-22T09:14:28.471352+0000","last_active":"2023-12-22T09:14:32.492765+0000","last_peered":"2023-12-22T09:14:32.492765+0000","last_clean":"2023-12-22T09:14:32.492765+0000","last_became_active":"2023-12-22T09:14:28.471042+0000","last_became_peered":"2023-12-22T09:14:28.471042+0000","last_unstale":"2023-12-22T09:14:32.492765+0000","last_undegraded":"2023-12-22T09:14:32.492765+0000","last_fullsized":"2023-12-22T09:14:32.492765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479697+0000","last_change":"2023-12-22T09:14:28.470575+0000","last_active":"2023-12-22T09:14:32.479697+0000","last_peered":"2023-12-22T09:14:32.479697+0000","last_clean":"2023-12-22T09:14:32.479697+0000","last_became_active":"2023-12-22T09:14:28.470317+0000","last_became_peered":"2023-12-22T09:14:28.470317+0000","last_unstale":"2023-12-22T09:14:32.479697+0000","last_undegraded":"2023-12-22T09:14:32.479697+0000","last_fullsized":"2023-12-22T09:14:32.479697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488959+0000","last_change":"2023-12-22T09:14:28.471255+0000","last_active":"2023-12-22T09:14:32.488959+0000","last_peered":"2023-12-22T09:14:32.488959+0000","last_clean":"2023-12-22T09:14:32.488959+0000","last_became_active":"2023-12-22T09:14:28.470985+0000","last_became_peered":"2023-12-22T09:14:28.470985+0000","last_unstale":"2023-12-22T09:14:32.488959+0000","last_undegraded":"2023-12-22T09:14:32.488959+0000","last_fullsized":"2023-12-22T09:14:32.488959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:32:58.600762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467160+0000","last_change":"2023-12-22T09:14:28.474205+0000","last_active":"2023-12-22T09:14:32.467160+0000","last_peered":"2023-12-22T09:14:32.467160+0000","last_clean":"2023-12-22T09:14:32.467160+0000","last_became_active":"2023-12-22T09:14:28.473905+0000","last_became_peered":"2023-12-22T09:14:28.473905+0000","last_unstale":"2023-12-22T09:14:32.467160+0000","last_undegraded":"2023-12-22T09:14:32.467160+0000","last_fullsized":"2023-12-22T09:14:32.467160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479259+0000","last_change":"2023-12-22T09:14:28.469345+0000","last_active":"2023-12-22T09:14:32.479259+0000","last_peered":"2023-12-22T09:14:32.479259+0000","last_clean":"2023-12-22T09:14:32.479259+0000","last_became_active":"2023-12-22T09:14:28.469074+0000","last_became_peered":"2023-12-22T09:14:28.469074+0000","last_unstale":"2023-12-22T09:14:32.479259+0000","last_undegraded":"2023-12-22T09:14:32.479259+0000","last_fullsized":"2023-12-22T09:14:32.479259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:36.805116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487868+0000","last_change":"2023-12-22T09:14:28.465762+0000","last_active":"2023-12-22T09:14:32.487868+0000","last_peered":"2023-12-22T09:14:32.487868+0000","last_clean":"2023-12-22T09:14:32.487868+0000","last_became_active":"2023-12-22T09:14:28.465457+0000","last_became_peered":"2023-12-22T09:14:28.465457+0000","last_unstale":"2023-12-22T09:14:32.487868+0000","last_undegraded":"2023-12-22T09:14:32.487868+0000","last_fullsized":"2023-12-22T09:14:32.487868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:03.107378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489453+0000","last_change":"2023-12-22T09:14:28.464288+0000","last_active":"2023-12-22T09:14:32.489453+0000","last_peered":"2023-12-22T09:14:32.489453+0000","last_clean":"2023-12-22T09:14:32.489453+0000","last_became_active":"2023-12-22T09:14:28.463738+0000","last_became_peered":"2023-12-22T09:14:28.463738+0000","last_unstale":"2023-12-22T09:14:32.489453+0000","last_undegraded":"2023-12-22T09:14:32.489453+0000","last_fullsized":"2023-12-22T09:14:32.489453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:59:57.709549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757917+0000","last_change":"2023-12-22T09:14:28.474461+0000","last_active":"2023-12-22T09:14:32.757917+0000","last_peered":"2023-12-22T09:14:32.757917+0000","last_clean":"2023-12-22T09:14:32.757917+0000","last_became_active":"2023-12-22T09:14:28.474159+0000","last_became_peered":"2023-12-22T09:14:28.474159+0000","last_unstale":"2023-12-22T09:14:32.757917+0000","last_undegraded":"2023-12-22T09:14:32.757917+0000","last_fullsized":"2023-12-22T09:14:32.757917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:15.678969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.465111+0000","last_change":"2023-12-22T09:14:28.471807+0000","last_active":"2023-12-22T09:14:32.465111+0000","last_peered":"2023-12-22T09:14:32.465111+0000","last_clean":"2023-12-22T09:14:32.465111+0000","last_became_active":"2023-12-22T09:14:28.471516+0000","last_became_peered":"2023-12-22T09:14:28.471516+0000","last_unstale":"2023-12-22T09:14:32.465111+0000","last_undegraded":"2023-12-22T09:14:32.465111+0000","last_fullsized":"2023-12-22T09:14:32.465111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.746735+0000","last_change":"2023-12-22T09:14:28.472378+0000","last_active":"2023-12-22T09:14:32.746735+0000","last_peered":"2023-12-22T09:14:32.746735+0000","last_clean":"2023-12-22T09:14:32.746735+0000","last_became_active":"2023-12-22T09:14:28.472104+0000","last_became_peered":"2023-12-22T09:14:28.472104+0000","last_unstale":"2023-12-22T09:14:32.746735+0000","last_undegraded":"2023-12-22T09:14:32.746735+0000","last_fullsized":"2023-12-22T09:14:32.746735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494167+0000","last_change":"2023-12-22T09:14:28.465305+0000","last_active":"2023-12-22T09:14:32.494167+0000","last_peered":"2023-12-22T09:14:32.494167+0000","last_clean":"2023-12-22T09:14:32.494167+0000","last_became_active":"2023-12-22T09:14:28.464795+0000","last_became_peered":"2023-12-22T09:14:28.464795+0000","last_unstale":"2023-12-22T09:14:32.494167+0000","last_undegraded":"2023-12-22T09:14:32.494167+0000","last_fullsized":"2023-12-22T09:14:32.494167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:26.849454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754743+0000","last_change":"2023-12-22T09:14:28.471738+0000","last_active":"2023-12-22T09:14:32.754743+0000","last_peered":"2023-12-22T09:14:32.754743+0000","last_clean":"2023-12-22T09:14:32.754743+0000","last_became_active":"2023-12-22T09:14:28.470650+0000","last_became_peered":"2023-12-22T09:14:28.470650+0000","last_unstale":"2023-12-22T09:14:32.754743+0000","last_undegraded":"2023-12-22T09:14:32.754743+0000","last_fullsized":"2023-12-22T09:14:32.754743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494158+0000","last_change":"2023-12-22T09:14:28.477696+0000","last_active":"2023-12-22T09:14:32.494158+0000","last_peered":"2023-12-22T09:14:32.494158+0000","last_clean":"2023-12-22T09:14:32.494158+0000","last_became_active":"2023-12-22T09:14:28.477426+0000","last_became_peered":"2023-12-22T09:14:28.477426+0000","last_unstale":"2023-12-22T09:14:32.494158+0000","last_undegraded":"2023-12-22T09:14:32.494158+0000","last_fullsized":"2023-12-22T09:14:32.494158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:50:41.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490998+0000","last_change":"2023-12-22T09:14:28.467153+0000","last_active":"2023-12-22T09:14:32.490998+0000","last_peered":"2023-12-22T09:14:32.490998+0000","last_clean":"2023-12-22T09:14:32.490998+0000","last_became_active":"2023-12-22T09:14:28.466719+0000","last_became_peered":"2023-12-22T09:14:28.466719+0000","last_unstale":"2023-12-22T09:14:32.490998+0000","last_undegraded":"2023-12-22T09:14:32.490998+0000","last_fullsized":"2023-12-22T09:14:32.490998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:15:05.682773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.484628+0000","last_change":"2023-12-22T09:14:28.479238+0000","last_active":"2023-12-22T09:14:32.484628+0000","last_peered":"2023-12-22T09:14:32.484628+0000","last_clean":"2023-12-22T09:14:32.484628+0000","last_became_active":"2023-12-22T09:14:28.478984+0000","last_became_peered":"2023-12-22T09:14:28.478984+0000","last_unstale":"2023-12-22T09:14:32.484628+0000","last_undegraded":"2023-12-22T09:14:32.484628+0000","last_fullsized":"2023-12-22T09:14:32.484628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757917+0000","last_change":"2023-12-22T09:14:28.482492+0000","last_active":"2023-12-22T09:14:32.757917+0000","last_peered":"2023-12-22T09:14:32.757917+0000","last_clean":"2023-12-22T09:14:32.757917+0000","last_became_active":"2023-12-22T09:14:28.474439+0000","last_became_peered":"2023-12-22T09:14:28.474439+0000","last_unstale":"2023-12-22T09:14:32.757917+0000","last_undegraded":"2023-12-22T09:14:32.757917+0000","last_fullsized":"2023-12-22T09:14:32.757917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":694025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6070000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":106871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6919999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":106871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3250000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":103075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8560000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8839999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5179999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3679999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8260000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5910000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:15:02.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:15:03.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.209+0000 7fdd7c44c640 1 Processor -- start 2023-12-22T09:15:03.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.209+0000 7fdd7c44c640 1 -- start start 2023-12-22T09:15:03.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.210+0000 7fdd7c44c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd74069e60 0x7fdd741551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.210+0000 7fdd7c44c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd74070480 0x7fdd740bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.210+0000 7fdd7c44c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7406fe60 con 0x7fdd7415c070 2023-12-22T09:15:03.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.210+0000 7fdd7c44c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7415c5e0 con 0x7fdd74069e60 2023-12-22T09:15:03.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.210+0000 7fdd7c44c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74070140 con 0x7fdd74070480 2023-12-22T09:15:03.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.211+0000 7fdd7a1e8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd74069e60 0x7fdd741551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.211+0000 7fdd7a1e8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd74069e60 0x7fdd741551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:43758/0 (socket says 172.21.15.106:43758) 2023-12-22T09:15:03.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.211+0000 7fdd7a1e8640 1 -- 172.21.15.106:0/2905381281 learned_addr learned my addr 172.21.15.106:0/2905381281 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:03.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.211+0000 7fdd799e7640 1 --1- 172.21.15.106:0/2905381281 >> v1:172.21.15.132:6789/0 conn(0x7fdd7415c070 0x7fdd74155730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:35592/0 (socket says 172.21.15.106:35592) 2023-12-22T09:15:03.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.211+0000 7fdd7a9e9640 1 --2- 172.21.15.106:0/2905381281 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd74070480 0x7fdd740bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.211+0000 7fdd7a1e8640 1 -- 172.21.15.106:0/2905381281 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd74070480 msgr2=0x7fdd740bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:03.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.211+0000 7fdd7a1e8640 1 --2- 172.21.15.106:0/2905381281 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd74070480 0x7fdd740bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.211+0000 7fdd7a1e8640 1 -- 172.21.15.106:0/2905381281 >> v1:172.21.15.132:6789/0 conn(0x7fdd7415c070 legacy=0x7fdd74155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.211+0000 7fdd7a1e8640 1 -- 172.21.15.106:0/2905381281 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740c1440 con 0x7fdd74069e60 2023-12-22T09:15:03.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.213+0000 7fdd7a1e8640 1 --2- 172.21.15.106:0/2905381281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd74069e60 0x7fdd741551f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009880 tx=0x7fdd7002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e26f470865a9760 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:03.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.213+0000 7fdd791e6640 1 -- 172.21.15.106:0/2905381281 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70004230 con 0x7fdd74069e60 2023-12-22T09:15:03.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.213+0000 7fdd791e6640 1 -- 172.21.15.106:0/2905381281 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70004390 con 0x7fdd74069e60 2023-12-22T09:15:03.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.213+0000 7fdd791e6640 1 -- 172.21.15.106:0/2905381281 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70003810 con 0x7fdd74069e60 2023-12-22T09:15:03.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.214+0000 7fdd7c44c640 1 -- 172.21.15.106:0/2905381281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd74069e60 msgr2=0x7fdd741551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.214+0000 7fdd7c44c640 1 --2- 172.21.15.106:0/2905381281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd74069e60 0x7fdd741551f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009880 tx=0x7fdd7002b960 comp rx=0 tx=0).stop 2023-12-22T09:15:03.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.214+0000 7fdd7c44c640 1 -- 172.21.15.106:0/2905381281 shutdown_connections 2023-12-22T09:15:03.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.214+0000 7fdd7c44c640 1 --2- 172.21.15.106:0/2905381281 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd74070480 0x7fdd740bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.214+0000 7fdd7c44c640 1 --2- 172.21.15.106:0/2905381281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd74069e60 0x7fdd741551f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.214+0000 7fdd7c44c640 1 -- 172.21.15.106:0/2905381281 >> 172.21.15.106:0/2905381281 conn(0x7fdd740c5360 msgr2=0x7fdd740c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:03.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.214+0000 7fdd7c44c640 1 -- 172.21.15.106:0/2905381281 shutdown_connections 2023-12-22T09:15:03.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.214+0000 7fdd7c44c640 1 -- 172.21.15.106:0/2905381281 wait complete. 2023-12-22T09:15:03.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.215+0000 7fdd7c44c640 1 Processor -- start 2023-12-22T09:15:03.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.215+0000 7fdd7c44c640 1 -- start start 2023-12-22T09:15:03.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.216+0000 7fdd7c44c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd74069e60 0x7fdd740aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.216+0000 7fdd7c44c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd74070480 0x7fdd741541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.216+0000 7fdd7c44c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd7415c070 0x7fdd74158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.216+0000 7fdd7c44c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7415a2b0 con 0x7fdd74069e60 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.216+0000 7fdd7c44c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd741edd80 con 0x7fdd74070480 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.216+0000 7fdd7c44c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd741588c0 con 0x7fdd7415c070 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.216+0000 7fdd7a1e8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd74069e60 0x7fdd740aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd7a1e8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd74069e60 0x7fdd740aaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50642/0 (socket says 172.21.15.106:50642) 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd7a1e8640 1 -- 172.21.15.106:0/1899622788 learned_addr learned my addr 172.21.15.106:0/1899622788 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd799e7640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd74070480 0x7fdd741541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd7a1e8640 1 -- 172.21.15.106:0/1899622788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd7415c070 msgr2=0x7fdd74158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd7a1e8640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd7415c070 0x7fdd74158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd7a1e8640 1 -- 172.21.15.106:0/1899622788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd74070480 msgr2=0x7fdd741541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd7a1e8640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd74070480 0x7fdd741541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd7a1e8640 1 -- 172.21.15.106:0/1899622788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd70009460 con 0x7fdd74069e60 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd7a1e8640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd74069e60 0x7fdd740aaa40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdd700099a0 tx=0x7fdd700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd6affd640 1 -- 172.21.15.106:0/1899622788 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7003e070 con 0x7fdd74069e60 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd6affd640 1 -- 172.21.15.106:0/1899622788 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70004500 con 0x7fdd74069e60 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd6affd640 1 -- 172.21.15.106:0/1899622788 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70003d70 con 0x7fdd74069e60 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.217+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd74158590 con 0x7fdd74069e60 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.218+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd741edf70 con 0x7fdd74069e60 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.219+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd74073f10 con 0x7fdd74069e60 2023-12-22T09:15:03.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.219+0000 7fdd6affd640 1 -- 172.21.15.106:0/1899622788 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd70006040 con 0x7fdd74069e60 2023-12-22T09:15:03.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.221+0000 7fdd6affd640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd5806a460 0x7fdd5806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.221+0000 7fdd6affd640 1 -- 172.21.15.106:0/1899622788 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdd700aa790 con 0x7fdd74069e60 2023-12-22T09:15:03.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.221+0000 7fdd799e7640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd5806a460 0x7fdd5806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.222+0000 7fdd799e7640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd5806a460 0x7fdd5806c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd740c49c0 tx=0x7fdd64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:03.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.225+0000 7fdd6affd640 1 -- 172.21.15.106:0/1899622788 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdd70075b10 con 0x7fdd74069e60 2023-12-22T09:15:03.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.397+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd740c1720 con 0x7fdd5806a460 2023-12-22T09:15:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.411+0000 7fdd6affd640 1 -- 172.21.15.106:0/1899622788 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345000 (secure 0 0 0) 0x7fdd640012c0 con 0x7fdd5806a460 2023-12-22T09:15:03.414 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:15:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.418+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd5806a460 msgr2=0x7fdd5806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.418+0000 7fdd7c44c640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd5806a460 0x7fdd5806c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd740c49c0 tx=0x7fdd64009040 comp rx=0 tx=0).stop 2023-12-22T09:15:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.418+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd74069e60 msgr2=0x7fdd740aaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.418+0000 7fdd7c44c640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd74069e60 0x7fdd740aaa40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdd700099a0 tx=0x7fdd700046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.419+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 shutdown_connections 2023-12-22T09:15:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.419+0000 7fdd7c44c640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd5806a460 0x7fdd5806c920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.419+0000 7fdd7c44c640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd7415c070 0x7fdd74158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.419+0000 7fdd7c44c640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd74070480 0x7fdd741541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.419+0000 7fdd7c44c640 1 --2- 172.21.15.106:0/1899622788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd74069e60 0x7fdd740aaa40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.419+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 >> 172.21.15.106:0/1899622788 conn(0x7fdd740c5360 msgr2=0x7fdd740c0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.419+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 shutdown_connections 2023-12-22T09:15:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.419+0000 7fdd7c44c640 1 -- 172.21.15.106:0/1899622788 wait complete. 2023-12-22T09:15:03.435 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-12-22T09:15:02.707239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218888,"kb_used_data":3272,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755832,"statfs":{"total":773094113280,"available":772869971968,"internally_reserved":0,"allocated":3350528,"data_stored":2014524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005650"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491770+0000","last_change":"2023-12-22T09:14:27.999590+0000","last_active":"2023-12-22T09:14:32.491770+0000","last_peered":"2023-12-22T09:14:32.491770+0000","last_clean":"2023-12-22T09:14:32.491770+0000","last_became_active":"2023-12-22T09:14:27.999168+0000","last_became_peered":"2023-12-22T09:14:27.999168+0000","last_unstale":"2023-12-22T09:14:32.491770+0000","last_undegraded":"2023-12-22T09:14:32.491770+0000","last_fullsized":"2023-12-22T09:14:32.491770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:55.319959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468195+0000","last_change":"2023-12-22T09:14:28.471978+0000","last_active":"2023-12-22T09:14:32.468195+0000","last_peered":"2023-12-22T09:14:32.468195+0000","last_clean":"2023-12-22T09:14:32.468195+0000","last_became_active":"2023-12-22T09:14:28.471551+0000","last_became_peered":"2023-12-22T09:14:28.471551+0000","last_unstale":"2023-12-22T09:14:32.468195+0000","last_undegraded":"2023-12-22T09:14:32.468195+0000","last_fullsized":"2023-12-22T09:14:32.468195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.753370+0000","last_change":"2023-12-22T09:14:32.750885+0000","last_active":"2023-12-22T09:14:32.753370+0000","last_peered":"2023-12-22T09:14:32.753370+0000","last_clean":"2023-12-22T09:14:32.753370+0000","last_became_active":"2023-12-22T09:14:32.750410+0000","last_became_peered":"2023-12-22T09:14:32.750410+0000","last_unstale":"2023-12-22T09:14:32.753370+0000","last_undegraded":"2023-12-22T09:14:32.753370+0000","last_fullsized":"2023-12-22T09:14:32.753370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:03:15.507458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468717+0000","last_change":"2023-12-22T09:14:27.993421+0000","last_active":"2023-12-22T09:14:32.468717+0000","last_peered":"2023-12-22T09:14:32.468717+0000","last_clean":"2023-12-22T09:14:32.468717+0000","last_became_active":"2023-12-22T09:14:27.993088+0000","last_became_peered":"2023-12-22T09:14:27.993088+0000","last_unstale":"2023-12-22T09:14:32.468717+0000","last_undegraded":"2023-12-22T09:14:32.468717+0000","last_fullsized":"2023-12-22T09:14:32.468717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491593+0000","last_change":"2023-12-22T09:14:28.475345+0000","last_active":"2023-12-22T09:14:32.491593+0000","last_peered":"2023-12-22T09:14:32.491593+0000","last_clean":"2023-12-22T09:14:32.491593+0000","last_became_active":"2023-12-22T09:14:28.473015+0000","last_became_peered":"2023-12-22T09:14:28.473015+0000","last_unstale":"2023-12-22T09:14:32.491593+0000","last_undegraded":"2023-12-22T09:14:32.491593+0000","last_fullsized":"2023-12-22T09:14:32.491593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502282+0000","last_change":"2023-12-22T09:14:32.497444+0000","last_active":"2023-12-22T09:14:32.502282+0000","last_peered":"2023-12-22T09:14:32.502282+0000","last_clean":"2023-12-22T09:14:32.502282+0000","last_became_active":"2023-12-22T09:14:32.494648+0000","last_became_peered":"2023-12-22T09:14:32.494648+0000","last_unstale":"2023-12-22T09:14:32.502282+0000","last_undegraded":"2023-12-22T09:14:32.502282+0000","last_fullsized":"2023-12-22T09:14:32.502282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:47:30.609572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749932+0000","last_change":"2023-12-22T09:14:28.004480+0000","last_active":"2023-12-22T09:14:32.749932+0000","last_peered":"2023-12-22T09:14:32.749932+0000","last_clean":"2023-12-22T09:14:32.749932+0000","last_became_active":"2023-12-22T09:14:28.004122+0000","last_became_peered":"2023-12-22T09:14:28.004122+0000","last_unstale":"2023-12-22T09:14:32.749932+0000","last_undegraded":"2023-12-22T09:14:32.749932+0000","last_fullsized":"2023-12-22T09:14:32.749932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:21.127787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494251+0000","last_change":"2023-12-22T09:14:28.476757+0000","last_active":"2023-12-22T09:14:32.494251+0000","last_peered":"2023-12-22T09:14:32.494251+0000","last_clean":"2023-12-22T09:14:32.494251+0000","last_became_active":"2023-12-22T09:14:28.476378+0000","last_became_peered":"2023-12-22T09:14:28.476378+0000","last_unstale":"2023-12-22T09:14:32.494251+0000","last_undegraded":"2023-12-22T09:14:32.494251+0000","last_fullsized":"2023-12-22T09:14:32.494251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507391+0000","last_change":"2023-12-22T09:14:32.502471+0000","last_active":"2023-12-22T09:14:32.507391+0000","last_peered":"2023-12-22T09:14:32.507391+0000","last_clean":"2023-12-22T09:14:32.507391+0000","last_became_active":"2023-12-22T09:14:32.501880+0000","last_became_peered":"2023-12-22T09:14:32.501880+0000","last_unstale":"2023-12-22T09:14:32.507391+0000","last_undegraded":"2023-12-22T09:14:32.507391+0000","last_fullsized":"2023-12-22T09:14:32.507391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:16.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749172+0000","last_change":"2023-12-22T09:14:28.005371+0000","last_active":"2023-12-22T09:14:32.749172+0000","last_peered":"2023-12-22T09:14:32.749172+0000","last_clean":"2023-12-22T09:14:32.749172+0000","last_became_active":"2023-12-22T09:14:28.005096+0000","last_became_peered":"2023-12-22T09:14:28.005096+0000","last_unstale":"2023-12-22T09:14:32.749172+0000","last_undegraded":"2023-12-22T09:14:32.749172+0000","last_fullsized":"2023-12-22T09:14:32.749172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495790+0000","last_change":"2023-12-22T09:14:28.481890+0000","last_active":"2023-12-22T09:14:32.495790+0000","last_peered":"2023-12-22T09:14:32.495790+0000","last_clean":"2023-12-22T09:14:32.495790+0000","last_became_active":"2023-12-22T09:14:28.480455+0000","last_became_peered":"2023-12-22T09:14:28.480455+0000","last_unstale":"2023-12-22T09:14:32.495790+0000","last_undegraded":"2023-12-22T09:14:32.495790+0000","last_fullsized":"2023-12-22T09:14:32.495790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:34.191893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502319+0000","last_change":"2023-12-22T09:14:32.497995+0000","last_active":"2023-12-22T09:14:32.502319+0000","last_peered":"2023-12-22T09:14:32.502319+0000","last_clean":"2023-12-22T09:14:32.502319+0000","last_became_active":"2023-12-22T09:14:32.497136+0000","last_became_peered":"2023-12-22T09:14:32.497136+0000","last_unstale":"2023-12-22T09:14:32.502319+0000","last_undegraded":"2023-12-22T09:14:32.502319+0000","last_fullsized":"2023-12-22T09:14:32.502319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:02.042832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490410+0000","last_change":"2023-12-22T09:14:28.467962+0000","last_active":"2023-12-22T09:14:32.490410+0000","last_peered":"2023-12-22T09:14:32.490410+0000","last_clean":"2023-12-22T09:14:32.490410+0000","last_became_active":"2023-12-22T09:14:28.467669+0000","last_became_peered":"2023-12-22T09:14:28.467669+0000","last_unstale":"2023-12-22T09:14:32.490410+0000","last_undegraded":"2023-12-22T09:14:32.490410+0000","last_fullsized":"2023-12-22T09:14:32.490410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:14:12.211157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749464+0000","last_change":"2023-12-22T09:14:28.003252+0000","last_active":"2023-12-22T09:14:32.749464+0000","last_peered":"2023-12-22T09:14:32.749464+0000","last_clean":"2023-12-22T09:14:32.749464+0000","last_became_active":"2023-12-22T09:14:28.002818+0000","last_became_peered":"2023-12-22T09:14:28.002818+0000","last_unstale":"2023-12-22T09:14:32.749464+0000","last_undegraded":"2023-12-22T09:14:32.749464+0000","last_fullsized":"2023-12-22T09:14:32.749464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:41.017884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502344+0000","last_change":"2023-12-22T09:14:32.498105+0000","last_active":"2023-12-22T09:14:32.502344+0000","last_peered":"2023-12-22T09:14:32.502344+0000","last_clean":"2023-12-22T09:14:32.502344+0000","last_became_active":"2023-12-22T09:14:32.497287+0000","last_became_peered":"2023-12-22T09:14:32.497287+0000","last_unstale":"2023-12-22T09:14:32.502344+0000","last_undegraded":"2023-12-22T09:14:32.502344+0000","last_fullsized":"2023-12-22T09:14:32.502344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:20.526932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467458+0000","last_change":"2023-12-22T09:14:28.481525+0000","last_active":"2023-12-22T09:14:32.467458+0000","last_peered":"2023-12-22T09:14:32.467458+0000","last_clean":"2023-12-22T09:14:32.467458+0000","last_became_active":"2023-12-22T09:14:28.480895+0000","last_became_peered":"2023-12-22T09:14:28.480895+0000","last_unstale":"2023-12-22T09:14:32.467458+0000","last_undegraded":"2023-12-22T09:14:32.467458+0000","last_fullsized":"2023-12-22T09:14:32.467458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477412+0000","last_change":"2023-12-22T09:14:27.988542+0000","last_active":"2023-12-22T09:14:32.477412+0000","last_peered":"2023-12-22T09:14:32.477412+0000","last_clean":"2023-12-22T09:14:32.477412+0000","last_became_active":"2023-12-22T09:14:27.988286+0000","last_became_peered":"2023-12-22T09:14:27.988286+0000","last_unstale":"2023-12-22T09:14:32.477412+0000","last_undegraded":"2023-12-22T09:14:32.477412+0000","last_fullsized":"2023-12-22T09:14:32.477412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.496996+0000","last_change":"2023-12-22T09:14:32.489874+0000","last_active":"2023-12-22T09:14:32.496996+0000","last_peered":"2023-12-22T09:14:32.496996+0000","last_clean":"2023-12-22T09:14:32.496996+0000","last_became_active":"2023-12-22T09:14:32.489424+0000","last_became_peered":"2023-12-22T09:14:32.489424+0000","last_unstale":"2023-12-22T09:14:32.496996+0000","last_undegraded":"2023-12-22T09:14:32.496996+0000","last_fullsized":"2023-12-22T09:14:32.496996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:16.494365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466677+0000","last_change":"2023-12-22T09:14:28.479495+0000","last_active":"2023-12-22T09:14:32.466677+0000","last_peered":"2023-12-22T09:14:32.466677+0000","last_clean":"2023-12-22T09:14:32.466677+0000","last_became_active":"2023-12-22T09:14:28.479219+0000","last_became_peered":"2023-12-22T09:14:28.479219+0000","last_unstale":"2023-12-22T09:14:32.466677+0000","last_undegraded":"2023-12-22T09:14:32.466677+0000","last_fullsized":"2023-12-22T09:14:32.466677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:34.191893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479772+0000","last_change":"2023-12-22T09:14:27.998498+0000","last_active":"2023-12-22T09:14:32.479772+0000","last_peered":"2023-12-22T09:14:32.479772+0000","last_clean":"2023-12-22T09:14:32.479772+0000","last_became_active":"2023-12-22T09:14:27.998184+0000","last_became_peered":"2023-12-22T09:14:27.998184+0000","last_unstale":"2023-12-22T09:14:32.479772+0000","last_undegraded":"2023-12-22T09:14:32.479772+0000","last_fullsized":"2023-12-22T09:14:32.479772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:21.127787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.761912+0000","last_change":"2023-12-22T09:14:32.760763+0000","last_active":"2023-12-22T09:14:32.761912+0000","last_peered":"2023-12-22T09:14:32.761912+0000","last_clean":"2023-12-22T09:14:32.761912+0000","last_became_active":"2023-12-22T09:14:32.760138+0000","last_became_peered":"2023-12-22T09:14:32.760138+0000","last_unstale":"2023-12-22T09:14:32.761912+0000","last_undegraded":"2023-12-22T09:14:32.761912+0000","last_fullsized":"2023-12-22T09:14:32.761912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:16.611039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.478893+0000","last_change":"2023-12-22T09:14:28.467496+0000","last_active":"2023-12-22T09:14:32.478893+0000","last_peered":"2023-12-22T09:14:32.478893+0000","last_clean":"2023-12-22T09:14:32.478893+0000","last_became_active":"2023-12-22T09:14:28.463616+0000","last_became_peered":"2023-12-22T09:14:28.463616+0000","last_unstale":"2023-12-22T09:14:32.478893+0000","last_undegraded":"2023-12-22T09:14:32.478893+0000","last_fullsized":"2023-12-22T09:14:32.478893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:26.247244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.745036+0000","last_change":"2023-12-22T09:14:28.000212+0000","last_active":"2023-12-22T09:14:32.745036+0000","last_peered":"2023-12-22T09:14:32.745036+0000","last_clean":"2023-12-22T09:14:32.745036+0000","last_became_active":"2023-12-22T09:14:27.999905+0000","last_became_peered":"2023-12-22T09:14:27.999905+0000","last_unstale":"2023-12-22T09:14:32.745036+0000","last_undegraded":"2023-12-22T09:14:32.745036+0000","last_fullsized":"2023-12-22T09:14:32.745036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.504899+0000","last_change":"2023-12-22T09:14:32.502188+0000","last_active":"2023-12-22T09:14:32.504899+0000","last_peered":"2023-12-22T09:14:32.504899+0000","last_clean":"2023-12-22T09:14:32.504899+0000","last_became_active":"2023-12-22T09:14:32.501764+0000","last_became_peered":"2023-12-22T09:14:32.501764+0000","last_unstale":"2023-12-22T09:14:32.504899+0000","last_undegraded":"2023-12-22T09:14:32.504899+0000","last_fullsized":"2023-12-22T09:14:32.504899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:38.035204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491844+0000","last_change":"2023-12-22T09:14:28.463499+0000","last_active":"2023-12-22T09:14:32.491844+0000","last_peered":"2023-12-22T09:14:32.491844+0000","last_clean":"2023-12-22T09:14:32.491844+0000","last_became_active":"2023-12-22T09:14:28.463220+0000","last_became_peered":"2023-12-22T09:14:28.463220+0000","last_unstale":"2023-12-22T09:14:32.491844+0000","last_undegraded":"2023-12-22T09:14:32.491844+0000","last_fullsized":"2023-12-22T09:14:32.491844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489384+0000","last_change":"2023-12-22T09:14:27.999099+0000","last_active":"2023-12-22T09:14:32.489384+0000","last_peered":"2023-12-22T09:14:32.489384+0000","last_clean":"2023-12-22T09:14:32.489384+0000","last_became_active":"2023-12-22T09:14:27.998803+0000","last_became_peered":"2023-12-22T09:14:27.998803+0000","last_unstale":"2023-12-22T09:14:32.489384+0000","last_undegraded":"2023-12-22T09:14:32.489384+0000","last_fullsized":"2023-12-22T09:14:32.489384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:15:18.285741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.766019+0000","last_change":"2023-12-22T09:14:32.764135+0000","last_active":"2023-12-22T09:14:32.766019+0000","last_peered":"2023-12-22T09:14:32.766019+0000","last_clean":"2023-12-22T09:14:32.766019+0000","last_became_active":"2023-12-22T09:14:32.761760+0000","last_became_peered":"2023-12-22T09:14:32.761760+0000","last_unstale":"2023-12-22T09:14:32.766019+0000","last_undegraded":"2023-12-22T09:14:32.766019+0000","last_fullsized":"2023-12-22T09:14:32.766019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.471279+0000","last_change":"2023-12-22T09:14:28.475255+0000","last_active":"2023-12-22T09:14:32.471279+0000","last_peered":"2023-12-22T09:14:32.471279+0000","last_clean":"2023-12-22T09:14:32.471279+0000","last_became_active":"2023-12-22T09:14:28.475002+0000","last_became_peered":"2023-12-22T09:14:28.475002+0000","last_unstale":"2023-12-22T09:14:32.471279+0000","last_undegraded":"2023-12-22T09:14:32.471279+0000","last_fullsized":"2023-12-22T09:14:32.471279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:33.410634+0000","last_change":"2023-12-22T09:14:27.992093+0000","last_active":"2023-12-22T09:14:33.410634+0000","last_peered":"2023-12-22T09:14:33.410634+0000","last_clean":"2023-12-22T09:14:33.410634+0000","last_became_active":"2023-12-22T09:14:27.991810+0000","last_became_peered":"2023-12-22T09:14:27.991810+0000","last_unstale":"2023-12-22T09:14:33.410634+0000","last_undegraded":"2023-12-22T09:14:33.410634+0000","last_fullsized":"2023-12-22T09:14:33.410634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.753349+0000","last_change":"2023-12-22T09:14:32.750234+0000","last_active":"2023-12-22T09:14:32.753349+0000","last_peered":"2023-12-22T09:14:32.753349+0000","last_clean":"2023-12-22T09:14:32.753349+0000","last_became_active":"2023-12-22T09:14:32.749801+0000","last_became_peered":"2023-12-22T09:14:32.749801+0000","last_unstale":"2023-12-22T09:14:32.753349+0000","last_undegraded":"2023-12-22T09:14:32.753349+0000","last_fullsized":"2023-12-22T09:14:32.753349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:14:08.228677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477551+0000","last_change":"2023-12-22T09:14:28.454337+0000","last_active":"2023-12-22T09:14:32.477551+0000","last_peered":"2023-12-22T09:14:32.477551+0000","last_clean":"2023-12-22T09:14:32.477551+0000","last_became_active":"2023-12-22T09:14:28.454047+0000","last_became_peered":"2023-12-22T09:14:28.454047+0000","last_unstale":"2023-12-22T09:14:32.477551+0000","last_undegraded":"2023-12-22T09:14:32.477551+0000","last_fullsized":"2023-12-22T09:14:32.477551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.756169+0000","last_change":"2023-12-22T09:14:28.001870+0000","last_active":"2023-12-22T09:14:32.756169+0000","last_peered":"2023-12-22T09:14:32.756169+0000","last_clean":"2023-12-22T09:14:32.756169+0000","last_became_active":"2023-12-22T09:14:28.001090+0000","last_became_peered":"2023-12-22T09:14:28.001090+0000","last_unstale":"2023-12-22T09:14:32.756169+0000","last_undegraded":"2023-12-22T09:14:32.756169+0000","last_fullsized":"2023-12-22T09:14:32.756169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.752284+0000","last_change":"2023-12-22T09:14:32.748035+0000","last_active":"2023-12-22T09:14:32.752284+0000","last_peered":"2023-12-22T09:14:32.752284+0000","last_clean":"2023-12-22T09:14:32.752284+0000","last_became_active":"2023-12-22T09:14:32.747593+0000","last_became_peered":"2023-12-22T09:14:32.747593+0000","last_unstale":"2023-12-22T09:14:32.752284+0000","last_undegraded":"2023-12-22T09:14:32.752284+0000","last_fullsized":"2023-12-22T09:14:32.752284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495880+0000","last_change":"2023-12-22T09:14:28.478893+0000","last_active":"2023-12-22T09:14:32.495880+0000","last_peered":"2023-12-22T09:14:32.495880+0000","last_clean":"2023-12-22T09:14:32.495880+0000","last_became_active":"2023-12-22T09:14:28.478270+0000","last_became_peered":"2023-12-22T09:14:28.478270+0000","last_unstale":"2023-12-22T09:14:32.495880+0000","last_undegraded":"2023-12-22T09:14:32.495880+0000","last_fullsized":"2023-12-22T09:14:32.495880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477626+0000","last_change":"2023-12-22T09:14:27.993596+0000","last_active":"2023-12-22T09:14:32.477626+0000","last_peered":"2023-12-22T09:14:32.477626+0000","last_clean":"2023-12-22T09:14:32.477626+0000","last_became_active":"2023-12-22T09:14:27.993333+0000","last_became_peered":"2023-12-22T09:14:27.993333+0000","last_unstale":"2023-12-22T09:14:32.477626+0000","last_undegraded":"2023-12-22T09:14:32.477626+0000","last_fullsized":"2023-12-22T09:14:32.477626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505508+0000","last_change":"2023-12-22T09:14:32.497013+0000","last_active":"2023-12-22T09:14:32.505508+0000","last_peered":"2023-12-22T09:14:32.505508+0000","last_clean":"2023-12-22T09:14:32.505508+0000","last_became_active":"2023-12-22T09:14:32.496344+0000","last_became_peered":"2023-12-22T09:14:32.496344+0000","last_unstale":"2023-12-22T09:14:32.505508+0000","last_undegraded":"2023-12-22T09:14:32.505508+0000","last_fullsized":"2023-12-22T09:14:32.505508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479912+0000","last_change":"2023-12-22T09:14:28.467982+0000","last_active":"2023-12-22T09:14:32.479912+0000","last_peered":"2023-12-22T09:14:32.479912+0000","last_clean":"2023-12-22T09:14:32.479912+0000","last_became_active":"2023-12-22T09:14:28.467733+0000","last_became_peered":"2023-12-22T09:14:28.467733+0000","last_unstale":"2023-12-22T09:14:32.479912+0000","last_undegraded":"2023-12-22T09:14:32.479912+0000","last_fullsized":"2023-12-22T09:14:32.479912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:42.586936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494566+0000","last_change":"2023-12-22T09:14:27.992541+0000","last_active":"2023-12-22T09:14:32.494566+0000","last_peered":"2023-12-22T09:14:32.494566+0000","last_clean":"2023-12-22T09:14:32.494566+0000","last_became_active":"2023-12-22T09:14:27.988045+0000","last_became_peered":"2023-12-22T09:14:27.988045+0000","last_unstale":"2023-12-22T09:14:32.494566+0000","last_undegraded":"2023-12-22T09:14:32.494566+0000","last_fullsized":"2023-12-22T09:14:32.494566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.499768+0000","last_change":"2023-12-22T09:14:32.496063+0000","last_active":"2023-12-22T09:14:32.499768+0000","last_peered":"2023-12-22T09:14:32.499768+0000","last_clean":"2023-12-22T09:14:32.499768+0000","last_became_active":"2023-12-22T09:14:32.495488+0000","last_became_peered":"2023-12-22T09:14:32.495488+0000","last_unstale":"2023-12-22T09:14:32.499768+0000","last_undegraded":"2023-12-22T09:14:32.499768+0000","last_fullsized":"2023-12-22T09:14:32.499768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:44.670493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.477408+0000","last_change":"2023-12-22T09:14:28.455447+0000","last_active":"2023-12-22T09:14:32.477408+0000","last_peered":"2023-12-22T09:14:32.477408+0000","last_clean":"2023-12-22T09:14:32.477408+0000","last_became_active":"2023-12-22T09:14:28.454567+0000","last_became_peered":"2023-12-22T09:14:28.454567+0000","last_unstale":"2023-12-22T09:14:32.477408+0000","last_undegraded":"2023-12-22T09:14:32.477408+0000","last_fullsized":"2023-12-22T09:14:32.477408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488568+0000","last_change":"2023-12-22T09:14:27.987747+0000","last_active":"2023-12-22T09:14:32.488568+0000","last_peered":"2023-12-22T09:14:32.488568+0000","last_clean":"2023-12-22T09:14:32.488568+0000","last_became_active":"2023-12-22T09:14:27.983166+0000","last_became_peered":"2023-12-22T09:14:27.983166+0000","last_unstale":"2023-12-22T09:14:32.488568+0000","last_undegraded":"2023-12-22T09:14:32.488568+0000","last_fullsized":"2023-12-22T09:14:32.488568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507955+0000","last_change":"2023-12-22T09:14:32.501586+0000","last_active":"2023-12-22T09:14:32.507955+0000","last_peered":"2023-12-22T09:14:32.507955+0000","last_clean":"2023-12-22T09:14:32.507955+0000","last_became_active":"2023-12-22T09:14:32.501007+0000","last_became_peered":"2023-12-22T09:14:32.501007+0000","last_unstale":"2023-12-22T09:14:32.507955+0000","last_undegraded":"2023-12-22T09:14:32.507955+0000","last_fullsized":"2023-12-22T09:14:32.507955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:18.752984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489906+0000","last_change":"2023-12-22T09:14:28.481869+0000","last_active":"2023-12-22T09:14:32.489906+0000","last_peered":"2023-12-22T09:14:32.489906+0000","last_clean":"2023-12-22T09:14:32.489906+0000","last_became_active":"2023-12-22T09:14:28.481649+0000","last_became_peered":"2023-12-22T09:14:28.481649+0000","last_unstale":"2023-12-22T09:14:32.489906+0000","last_undegraded":"2023-12-22T09:14:32.489906+0000","last_fullsized":"2023-12-22T09:14:32.489906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747355+0000","last_change":"2023-12-22T09:14:28.001413+0000","last_active":"2023-12-22T09:14:32.747355+0000","last_peered":"2023-12-22T09:14:32.747355+0000","last_clean":"2023-12-22T09:14:32.747355+0000","last_became_active":"2023-12-22T09:14:28.001068+0000","last_became_peered":"2023-12-22T09:14:28.001068+0000","last_unstale":"2023-12-22T09:14:32.747355+0000","last_undegraded":"2023-12-22T09:14:32.747355+0000","last_fullsized":"2023-12-22T09:14:32.747355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754573+0000","last_change":"2023-12-22T09:14:32.750326+0000","last_active":"2023-12-22T09:14:32.754573+0000","last_peered":"2023-12-22T09:14:32.754573+0000","last_clean":"2023-12-22T09:14:32.754573+0000","last_became_active":"2023-12-22T09:14:32.748190+0000","last_became_peered":"2023-12-22T09:14:32.748190+0000","last_unstale":"2023-12-22T09:14:32.754573+0000","last_undegraded":"2023-12-22T09:14:32.754573+0000","last_fullsized":"2023-12-22T09:14:32.754573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:33.308005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466660+0000","last_change":"2023-12-22T09:14:28.473067+0000","last_active":"2023-12-22T09:14:32.466660+0000","last_peered":"2023-12-22T09:14:32.466660+0000","last_clean":"2023-12-22T09:14:32.466660+0000","last_became_active":"2023-12-22T09:14:28.471735+0000","last_became_peered":"2023-12-22T09:14:28.471735+0000","last_unstale":"2023-12-22T09:14:32.466660+0000","last_undegraded":"2023-12-22T09:14:32.466660+0000","last_fullsized":"2023-12-22T09:14:32.466660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.495258+0000","last_change":"2023-12-22T09:14:27.991666+0000","last_active":"2023-12-22T09:14:32.495258+0000","last_peered":"2023-12-22T09:14:32.495258+0000","last_clean":"2023-12-22T09:14:32.495258+0000","last_became_active":"2023-12-22T09:14:27.991399+0000","last_became_peered":"2023-12-22T09:14:27.991399+0000","last_unstale":"2023-12-22T09:14:32.495258+0000","last_undegraded":"2023-12-22T09:14:32.495258+0000","last_fullsized":"2023-12-22T09:14:32.495258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747364+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:14:32.747364+0000","last_peered":"2023-12-22T09:14:32.747364+0000","last_clean":"2023-12-22T09:14:32.747364+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:14:32.747364+0000","last_undegraded":"2023-12-22T09:14:32.747364+0000","last_fullsized":"2023-12-22T09:14:32.747364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.958460+0000","last_change":"2023-12-22T09:14:32.750023+0000","last_active":"2023-12-22T09:14:32.958460+0000","last_peered":"2023-12-22T09:14:32.958460+0000","last_clean":"2023-12-22T09:14:32.958460+0000","last_became_active":"2023-12-22T09:14:32.748764+0000","last_became_peered":"2023-12-22T09:14:32.748764+0000","last_unstale":"2023-12-22T09:14:32.958460+0000","last_undegraded":"2023-12-22T09:14:32.958460+0000","last_fullsized":"2023-12-22T09:14:32.958460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:42.444884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749613+0000","last_change":"2023-12-22T09:14:28.474500+0000","last_active":"2023-12-22T09:14:32.749613+0000","last_peered":"2023-12-22T09:14:32.749613+0000","last_clean":"2023-12-22T09:14:32.749613+0000","last_became_active":"2023-12-22T09:14:28.474257+0000","last_became_peered":"2023-12-22T09:14:28.474257+0000","last_unstale":"2023-12-22T09:14:32.749613+0000","last_undegraded":"2023-12-22T09:14:32.749613+0000","last_fullsized":"2023-12-22T09:14:32.749613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:14.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487370+0000","last_change":"2023-12-22T09:14:27.991242+0000","last_active":"2023-12-22T09:14:32.487370+0000","last_peered":"2023-12-22T09:14:32.487370+0000","last_clean":"2023-12-22T09:14:32.487370+0000","last_became_active":"2023-12-22T09:14:27.990742+0000","last_became_peered":"2023-12-22T09:14:27.990742+0000","last_unstale":"2023-12-22T09:14:32.487370+0000","last_undegraded":"2023-12-22T09:14:32.487370+0000","last_fullsized":"2023-12-22T09:14:32.487370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.957774+0000","last_change":"2023-12-22T09:14:32.749763+0000","last_active":"2023-12-22T09:14:32.957774+0000","last_peered":"2023-12-22T09:14:32.957774+0000","last_clean":"2023-12-22T09:14:32.957774+0000","last_became_active":"2023-12-22T09:14:32.748485+0000","last_became_peered":"2023-12-22T09:14:32.748485+0000","last_unstale":"2023-12-22T09:14:32.957774+0000","last_undegraded":"2023-12-22T09:14:32.957774+0000","last_fullsized":"2023-12-22T09:14:32.957774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:46:07.062719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494350+0000","last_change":"2023-12-22T09:14:28.477663+0000","last_active":"2023-12-22T09:14:32.494350+0000","last_peered":"2023-12-22T09:14:32.494350+0000","last_clean":"2023-12-22T09:14:32.494350+0000","last_became_active":"2023-12-22T09:14:28.477380+0000","last_became_peered":"2023-12-22T09:14:28.477380+0000","last_unstale":"2023-12-22T09:14:32.494350+0000","last_undegraded":"2023-12-22T09:14:32.494350+0000","last_fullsized":"2023-12-22T09:14:32.494350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.481313+0000","last_change":"2023-12-22T09:14:27.995562+0000","last_active":"2023-12-22T09:14:32.481313+0000","last_peered":"2023-12-22T09:14:32.481313+0000","last_clean":"2023-12-22T09:14:32.481313+0000","last_became_active":"2023-12-22T09:14:27.995251+0000","last_became_peered":"2023-12-22T09:14:27.995251+0000","last_unstale":"2023-12-22T09:14:32.481313+0000","last_undegraded":"2023-12-22T09:14:32.481313+0000","last_fullsized":"2023-12-22T09:14:32.481313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:41.573305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507091+0000","last_change":"2023-12-22T09:14:32.502846+0000","last_active":"2023-12-22T09:14:32.507091+0000","last_peered":"2023-12-22T09:14:32.507091+0000","last_clean":"2023-12-22T09:14:32.507091+0000","last_became_active":"2023-12-22T09:14:32.502395+0000","last_became_peered":"2023-12-22T09:14:32.502395+0000","last_unstale":"2023-12-22T09:14:32.507091+0000","last_undegraded":"2023-12-22T09:14:32.507091+0000","last_fullsized":"2023-12-22T09:14:32.507091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.758162+0000","last_change":"2023-12-22T09:14:28.482682+0000","last_active":"2023-12-22T09:14:32.758162+0000","last_peered":"2023-12-22T09:14:32.758162+0000","last_clean":"2023-12-22T09:14:32.758162+0000","last_became_active":"2023-12-22T09:14:28.475766+0000","last_became_peered":"2023-12-22T09:14:28.475766+0000","last_unstale":"2023-12-22T09:14:32.758162+0000","last_undegraded":"2023-12-22T09:14:32.758162+0000","last_fullsized":"2023-12-22T09:14:32.758162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:17.017778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486650+0000","last_change":"2023-12-22T09:14:27.982302+0000","last_active":"2023-12-22T09:14:32.486650+0000","last_peered":"2023-12-22T09:14:32.486650+0000","last_clean":"2023-12-22T09:14:32.486650+0000","last_became_active":"2023-12-22T09:14:27.982025+0000","last_became_peered":"2023-12-22T09:14:27.982025+0000","last_unstale":"2023-12-22T09:14:32.486650+0000","last_undegraded":"2023-12-22T09:14:32.486650+0000","last_fullsized":"2023-12-22T09:14:32.486650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:25.233613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757174+0000","last_change":"2023-12-22T09:14:32.754165+0000","last_active":"2023-12-22T09:14:32.757174+0000","last_peered":"2023-12-22T09:14:32.757174+0000","last_clean":"2023-12-22T09:14:32.757174+0000","last_became_active":"2023-12-22T09:14:32.753078+0000","last_became_peered":"2023-12-22T09:14:32.753078+0000","last_unstale":"2023-12-22T09:14:32.757174+0000","last_undegraded":"2023-12-22T09:14:32.757174+0000","last_fullsized":"2023-12-22T09:14:32.757174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.755255+0000","last_change":"2023-12-22T09:14:28.488566+0000","last_active":"2023-12-22T09:14:32.755255+0000","last_peered":"2023-12-22T09:14:32.755255+0000","last_clean":"2023-12-22T09:14:32.755255+0000","last_became_active":"2023-12-22T09:14:28.488216+0000","last_became_peered":"2023-12-22T09:14:28.488216+0000","last_unstale":"2023-12-22T09:14:32.755255+0000","last_undegraded":"2023-12-22T09:14:32.755255+0000","last_fullsized":"2023-12-22T09:14:32.755255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479697+0000","last_change":"2023-12-22T09:14:27.995501+0000","last_active":"2023-12-22T09:14:32.479697+0000","last_peered":"2023-12-22T09:14:32.479697+0000","last_clean":"2023-12-22T09:14:32.479697+0000","last_became_active":"2023-12-22T09:14:27.995234+0000","last_became_peered":"2023-12-22T09:14:27.995234+0000","last_unstale":"2023-12-22T09:14:32.479697+0000","last_undegraded":"2023-12-22T09:14:32.479697+0000","last_fullsized":"2023-12-22T09:14:32.479697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:23.399786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.502467+0000","last_change":"2023-12-22T09:14:32.498587+0000","last_active":"2023-12-22T09:14:32.502467+0000","last_peered":"2023-12-22T09:14:32.502467+0000","last_clean":"2023-12-22T09:14:32.502467+0000","last_became_active":"2023-12-22T09:14:32.497206+0000","last_became_peered":"2023-12-22T09:14:32.497206+0000","last_unstale":"2023-12-22T09:14:32.502467+0000","last_undegraded":"2023-12-22T09:14:32.502467+0000","last_fullsized":"2023-12-22T09:14:32.502467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:09.547807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.747037+0000","last_change":"2023-12-22T09:14:28.486764+0000","last_active":"2023-12-22T09:14:32.747037+0000","last_peered":"2023-12-22T09:14:32.747037+0000","last_clean":"2023-12-22T09:14:32.747037+0000","last_became_active":"2023-12-22T09:14:28.486496+0000","last_became_peered":"2023-12-22T09:14:28.486496+0000","last_unstale":"2023-12-22T09:14:32.747037+0000","last_undegraded":"2023-12-22T09:14:32.747037+0000","last_fullsized":"2023-12-22T09:14:32.747037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:50:41.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486193+0000","last_change":"2023-12-22T09:14:27.988914+0000","last_active":"2023-12-22T09:14:32.486193+0000","last_peered":"2023-12-22T09:14:32.486193+0000","last_clean":"2023-12-22T09:14:32.486193+0000","last_became_active":"2023-12-22T09:14:27.988557+0000","last_became_peered":"2023-12-22T09:14:27.988557+0000","last_unstale":"2023-12-22T09:14:32.486193+0000","last_undegraded":"2023-12-22T09:14:32.486193+0000","last_fullsized":"2023-12-22T09:14:32.486193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.509994+0000","last_change":"2023-12-22T09:14:32.504445+0000","last_active":"2023-12-22T09:14:32.509994+0000","last_peered":"2023-12-22T09:14:32.509994+0000","last_clean":"2023-12-22T09:14:32.509994+0000","last_became_active":"2023-12-22T09:14:32.504017+0000","last_became_peered":"2023-12-22T09:14:32.504017+0000","last_unstale":"2023-12-22T09:14:32.509994+0000","last_undegraded":"2023-12-22T09:14:32.509994+0000","last_fullsized":"2023-12-22T09:14:32.509994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:16.494365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486277+0000","last_change":"2023-12-22T09:14:28.471567+0000","last_active":"2023-12-22T09:14:32.486277+0000","last_peered":"2023-12-22T09:14:32.486277+0000","last_clean":"2023-12-22T09:14:32.486277+0000","last_became_active":"2023-12-22T09:14:28.471239+0000","last_became_peered":"2023-12-22T09:14:28.471239+0000","last_unstale":"2023-12-22T09:14:32.486277+0000","last_undegraded":"2023-12-22T09:14:32.486277+0000","last_fullsized":"2023-12-22T09:14:32.486277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:36.670203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487591+0000","last_change":"2023-12-22T09:14:27.997965+0000","last_active":"2023-12-22T09:14:32.487591+0000","last_peered":"2023-12-22T09:14:32.487591+0000","last_clean":"2023-12-22T09:14:32.487591+0000","last_became_active":"2023-12-22T09:14:27.995729+0000","last_became_peered":"2023-12-22T09:14:27.995729+0000","last_unstale":"2023-12-22T09:14:32.487591+0000","last_undegraded":"2023-12-22T09:14:32.487591+0000","last_fullsized":"2023-12-22T09:14:32.487591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:39.444798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.760822+0000","last_change":"2023-12-22T09:14:32.759895+0000","last_active":"2023-12-22T09:14:32.760822+0000","last_peered":"2023-12-22T09:14:32.760822+0000","last_clean":"2023-12-22T09:14:32.760822+0000","last_became_active":"2023-12-22T09:14:32.759468+0000","last_became_peered":"2023-12-22T09:14:32.759468+0000","last_unstale":"2023-12-22T09:14:32.760822+0000","last_undegraded":"2023-12-22T09:14:32.760822+0000","last_fullsized":"2023-12-22T09:14:32.760822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:50:22.096701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.749005+0000","last_change":"2023-12-22T09:14:28.474331+0000","last_active":"2023-12-22T09:14:32.749005+0000","last_peered":"2023-12-22T09:14:32.749005+0000","last_clean":"2023-12-22T09:14:32.749005+0000","last_became_active":"2023-12-22T09:14:28.473856+0000","last_became_peered":"2023-12-22T09:14:28.473856+0000","last_unstale":"2023-12-22T09:14:32.749005+0000","last_undegraded":"2023-12-22T09:14:32.749005+0000","last_fullsized":"2023-12-22T09:14:32.749005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494464+0000","last_change":"2023-12-22T09:14:28.003970+0000","last_active":"2023-12-22T09:14:32.494464+0000","last_peered":"2023-12-22T09:14:32.494464+0000","last_clean":"2023-12-22T09:14:32.494464+0000","last_became_active":"2023-12-22T09:14:28.003627+0000","last_became_peered":"2023-12-22T09:14:28.003627+0000","last_unstale":"2023-12-22T09:14:32.494464+0000","last_undegraded":"2023-12-22T09:14:32.494464+0000","last_fullsized":"2023-12-22T09:14:32.494464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:35.791485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754851+0000","last_change":"2023-12-22T09:14:32.752183+0000","last_active":"2023-12-22T09:14:32.754851+0000","last_peered":"2023-12-22T09:14:32.754851+0000","last_clean":"2023-12-22T09:14:32.754851+0000","last_became_active":"2023-12-22T09:14:32.749483+0000","last_became_peered":"2023-12-22T09:14:32.749483+0000","last_unstale":"2023-12-22T09:14:32.754851+0000","last_undegraded":"2023-12-22T09:14:32.754851+0000","last_fullsized":"2023-12-22T09:14:32.754851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:09.047311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489001+0000","last_change":"2023-12-22T09:14:28.477740+0000","last_active":"2023-12-22T09:14:32.489001+0000","last_peered":"2023-12-22T09:14:32.489001+0000","last_clean":"2023-12-22T09:14:32.489001+0000","last_became_active":"2023-12-22T09:14:28.477495+0000","last_became_peered":"2023-12-22T09:14:28.477495+0000","last_unstale":"2023-12-22T09:14:32.489001+0000","last_undegraded":"2023-12-22T09:14:32.489001+0000","last_fullsized":"2023-12-22T09:14:32.489001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:28.625454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489565+0000","last_change":"2023-12-22T09:14:27.994572+0000","last_active":"2023-12-22T09:14:32.489565+0000","last_peered":"2023-12-22T09:14:32.489565+0000","last_clean":"2023-12-22T09:14:32.489565+0000","last_became_active":"2023-12-22T09:14:27.994200+0000","last_became_peered":"2023-12-22T09:14:27.994200+0000","last_unstale":"2023-12-22T09:14:32.489565+0000","last_undegraded":"2023-12-22T09:14:32.489565+0000","last_fullsized":"2023-12-22T09:14:32.489565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:50:40.407650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754400+0000","last_change":"2023-12-22T09:14:32.751024+0000","last_active":"2023-12-22T09:14:32.754400+0000","last_peered":"2023-12-22T09:14:32.754400+0000","last_clean":"2023-12-22T09:14:32.754400+0000","last_became_active":"2023-12-22T09:14:32.748055+0000","last_became_peered":"2023-12-22T09:14:32.748055+0000","last_unstale":"2023-12-22T09:14:32.754400+0000","last_undegraded":"2023-12-22T09:14:32.754400+0000","last_fullsized":"2023-12-22T09:14:32.754400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:18.069342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757751+0000","last_change":"2023-12-22T09:14:28.475564+0000","last_active":"2023-12-22T09:14:32.757751+0000","last_peered":"2023-12-22T09:14:32.757751+0000","last_clean":"2023-12-22T09:14:32.757751+0000","last_became_active":"2023-12-22T09:14:28.475209+0000","last_became_peered":"2023-12-22T09:14:28.475209+0000","last_unstale":"2023-12-22T09:14:32.757751+0000","last_undegraded":"2023-12-22T09:14:32.757751+0000","last_fullsized":"2023-12-22T09:14:32.757751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:46.880888+0000","last_change":"2023-12-22T09:14:27.986129+0000","last_active":"2023-12-22T09:14:46.880888+0000","last_peered":"2023-12-22T09:14:46.880888+0000","last_clean":"2023-12-22T09:14:46.880888+0000","last_became_active":"2023-12-22T09:14:27.984848+0000","last_became_peered":"2023-12-22T09:14:27.984848+0000","last_unstale":"2023-12-22T09:14:46.880888+0000","last_undegraded":"2023-12-22T09:14:46.880888+0000","last_fullsized":"2023-12-22T09:14:46.880888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:26:42.194176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505485+0000","last_change":"2023-12-22T09:14:32.496763+0000","last_active":"2023-12-22T09:14:32.505485+0000","last_peered":"2023-12-22T09:14:32.505485+0000","last_clean":"2023-12-22T09:14:32.505485+0000","last_became_active":"2023-12-22T09:14:32.495748+0000","last_became_peered":"2023-12-22T09:14:32.495748+0000","last_unstale":"2023-12-22T09:14:32.505485+0000","last_undegraded":"2023-12-22T09:14:32.505485+0000","last_fullsized":"2023-12-22T09:14:32.505485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:47.269989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479467+0000","last_change":"2023-12-22T09:14:28.479921+0000","last_active":"2023-12-22T09:14:32.479467+0000","last_peered":"2023-12-22T09:14:32.479467+0000","last_clean":"2023-12-22T09:14:32.479467+0000","last_became_active":"2023-12-22T09:14:28.479147+0000","last_became_peered":"2023-12-22T09:14:28.479147+0000","last_unstale":"2023-12-22T09:14:32.479467+0000","last_undegraded":"2023-12-22T09:14:32.479467+0000","last_fullsized":"2023-12-22T09:14:32.479467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:22.141418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.481162+0000","last_change":"2023-12-22T09:14:27.998821+0000","last_active":"2023-12-22T09:14:32.481162+0000","last_peered":"2023-12-22T09:14:32.481162+0000","last_clean":"2023-12-22T09:14:32.481162+0000","last_became_active":"2023-12-22T09:14:27.998503+0000","last_became_peered":"2023-12-22T09:14:27.998503+0000","last_unstale":"2023-12-22T09:14:32.481162+0000","last_undegraded":"2023-12-22T09:14:32.481162+0000","last_fullsized":"2023-12-22T09:14:32.481162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.507446+0000","last_change":"2023-12-22T09:14:32.502980+0000","last_active":"2023-12-22T09:14:32.507446+0000","last_peered":"2023-12-22T09:14:32.507446+0000","last_clean":"2023-12-22T09:14:32.507446+0000","last_became_active":"2023-12-22T09:14:32.502553+0000","last_became_peered":"2023-12-22T09:14:32.502553+0000","last_unstale":"2023-12-22T09:14:32.507446+0000","last_undegraded":"2023-12-22T09:14:32.507446+0000","last_fullsized":"2023-12-22T09:14:32.507446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:45:19.291884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.491688+0000","last_change":"2023-12-22T09:14:28.475888+0000","last_active":"2023-12-22T09:14:32.491688+0000","last_peered":"2023-12-22T09:14:32.491688+0000","last_clean":"2023-12-22T09:14:32.491688+0000","last_became_active":"2023-12-22T09:14:28.475647+0000","last_became_peered":"2023-12-22T09:14:28.475647+0000","last_unstale":"2023-12-22T09:14:32.491688+0000","last_undegraded":"2023-12-22T09:14:32.491688+0000","last_fullsized":"2023-12-22T09:14:32.491688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494265+0000","last_change":"2023-12-22T09:14:27.995374+0000","last_active":"2023-12-22T09:14:32.494265+0000","last_peered":"2023-12-22T09:14:32.494265+0000","last_clean":"2023-12-22T09:14:32.494265+0000","last_became_active":"2023-12-22T09:14:27.995047+0000","last_became_peered":"2023-12-22T09:14:27.995047+0000","last_unstale":"2023-12-22T09:14:32.494265+0000","last_undegraded":"2023-12-22T09:14:32.494265+0000","last_fullsized":"2023-12-22T09:14:32.494265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:40.044198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.497163+0000","last_change":"2023-12-22T09:14:32.493394+0000","last_active":"2023-12-22T09:14:32.497163+0000","last_peered":"2023-12-22T09:14:32.497163+0000","last_clean":"2023-12-22T09:14:32.497163+0000","last_became_active":"2023-12-22T09:14:32.492984+0000","last_became_peered":"2023-12-22T09:14:32.492984+0000","last_unstale":"2023-12-22T09:14:32.497163+0000","last_undegraded":"2023-12-22T09:14:32.497163+0000","last_fullsized":"2023-12-22T09:14:32.497163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:53:49.846745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494126+0000","last_change":"2023-12-22T09:14:28.486602+0000","last_active":"2023-12-22T09:14:32.494126+0000","last_peered":"2023-12-22T09:14:32.494126+0000","last_clean":"2023-12-22T09:14:32.494126+0000","last_became_active":"2023-12-22T09:14:28.485948+0000","last_became_peered":"2023-12-22T09:14:28.485948+0000","last_unstale":"2023-12-22T09:14:32.494126+0000","last_undegraded":"2023-12-22T09:14:32.494126+0000","last_fullsized":"2023-12-22T09:14:32.494126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:14.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489192+0000","last_change":"2023-12-22T09:14:28.000308+0000","last_active":"2023-12-22T09:14:32.489192+0000","last_peered":"2023-12-22T09:14:32.489192+0000","last_clean":"2023-12-22T09:14:32.489192+0000","last_became_active":"2023-12-22T09:14:28.000003+0000","last_became_peered":"2023-12-22T09:14:28.000003+0000","last_unstale":"2023-12-22T09:14:32.489192+0000","last_undegraded":"2023-12-22T09:14:32.489192+0000","last_fullsized":"2023-12-22T09:14:32.489192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:28:22.560684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.746514+0000","last_change":"2023-12-22T09:14:32.744415+0000","last_active":"2023-12-22T09:14:32.746514+0000","last_peered":"2023-12-22T09:14:32.746514+0000","last_clean":"2023-12-22T09:14:32.746514+0000","last_became_active":"2023-12-22T09:14:32.744068+0000","last_became_peered":"2023-12-22T09:14:32.744068+0000","last_unstale":"2023-12-22T09:14:32.746514+0000","last_undegraded":"2023-12-22T09:14:32.746514+0000","last_fullsized":"2023-12-22T09:14:32.746514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:57.666688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754553+0000","last_change":"2023-12-22T09:14:32.748417+0000","last_active":"2023-12-22T09:14:32.754553+0000","last_peered":"2023-12-22T09:14:32.754553+0000","last_clean":"2023-12-22T09:14:32.754553+0000","last_became_active":"2023-12-22T09:14:32.747730+0000","last_became_peered":"2023-12-22T09:14:32.747730+0000","last_unstale":"2023-12-22T09:14:32.754553+0000","last_undegraded":"2023-12-22T09:14:32.754553+0000","last_fullsized":"2023-12-22T09:14:32.754553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:18.069342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479643+0000","last_change":"2023-12-22T09:14:28.477761+0000","last_active":"2023-12-22T09:14:32.479643+0000","last_peered":"2023-12-22T09:14:32.479643+0000","last_clean":"2023-12-22T09:14:32.479643+0000","last_became_active":"2023-12-22T09:14:28.477515+0000","last_became_peered":"2023-12-22T09:14:28.477515+0000","last_unstale":"2023-12-22T09:14:32.479643+0000","last_undegraded":"2023-12-22T09:14:32.479643+0000","last_fullsized":"2023-12-22T09:14:32.479643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:59.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.493081+0000","last_change":"2023-12-22T09:14:27.997801+0000","last_active":"2023-12-22T09:14:32.493081+0000","last_peered":"2023-12-22T09:14:32.493081+0000","last_clean":"2023-12-22T09:14:32.493081+0000","last_became_active":"2023-12-22T09:14:27.995420+0000","last_became_peered":"2023-12-22T09:14:27.995420+0000","last_unstale":"2023-12-22T09:14:32.493081+0000","last_undegraded":"2023-12-22T09:14:32.493081+0000","last_fullsized":"2023-12-22T09:14:32.493081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.958796+0000","last_change":"2023-12-22T09:14:32.502003+0000","last_active":"2023-12-22T09:14:32.958796+0000","last_peered":"2023-12-22T09:14:32.958796+0000","last_clean":"2023-12-22T09:14:32.958796+0000","last_became_active":"2023-12-22T09:14:32.501565+0000","last_became_peered":"2023-12-22T09:14:32.501565+0000","last_unstale":"2023-12-22T09:14:32.958796+0000","last_undegraded":"2023-12-22T09:14:32.958796+0000","last_fullsized":"2023-12-22T09:14:32.958796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:53.560717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.466430+0000","last_change":"2023-12-22T09:14:28.476695+0000","last_active":"2023-12-22T09:14:32.466430+0000","last_peered":"2023-12-22T09:14:32.466430+0000","last_clean":"2023-12-22T09:14:32.466430+0000","last_became_active":"2023-12-22T09:14:28.476418+0000","last_became_peered":"2023-12-22T09:14:28.476418+0000","last_unstale":"2023-12-22T09:14:32.466430+0000","last_undegraded":"2023-12-22T09:14:32.466430+0000","last_fullsized":"2023-12-22T09:14:32.466430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467174+0000","last_change":"2023-12-22T09:14:27.981491+0000","last_active":"2023-12-22T09:14:32.467174+0000","last_peered":"2023-12-22T09:14:32.467174+0000","last_clean":"2023-12-22T09:14:32.467174+0000","last_became_active":"2023-12-22T09:14:27.981149+0000","last_became_peered":"2023-12-22T09:14:27.981149+0000","last_unstale":"2023-12-22T09:14:32.467174+0000","last_undegraded":"2023-12-22T09:14:32.467174+0000","last_fullsized":"2023-12-22T09:14:32.467174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:42.552673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490549+0000","last_change":"2023-12-22T09:14:27.995250+0000","last_active":"2023-12-22T09:14:32.490549+0000","last_peered":"2023-12-22T09:14:32.490549+0000","last_clean":"2023-12-22T09:14:32.490549+0000","last_became_active":"2023-12-22T09:14:27.994964+0000","last_became_peered":"2023-12-22T09:14:27.994964+0000","last_unstale":"2023-12-22T09:14:32.490549+0000","last_undegraded":"2023-12-22T09:14:32.490549+0000","last_fullsized":"2023-12-22T09:14:32.490549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:08.238642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489470+0000","last_change":"2023-12-22T09:14:28.481744+0000","last_active":"2023-12-22T09:14:32.489470+0000","last_peered":"2023-12-22T09:14:32.489470+0000","last_clean":"2023-12-22T09:14:32.489470+0000","last_became_active":"2023-12-22T09:14:28.481329+0000","last_became_peered":"2023-12-22T09:14:28.481329+0000","last_unstale":"2023-12-22T09:14:32.489470+0000","last_undegraded":"2023-12-22T09:14:32.489470+0000","last_fullsized":"2023-12-22T09:14:32.489470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:18:59.454414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.505339+0000","last_change":"2023-12-22T09:14:32.500565+0000","last_active":"2023-12-22T09:14:32.505339+0000","last_peered":"2023-12-22T09:14:32.505339+0000","last_clean":"2023-12-22T09:14:32.505339+0000","last_became_active":"2023-12-22T09:14:32.500063+0000","last_became_peered":"2023-12-22T09:14:32.500063+0000","last_unstale":"2023-12-22T09:14:32.505339+0000","last_undegraded":"2023-12-22T09:14:32.505339+0000","last_fullsized":"2023-12-22T09:14:32.505339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:19.878873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467700+0000","last_change":"2023-12-22T09:14:27.997689+0000","last_active":"2023-12-22T09:14:32.467700+0000","last_peered":"2023-12-22T09:14:32.467700+0000","last_clean":"2023-12-22T09:14:32.467700+0000","last_became_active":"2023-12-22T09:14:27.997332+0000","last_became_peered":"2023-12-22T09:14:27.997332+0000","last_unstale":"2023-12-22T09:14:32.467700+0000","last_undegraded":"2023-12-22T09:14:32.467700+0000","last_fullsized":"2023-12-22T09:14:32.467700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:26.928181+0000","last_clean_scrub_stamp":"2023-12-22T09:14:26.928181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:42.208458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.478532+0000","last_change":"2023-12-22T09:14:28.466320+0000","last_active":"2023-12-22T09:14:32.478532+0000","last_peered":"2023-12-22T09:14:32.478532+0000","last_clean":"2023-12-22T09:14:32.478532+0000","last_became_active":"2023-12-22T09:14:28.465905+0000","last_became_peered":"2023-12-22T09:14:28.465905+0000","last_unstale":"2023-12-22T09:14:32.478532+0000","last_undegraded":"2023-12-22T09:14:32.478532+0000","last_fullsized":"2023-12-22T09:14:32.478532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:41.057829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.499215+0000","last_change":"2023-12-22T09:14:32.496695+0000","last_active":"2023-12-22T09:14:32.499215+0000","last_peered":"2023-12-22T09:14:32.499215+0000","last_clean":"2023-12-22T09:14:32.499215+0000","last_became_active":"2023-12-22T09:14:32.494463+0000","last_became_peered":"2023-12-22T09:14:32.494463+0000","last_unstale":"2023-12-22T09:14:32.499215+0000","last_undegraded":"2023-12-22T09:14:32.499215+0000","last_fullsized":"2023-12-22T09:14:32.499215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:31.450966+0000","last_clean_scrub_stamp":"2023-12-22T09:14:31.450966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:05:19.971364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486096+0000","last_change":"2023-12-22T09:14:28.463582+0000","last_active":"2023-12-22T09:14:32.486096+0000","last_peered":"2023-12-22T09:14:32.486096+0000","last_clean":"2023-12-22T09:14:32.486096+0000","last_became_active":"2023-12-22T09:14:28.463247+0000","last_became_peered":"2023-12-22T09:14:28.463247+0000","last_unstale":"2023-12-22T09:14:32.486096+0000","last_undegraded":"2023-12-22T09:14:32.486096+0000","last_fullsized":"2023-12-22T09:14:32.486096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:52.250368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488481+0000","last_change":"2023-12-22T09:14:28.466146+0000","last_active":"2023-12-22T09:14:32.488481+0000","last_peered":"2023-12-22T09:14:32.488481+0000","last_clean":"2023-12-22T09:14:32.488481+0000","last_became_active":"2023-12-22T09:14:28.460909+0000","last_became_peered":"2023-12-22T09:14:28.460909+0000","last_unstale":"2023-12-22T09:14:32.488481+0000","last_undegraded":"2023-12-22T09:14:32.488481+0000","last_fullsized":"2023-12-22T09:14:32.488481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:13.826585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494360+0000","last_change":"2023-12-22T09:14:28.477080+0000","last_active":"2023-12-22T09:14:32.494360+0000","last_peered":"2023-12-22T09:14:32.494360+0000","last_clean":"2023-12-22T09:14:32.494360+0000","last_became_active":"2023-12-22T09:14:28.474190+0000","last_became_peered":"2023-12-22T09:14:28.474190+0000","last_unstale":"2023-12-22T09:14:32.494360+0000","last_undegraded":"2023-12-22T09:14:32.494360+0000","last_fullsized":"2023-12-22T09:14:32.494360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489372+0000","last_change":"2023-12-22T09:14:28.475187+0000","last_active":"2023-12-22T09:14:32.489372+0000","last_peered":"2023-12-22T09:14:32.489372+0000","last_clean":"2023-12-22T09:14:32.489372+0000","last_became_active":"2023-12-22T09:14:28.474944+0000","last_became_peered":"2023-12-22T09:14:28.474944+0000","last_unstale":"2023-12-22T09:14:32.489372+0000","last_undegraded":"2023-12-22T09:14:32.489372+0000","last_fullsized":"2023-12-22T09:14:32.489372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:54:29.516809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.468613+0000","last_change":"2023-12-22T09:14:28.479990+0000","last_active":"2023-12-22T09:14:32.468613+0000","last_peered":"2023-12-22T09:14:32.468613+0000","last_clean":"2023-12-22T09:14:32.468613+0000","last_became_active":"2023-12-22T09:14:28.479746+0000","last_became_peered":"2023-12-22T09:14:28.479746+0000","last_unstale":"2023-12-22T09:14:32.468613+0000","last_undegraded":"2023-12-22T09:14:32.468613+0000","last_fullsized":"2023-12-22T09:14:32.468613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:26.849454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.480832+0000","last_change":"2023-12-22T09:14:28.472845+0000","last_active":"2023-12-22T09:14:32.480832+0000","last_peered":"2023-12-22T09:14:32.480832+0000","last_clean":"2023-12-22T09:14:32.480832+0000","last_became_active":"2023-12-22T09:14:28.472592+0000","last_became_peered":"2023-12-22T09:14:28.472592+0000","last_unstale":"2023-12-22T09:14:32.480832+0000","last_undegraded":"2023-12-22T09:14:32.480832+0000","last_fullsized":"2023-12-22T09:14:32.480832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:28.625454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489554+0000","last_change":"2023-12-22T09:14:28.476150+0000","last_active":"2023-12-22T09:14:32.489554+0000","last_peered":"2023-12-22T09:14:32.489554+0000","last_clean":"2023-12-22T09:14:32.489554+0000","last_became_active":"2023-12-22T09:14:28.475897+0000","last_became_peered":"2023-12-22T09:14:28.475897+0000","last_unstale":"2023-12-22T09:14:32.489554+0000","last_undegraded":"2023-12-22T09:14:32.489554+0000","last_fullsized":"2023-12-22T09:14:32.489554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:53:11.117313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.471112+0000","last_change":"2023-12-22T09:14:28.480478+0000","last_active":"2023-12-22T09:14:32.471112+0000","last_peered":"2023-12-22T09:14:32.471112+0000","last_clean":"2023-12-22T09:14:32.471112+0000","last_became_active":"2023-12-22T09:14:28.480143+0000","last_became_peered":"2023-12-22T09:14:28.480143+0000","last_unstale":"2023-12-22T09:14:32.471112+0000","last_undegraded":"2023-12-22T09:14:32.471112+0000","last_fullsized":"2023-12-22T09:14:32.471112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.492960+0000","last_change":"2023-12-22T09:14:28.478251+0000","last_active":"2023-12-22T09:14:32.492960+0000","last_peered":"2023-12-22T09:14:32.492960+0000","last_clean":"2023-12-22T09:14:32.492960+0000","last_became_active":"2023-12-22T09:14:28.477973+0000","last_became_peered":"2023-12-22T09:14:28.477973+0000","last_unstale":"2023-12-22T09:14:32.492960+0000","last_undegraded":"2023-12-22T09:14:32.492960+0000","last_fullsized":"2023-12-22T09:14:32.492960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467428+0000","last_change":"2023-12-22T09:14:28.479996+0000","last_active":"2023-12-22T09:14:32.467428+0000","last_peered":"2023-12-22T09:14:32.467428+0000","last_clean":"2023-12-22T09:14:32.467428+0000","last_became_active":"2023-12-22T09:14:28.479737+0000","last_became_peered":"2023-12-22T09:14:28.479737+0000","last_unstale":"2023-12-22T09:14:32.467428+0000","last_undegraded":"2023-12-22T09:14:32.467428+0000","last_fullsized":"2023-12-22T09:14:32.467428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:46.323744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494265+0000","last_change":"2023-12-22T09:14:28.479078+0000","last_active":"2023-12-22T09:14:32.494265+0000","last_peered":"2023-12-22T09:14:32.494265+0000","last_clean":"2023-12-22T09:14:32.494265+0000","last_became_active":"2023-12-22T09:14:28.478851+0000","last_became_peered":"2023-12-22T09:14:28.478851+0000","last_unstale":"2023-12-22T09:14:32.494265+0000","last_undegraded":"2023-12-22T09:14:32.494265+0000","last_fullsized":"2023-12-22T09:14:32.494265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:15.678969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489256+0000","last_change":"2023-12-22T09:14:28.480955+0000","last_active":"2023-12-22T09:14:32.489256+0000","last_peered":"2023-12-22T09:14:32.489256+0000","last_clean":"2023-12-22T09:14:32.489256+0000","last_became_active":"2023-12-22T09:14:28.479777+0000","last_became_peered":"2023-12-22T09:14:28.479777+0000","last_unstale":"2023-12-22T09:14:32.489256+0000","last_undegraded":"2023-12-22T09:14:32.489256+0000","last_fullsized":"2023-12-22T09:14:32.489256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:16.369720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488409+0000","last_change":"2023-12-22T09:14:28.477114+0000","last_active":"2023-12-22T09:14:32.488409+0000","last_peered":"2023-12-22T09:14:32.488409+0000","last_clean":"2023-12-22T09:14:32.488409+0000","last_became_active":"2023-12-22T09:14:28.476857+0000","last_became_peered":"2023-12-22T09:14:28.476857+0000","last_unstale":"2023-12-22T09:14:32.488409+0000","last_undegraded":"2023-12-22T09:14:32.488409+0000","last_fullsized":"2023-12-22T09:14:32.488409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:11:22.661582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.755992+0000","last_change":"2023-12-22T09:14:28.473400+0000","last_active":"2023-12-22T09:14:32.755992+0000","last_peered":"2023-12-22T09:14:32.755992+0000","last_clean":"2023-12-22T09:14:32.755992+0000","last_became_active":"2023-12-22T09:14:28.473079+0000","last_became_peered":"2023-12-22T09:14:28.473079+0000","last_unstale":"2023-12-22T09:14:32.755992+0000","last_undegraded":"2023-12-22T09:14:32.755992+0000","last_fullsized":"2023-12-22T09:14:32.755992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:57.405682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.486749+0000","last_change":"2023-12-22T09:14:28.456928+0000","last_active":"2023-12-22T09:14:32.486749+0000","last_peered":"2023-12-22T09:14:32.486749+0000","last_clean":"2023-12-22T09:14:32.486749+0000","last_became_active":"2023-12-22T09:14:28.456756+0000","last_became_peered":"2023-12-22T09:14:28.456756+0000","last_unstale":"2023-12-22T09:14:32.486749+0000","last_undegraded":"2023-12-22T09:14:32.486749+0000","last_fullsized":"2023-12-22T09:14:32.486749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:42.031515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494912+0000","last_change":"2023-12-22T09:14:28.475388+0000","last_active":"2023-12-22T09:14:32.494912+0000","last_peered":"2023-12-22T09:14:32.494912+0000","last_clean":"2023-12-22T09:14:32.494912+0000","last_became_active":"2023-12-22T09:14:28.474472+0000","last_became_peered":"2023-12-22T09:14:28.474472+0000","last_unstale":"2023-12-22T09:14:32.494912+0000","last_undegraded":"2023-12-22T09:14:32.494912+0000","last_fullsized":"2023-12-22T09:14:32.494912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:05:17.017778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.492765+0000","last_change":"2023-12-22T09:14:28.471352+0000","last_active":"2023-12-22T09:14:32.492765+0000","last_peered":"2023-12-22T09:14:32.492765+0000","last_clean":"2023-12-22T09:14:32.492765+0000","last_became_active":"2023-12-22T09:14:28.471042+0000","last_became_peered":"2023-12-22T09:14:28.471042+0000","last_unstale":"2023-12-22T09:14:32.492765+0000","last_undegraded":"2023-12-22T09:14:32.492765+0000","last_fullsized":"2023-12-22T09:14:32.492765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479697+0000","last_change":"2023-12-22T09:14:28.470575+0000","last_active":"2023-12-22T09:14:32.479697+0000","last_peered":"2023-12-22T09:14:32.479697+0000","last_clean":"2023-12-22T09:14:32.479697+0000","last_became_active":"2023-12-22T09:14:28.470317+0000","last_became_peered":"2023-12-22T09:14:28.470317+0000","last_unstale":"2023-12-22T09:14:32.479697+0000","last_undegraded":"2023-12-22T09:14:32.479697+0000","last_fullsized":"2023-12-22T09:14:32.479697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:15.433364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.488959+0000","last_change":"2023-12-22T09:14:28.471255+0000","last_active":"2023-12-22T09:14:32.488959+0000","last_peered":"2023-12-22T09:14:32.488959+0000","last_clean":"2023-12-22T09:14:32.488959+0000","last_became_active":"2023-12-22T09:14:28.470985+0000","last_became_peered":"2023-12-22T09:14:28.470985+0000","last_unstale":"2023-12-22T09:14:32.488959+0000","last_undegraded":"2023-12-22T09:14:32.488959+0000","last_fullsized":"2023-12-22T09:14:32.488959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:32:58.600762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.467160+0000","last_change":"2023-12-22T09:14:28.474205+0000","last_active":"2023-12-22T09:14:32.467160+0000","last_peered":"2023-12-22T09:14:32.467160+0000","last_clean":"2023-12-22T09:14:32.467160+0000","last_became_active":"2023-12-22T09:14:28.473905+0000","last_became_peered":"2023-12-22T09:14:28.473905+0000","last_unstale":"2023-12-22T09:14:32.467160+0000","last_undegraded":"2023-12-22T09:14:32.467160+0000","last_fullsized":"2023-12-22T09:14:32.467160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.479259+0000","last_change":"2023-12-22T09:14:28.469345+0000","last_active":"2023-12-22T09:14:32.479259+0000","last_peered":"2023-12-22T09:14:32.479259+0000","last_clean":"2023-12-22T09:14:32.479259+0000","last_became_active":"2023-12-22T09:14:28.469074+0000","last_became_peered":"2023-12-22T09:14:28.469074+0000","last_unstale":"2023-12-22T09:14:32.479259+0000","last_undegraded":"2023-12-22T09:14:32.479259+0000","last_fullsized":"2023-12-22T09:14:32.479259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:09:36.805116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.487868+0000","last_change":"2023-12-22T09:14:28.465762+0000","last_active":"2023-12-22T09:14:32.487868+0000","last_peered":"2023-12-22T09:14:32.487868+0000","last_clean":"2023-12-22T09:14:32.487868+0000","last_became_active":"2023-12-22T09:14:28.465457+0000","last_became_peered":"2023-12-22T09:14:28.465457+0000","last_unstale":"2023-12-22T09:14:32.487868+0000","last_undegraded":"2023-12-22T09:14:32.487868+0000","last_fullsized":"2023-12-22T09:14:32.487868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:03.107378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.489453+0000","last_change":"2023-12-22T09:14:28.464288+0000","last_active":"2023-12-22T09:14:32.489453+0000","last_peered":"2023-12-22T09:14:32.489453+0000","last_clean":"2023-12-22T09:14:32.489453+0000","last_became_active":"2023-12-22T09:14:28.463738+0000","last_became_peered":"2023-12-22T09:14:28.463738+0000","last_unstale":"2023-12-22T09:14:32.489453+0000","last_undegraded":"2023-12-22T09:14:32.489453+0000","last_fullsized":"2023-12-22T09:14:32.489453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:59:57.709549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757917+0000","last_change":"2023-12-22T09:14:28.474461+0000","last_active":"2023-12-22T09:14:32.757917+0000","last_peered":"2023-12-22T09:14:32.757917+0000","last_clean":"2023-12-22T09:14:32.757917+0000","last_became_active":"2023-12-22T09:14:28.474159+0000","last_became_peered":"2023-12-22T09:14:28.474159+0000","last_unstale":"2023-12-22T09:14:32.757917+0000","last_undegraded":"2023-12-22T09:14:32.757917+0000","last_fullsized":"2023-12-22T09:14:32.757917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:15.678969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.465111+0000","last_change":"2023-12-22T09:14:28.471807+0000","last_active":"2023-12-22T09:14:32.465111+0000","last_peered":"2023-12-22T09:14:32.465111+0000","last_clean":"2023-12-22T09:14:32.465111+0000","last_became_active":"2023-12-22T09:14:28.471516+0000","last_became_peered":"2023-12-22T09:14:28.471516+0000","last_unstale":"2023-12-22T09:14:32.465111+0000","last_undegraded":"2023-12-22T09:14:32.465111+0000","last_fullsized":"2023-12-22T09:14:32.465111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:45.782582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.746735+0000","last_change":"2023-12-22T09:14:28.472378+0000","last_active":"2023-12-22T09:14:32.746735+0000","last_peered":"2023-12-22T09:14:32.746735+0000","last_clean":"2023-12-22T09:14:32.746735+0000","last_became_active":"2023-12-22T09:14:28.472104+0000","last_became_peered":"2023-12-22T09:14:28.472104+0000","last_unstale":"2023-12-22T09:14:32.746735+0000","last_undegraded":"2023-12-22T09:14:32.746735+0000","last_fullsized":"2023-12-22T09:14:32.746735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:31:49.310976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494167+0000","last_change":"2023-12-22T09:14:28.465305+0000","last_active":"2023-12-22T09:14:32.494167+0000","last_peered":"2023-12-22T09:14:32.494167+0000","last_clean":"2023-12-22T09:14:32.494167+0000","last_became_active":"2023-12-22T09:14:28.464795+0000","last_became_peered":"2023-12-22T09:14:28.464795+0000","last_unstale":"2023-12-22T09:14:32.494167+0000","last_undegraded":"2023-12-22T09:14:32.494167+0000","last_fullsized":"2023-12-22T09:14:32.494167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:26.849454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.754743+0000","last_change":"2023-12-22T09:14:28.471738+0000","last_active":"2023-12-22T09:14:32.754743+0000","last_peered":"2023-12-22T09:14:32.754743+0000","last_clean":"2023-12-22T09:14:32.754743+0000","last_became_active":"2023-12-22T09:14:28.470650+0000","last_became_peered":"2023-12-22T09:14:28.470650+0000","last_unstale":"2023-12-22T09:14:32.754743+0000","last_undegraded":"2023-12-22T09:14:32.754743+0000","last_fullsized":"2023-12-22T09:14:32.754743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:06:29.032842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.494158+0000","last_change":"2023-12-22T09:14:28.477696+0000","last_active":"2023-12-22T09:14:32.494158+0000","last_peered":"2023-12-22T09:14:32.494158+0000","last_clean":"2023-12-22T09:14:32.494158+0000","last_became_active":"2023-12-22T09:14:28.477426+0000","last_became_peered":"2023-12-22T09:14:28.477426+0000","last_unstale":"2023-12-22T09:14:32.494158+0000","last_undegraded":"2023-12-22T09:14:32.494158+0000","last_fullsized":"2023-12-22T09:14:32.494158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:50:41.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.490998+0000","last_change":"2023-12-22T09:14:28.467153+0000","last_active":"2023-12-22T09:14:32.490998+0000","last_peered":"2023-12-22T09:14:32.490998+0000","last_clean":"2023-12-22T09:14:32.490998+0000","last_became_active":"2023-12-22T09:14:28.466719+0000","last_became_peered":"2023-12-22T09:14:28.466719+0000","last_unstale":"2023-12-22T09:14:32.490998+0000","last_undegraded":"2023-12-22T09:14:32.490998+0000","last_fullsized":"2023-12-22T09:14:32.490998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:15:05.682773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.484628+0000","last_change":"2023-12-22T09:14:28.479238+0000","last_active":"2023-12-22T09:14:32.484628+0000","last_peered":"2023-12-22T09:14:32.484628+0000","last_clean":"2023-12-22T09:14:32.484628+0000","last_became_active":"2023-12-22T09:14:28.478984+0000","last_became_peered":"2023-12-22T09:14:28.478984+0000","last_unstale":"2023-12-22T09:14:32.484628+0000","last_undegraded":"2023-12-22T09:14:32.484628+0000","last_fullsized":"2023-12-22T09:14:32.484628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:52:39.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-22T09:14:32.757917+0000","last_change":"2023-12-22T09:14:28.482492+0000","last_active":"2023-12-22T09:14:32.757917+0000","last_peered":"2023-12-22T09:14:32.757917+0000","last_clean":"2023-12-22T09:14:32.757917+0000","last_became_active":"2023-12-22T09:14:28.474439+0000","last_became_peered":"2023-12-22T09:14:28.474439+0000","last_unstale":"2023-12-22T09:14:32.757917+0000","last_undegraded":"2023-12-22T09:14:32.757917+0000","last_fullsized":"2023-12-22T09:14:32.757917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:27.941812+0000","last_clean_scrub_stamp":"2023-12-22T09:14:27.941812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:29:03.538309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":694025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6070000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":106871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6919999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":106871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3250000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":103075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8560000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8839999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5179999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3679999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8260000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5910000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:15:03.444 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-22T09:15:03.444 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-22T09:15:03.444 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-22T09:15:03.445 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-22T09:15:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.691+0000 7f9b33eb2640 1 Processor -- start 2023-12-22T09:15:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.691+0000 7f9b33eb2640 1 -- start start 2023-12-22T09:15:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.693+0000 7f9b33eb2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b2c1514b0 0x7f9b2c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.693+0000 7f9b33eb2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0c4130 0x7f9b2c154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.693+0000 7f9b33eb2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2c0c4660 con 0x7f9b2c154a80 2023-12-22T09:15:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.693+0000 7f9b33eb2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2c153d60 con 0x7f9b2c1514b0 2023-12-22T09:15:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.693+0000 7f9b33eb2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c06b250 con 0x7f9b2c0c4130 2023-12-22T09:15:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.693+0000 7f9b3244f640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9b2c154a80 0x7f9b2c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51320/0 (socket says 172.21.15.106:51320) 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.693+0000 7f9b3244f640 1 -- 172.21.15.106:0/2651321833 learned_addr learned my addr 172.21.15.106:0/2651321833 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.693+0000 7f9b3144d640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0c4130 0x7f9b2c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.693+0000 7f9b31c4e640 1 --2- 172.21.15.106:0/2651321833 >> v2:172.21.15.132:3300/0 conn(0x7f9b2c1514b0 0x7f9b2c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789432721 0 0) 0x7f9b2c0c4660 con 0x7f9b2c154a80 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b18003520 con 0x7f9b2c154a80 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2237224447 0 0) 0x7f9b18003520 con 0x7f9b2c154a80 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0c4130 msgr2=0x7f9b2c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0c4130 0x7f9b2c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 >> v2:172.21.15.132:3300/0 conn(0x7f9b2c1514b0 msgr2=0x7f9b2c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 --2- 172.21.15.106:0/2651321833 >> v2:172.21.15.132:3300/0 conn(0x7f9b2c1514b0 0x7f9b2c0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c06b530 con 0x7f9b2c154a80 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f9b240019f0 con 0x7f9b2c154a80 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 >> v1:172.21.15.106:6789/0 conn(0x7f9b2c154a80 legacy=0x7f9b2c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0c4130 0x7f9b18003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18004d00 0x7f9b18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c153d60 con 0x7f9b18003f40 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c06b250 con 0x7f9b18004d00 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1800ba30 con 0x7f9b2c0c4130 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.694+0000 7f9b3144d640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.695+0000 7f9b31c4e640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0c4130 0x7f9b18003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.695+0000 7f9b3144d640 1 -- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0c4130 msgr2=0x7f9b18003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.695+0000 7f9b3144d640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0c4130 0x7f9b18003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.695+0000 7f9b3244f640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18004d00 0x7f9b18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.695+0000 7f9b3144d640 1 -- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18004d00 msgr2=0x7f9b18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:03.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.695+0000 7f9b3144d640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b18004d00 0x7f9b18005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.695+0000 7f9b3144d640 1 -- 172.21.15.106:0/2651321833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18003520 con 0x7f9b18003f40 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.696+0000 7f9b3144d640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b180047c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009a90 tx=0x7f9b180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9fffe9d0385cc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.696+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c02c680 con 0x7f9b18003f40 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.696+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c02c7e0 con 0x7f9b18003f40 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.696+0000 7f9b30c4c640 1 -- 172.21.15.106:0/2651321833 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c02cb70 con 0x7f9b18003f40 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.697+0000 7f9b33eb2640 1 -- 172.21.15.106:0/2651321833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 msgr2=0x7f9b180047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.697+0000 7f9b33eb2640 1 --2- 172.21.15.106:0/2651321833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b180047c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009a90 tx=0x7f9b180057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.697+0000 7f9b3244f640 1 -- 172.21.15.106:0/2651321833 reap_dead start 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.697+0000 7f9b33eb2640 1 -- 172.21.15.106:0/2651321833 shutdown_connections 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.697+0000 7f9b33eb2640 1 -- 172.21.15.106:0/2651321833 >> 172.21.15.106:0/2651321833 conn(0x7f9b2c0ab1a0 msgr2=0x7f9b2c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.697+0000 7f9b33eb2640 1 -- 172.21.15.106:0/2651321833 shutdown_connections 2023-12-22T09:15:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.697+0000 7f9b33eb2640 1 -- 172.21.15.106:0/2651321833 wait complete. 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.699+0000 7f9b33eb2640 1 Processor -- start 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.699+0000 7f9b33eb2640 1 -- start start 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.699+0000 7f9b33eb2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b2c0bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b33eb2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0be5c0 0x7f9b2c14cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b33eb2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b2c0c0780 0x7f9b2c14d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b33eb2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c14d810 con 0x7f9b18003f40 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b33eb2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c1ec6a0 con 0x7f9b2c0c0780 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b33eb2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0bd270 con 0x7f9b2c0be5c0 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b31c4e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b2c0bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b31c4e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b2c0bdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50668/0 (socket says 172.21.15.106:50668) 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b31c4e640 1 -- 172.21.15.106:0/1240072649 learned_addr learned my addr 172.21.15.106:0/1240072649 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b31c4e640 1 -- 172.21.15.106:0/1240072649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0be5c0 msgr2=0x7f9b2c14cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b31c4e640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0be5c0 0x7f9b2c14cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b3244f640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b2c0c0780 0x7f9b2c14d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b31c4e640 1 -- 172.21.15.106:0/1240072649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b2c0c0780 msgr2=0x7f9b2c14d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b31c4e640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b2c0c0780 0x7f9b2c14d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b31c4e640 1 -- 172.21.15.106:0/1240072649 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c1ec8f0 con 0x7f9b18003f40 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.700+0000 7f9b31c4e640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b2c0bdac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9b28010940 tx=0x7f9b28010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.701+0000 7f9b227fc640 1 -- 172.21.15.106:0/1240072649 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28009690 con 0x7f9b18003f40 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.701+0000 7f9b227fc640 1 -- 172.21.15.106:0/1240072649 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2800ec20 con 0x7f9b18003f40 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.701+0000 7f9b227fc640 1 -- 172.21.15.106:0/1240072649 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2801c400 con 0x7f9b18003f40 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.701+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2c1ecbd0 con 0x7f9b18003f40 2023-12-22T09:15:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.701+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2c1ed190 con 0x7f9b18003f40 2023-12-22T09:15:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.702+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c073f10 con 0x7f9b18003f40 2023-12-22T09:15:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.703+0000 7f9b227fc640 1 -- 172.21.15.106:0/1240072649 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9b2801c560 con 0x7f9b18003f40 2023-12-22T09:15:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.703+0000 7f9b227fc640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9b1006a430 0x7f9b1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.704+0000 7f9b227fc640 1 -- 172.21.15.106:0/1240072649 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9b28089290 con 0x7f9b18003f40 2023-12-22T09:15:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.704+0000 7f9b3144d640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9b1006a430 0x7f9b1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.704+0000 7f9b3144d640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9b1006a430 0x7f9b1006c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c036000 tx=0x7f9b1c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.708+0000 7f9b227fc640 1 -- 172.21.15.106:0/1240072649 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9b280546d0 con 0x7f9b18003f40 2023-12-22T09:15:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.918+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9b2c0c6aa0 con 0x7f9b18003f40 2023-12-22T09:15:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.919+0000 7f9b227fc640 1 -- 172.21.15.106:0/1240072649 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9b28057cf0 con 0x7f9b18003f40 2023-12-22T09:15:03.919 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:03.919 INFO:teuthology.orchestra.run.smithi106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-22T09:15:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.921+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9b1006a430 msgr2=0x7f9b1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.921+0000 7f9b33eb2640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9b1006a430 0x7f9b1006c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c036000 tx=0x7f9b1c02e000 comp rx=0 tx=0).stop 2023-12-22T09:15:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.921+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 msgr2=0x7f9b2c0bdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.921+0000 7f9b33eb2640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b2c0bdac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9b28010940 tx=0x7f9b28010e00 comp rx=0 tx=0).stop 2023-12-22T09:15:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.922+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 shutdown_connections 2023-12-22T09:15:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.922+0000 7f9b33eb2640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9b1006a430 0x7f9b1006c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.922+0000 7f9b33eb2640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b2c0c0780 0x7f9b2c14d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.922+0000 7f9b33eb2640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b2c0be5c0 0x7f9b2c14cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.922+0000 7f9b33eb2640 1 --2- 172.21.15.106:0/1240072649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b18003f40 0x7f9b2c0bdac0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.922+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 >> 172.21.15.106:0/1240072649 conn(0x7f9b2c0ab1a0 msgr2=0x7f9b2c152c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.922+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 shutdown_connections 2023-12-22T09:15:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:03.922+0000 7f9b33eb2640 1 -- 172.21.15.106:0/1240072649 wait complete. 2023-12-22T09:15:03.940 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-22T09:15:03.941 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:04.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.147+0000 7fc4dd496640 1 Processor -- start 2023-12-22T09:15:04.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.147+0000 7fc4dd496640 1 -- start start 2023-12-22T09:15:04.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.149+0000 7fc4dd496640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d8152680 0x7fc4d815c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.149+0000 7fc4dd496640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d80bfce0 con 0x7fc4d8069e60 2023-12-22T09:15:04.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.149+0000 7fc4dd496640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d80bffc0 con 0x7fc4d8150a80 2023-12-22T09:15:04.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.149+0000 7fc4dd496640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d80c0960 con 0x7fc4d8152680 2023-12-22T09:15:04.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.149+0000 7fc4d6ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc4d8069e60 0x7fc4d814a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51322/0 (socket says 172.21.15.106:51322) 2023-12-22T09:15:04.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.149+0000 7fc4d6ffd640 1 -- 172.21.15.106:0/1637765100 learned_addr learned my addr 172.21.15.106:0/1637765100 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:04.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.149+0000 7fc4d77fe640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d8152680 0x7fc4d815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.149+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259859640 0 0) 0x7fc4d80bfce0 con 0x7fc4d8069e60 2023-12-22T09:15:04.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.149+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4c4003520 con 0x7fc4d8069e60 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 159249001 0 0) 0x7fc4c4003520 con 0x7fc4d8069e60 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d8152680 msgr2=0x7fc4d815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d8152680 0x7fc4d815c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 >> v1:172.21.15.132:6789/0 conn(0x7fc4d8150a80 legacy=0x7fc4d8151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d80c02a0 con 0x7fc4d8069e60 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fc4c8001b70 con 0x7fc4d8069e60 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 >> v1:172.21.15.106:6789/0 conn(0x7fc4d8069e60 legacy=0x7fc4d814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4c4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4c40047c0 0x7fc4c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d8152680 0x7fc4c4005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d80c0960 con 0x7fc4c40039a0 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c400bb40 con 0x7fc4c40047c0 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c400bd00 con 0x7fc4d8152680 2023-12-22T09:15:04.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d6ffd640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4c4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.150+0000 7fc4d67fc640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4c40047c0 0x7fc4c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.151+0000 7fc4d6ffd640 1 -- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d8152680 msgr2=0x7fc4c4005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:04.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.151+0000 7fc4d6ffd640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d8152680 0x7fc4c4005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.151+0000 7fc4d6ffd640 1 -- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4c40047c0 msgr2=0x7fc4c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:04.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.151+0000 7fc4d6ffd640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4c40047c0 0x7fc4c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.151+0000 7fc4d6ffd640 1 -- 172.21.15.106:0/1637765100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c4003520 con 0x7fc4c40039a0 2023-12-22T09:15:04.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.151+0000 7fc4d67fc640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4c40047c0 0x7fc4c4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:04.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.152+0000 7fc4d6ffd640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4c4003dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800c100 tx=0x7fc4c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2570db6e92e9a325 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:04.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.152+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8005d20 con 0x7fc4c40039a0 2023-12-22T09:15:04.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.152+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8031070 con 0x7fc4c40039a0 2023-12-22T09:15:04.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.152+0000 7fc4d5ffb640 1 -- 172.21.15.106:0/1637765100 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80072b0 con 0x7fc4c40039a0 2023-12-22T09:15:04.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.152+0000 7fc4dd496640 1 -- 172.21.15.106:0/1637765100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 msgr2=0x7fc4c4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.152+0000 7fc4dd496640 1 --2- 172.21.15.106:0/1637765100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4c4003dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800c100 tx=0x7fc4c40057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.153+0000 7fc4d77fe640 1 -- 172.21.15.106:0/1637765100 reap_dead start 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.153+0000 7fc4dd496640 1 -- 172.21.15.106:0/1637765100 shutdown_connections 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.153+0000 7fc4dd496640 1 -- 172.21.15.106:0/1637765100 >> 172.21.15.106:0/1637765100 conn(0x7fc4d80c5360 msgr2=0x7fc4d80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.153+0000 7fc4dd496640 1 -- 172.21.15.106:0/1637765100 shutdown_connections 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.153+0000 7fc4dd496640 1 -- 172.21.15.106:0/1637765100 wait complete. 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.154+0000 7fc4dd496640 1 Processor -- start 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.155+0000 7fc4dd496640 1 -- start start 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.155+0000 7fc4dd496640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4d81e93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.155+0000 7fc4dd496640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d814a440 0x7fc4d814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.155+0000 7fc4dd496640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d814b640 0x7fc4d814bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.155+0000 7fc4dd496640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d8142db0 con 0x7fc4c40039a0 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.155+0000 7fc4dd496640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d81e98f0 con 0x7fc4d814b640 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.155+0000 7fc4dd496640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d8153ae0 con 0x7fc4d814a440 2023-12-22T09:15:04.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d6ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4d81e93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d6ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4d81e93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50684/0 (socket says 172.21.15.106:50684) 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d6ffd640 1 -- 172.21.15.106:0/555690078 learned_addr learned my addr 172.21.15.106:0/555690078 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d67fc640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d814a440 0x7fc4d814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d77fe640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d814b640 0x7fc4d814bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d6ffd640 1 -- 172.21.15.106:0/555690078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d814a440 msgr2=0x7fc4d814ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d6ffd640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d814a440 0x7fc4d814ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d6ffd640 1 -- 172.21.15.106:0/555690078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d814b640 msgr2=0x7fc4d814bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d6ffd640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d814b640 0x7fc4d814bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d6ffd640 1 -- 172.21.15.106:0/555690078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d81ec0f0 con 0x7fc4c40039a0 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d77fe640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d814b640 0x7fc4d814bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.156+0000 7fc4d6ffd640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4d81e93b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc4c802ead0 tx=0x7fc4c8001f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.157+0000 7fc4cf7fe640 1 -- 172.21.15.106:0/555690078 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8001c70 con 0x7fc4c40039a0 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.157+0000 7fc4cf7fe640 1 -- 172.21.15.106:0/555690078 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8005b20 con 0x7fc4c40039a0 2023-12-22T09:15:04.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.157+0000 7fc4cf7fe640 1 -- 172.21.15.106:0/555690078 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8005e90 con 0x7fc4c40039a0 2023-12-22T09:15:04.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.157+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d8150660 con 0x7fc4c40039a0 2023-12-22T09:15:04.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.157+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d8154010 con 0x7fc4c40039a0 2023-12-22T09:15:04.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.158+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d81ebec0 con 0x7fc4c40039a0 2023-12-22T09:15:04.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.159+0000 7fc4cf7fe640 1 -- 172.21.15.106:0/555690078 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc4c8033030 con 0x7fc4c40039a0 2023-12-22T09:15:04.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.160+0000 7fc4cf7fe640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc4b806a430 0x7fc4b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.160+0000 7fc4cf7fe640 1 -- 172.21.15.106:0/555690078 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4c80aa850 con 0x7fc4c40039a0 2023-12-22T09:15:04.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.160+0000 7fc4d67fc640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc4b806a430 0x7fc4b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.161+0000 7fc4d67fc640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc4b806a430 0x7fc4b806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0007fd0 tx=0x7fc4c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:04.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.165+0000 7fc4cf7fe640 1 -- 172.21.15.106:0/555690078 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc4d81ebec0 con 0x7fc4c40039a0 2023-12-22T09:15:04.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.357+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4d81ebec0 con 0x7fc4c40039a0 2023-12-22T09:15:04.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.360+0000 7fc4cf7fe640 1 -- 172.21.15.106:0/555690078 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fc4d81ebec0 con 0x7fc4c40039a0 2023-12-22T09:15:04.359 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:04.360 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.362+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc4b806a430 msgr2=0x7fc4b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.362+0000 7fc4dd496640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc4b806a430 0x7fc4b806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0007fd0 tx=0x7fc4c0009040 comp rx=0 tx=0).stop 2023-12-22T09:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.362+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 msgr2=0x7fc4d81e93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.362+0000 7fc4dd496640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4d81e93b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc4c802ead0 tx=0x7fc4c8001f00 comp rx=0 tx=0).stop 2023-12-22T09:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.362+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 shutdown_connections 2023-12-22T09:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.362+0000 7fc4dd496640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc4b806a430 0x7fc4b806c8f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.363+0000 7fc4dd496640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4d814b640 0x7fc4d814bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.363+0000 7fc4dd496640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4d814a440 0x7fc4d814ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.363+0000 7fc4dd496640 1 --2- 172.21.15.106:0/555690078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4c40039a0 0x7fc4d81e93b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.363+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 >> 172.21.15.106:0/555690078 conn(0x7fc4d80c5360 msgr2=0x7fc4d8071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.363+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 shutdown_connections 2023-12-22T09:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.363+0000 7fc4dd496640 1 -- 172.21.15.106:0/555690078 wait complete. 2023-12-22T09:15:04.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:04.382 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.587+0000 7f0f995f1640 1 Processor -- start 2023-12-22T09:15:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.587+0000 7f0f995f1640 1 -- start start 2023-12-22T09:15:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.588+0000 7f0f995f1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 0x7f0f94154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.588+0000 7f0f995f1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f94151760 0x7f0f940a8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.588+0000 7f0f995f1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0f940a88a0 0x7f0f940c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.588+0000 7f0f995f1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f94150ab0 con 0x7f0f940a88a0 2023-12-22T09:15:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.588+0000 7f0f995f1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f94072130 con 0x7f0f94151760 2023-12-22T09:15:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.588+0000 7f0f995f1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f94150cc0 con 0x7f0f9414dfe0 2023-12-22T09:15:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f937fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0f940a88a0 0x7f0f940c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f937fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0f940a88a0 0x7f0f940c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50690/0 (socket says 172.21.15.106:50690) 2023-12-22T09:15:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f937fe640 1 -- 172.21.15.106:0/2859117588 learned_addr learned my addr 172.21.15.106:0/2859117588 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f92ffd640 1 --2- 172.21.15.106:0/2859117588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 0x7f0f94154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f937fe640 1 -- 172.21.15.106:0/2859117588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 msgr2=0x7f0f94154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f937fe640 1 --2- 172.21.15.106:0/2859117588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 0x7f0f94154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f937fe640 1 -- 172.21.15.106:0/2859117588 >> v2:172.21.15.132:3300/0 conn(0x7f0f94151760 msgr2=0x7f0f940a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f927fc640 1 --2- 172.21.15.106:0/2859117588 >> v2:172.21.15.132:3300/0 conn(0x7f0f94151760 0x7f0f940a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f937fe640 1 --2- 172.21.15.106:0/2859117588 >> v2:172.21.15.132:3300/0 conn(0x7f0f94151760 0x7f0f940a8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.589+0000 7f0f937fe640 1 -- 172.21.15.106:0/2859117588 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f94154ff0 con 0x7f0f940a88a0 2023-12-22T09:15:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.590+0000 7f0f937fe640 1 --2- 172.21.15.106:0/2859117588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f940a88a0 0x7f0f940c2010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0f940c2a20 tx=0x7f0f8c02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af6a5f6023a3f03 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f91ffb640 1 -- 172.21.15.106:0/2859117588 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c02edf0 con 0x7f0f940a88a0 2023-12-22T09:15:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f91ffb640 1 -- 172.21.15.106:0/2859117588 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c036440 con 0x7f0f940a88a0 2023-12-22T09:15:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f91ffb640 1 -- 172.21.15.106:0/2859117588 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0367d0 con 0x7f0f940a88a0 2023-12-22T09:15:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f995f1640 1 -- 172.21.15.106:0/2859117588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f940a88a0 msgr2=0x7f0f940c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f995f1640 1 --2- 172.21.15.106:0/2859117588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f940a88a0 0x7f0f940c2010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0f940c2a20 tx=0x7f0f8c02e040 comp rx=0 tx=0).stop 2023-12-22T09:15:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f995f1640 1 -- 172.21.15.106:0/2859117588 shutdown_connections 2023-12-22T09:15:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f995f1640 1 --2- 172.21.15.106:0/2859117588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f940a88a0 0x7f0f940c2010 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f995f1640 1 --2- 172.21.15.106:0/2859117588 >> v2:172.21.15.132:3300/0 conn(0x7f0f94151760 0x7f0f940a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f995f1640 1 --2- 172.21.15.106:0/2859117588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 0x7f0f94154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.591+0000 7f0f995f1640 1 -- 172.21.15.106:0/2859117588 >> 172.21.15.106:0/2859117588 conn(0x7f0f94069dd0 msgr2=0x7f0f9406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.592+0000 7f0f995f1640 1 -- 172.21.15.106:0/2859117588 shutdown_connections 2023-12-22T09:15:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.592+0000 7f0f995f1640 1 -- 172.21.15.106:0/2859117588 wait complete. 2023-12-22T09:15:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.593+0000 7f0f995f1640 1 Processor -- start 2023-12-22T09:15:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.593+0000 7f0f995f1640 1 -- start start 2023-12-22T09:15:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.594+0000 7f0f995f1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f940a88a0 0x7f0f940be850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.594+0000 7f0f995f1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 0x7f0f941ec270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.594+0000 7f0f995f1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f94151760 0x7f0f941ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.594+0000 7f0f995f1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941e9610 con 0x7f0f94151760 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.594+0000 7f0f995f1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941e9b40 con 0x7f0f940a88a0 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.594+0000 7f0f995f1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941e9860 con 0x7f0f9414dfe0 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.594+0000 7f0f937fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f94151760 0x7f0f941ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.594+0000 7f0f937fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f94151760 0x7f0f941ec7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50704/0 (socket says 172.21.15.106:50704) 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.594+0000 7f0f937fe640 1 -- 172.21.15.106:0/540747072 learned_addr learned my addr 172.21.15.106:0/540747072 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f92ffd640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f940a88a0 0x7f0f940be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f927fc640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 0x7f0f941ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f937fe640 1 -- 172.21.15.106:0/540747072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 msgr2=0x7f0f941ec270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f937fe640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 0x7f0f941ec270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f937fe640 1 -- 172.21.15.106:0/540747072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f940a88a0 msgr2=0x7f0f940be850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f937fe640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f940a88a0 0x7f0f940be850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f937fe640 1 -- 172.21.15.106:0/540747072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c00b770 con 0x7f0f94151760 2023-12-22T09:15:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f937fe640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f94151760 0x7f0f941ec7b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c02e080 tx=0x7f0f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f8b7fe640 1 -- 172.21.15.106:0/540747072 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c034b80 con 0x7f0f94151760 2023-12-22T09:15:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f8b7fe640 1 -- 172.21.15.106:0/540747072 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c034d00 con 0x7f0f94151760 2023-12-22T09:15:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f8b7fe640 1 -- 172.21.15.106:0/540747072 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0416a0 con 0x7f0f94151760 2023-12-22T09:15:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.595+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f941541c0 con 0x7f0f94151760 2023-12-22T09:15:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.596+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9406d4a0 con 0x7f0f94151760 2023-12-22T09:15:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.597+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f94154000 con 0x7f0f94151760 2023-12-22T09:15:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.598+0000 7f0f8b7fe640 1 -- 172.21.15.106:0/540747072 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f8c049360 con 0x7f0f94151760 2023-12-22T09:15:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.598+0000 7f0f8b7fe640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0f7406a430 0x7f0f7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.599+0000 7f0f8b7fe640 1 -- 172.21.15.106:0/540747072 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f8c0ab220 con 0x7f0f94151760 2023-12-22T09:15:04.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.599+0000 7f0f92ffd640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0f7406a430 0x7f0f7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:04.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.599+0000 7f0f92ffd640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0f7406a430 0x7f0f7406c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f940bf240 tx=0x7f0f840083e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.602+0000 7f0f8b7fe640 1 -- 172.21.15.106:0/540747072 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0f8c076510 con 0x7f0f94151760 2023-12-22T09:15:04.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.784+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f94073f10 con 0x7f0f94151760 2023-12-22T09:15:04.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.785+0000 7f0f8b7fe640 1 -- 172.21.15.106:0/540747072 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f8c079b30 con 0x7f0f94151760 2023-12-22T09:15:04.785 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:04.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0f7406a430 msgr2=0x7f0f7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0f7406a430 0x7f0f7406c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f940bf240 tx=0x7f0f840083e0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f94151760 msgr2=0x7f0f941ec7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:04.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f94151760 0x7f0f941ec7b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c02e080 tx=0x7f0f8c0046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 shutdown_connections 2023-12-22T09:15:04.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0f7406a430 0x7f0f7406c8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f94151760 0x7f0f941ec7b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0f9414dfe0 0x7f0f941ec270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 --2- 172.21.15.106:0/540747072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f940a88a0 0x7f0f940be850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:04.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 >> 172.21.15.106:0/540747072 conn(0x7f0f94069dd0 msgr2=0x7f0f9414e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:04.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 shutdown_connections 2023-12-22T09:15:04.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:04.788+0000 7f0f995f1640 1 -- 172.21.15.106:0/540747072 wait complete. 2023-12-22T09:15:04.805 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:05.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.009+0000 7f75a733c640 1 Processor -- start 2023-12-22T09:15:05.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.009+0000 7f75a733c640 1 -- start start 2023-12-22T09:15:05.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.011+0000 7f75a733c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a00c5a30 0x7f75a00c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.011+0000 7f75a733c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75a006c2d0 0x7f75a01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.011+0000 7f75a733c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a014f570 con 0x7f75a006bdc0 2023-12-22T09:15:05.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.011+0000 7f75a733c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a00a90f0 con 0x7f75a006c2d0 2023-12-22T09:15:05.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.011+0000 7f75a733c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00c0b00 con 0x7f75a00c5a30 2023-12-22T09:15:05.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.011+0000 7f75a50d8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a00c5a30 0x7f75a00c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.012+0000 7f75a48d7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f75a006bdc0 0x7f75a01550e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:35608/0 (socket says 172.21.15.106:35608) 2023-12-22T09:15:05.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.012+0000 7f75a48d7640 1 -- 172.21.15.106:0/2211676992 learned_addr learned my addr 172.21.15.106:0/2211676992 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:05.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.012+0000 7f75a58d9640 1 --2- 172.21.15.106:0/2211676992 >> v2:172.21.15.132:3300/0 conn(0x7f75a006c2d0 0x7f75a01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.012+0000 7f75a50d8640 1 -- 172.21.15.106:0/2211676992 >> v2:172.21.15.132:3300/0 conn(0x7f75a006c2d0 msgr2=0x7f75a01557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:05.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.012+0000 7f75a50d8640 1 --2- 172.21.15.106:0/2211676992 >> v2:172.21.15.132:3300/0 conn(0x7f75a006c2d0 0x7f75a01557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.012+0000 7f75a50d8640 1 -- 172.21.15.106:0/2211676992 >> v1:172.21.15.132:6789/0 conn(0x7f75a006bdc0 legacy=0x7f75a01550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.012+0000 7f75a50d8640 1 -- 172.21.15.106:0/2211676992 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00bfd40 con 0x7f75a00c5a30 2023-12-22T09:15:05.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.014+0000 7f75a50d8640 1 --2- 172.21.15.106:0/2211676992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a00c5a30 0x7f75a00c5e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f759c0097a0 tx=0x7f759c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b42ebf72817db49c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:05.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.014+0000 7f7597fff640 1 -- 172.21.15.106:0/2211676992 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c02e070 con 0x7f75a00c5a30 2023-12-22T09:15:05.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.014+0000 7f7597fff640 1 -- 172.21.15.106:0/2211676992 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c0315a0 con 0x7f75a00c5a30 2023-12-22T09:15:05.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.014+0000 7f7597fff640 1 -- 172.21.15.106:0/2211676992 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c031930 con 0x7f75a00c5a30 2023-12-22T09:15:05.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.015+0000 7f75a733c640 1 -- 172.21.15.106:0/2211676992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a00c5a30 msgr2=0x7f75a00c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.015+0000 7f75a733c640 1 --2- 172.21.15.106:0/2211676992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a00c5a30 0x7f75a00c5e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f759c0097a0 tx=0x7f759c02b840 comp rx=0 tx=0).stop 2023-12-22T09:15:05.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.015+0000 7f75a733c640 1 -- 172.21.15.106:0/2211676992 shutdown_connections 2023-12-22T09:15:05.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.015+0000 7f75a733c640 1 --2- 172.21.15.106:0/2211676992 >> v2:172.21.15.132:3300/0 conn(0x7f75a006c2d0 0x7f75a01557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.015+0000 7f75a733c640 1 --2- 172.21.15.106:0/2211676992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a00c5a30 0x7f75a00c5e10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.015+0000 7f75a733c640 1 -- 172.21.15.106:0/2211676992 >> 172.21.15.106:0/2211676992 conn(0x7f75a006a220 msgr2=0x7f75a00c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:05.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.015+0000 7f75a733c640 1 -- 172.21.15.106:0/2211676992 shutdown_connections 2023-12-22T09:15:05.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.015+0000 7f75a733c640 1 -- 172.21.15.106:0/2211676992 wait complete. 2023-12-22T09:15:05.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.017+0000 7f75a733c640 1 Processor -- start 2023-12-22T09:15:05.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.017+0000 7f75a733c640 1 -- start start 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a733c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a006bdc0 0x7f75a014a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a733c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a006c2d0 0x7f75a01ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a733c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a00c5a30 0x7f75a01eaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a733c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00bd050 con 0x7f75a006bdc0 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a733c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a01ea060 con 0x7f75a00c5a30 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a733c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00bcab0 con 0x7f75a006c2d0 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a50d8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a006bdc0 0x7f75a014a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a50d8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a006bdc0 0x7f75a014a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50712/0 (socket says 172.21.15.106:50712) 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a50d8640 1 -- 172.21.15.106:0/3956233267 learned_addr learned my addr 172.21.15.106:0/3956233267 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:05.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a48d7640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a006c2d0 0x7f75a01ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a50d8640 1 -- 172.21.15.106:0/3956233267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a006c2d0 msgr2=0x7f75a01ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a50d8640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a006c2d0 0x7f75a01ea4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a58d9640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a00c5a30 0x7f75a01eaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a50d8640 1 -- 172.21.15.106:0/3956233267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a00c5a30 msgr2=0x7f75a01eaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a50d8640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a00c5a30 0x7f75a01eaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a50d8640 1 -- 172.21.15.106:0/3956233267 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c009400 con 0x7f75a006bdc0 2023-12-22T09:15:05.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.018+0000 7f75a48d7640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a006c2d0 0x7f75a01ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:05.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.019+0000 7f75a50d8640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a006bdc0 0x7f75a014a3e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f759c034040 tx=0x7f759c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:05.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.019+0000 7f7595ffb640 1 -- 172.21.15.106:0/3956233267 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c032640 con 0x7f75a006bdc0 2023-12-22T09:15:05.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.019+0000 7f7595ffb640 1 -- 172.21.15.106:0/3956233267 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c0327c0 con 0x7f75a006bdc0 2023-12-22T09:15:05.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.019+0000 7f7595ffb640 1 -- 172.21.15.106:0/3956233267 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c032b70 con 0x7f75a006bdc0 2023-12-22T09:15:05.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.019+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a00bcd70 con 0x7f75a006bdc0 2023-12-22T09:15:05.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.019+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a00c5300 con 0x7f75a006bdc0 2023-12-22T09:15:05.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.020+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a01e9e70 con 0x7f75a006bdc0 2023-12-22T09:15:05.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.021+0000 7f7595ffb640 1 -- 172.21.15.106:0/3956233267 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f759c032cd0 con 0x7f75a006bdc0 2023-12-22T09:15:05.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.022+0000 7f7595ffb640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f758406a460 0x7f758406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.022+0000 7f7595ffb640 1 -- 172.21.15.106:0/3956233267 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f759c0aa290 con 0x7f75a006bdc0 2023-12-22T09:15:05.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.022+0000 7f75a48d7640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f758406a460 0x7f758406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.023+0000 7f75a48d7640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f758406a460 0x7f758406c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f75a0152c90 tx=0x7f7590009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:05.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.026+0000 7f7595ffb640 1 -- 172.21.15.106:0/3956233267 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f759c0756b0 con 0x7f75a006bdc0 2023-12-22T09:15:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.218+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75a0073f10 con 0x7f75a006bdc0 2023-12-22T09:15:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.219+0000 7f7595ffb640 1 -- 172.21.15.106:0/3956233267 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f759c078cd0 con 0x7f75a006bdc0 2023-12-22T09:15:05.218 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f758406a460 msgr2=0x7f758406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f758406a460 0x7f758406c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f75a0152c90 tx=0x7f7590009040 comp rx=0 tx=0).stop 2023-12-22T09:15:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a006bdc0 msgr2=0x7f75a014a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a006bdc0 0x7f75a014a3e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f759c034040 tx=0x7f759c0046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 shutdown_connections 2023-12-22T09:15:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f758406a460 0x7f758406c920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75a00c5a30 0x7f75a01eaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75a006c2d0 0x7f75a01ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 --2- 172.21.15.106:0/3956233267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75a006bdc0 0x7f75a014a3e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 >> 172.21.15.106:0/3956233267 conn(0x7f75a006a220 msgr2=0x7f75a014cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.221+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 shutdown_connections 2023-12-22T09:15:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.222+0000 7f75a733c640 1 -- 172.21.15.106:0/3956233267 wait complete. 2023-12-22T09:15:05.241 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.455+0000 7f74bcd00640 1 Processor -- start 2023-12-22T09:15:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.456+0000 7f74bcd00640 1 -- start start 2023-12-22T09:15:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.457+0000 7f74bcd00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74b81514f0 0x7f74b80c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.457+0000 7f74bcd00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74b80c4380 0x7f74b80c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.457+0000 7f74bcd00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b806aca0 0x7f74b80c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.457+0000 7f74bcd00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80c4e10 con 0x7f74b81514f0 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.457+0000 7f74bcd00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80c5b40 con 0x7f74b80c4380 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.457+0000 7f74bcd00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80c7b50 con 0x7f74b806aca0 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.457+0000 7f74b659c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74b81514f0 0x7f74b80c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.457+0000 7f74b659c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74b81514f0 0x7f74b80c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50724/0 (socket says 172.21.15.106:50724) 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.457+0000 7f74b659c640 1 -- 172.21.15.106:0/2650811023 learned_addr learned my addr 172.21.15.106:0/2650811023 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.458+0000 7f74b6d9d640 1 --2- 172.21.15.106:0/2650811023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b806aca0 0x7f74b80c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.458+0000 7f74b5d9b640 1 --2- 172.21.15.106:0/2650811023 >> v2:172.21.15.132:3300/0 conn(0x7f74b80c4380 0x7f74b80c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.458+0000 7f74b659c640 1 -- 172.21.15.106:0/2650811023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b806aca0 msgr2=0x7f74b80c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.458+0000 7f74b659c640 1 --2- 172.21.15.106:0/2650811023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b806aca0 0x7f74b80c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.458+0000 7f74b659c640 1 -- 172.21.15.106:0/2650811023 >> v2:172.21.15.132:3300/0 conn(0x7f74b80c4380 msgr2=0x7f74b80c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.458+0000 7f74b659c640 1 --2- 172.21.15.106:0/2650811023 >> v2:172.21.15.132:3300/0 conn(0x7f74b80c4380 0x7f74b80c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.458+0000 7f74b659c640 1 -- 172.21.15.106:0/2650811023 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b806b390 con 0x7f74b81514f0 2023-12-22T09:15:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.459+0000 7f74b659c640 1 --2- 172.21.15.106:0/2650811023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b81514f0 0x7f74b80c48d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f74b808b380 tx=0x7f74a802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb492532915d45e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.459+0000 7f74b559a640 1 -- 172.21.15.106:0/2650811023 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a802c9e0 con 0x7f74b81514f0 2023-12-22T09:15:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.459+0000 7f74b559a640 1 -- 172.21.15.106:0/2650811023 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a802cb40 con 0x7f74b81514f0 2023-12-22T09:15:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.459+0000 7f74b559a640 1 -- 172.21.15.106:0/2650811023 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80343f0 con 0x7f74b81514f0 2023-12-22T09:15:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.460+0000 7f74bcd00640 1 -- 172.21.15.106:0/2650811023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b81514f0 msgr2=0x7f74b80c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.460+0000 7f74bcd00640 1 --2- 172.21.15.106:0/2650811023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b81514f0 0x7f74b80c48d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f74b808b380 tx=0x7f74a802be40 comp rx=0 tx=0).stop 2023-12-22T09:15:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.460+0000 7f74bcd00640 1 -- 172.21.15.106:0/2650811023 shutdown_connections 2023-12-22T09:15:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.460+0000 7f74bcd00640 1 --2- 172.21.15.106:0/2650811023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b806aca0 0x7f74b80c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.460+0000 7f74bcd00640 1 --2- 172.21.15.106:0/2650811023 >> v2:172.21.15.132:3300/0 conn(0x7f74b80c4380 0x7f74b80c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.460+0000 7f74bcd00640 1 --2- 172.21.15.106:0/2650811023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b81514f0 0x7f74b80c48d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.460+0000 7f74bcd00640 1 -- 172.21.15.106:0/2650811023 >> 172.21.15.106:0/2650811023 conn(0x7f74b80c9710 msgr2=0x7f74b80c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.460+0000 7f74bcd00640 1 -- 172.21.15.106:0/2650811023 shutdown_connections 2023-12-22T09:15:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.460+0000 7f74bcd00640 1 -- 172.21.15.106:0/2650811023 wait complete. 2023-12-22T09:15:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.462+0000 7f74bcd00640 1 Processor -- start 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.462+0000 7f74bcd00640 1 -- start start 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.463+0000 7f74bcd00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b806aca0 0x7f74b8147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.463+0000 7f74bcd00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b80c4380 0x7f74b814fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.463+0000 7f74bcd00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b81514f0 0x7f74b8156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.463+0000 7f74bcd00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b814da50 con 0x7f74b806aca0 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.463+0000 7f74bcd00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b81e9a60 con 0x7f74b81514f0 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.463+0000 7f74bcd00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8150d00 con 0x7f74b80c4380 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.463+0000 7f74b659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b806aca0 0x7f74b8147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.463+0000 7f74b659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b806aca0 0x7f74b8147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50736/0 (socket says 172.21.15.106:50736) 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.463+0000 7f74b659c640 1 -- 172.21.15.106:0/1242166188 learned_addr learned my addr 172.21.15.106:0/1242166188 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74b5d9b640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b80c4380 0x7f74b814fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74b6d9d640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b81514f0 0x7f74b8156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74b659c640 1 -- 172.21.15.106:0/1242166188 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b80c4380 msgr2=0x7f74b814fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74b659c640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b80c4380 0x7f74b814fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74b659c640 1 -- 172.21.15.106:0/1242166188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b81514f0 msgr2=0x7f74b8156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74b659c640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b81514f0 0x7f74b8156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74b659c640 1 -- 172.21.15.106:0/1242166188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009b30 con 0x7f74b806aca0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74b659c640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b806aca0 0x7f74b8147950 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74a8036040 tx=0x7f74a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74aeffd640 1 -- 172.21.15.106:0/1242166188 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8009510 con 0x7f74b806aca0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74aeffd640 1 -- 172.21.15.106:0/1242166188 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a803e450 con 0x7f74b806aca0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74aeffd640 1 -- 172.21.15.106:0/1242166188 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a803e800 con 0x7f74b806aca0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.464+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b81e8e70 con 0x7f74b806aca0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.465+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b81e9410 con 0x7f74b806aca0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.466+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b8073f10 con 0x7f74b806aca0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.466+0000 7f74aeffd640 1 -- 172.21.15.106:0/1242166188 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f74a803e960 con 0x7f74b806aca0 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.467+0000 7f74aeffd640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f749806a430 0x7f749806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.467+0000 7f74aeffd640 1 -- 172.21.15.106:0/1242166188 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f74a80ab9d0 con 0x7f74b806aca0 2023-12-22T09:15:05.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.468+0000 7f74b5d9b640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f749806a430 0x7f749806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.468+0000 7f74b5d9b640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f749806a430 0x7f749806c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74a0006fd0 tx=0x7f74a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:05.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.472+0000 7f74aeffd640 1 -- 172.21.15.106:0/1242166188 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f74a8076cd0 con 0x7f74b806aca0 2023-12-22T09:15:05.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.661+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74b80c4160 con 0x7f74b806aca0 2023-12-22T09:15:05.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.662+0000 7f74aeffd640 1 -- 172.21.15.106:0/1242166188 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74a807a2f0 con 0x7f74b806aca0 2023-12-22T09:15:05.662 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f749806a430 msgr2=0x7f749806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f749806a430 0x7f749806c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74a0006fd0 tx=0x7f74a0008040 comp rx=0 tx=0).stop 2023-12-22T09:15:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b806aca0 msgr2=0x7f74b8147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b806aca0 0x7f74b8147950 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74a8036040 tx=0x7f74a8004a40 comp rx=0 tx=0).stop 2023-12-22T09:15:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 shutdown_connections 2023-12-22T09:15:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f749806a430 0x7f749806c8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b81514f0 0x7f74b8156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74b80c4380 0x7f74b814fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 --2- 172.21.15.106:0/1242166188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b806aca0 0x7f74b8147950 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 >> 172.21.15.106:0/1242166188 conn(0x7f74b80c9710 msgr2=0x7f74b80aa230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 shutdown_connections 2023-12-22T09:15:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.665+0000 7f74bcd00640 1 -- 172.21.15.106:0/1242166188 wait complete. 2023-12-22T09:15:05.684 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:05.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.890+0000 7fb1a7a0e640 1 Processor -- start 2023-12-22T09:15:05.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.890+0000 7fb1a7a0e640 1 -- start start 2023-12-22T09:15:05.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a7a0e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb1a006bdc0 0x7fb1a01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a7a0e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a014f570 con 0x7fb1a006c2d0 2023-12-22T09:15:05.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a7a0e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a00c0b00 con 0x7fb1a00c5a30 2023-12-22T09:15:05.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a7a0e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00a90f0 con 0x7fb1a006bdc0 2023-12-22T09:15:05.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a4fa9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb1a006bdc0 0x7fb1a01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a5fab640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb1a006c2d0 0x7fb1a015c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51330/0 (socket says 172.21.15.106:51330) 2023-12-22T09:15:05.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a5fab640 1 -- 172.21.15.106:0/4157855677 learned_addr learned my addr 172.21.15.106:0/4157855677 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:05.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a4fa9640 1 -- 172.21.15.106:0/4157855677 >> v1:172.21.15.132:6789/0 conn(0x7fb1a00c5a30 legacy=0x7fb1a01550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a4fa9640 1 -- 172.21.15.106:0/4157855677 >> v1:172.21.15.106:6789/0 conn(0x7fb1a006c2d0 legacy=0x7fb1a015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb1a4fa9640 1 -- 172.21.15.106:0/4157855677 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00bfd40 con 0x7fb1a006bdc0 2023-12-22T09:15:05.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.892+0000 7fb197fff640 1 -- 172.21.15.106:0/4157855677 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014539277 0 0) 0x7fb1a014f570 con 0x7fb1a006c2d0 2023-12-22T09:15:05.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.894+0000 7fb1a4fa9640 1 --2- 172.21.15.106:0/4157855677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006bdc0 0x7fb1a01557f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb1900097a0 tx=0x7fb19002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdfd7cf02255be5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:05.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.894+0000 7fb197fff640 1 -- 172.21.15.106:0/4157855677 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190031830 con 0x7fb1a006bdc0 2023-12-22T09:15:05.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.894+0000 7fb197fff640 1 -- 172.21.15.106:0/4157855677 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190031990 con 0x7fb1a006bdc0 2023-12-22T09:15:05.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.894+0000 7fb197fff640 1 -- 172.21.15.106:0/4157855677 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190031d20 con 0x7fb1a006bdc0 2023-12-22T09:15:05.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.894+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/4157855677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006bdc0 msgr2=0x7fb1a01557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.894+0000 7fb1a7a0e640 1 --2- 172.21.15.106:0/4157855677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006bdc0 0x7fb1a01557f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb1900097a0 tx=0x7fb19002b8d0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.894+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/4157855677 shutdown_connections 2023-12-22T09:15:05.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.894+0000 7fb1a7a0e640 1 --2- 172.21.15.106:0/4157855677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006bdc0 0x7fb1a01557f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.894+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/4157855677 >> 172.21.15.106:0/4157855677 conn(0x7fb1a006a220 msgr2=0x7fb1a00c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:05.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.895+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/4157855677 shutdown_connections 2023-12-22T09:15:05.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.895+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/4157855677 wait complete. 2023-12-22T09:15:05.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.896+0000 7fb1a7a0e640 1 Processor -- start 2023-12-22T09:15:05.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.896+0000 7fb1a7a0e640 1 -- start start 2023-12-22T09:15:05.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.897+0000 7fb1a7a0e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1a006bdc0 0x7fb1a00bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.897+0000 7fb1a7a0e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006c2d0 0x7fb1a01eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.897+0000 7fb1a7a0e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1a00c5a30 0x7fb1a006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.897+0000 7fb1a7a0e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a014bd00 con 0x7fb1a006c2d0 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.897+0000 7fb1a7a0e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00bc3f0 con 0x7fb1a006bdc0 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.897+0000 7fb1a7a0e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a01eb040 con 0x7fb1a00c5a30 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.897+0000 7fb1a4fa9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006c2d0 0x7fb1a01eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a4fa9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006c2d0 0x7fb1a01eab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50758/0 (socket says 172.21.15.106:50758) 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a4fa9640 1 -- 172.21.15.106:0/993695744 learned_addr learned my addr 172.21.15.106:0/993695744 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a5fab640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1a00c5a30 0x7fb1a006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a57aa640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1a006bdc0 0x7fb1a00bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a4fa9640 1 -- 172.21.15.106:0/993695744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1a00c5a30 msgr2=0x7fb1a006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a4fa9640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1a00c5a30 0x7fb1a006d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a4fa9640 1 -- 172.21.15.106:0/993695744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1a006bdc0 msgr2=0x7fb1a00bbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a4fa9640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1a006bdc0 0x7fb1a00bbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a4fa9640 1 -- 172.21.15.106:0/993695744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190009400 con 0x7fb1a006c2d0 2023-12-22T09:15:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.898+0000 7fb1a4fa9640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006c2d0 0x7fb1a01eab00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb19002bee0 tx=0x7fb1900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.899+0000 7fb195ffb640 1 -- 172.21.15.106:0/993695744 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19003ba70 con 0x7fb1a006c2d0 2023-12-22T09:15:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.899+0000 7fb195ffb640 1 -- 172.21.15.106:0/993695744 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19003bbf0 con 0x7fb1a006c2d0 2023-12-22T09:15:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.899+0000 7fb195ffb640 1 -- 172.21.15.106:0/993695744 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1900453f0 con 0x7fb1a006c2d0 2023-12-22T09:15:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.899+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a00bd380 con 0x7fb1a006c2d0 2023-12-22T09:15:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.899+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a00bc920 con 0x7fb1a006c2d0 2023-12-22T09:15:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.900+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a0073f10 con 0x7fb1a006c2d0 2023-12-22T09:15:05.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.901+0000 7fb195ffb640 1 -- 172.21.15.106:0/993695744 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb19004e450 con 0x7fb1a006c2d0 2023-12-22T09:15:05.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.902+0000 7fb195ffb640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb18406a4b0 0x7fb18406c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:05.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.902+0000 7fb195ffb640 1 -- 172.21.15.106:0/993695744 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1900ab060 con 0x7fb1a006c2d0 2023-12-22T09:15:05.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.902+0000 7fb1a57aa640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb18406a4b0 0x7fb18406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:05.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.903+0000 7fb1a57aa640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb18406a4b0 0x7fb18406c970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb19c000f60 tx=0x7fb19c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:05.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:05.906+0000 7fb195ffb640 1 -- 172.21.15.106:0/993695744 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb1900ddc80 con 0x7fb1a006c2d0 2023-12-22T09:15:06.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.099+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb1a00bfff0 con 0x7fb1a006c2d0 2023-12-22T09:15:06.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.100+0000 7fb195ffb640 1 -- 172.21.15.106:0/993695744 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb190035070 con 0x7fb1a006c2d0 2023-12-22T09:15:06.100 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb18406a4b0 msgr2=0x7fb18406c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb18406a4b0 0x7fb18406c970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb19c000f60 tx=0x7fb19c009040 comp rx=0 tx=0).stop 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006c2d0 msgr2=0x7fb1a01eab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006c2d0 0x7fb1a01eab00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb19002bee0 tx=0x7fb1900046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 shutdown_connections 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb18406a4b0 0x7fb18406c970 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1a00c5a30 0x7fb1a006d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1a006c2d0 0x7fb1a01eab00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 --2- 172.21.15.106:0/993695744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1a006bdc0 0x7fb1a00bbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.102+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 >> 172.21.15.106:0/993695744 conn(0x7fb1a006a220 msgr2=0x7fb1a00c1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.103+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 shutdown_connections 2023-12-22T09:15:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.103+0000 7fb1a7a0e640 1 -- 172.21.15.106:0/993695744 wait complete. 2023-12-22T09:15:06.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:15:06.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.324+0000 7f0983f39640 1 Processor -- start 2023-12-22T09:15:06.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.324+0000 7f0983f39640 1 -- start start 2023-12-22T09:15:06.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.326+0000 7f0983f39640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f097c1514b0 0x7f097c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.326+0000 7f0983f39640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f097c06aad0 0x7f097c0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.326+0000 7f0983f39640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c0c4660 con 0x7f097c0c4130 2023-12-22T09:15:06.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.326+0000 7f0983f39640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c153d60 con 0x7f097c1514b0 2023-12-22T09:15:06.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.326+0000 7f0983f39640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c154c50 con 0x7f097c06aad0 2023-12-22T09:15:06.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.326+0000 7f09814d4640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f097c0c4130 0x7f097c154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51332/0 (socket says 172.21.15.106:51332) 2023-12-22T09:15:06.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.326+0000 7f09814d4640 1 -- 172.21.15.106:0/674043665 learned_addr learned my addr 172.21.15.106:0/674043665 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.326+0000 7f09824d6640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f097c06aad0 0x7f097c0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.326+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283509846 0 0) 0x7f097c0c4660 con 0x7f097c0c4130 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0981cd5640 1 --2- 172.21.15.106:0/674043665 >> v2:172.21.15.132:3300/0 conn(0x7f097c1514b0 0x7f097c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0968003520 con 0x7f097c0c4130 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 907422339 0 0) 0x7f0968003520 con 0x7f097c0c4130 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f097c06aad0 msgr2=0x7f097c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f097c06aad0 0x7f097c0c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 >> v2:172.21.15.132:3300/0 conn(0x7f097c1514b0 msgr2=0x7f097c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 --2- 172.21.15.106:0/674043665 >> v2:172.21.15.132:3300/0 conn(0x7f097c1514b0 0x7f097c0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c06b250 con 0x7f097c0c4130 2023-12-22T09:15:06.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f096c001670 con 0x7f097c0c4130 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 >> v1:172.21.15.106:6789/0 conn(0x7f097c0c4130 legacy=0x7f097c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f097c06aad0 0x7f0968003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0968003ef0 0x7f09680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0968004d00 0x7f0968005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c153d60 con 0x7f0968003ef0 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c154c50 con 0x7f0968004d00 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096800ba80 con 0x7f097c06aad0 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.327+0000 7f09814d4640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0968003ef0 0x7f09680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.328+0000 7f09824d6640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0968004d00 0x7f0968005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.328+0000 7f0981cd5640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f097c06aad0 0x7f0968003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.328+0000 7f09814d4640 1 -- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f097c06aad0 msgr2=0x7f0968003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.328+0000 7f09814d4640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f097c06aad0 0x7f0968003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.328+0000 7f09814d4640 1 -- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0968004d00 msgr2=0x7f0968005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:06.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.328+0000 7f09814d4640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0968004d00 0x7f0968005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.328+0000 7f09814d4640 1 -- 172.21.15.106:0/674043665 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0968003520 con 0x7f0968003ef0 2023-12-22T09:15:06.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.328+0000 7f09824d6640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0968004d00 0x7f0968005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:06.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.329+0000 7f09814d4640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0968003ef0 0x7f09680047c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c2c0 tx=0x7f09680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c529060cfc0b3ed server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:06.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.329+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c005ad0 con 0x7f0968003ef0 2023-12-22T09:15:06.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.329+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c005c30 con 0x7f0968003ef0 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.329+0000 7f0980cd3640 1 -- 172.21.15.106:0/674043665 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c02c8b0 con 0x7f0968003ef0 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.330+0000 7f0983f39640 1 -- 172.21.15.106:0/674043665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0968003ef0 msgr2=0x7f09680047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.330+0000 7f0983f39640 1 --2- 172.21.15.106:0/674043665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0968003ef0 0x7f09680047c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c2c0 tx=0x7f09680057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.330+0000 7f09824d6640 1 -- 172.21.15.106:0/674043665 reap_dead start 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.330+0000 7f0983f39640 1 -- 172.21.15.106:0/674043665 shutdown_connections 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.330+0000 7f0983f39640 1 -- 172.21.15.106:0/674043665 >> 172.21.15.106:0/674043665 conn(0x7f097c0ab1a0 msgr2=0x7f097c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.330+0000 7f0983f39640 1 -- 172.21.15.106:0/674043665 shutdown_connections 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.330+0000 7f0983f39640 1 -- 172.21.15.106:0/674043665 wait complete. 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.332+0000 7f0983f39640 1 Processor -- start 2023-12-22T09:15:06.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.332+0000 7f0983f39640 1 -- start start 2023-12-22T09:15:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f0983f39640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0968003ef0 0x7f097c14c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f0983f39640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c150a60 0x7f097c0a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f0983f39640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f097c0aa4d0 0x7f097c1ec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f0983f39640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0a9b70 con 0x7f097c150a60 2023-12-22T09:15:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f0983f39640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c14de00 con 0x7f097c0aa4d0 2023-12-22T09:15:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f0983f39640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c3740 con 0x7f0968003ef0 2023-12-22T09:15:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f09814d4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c150a60 0x7f097c0a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f09814d4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c150a60 0x7f097c0a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50770/0 (socket says 172.21.15.106:50770) 2023-12-22T09:15:06.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f09814d4640 1 -- 172.21.15.106:0/1954727070 learned_addr learned my addr 172.21.15.106:0/1954727070 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:06.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f0981cd5640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0968003ef0 0x7f097c14c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f09824d6640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f097c0aa4d0 0x7f097c1ec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f09814d4640 1 -- 172.21.15.106:0/1954727070 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0968003ef0 msgr2=0x7f097c14c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f09814d4640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0968003ef0 0x7f097c14c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f09814d4640 1 -- 172.21.15.106:0/1954727070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f097c0aa4d0 msgr2=0x7f097c1ec8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.333+0000 7f09814d4640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f097c0aa4d0 0x7f097c1ec8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.334+0000 7f09814d4640 1 -- 172.21.15.106:0/1954727070 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0c34a0 con 0x7f097c150a60 2023-12-22T09:15:06.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.334+0000 7f09814d4640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c150a60 0x7f097c0a9f90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f096c001930 tx=0x7f096c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:06.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.334+0000 7f09727fc640 1 -- 172.21.15.106:0/1954727070 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c02ccc0 con 0x7f097c150a60 2023-12-22T09:15:06.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.334+0000 7f09727fc640 1 -- 172.21.15.106:0/1954727070 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c02ce60 con 0x7f097c150a60 2023-12-22T09:15:06.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.334+0000 7f09727fc640 1 -- 172.21.15.106:0/1954727070 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0072b0 con 0x7f097c150a60 2023-12-22T09:15:06.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.334+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c14e350 con 0x7f097c150a60 2023-12-22T09:15:06.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.334+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c14cb40 con 0x7f097c150a60 2023-12-22T09:15:06.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.335+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c14e1b0 con 0x7f097c150a60 2023-12-22T09:15:06.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.336+0000 7f09727fc640 1 -- 172.21.15.106:0/1954727070 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f096c032070 con 0x7f097c150a60 2023-12-22T09:15:06.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.337+0000 7f09727fc640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f096006a4b0 0x7f096006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.337+0000 7f09727fc640 1 -- 172.21.15.106:0/1954727070 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f096c03c040 con 0x7f097c150a60 2023-12-22T09:15:06.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.337+0000 7f0981cd5640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f096006a4b0 0x7f096006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.338+0000 7f0981cd5640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f096006a4b0 0x7f096006c970 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f097c1531c0 tx=0x7f0978008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:06.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.341+0000 7f09727fc640 1 -- 172.21.15.106:0/1954727070 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f097c14e1b0 con 0x7f097c150a60 2023-12-22T09:15:06.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.571+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f097c14e1b0 con 0x7f097c150a60 2023-12-22T09:15:06.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.572+0000 7f09727fc640 1 -- 172.21.15.106:0/1954727070 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4653 (secure 0 0 0) 0x7f097c14e1b0 con 0x7f097c150a60 2023-12-22T09:15:06.572 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:06.572 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:55.943828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T09:15:06.572 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-12-22T09:15:06.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f096006a4b0 msgr2=0x7f096006c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f096006a4b0 0x7f096006c970 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f097c1531c0 tx=0x7f0978008040 comp rx=0 tx=0).stop 2023-12-22T09:15:06.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c150a60 msgr2=0x7f097c0a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c150a60 0x7f097c0a9f90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f096c001930 tx=0x7f096c000fe0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 shutdown_connections 2023-12-22T09:15:06.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f096006a4b0 0x7f096006c970 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f097c0aa4d0 0x7f097c1ec8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c150a60 0x7f097c0a9f90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 --2- 172.21.15.106:0/1954727070 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0968003ef0 0x7f097c14c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 >> 172.21.15.106:0/1954727070 conn(0x7f097c0ab1a0 msgr2=0x7f097c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:06.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 shutdown_connections 2023-12-22T09:15:06.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.575+0000 7f0983f39640 1 -- 172.21.15.106:0/1954727070 wait complete. 2023-12-22T09:15:06.594 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:06.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.807+0000 7f880d65f640 1 Processor -- start 2023-12-22T09:15:06.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.807+0000 7f880d65f640 1 -- start start 2023-12-22T09:15:06.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.809+0000 7f880d65f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f88081514b0 0x7f88080c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.809+0000 7f880d65f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88080c4130 0x7f8808154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.809+0000 7f880d65f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080c4660 con 0x7f8808154a80 2023-12-22T09:15:06.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.809+0000 7f880d65f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8808153d60 con 0x7f88081514b0 2023-12-22T09:15:06.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.809+0000 7f880d65f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880806b250 con 0x7f88080c4130 2023-12-22T09:15:06.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.809+0000 7f88077fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8808154a80 0x7f88080c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51340/0 (socket says 172.21.15.106:51340) 2023-12-22T09:15:06.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.809+0000 7f88077fe640 1 -- 172.21.15.106:0/2611817084 learned_addr learned my addr 172.21.15.106:0/2611817084 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:06.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f87fe7fc640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88080c4130 0x7f8808154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f8806ffd640 1 --2- 172.21.15.106:0/2611817084 >> v2:172.21.15.132:3300/0 conn(0x7f88081514b0 0x7f88080c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062248210 0 0) 0x7f88080c4660 con 0x7f8808154a80 2023-12-22T09:15:06.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f4003520 con 0x7f8808154a80 2023-12-22T09:15:06.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1283252926 0 0) 0x7f87f4003520 con 0x7f8808154a80 2023-12-22T09:15:06.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88080c4130 msgr2=0x7f8808154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:06.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f88067fc640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88080c4130 0x7f8808154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 >> v2:172.21.15.132:3300/0 conn(0x7f88081514b0 msgr2=0x7f88080c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:06.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f88067fc640 1 --2- 172.21.15.106:0/2611817084 >> v2:172.21.15.132:3300/0 conn(0x7f88081514b0 0x7f88080c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880806b530 con 0x7f8808154a80 2023-12-22T09:15:06.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f8800001670 con 0x7f8808154a80 2023-12-22T09:15:06.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.810+0000 7f8806ffd640 1 --2- 172.21.15.106:0/2611817084 >> v2:172.21.15.132:3300/0 conn(0x7f88081514b0 0x7f88080c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:15:06.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 >> v1:172.21.15.106:6789/0 conn(0x7f8808154a80 legacy=0x7f88080c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88067fc640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88080c4130 0x7f87f4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88067fc640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f4003ef0 0x7f87f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88067fc640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f87f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808153d60 con 0x7f87f4004d00 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880806b250 con 0x7f87f4003ef0 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f400ba80 con 0x7f88080c4130 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88077fe640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f87f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f8806ffd640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88080c4130 0x7f87f4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f87fe7fc640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f4003ef0 0x7f87f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88077fe640 1 -- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88080c4130 msgr2=0x7f87f4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88077fe640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88080c4130 0x7f87f4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88077fe640 1 -- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f4003ef0 msgr2=0x7f87f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88077fe640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f4003ef0 0x7f87f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f88077fe640 1 -- 172.21.15.106:0/2611817084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4003520 con 0x7f87f4004d00 2023-12-22T09:15:06.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.811+0000 7f87fe7fc640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f4003ef0 0x7f87f40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:06.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.812+0000 7f88077fe640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f87f4005180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88080a90c0 tx=0x7f87f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98350a7a23b41e95 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:06.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800005ad0 con 0x7f87f4004d00 2023-12-22T09:15:06.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8800005c30 con 0x7f87f4004d00 2023-12-22T09:15:06.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f88067fc640 1 -- 172.21.15.106:0/2611817084 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880002ca90 con 0x7f87f4004d00 2023-12-22T09:15:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f880d65f640 1 -- 172.21.15.106:0/2611817084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 msgr2=0x7f87f4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f880d65f640 1 --2- 172.21.15.106:0/2611817084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f87f4005180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88080a90c0 tx=0x7f87f40057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f88077fe640 1 -- 172.21.15.106:0/2611817084 reap_dead start 2023-12-22T09:15:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f880d65f640 1 -- 172.21.15.106:0/2611817084 shutdown_connections 2023-12-22T09:15:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f880d65f640 1 -- 172.21.15.106:0/2611817084 >> 172.21.15.106:0/2611817084 conn(0x7f88080ab1a0 msgr2=0x7f88080ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f880d65f640 1 -- 172.21.15.106:0/2611817084 shutdown_connections 2023-12-22T09:15:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.813+0000 7f880d65f640 1 -- 172.21.15.106:0/2611817084 wait complete. 2023-12-22T09:15:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.815+0000 7f880d65f640 1 Processor -- start 2023-12-22T09:15:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.815+0000 7f880d65f640 1 -- start start 2023-12-22T09:15:06.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.816+0000 7f880d65f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f8808146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.816+0000 7f880d65f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8808146ed0 0x7f88081478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.816+0000 7f880d65f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8808147df0 0x7f88081ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.816+0000 7f880d65f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808147350 con 0x7f87f4004d00 2023-12-22T09:15:06.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.816+0000 7f880d65f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808148910 con 0x7f8808147df0 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.816+0000 7f880d65f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8808148270 con 0x7f8808146ed0 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.816+0000 7f8806ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f8808146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.816+0000 7f8806ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f8808146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50780/0 (socket says 172.21.15.106:50780) 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.816+0000 7f8806ffd640 1 -- 172.21.15.106:0/4254325971 learned_addr learned my addr 172.21.15.106:0/4254325971 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f87fe7fc640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8808146ed0 0x7f88081478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f8806ffd640 1 -- 172.21.15.106:0/4254325971 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8808146ed0 msgr2=0x7f88081478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f8806ffd640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8808146ed0 0x7f88081478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f88077fe640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8808147df0 0x7f88081ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f8806ffd640 1 -- 172.21.15.106:0/4254325971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8808147df0 msgr2=0x7f88081ebe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f8806ffd640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8808147df0 0x7f88081ebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f8806ffd640 1 -- 172.21.15.106:0/4254325971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080c23c0 con 0x7f87f4004d00 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f87fe7fc640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8808146ed0 0x7f88081478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f8806ffd640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f8808146990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f87f80046b0 tx=0x7f87f8007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f87fffff640 1 -- 172.21.15.106:0/4254325971 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8014610 con 0x7f87f4004d00 2023-12-22T09:15:06.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f87fffff640 1 -- 172.21.15.106:0/4254325971 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f800f050 con 0x7f87f4004d00 2023-12-22T09:15:06.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8808148b60 con 0x7f87f4004d00 2023-12-22T09:15:06.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.817+0000 7f87fffff640 1 -- 172.21.15.106:0/4254325971 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80149b0 con 0x7f87f4004d00 2023-12-22T09:15:06.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.818+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8808149120 con 0x7f87f4004d00 2023-12-22T09:15:06.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.819+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8808073f10 con 0x7f87f4004d00 2023-12-22T09:15:06.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.820+0000 7f87fffff640 1 -- 172.21.15.106:0/4254325971 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87f8014b10 con 0x7f87f4004d00 2023-12-22T09:15:06.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.821+0000 7f87fffff640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87e806a430 0x7f87e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:06.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.821+0000 7f87fffff640 1 -- 172.21.15.106:0/4254325971 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87f8089500 con 0x7f87f4004d00 2023-12-22T09:15:06.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.821+0000 7f87fe7fc640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87e806a430 0x7f87e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:06.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.822+0000 7f87fe7fc640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87e806a430 0x7f87e806c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f88080ab170 tx=0x7f87f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:06.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:06.825+0000 7f87fffff640 1 -- 172.21.15.106:0/4254325971 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87f8054890 con 0x7f87f4004d00 2023-12-22T09:15:07.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.020+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88080c76c0 con 0x7f87f4004d00 2023-12-22T09:15:07.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.023+0000 7f87fffff640 1 -- 172.21.15.106:0/4254325971 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f87f8057eb0 con 0x7f87f4004d00 2023-12-22T09:15:07.023 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:07.023 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:14:32.945586+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:07.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87e806a430 msgr2=0x7f87e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87e806a430 0x7f87e806c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f88080ab170 tx=0x7f87f0008040 comp rx=0 tx=0).stop 2023-12-22T09:15:07.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 msgr2=0x7f8808146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f8808146990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f87f80046b0 tx=0x7f87f8007700 comp rx=0 tx=0).stop 2023-12-22T09:15:07.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 shutdown_connections 2023-12-22T09:15:07.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87e806a430 0x7f87e806c8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8808147df0 0x7f88081ebe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8808146ed0 0x7f88081478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 --2- 172.21.15.106:0/4254325971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f4004d00 0x7f8808146990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.026+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 >> 172.21.15.106:0/4254325971 conn(0x7f88080ab1a0 msgr2=0x7f88080c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:07.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.027+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 shutdown_connections 2023-12-22T09:15:07.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.027+0000 7f880d65f640 1 -- 172.21.15.106:0/4254325971 wait complete. 2023-12-22T09:15:07.047 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:07.047 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:07.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.257+0000 7f070bde0640 1 Processor -- start 2023-12-22T09:15:07.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.257+0000 7f070bde0640 1 -- start start 2023-12-22T09:15:07.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070bde0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07040c6150 0x7f07040c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070bde0640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f070406ca00 0x7f070406b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070bde0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040c4560 con 0x7f07040c7640 2023-12-22T09:15:07.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070bde0640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07040c4f90 con 0x7f070406ca00 2023-12-22T09:15:07.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070bde0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0704154720 con 0x7f07040c6150 2023-12-22T09:15:07.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070a37d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f070406ca00 0x7f070406b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:07.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070937b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f07040c7640 0x7f070406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51344/0 (socket says 172.21.15.106:51344) 2023-12-22T09:15:07.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070937b640 1 -- 172.21.15.106:0/655641286 learned_addr learned my addr 172.21.15.106:0/655641286 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:07.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f0709b7c640 1 --2- 172.21.15.106:0/655641286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07040c6150 0x7f07040c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:07.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070a37d640 1 -- 172.21.15.106:0/655641286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07040c6150 msgr2=0x7f07040c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:07.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.259+0000 7f070a37d640 1 --2- 172.21.15.106:0/655641286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07040c6150 0x7f07040c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.260+0000 7f070a37d640 1 -- 172.21.15.106:0/655641286 >> v1:172.21.15.106:6789/0 conn(0x7f07040c7640 legacy=0x7f070406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.260+0000 7f070a37d640 1 -- 172.21.15.106:0/655641286 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0704154c50 con 0x7f070406ca00 2023-12-22T09:15:07.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.260+0000 7f0708b7a640 1 -- 172.21.15.106:0/655641286 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332990633 0 0) 0x7f07040c4560 con 0x7f07040c7640 2023-12-22T09:15:07.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.261+0000 7f070a37d640 1 --2- 172.21.15.106:0/655641286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f070406ca00 0x7f070406b8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f06fc009d90 tx=0x7f06fc02bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65032a0a516ef4bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:07.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.261+0000 7f0708b7a640 1 -- 172.21.15.106:0/655641286 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc02cb30 con 0x7f070406ca00 2023-12-22T09:15:07.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.261+0000 7f0708b7a640 1 -- 172.21.15.106:0/655641286 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc02cc90 con 0x7f070406ca00 2023-12-22T09:15:07.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.261+0000 7f0708b7a640 1 -- 172.21.15.106:0/655641286 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc034440 con 0x7f070406ca00 2023-12-22T09:15:07.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.261+0000 7f070bde0640 1 -- 172.21.15.106:0/655641286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f070406ca00 msgr2=0x7f070406b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.261+0000 7f070bde0640 1 --2- 172.21.15.106:0/655641286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f070406ca00 0x7f070406b8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f06fc009d90 tx=0x7f06fc02bd80 comp rx=0 tx=0).stop 2023-12-22T09:15:07.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.262+0000 7f070bde0640 1 -- 172.21.15.106:0/655641286 shutdown_connections 2023-12-22T09:15:07.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.262+0000 7f070bde0640 1 --2- 172.21.15.106:0/655641286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f070406ca00 0x7f070406b8f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.262+0000 7f070bde0640 1 --2- 172.21.15.106:0/655641286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07040c6150 0x7f07040c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.262+0000 7f070bde0640 1 -- 172.21.15.106:0/655641286 >> 172.21.15.106:0/655641286 conn(0x7f07040ab330 msgr2=0x7f07040ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:07.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.262+0000 7f070bde0640 1 -- 172.21.15.106:0/655641286 shutdown_connections 2023-12-22T09:15:07.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.262+0000 7f070bde0640 1 -- 172.21.15.106:0/655641286 wait complete. 2023-12-22T09:15:07.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.263+0000 7f070bde0640 1 Processor -- start 2023-12-22T09:15:07.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.263+0000 7f070bde0640 1 -- start start 2023-12-22T09:15:07.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.264+0000 7f070bde0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f070406ca00 0x7f07041ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.264+0000 7f070bde0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07040c6150 0x7f0704152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.264+0000 7f070bde0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07040c7640 0x7f0704147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.264+0000 7f070bde0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040aece0 con 0x7f07040c6150 2023-12-22T09:15:07.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.264+0000 7f070bde0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040c2c60 con 0x7f070406ca00 2023-12-22T09:15:07.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.264+0000 7f070bde0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07040c2eb0 con 0x7f07040c7640 2023-12-22T09:15:07.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.264+0000 7f070937b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07040c6150 0x7f0704152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:07.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f070937b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07040c6150 0x7f0704152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50808/0 (socket says 172.21.15.106:50808) 2023-12-22T09:15:07.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f070937b640 1 -- 172.21.15.106:0/1376934926 learned_addr learned my addr 172.21.15.106:0/1376934926 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:07.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f070937b640 1 -- 172.21.15.106:0/1376934926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07040c7640 msgr2=0x7f0704147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f070937b640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07040c7640 0x7f0704147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f070937b640 1 -- 172.21.15.106:0/1376934926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f070406ca00 msgr2=0x7f07041ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f070937b640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f070406ca00 0x7f07041ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f070937b640 1 -- 172.21.15.106:0/1376934926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc009a70 con 0x7f07040c6150 2023-12-22T09:15:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f070937b640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07040c6150 0x7f0704152f00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f06f400c410 tx=0x7f06f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f06fa7fc640 1 -- 172.21.15.106:0/1376934926 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40074e0 con 0x7f07040c6150 2023-12-22T09:15:07.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f06fa7fc640 1 -- 172.21.15.106:0/1376934926 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f4007660 con 0x7f07040c6150 2023-12-22T09:15:07.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.265+0000 7f06fa7fc640 1 -- 172.21.15.106:0/1376934926 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4004a20 con 0x7f07040c6150 2023-12-22T09:15:07.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.266+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07040c3190 con 0x7f07040c6150 2023-12-22T09:15:07.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.266+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0704153440 con 0x7f07040c6150 2023-12-22T09:15:07.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.267+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07040a99b0 con 0x7f07040c6150 2023-12-22T09:15:07.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.268+0000 7f06fa7fc640 1 -- 172.21.15.106:0/1376934926 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06f4004b80 con 0x7f07040c6150 2023-12-22T09:15:07.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.268+0000 7f06fa7fc640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f06e806a460 0x7f06e806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.269+0000 7f06fa7fc640 1 -- 172.21.15.106:0/1376934926 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f06f40889f0 con 0x7f07040c6150 2023-12-22T09:15:07.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.269+0000 7f0709b7c640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f06e806a460 0x7f06e806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:07.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.270+0000 7f0709b7c640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f06e806a460 0x7f06e806c920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0700006fd0 tx=0x7f0700008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:07.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.273+0000 7f06fa7fc640 1 -- 172.21.15.106:0/1376934926 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f06f4057770 con 0x7f07040c6150 2023-12-22T09:15:07.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.462+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0704073f10 con 0x7f07040c6150 2023-12-22T09:15:07.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.462+0000 7f06fa7fc640 1 -- 172.21.15.106:0/1376934926 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06f4057300 con 0x7f07040c6150 2023-12-22T09:15:07.462 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f06e806a460 msgr2=0x7f06e806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f06e806a460 0x7f06e806c920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0700006fd0 tx=0x7f0700008040 comp rx=0 tx=0).stop 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07040c6150 msgr2=0x7f0704152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07040c6150 0x7f0704152f00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f06f400c410 tx=0x7f06f400c8d0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 shutdown_connections 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f06e806a460 0x7f06e806c920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07040c7640 0x7f0704147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07040c6150 0x7f0704152f00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 --2- 172.21.15.106:0/1376934926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f070406ca00 0x7f07041ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 >> 172.21.15.106:0/1376934926 conn(0x7f07040ab330 msgr2=0x7f07040ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:07.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 shutdown_connections 2023-12-22T09:15:07.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.465+0000 7f070bde0640 1 -- 172.21.15.106:0/1376934926 wait complete. 2023-12-22T09:15:07.483 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:07.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.691+0000 7f878f75c640 1 Processor -- start 2023-12-22T09:15:07.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.692+0000 7f878f75c640 1 -- start start 2023-12-22T09:15:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.693+0000 7f878f75c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87880c5a30 0x7f87880c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.693+0000 7f878f75c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f878806bdc0 0x7f87881550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.693+0000 7f878f75c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878814f570 con 0x7f878806c2d0 2023-12-22T09:15:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.693+0000 7f878f75c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87880a90f0 con 0x7f87880c5a30 2023-12-22T09:15:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.693+0000 7f878f75c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87880c0b00 con 0x7f878806bdc0 2023-12-22T09:15:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.693+0000 7f878d4f8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87880c5a30 0x7f87880c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.693+0000 7f878d4f8640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87880c5a30 0x7f87880c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50820/0 (socket says 172.21.15.106:50820) 2023-12-22T09:15:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.693+0000 7f878d4f8640 1 -- 172.21.15.106:0/1198753327 learned_addr learned my addr 172.21.15.106:0/1198753327 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.694+0000 7f878ccf7640 1 --2- 172.21.15.106:0/1198753327 >> v2:172.21.15.132:3300/0 conn(0x7f878806bdc0 0x7f87881550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.694+0000 7f878d4f8640 1 -- 172.21.15.106:0/1198753327 >> v2:172.21.15.132:3300/0 conn(0x7f878806bdc0 msgr2=0x7f87881550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.694+0000 7f878d4f8640 1 --2- 172.21.15.106:0/1198753327 >> v2:172.21.15.132:3300/0 conn(0x7f878806bdc0 0x7f87881550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.694+0000 7f878d4f8640 1 -- 172.21.15.106:0/1198753327 >> v1:172.21.15.132:6789/0 conn(0x7f878806c2d0 legacy=0x7f8788155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.694+0000 7f878d4f8640 1 -- 172.21.15.106:0/1198753327 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880bfd40 con 0x7f87880c5a30 2023-12-22T09:15:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.695+0000 7f878d4f8640 1 --2- 172.21.15.106:0/1198753327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 0x7f87880c5e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f878806aa50 tx=0x7f878402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad70ca50da5ea21 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:07.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.695+0000 7f877bfff640 1 -- 172.21.15.106:0/1198753327 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840317e0 con 0x7f87880c5a30 2023-12-22T09:15:07.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.695+0000 7f877bfff640 1 -- 172.21.15.106:0/1198753327 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8784031940 con 0x7f87880c5a30 2023-12-22T09:15:07.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.695+0000 7f877bfff640 1 -- 172.21.15.106:0/1198753327 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784031cd0 con 0x7f87880c5a30 2023-12-22T09:15:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.696+0000 7f878f75c640 1 -- 172.21.15.106:0/1198753327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 msgr2=0x7f87880c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.696+0000 7f878f75c640 1 --2- 172.21.15.106:0/1198753327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 0x7f87880c5e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f878806aa50 tx=0x7f878402b880 comp rx=0 tx=0).stop 2023-12-22T09:15:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.696+0000 7f878f75c640 1 -- 172.21.15.106:0/1198753327 shutdown_connections 2023-12-22T09:15:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.696+0000 7f878f75c640 1 --2- 172.21.15.106:0/1198753327 >> v2:172.21.15.132:3300/0 conn(0x7f878806bdc0 0x7f87881550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.696+0000 7f878f75c640 1 --2- 172.21.15.106:0/1198753327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 0x7f87880c5e10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.696+0000 7f878f75c640 1 -- 172.21.15.106:0/1198753327 >> 172.21.15.106:0/1198753327 conn(0x7f878806a220 msgr2=0x7f87880c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.696+0000 7f878f75c640 1 -- 172.21.15.106:0/1198753327 shutdown_connections 2023-12-22T09:15:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.696+0000 7f878f75c640 1 -- 172.21.15.106:0/1198753327 wait complete. 2023-12-22T09:15:07.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.698+0000 7f878f75c640 1 Processor -- start 2023-12-22T09:15:07.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.698+0000 7f878f75c640 1 -- start start 2023-12-22T09:15:07.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878f75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f878806bdc0 0x7f87881e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878f75c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f878806c2d0 0x7f878806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878f75c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 0x7f87880702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878f75c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87881e9c80 con 0x7f87880c5a30 2023-12-22T09:15:07.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878f75c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880c3cf0 con 0x7f878806bdc0 2023-12-22T09:15:07.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878f75c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87880c3fd0 con 0x7f878806c2d0 2023-12-22T09:15:07.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878dcf9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 0x7f87880702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:07.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878dcf9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 0x7f87880702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50826/0 (socket says 172.21.15.106:50826) 2023-12-22T09:15:07.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878dcf9640 1 -- 172.21.15.106:0/1363793997 learned_addr learned my addr 172.21.15.106:0/1363793997 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:07.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.699+0000 7f878d4f8640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f878806bdc0 0x7f87881e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f878dcf9640 1 -- 172.21.15.106:0/1363793997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f878806c2d0 msgr2=0x7f878806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f878dcf9640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f878806c2d0 0x7f878806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f878dcf9640 1 -- 172.21.15.106:0/1363793997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f878806bdc0 msgr2=0x7f87881e9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f878dcf9640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f878806bdc0 0x7f87881e9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f878dcf9640 1 -- 172.21.15.106:0/1363793997 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87840094d0 con 0x7f87880c5a30 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f878d4f8640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f878806bdc0 0x7f87881e9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f878dcf9640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 0x7f87880702e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f878000c780 tx=0x7f878000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f8779ffb640 1 -- 172.21.15.106:0/1363793997 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780004b10 con 0x7f87880c5a30 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f8779ffb640 1 -- 172.21.15.106:0/1363793997 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8780004c70 con 0x7f87880c5a30 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f8779ffb640 1 -- 172.21.15.106:0/1363793997 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878000aa90 con 0x7f87880c5a30 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87880c42b0 con 0x7f87880c5a30 2023-12-22T09:15:07.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.700+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87880c4fa0 con 0x7f87880c5a30 2023-12-22T09:15:07.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.701+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87880c3b10 con 0x7f87880c5a30 2023-12-22T09:15:07.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.702+0000 7f8779ffb640 1 -- 172.21.15.106:0/1363793997 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f878000abf0 con 0x7f87880c5a30 2023-12-22T09:15:07.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.703+0000 7f8779ffb640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f876c06a430 0x7f876c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:07.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.703+0000 7f8779ffb640 1 -- 172.21.15.106:0/1363793997 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8780088c80 con 0x7f87880c5a30 2023-12-22T09:15:07.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.703+0000 7f878d4f8640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f876c06a430 0x7f876c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:07.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.704+0000 7f878d4f8640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f876c06a430 0x7f876c06c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8784036000 tx=0x7f878403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:07.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.707+0000 7f8779ffb640 1 -- 172.21.15.106:0/1363793997 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f878008e020 con 0x7f87880c5a30 2023-12-22T09:15:07.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.898+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8788073f10 con 0x7f87880c5a30 2023-12-22T09:15:07.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.899+0000 7f8779ffb640 1 -- 172.21.15.106:0/1363793997 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8780053ff0 con 0x7f87880c5a30 2023-12-22T09:15:07.899 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:07.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f876c06a430 msgr2=0x7f876c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f876c06a430 0x7f876c06c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8784036000 tx=0x7f878403d040 comp rx=0 tx=0).stop 2023-12-22T09:15:07.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 msgr2=0x7f87880702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 0x7f87880702e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f878000c780 tx=0x7f878000cc40 comp rx=0 tx=0).stop 2023-12-22T09:15:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 shutdown_connections 2023-12-22T09:15:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f876c06a430 0x7f876c06c8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87880c5a30 0x7f87880702e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f878806c2d0 0x7f878806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 --2- 172.21.15.106:0/1363793997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f878806bdc0 0x7f87881e9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 >> 172.21.15.106:0/1363793997 conn(0x7f878806a220 msgr2=0x7f878814c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 shutdown_connections 2023-12-22T09:15:07.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:07.901+0000 7f878f75c640 1 -- 172.21.15.106:0/1363793997 wait complete. 2023-12-22T09:15:07.918 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:08.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.134+0000 7fbfa423e640 1 Processor -- start 2023-12-22T09:15:08.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.135+0000 7fbfa423e640 1 -- start start 2023-12-22T09:15:08.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.136+0000 7fbfa423e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbf9c0c6150 0x7fbf9c0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.136+0000 7fbfa423e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbf9c0c7640 0x7fbf9c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.136+0000 7fbfa423e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf9c06ca00 0x7fbf9c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.136+0000 7fbfa423e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c0c4f90 con 0x7fbf9c0c6150 2023-12-22T09:15:08.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.136+0000 7fbfa423e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c0c4560 con 0x7fbf9c0c7640 2023-12-22T09:15:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.136+0000 7fbfa423e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c154720 con 0x7fbf9c06ca00 2023-12-22T09:15:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.136+0000 7fbfa1fda640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbf9c0c6150 0x7fbf9c0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.136+0000 7fbfa1fda640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbf9c0c6150 0x7fbf9c0c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50832/0 (socket says 172.21.15.106:50832) 2023-12-22T09:15:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.136+0000 7fbfa1fda640 1 -- 172.21.15.106:0/1364470856 learned_addr learned my addr 172.21.15.106:0/1364470856 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.137+0000 7fbfa1fda640 1 -- 172.21.15.106:0/1364470856 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf9c06ca00 msgr2=0x7fbf9c06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.137+0000 7fbfa1fda640 1 --2- 172.21.15.106:0/1364470856 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf9c06ca00 0x7fbf9c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.137+0000 7fbfa1fda640 1 -- 172.21.15.106:0/1364470856 >> v2:172.21.15.132:3300/0 conn(0x7fbf9c0c7640 msgr2=0x7fbf9c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:08.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.137+0000 7fbfa1fda640 1 --2- 172.21.15.106:0/1364470856 >> v2:172.21.15.132:3300/0 conn(0x7fbf9c0c7640 0x7fbf9c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.137+0000 7fbfa1fda640 1 -- 172.21.15.106:0/1364470856 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c154c50 con 0x7fbf9c0c6150 2023-12-22T09:15:08.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.138+0000 7fbfa1fda640 1 --2- 172.21.15.106:0/1364470856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c0c6150 0x7fbf9c0c6530 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c06c510 tx=0x7fbf8c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c00a91c0ebae687 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:08.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.138+0000 7fbfa0fd8640 1 -- 172.21.15.106:0/1364470856 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c031740 con 0x7fbf9c0c6150 2023-12-22T09:15:08.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.138+0000 7fbfa0fd8640 1 -- 172.21.15.106:0/1364470856 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c0318a0 con 0x7fbf9c0c6150 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.138+0000 7fbfa0fd8640 1 -- 172.21.15.106:0/1364470856 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c031c30 con 0x7fbf9c0c6150 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.139+0000 7fbfa423e640 1 -- 172.21.15.106:0/1364470856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c0c6150 msgr2=0x7fbf9c0c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.139+0000 7fbfa423e640 1 --2- 172.21.15.106:0/1364470856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c0c6150 0x7fbf9c0c6530 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c06c510 tx=0x7fbf8c02b7e0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.139+0000 7fbfa423e640 1 -- 172.21.15.106:0/1364470856 shutdown_connections 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.139+0000 7fbfa423e640 1 --2- 172.21.15.106:0/1364470856 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf9c06ca00 0x7fbf9c06b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.139+0000 7fbfa423e640 1 --2- 172.21.15.106:0/1364470856 >> v2:172.21.15.132:3300/0 conn(0x7fbf9c0c7640 0x7fbf9c06b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.139+0000 7fbfa423e640 1 --2- 172.21.15.106:0/1364470856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c0c6150 0x7fbf9c0c6530 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.139+0000 7fbfa423e640 1 -- 172.21.15.106:0/1364470856 >> 172.21.15.106:0/1364470856 conn(0x7fbf9c0ab330 msgr2=0x7fbf9c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.139+0000 7fbfa423e640 1 -- 172.21.15.106:0/1364470856 shutdown_connections 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.139+0000 7fbfa423e640 1 -- 172.21.15.106:0/1364470856 wait complete. 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.141+0000 7fbfa423e640 1 Processor -- start 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.141+0000 7fbfa423e640 1 -- start start 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa423e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c06ca00 0x7fbf9c1e91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa423e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf9c0c6150 0x7fbf9c1ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa423e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf9c0c7640 0x7fbf9c0c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa423e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c1eac10 con 0x7fbf9c06ca00 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa423e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0c0dd0 con 0x7fbf9c0c6150 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa423e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0c10b0 con 0x7fbf9c0c7640 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa1fda640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c06ca00 0x7fbf9c1e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa1fda640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c06ca00 0x7fbf9c1e91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50834/0 (socket says 172.21.15.106:50834) 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa1fda640 1 -- 172.21.15.106:0/3760602716 learned_addr learned my addr 172.21.15.106:0/3760602716 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa17d9640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf9c0c6150 0x7fbf9c1ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa1fda640 1 -- 172.21.15.106:0/3760602716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf9c0c7640 msgr2=0x7fbf9c0c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa1fda640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf9c0c7640 0x7fbf9c0c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa1fda640 1 -- 172.21.15.106:0/3760602716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf9c0c6150 msgr2=0x7fbf9c1ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa1fda640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf9c0c6150 0x7fbf9c1ea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa1fda640 1 -- 172.21.15.106:0/3760602716 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0094d0 con 0x7fbf9c06ca00 2023-12-22T09:15:08.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.142+0000 7fbfa17d9640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf9c0c6150 0x7fbf9c1ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.143+0000 7fbfa1fda640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c06ca00 0x7fbf9c1e91e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c000c00 tx=0x7fbf8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.143+0000 7fbf9a7fc640 1 -- 172.21.15.106:0/3760602716 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c033c50 con 0x7fbf9c06ca00 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.143+0000 7fbf9a7fc640 1 -- 172.21.15.106:0/3760602716 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c033db0 con 0x7fbf9c06ca00 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.143+0000 7fbf9a7fc640 1 -- 172.21.15.106:0/3760602716 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c03d6b0 con 0x7fbf9c06ca00 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.143+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c0c1390 con 0x7fbf9c06ca00 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.143+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c0c1950 con 0x7fbf9c06ca00 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.144+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9c0c1b40 con 0x7fbf9c06ca00 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.145+0000 7fbf9a7fc640 1 -- 172.21.15.106:0/3760602716 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf8c03a040 con 0x7fbf9c06ca00 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.147+0000 7fbf9a7fc640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf8806a430 0x7fbf8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.147+0000 7fbf9a7fc640 1 -- 172.21.15.106:0/3760602716 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbf8c0aaaa0 con 0x7fbf9c06ca00 2023-12-22T09:15:08.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.147+0000 7fbfa17d9640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf8806a430 0x7fbf8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:08.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.148+0000 7fbfa17d9640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf8806a430 0x7fbf8806c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf90006fd0 tx=0x7fbf90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:08.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.151+0000 7fbf9a7fc640 1 -- 172.21.15.106:0/3760602716 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbf8c075f50 con 0x7fbf9c06ca00 2023-12-22T09:15:08.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.339+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf9c073f10 con 0x7fbf9c06ca00 2023-12-22T09:15:08.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.340+0000 7fbf9a7fc640 1 -- 172.21.15.106:0/3760602716 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf8c0380a0 con 0x7fbf9c06ca00 2023-12-22T09:15:08.340 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf8806a430 msgr2=0x7fbf8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf8806a430 0x7fbf8806c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf90006fd0 tx=0x7fbf90008040 comp rx=0 tx=0).stop 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c06ca00 msgr2=0x7fbf9c1e91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c06ca00 0x7fbf9c1e91e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c000c00 tx=0x7fbf8c0046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 shutdown_connections 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf8806a430 0x7fbf8806c8f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf9c0c7640 0x7fbf9c0c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf9c0c6150 0x7fbf9c1ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 --2- 172.21.15.106:0/3760602716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf9c06ca00 0x7fbf9c1e91e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 >> 172.21.15.106:0/3760602716 conn(0x7fbf9c0ab330 msgr2=0x7fbf9c0aa180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 shutdown_connections 2023-12-22T09:15:08.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.343+0000 7fbfa423e640 1 -- 172.21.15.106:0/3760602716 wait complete. 2023-12-22T09:15:08.362 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:08.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.578+0000 7f30fb557640 1 Processor -- start 2023-12-22T09:15:08.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.579+0000 7f30fb557640 1 -- start start 2023-12-22T09:15:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.580+0000 7f30fb557640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30f406ace0 0x7f30f41541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.580+0000 7f30fb557640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30f40c4af0 0x7f30f4154710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.580+0000 7f30fb557640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f4153d20 con 0x7f30f406a420 2023-12-22T09:15:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.580+0000 7f30fb557640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f40c53c0 con 0x7f30f406ace0 2023-12-22T09:15:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.580+0000 7f30fb557640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f40c5660 con 0x7f30f40c4af0 2023-12-22T09:15:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.580+0000 7f30fa555640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30f406ace0 0x7f30f41541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.580+0000 7f30fa555640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30f406ace0 0x7f30f41541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50836/0 (socket says 172.21.15.106:50836) 2023-12-22T09:15:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.580+0000 7f30fa555640 1 -- 172.21.15.106:0/4172050842 learned_addr learned my addr 172.21.15.106:0/4172050842 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.581+0000 7f30fa555640 1 -- 172.21.15.106:0/4172050842 >> v2:172.21.15.132:3300/0 conn(0x7f30f40c4af0 msgr2=0x7f30f4154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.581+0000 7f30fa555640 1 --2- 172.21.15.106:0/4172050842 >> v2:172.21.15.132:3300/0 conn(0x7f30f40c4af0 0x7f30f4154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.581+0000 7f30fa555640 1 -- 172.21.15.106:0/4172050842 >> v1:172.21.15.132:6789/0 conn(0x7f30f406a420 legacy=0x7f30f4150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.581+0000 7f30fa555640 1 -- 172.21.15.106:0/4172050842 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f40c5940 con 0x7f30f406ace0 2023-12-22T09:15:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.582+0000 7f30fa555640 1 --2- 172.21.15.106:0/4172050842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406ace0 0x7f30f41541d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009e50 tx=0x7f30e402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b924e9d9692619 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.582+0000 7f30f9553640 1 -- 172.21.15.106:0/4172050842 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e402c9f0 con 0x7f30f406ace0 2023-12-22T09:15:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.582+0000 7f30f9553640 1 -- 172.21.15.106:0/4172050842 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e402cb50 con 0x7f30f406ace0 2023-12-22T09:15:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.582+0000 7f30f9553640 1 -- 172.21.15.106:0/4172050842 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40343f0 con 0x7f30f406ace0 2023-12-22T09:15:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.583+0000 7f30fb557640 1 -- 172.21.15.106:0/4172050842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406ace0 msgr2=0x7f30f41541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.583+0000 7f30fb557640 1 --2- 172.21.15.106:0/4172050842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406ace0 0x7f30f41541d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009e50 tx=0x7f30e402be50 comp rx=0 tx=0).stop 2023-12-22T09:15:08.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.583+0000 7f30fb557640 1 -- 172.21.15.106:0/4172050842 shutdown_connections 2023-12-22T09:15:08.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.583+0000 7f30fb557640 1 --2- 172.21.15.106:0/4172050842 >> v2:172.21.15.132:3300/0 conn(0x7f30f40c4af0 0x7f30f4154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.583+0000 7f30fb557640 1 --2- 172.21.15.106:0/4172050842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406ace0 0x7f30f41541d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.583+0000 7f30fb557640 1 -- 172.21.15.106:0/4172050842 >> 172.21.15.106:0/4172050842 conn(0x7f30f40c5f70 msgr2=0x7f30f40c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:08.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.583+0000 7f30fb557640 1 -- 172.21.15.106:0/4172050842 shutdown_connections 2023-12-22T09:15:08.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.583+0000 7f30fb557640 1 -- 172.21.15.106:0/4172050842 wait complete. 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.584+0000 7f30fb557640 1 Processor -- start 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.584+0000 7f30fb557640 1 -- start start 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.585+0000 7f30fb557640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406a420 0x7f30f41ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.585+0000 7f30fb557640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f406ace0 0x7f30f40aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.585+0000 7f30fb557640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30f40c4af0 0x7f30f40bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.585+0000 7f30fb557640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f4149900 con 0x7f30f406a420 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.585+0000 7f30fb557640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40ae6a0 con 0x7f30f40c4af0 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.585+0000 7f30fb557640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41ea7f0 con 0x7f30f406ace0 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.586+0000 7f30fa555640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406a420 0x7f30f41ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.586+0000 7f30fa555640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406a420 0x7f30f41ea2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50838/0 (socket says 172.21.15.106:50838) 2023-12-22T09:15:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.586+0000 7f30fa555640 1 -- 172.21.15.106:0/2945941956 learned_addr learned my addr 172.21.15.106:0/2945941956 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.586+0000 7f30fa555640 1 -- 172.21.15.106:0/2945941956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f406ace0 msgr2=0x7f30f40aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.586+0000 7f30fa555640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f406ace0 0x7f30f40aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.586+0000 7f30fa555640 1 -- 172.21.15.106:0/2945941956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30f40c4af0 msgr2=0x7f30f40bf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.586+0000 7f30fa555640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30f40c4af0 0x7f30f40bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.586+0000 7f30fa555640 1 -- 172.21.15.106:0/2945941956 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4009b30 con 0x7f30f406a420 2023-12-22T09:15:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.586+0000 7f30fa555640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406a420 0x7f30f41ea2b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009e50 tx=0x7f30e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.587+0000 7f30f2ffd640 1 -- 172.21.15.106:0/2945941956 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e403e450 con 0x7f30f406a420 2023-12-22T09:15:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.587+0000 7f30f2ffd640 1 -- 172.21.15.106:0/2945941956 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e403e5b0 con 0x7f30f406a420 2023-12-22T09:15:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.587+0000 7f30f2ffd640 1 -- 172.21.15.106:0/2945941956 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e403e960 con 0x7f30f406a420 2023-12-22T09:15:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.587+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f4149e30 con 0x7f30f406a420 2023-12-22T09:15:08.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.587+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f4149b50 con 0x7f30f406a420 2023-12-22T09:15:08.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.588+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f408b340 con 0x7f30f406a420 2023-12-22T09:15:08.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.589+0000 7f30f2ffd640 1 -- 172.21.15.106:0/2945941956 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f30e403eac0 con 0x7f30f406a420 2023-12-22T09:15:08.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.590+0000 7f30f2ffd640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f30e006a460 0x7f30e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:08.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.590+0000 7f30f2ffd640 1 -- 172.21.15.106:0/2945941956 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30e40ab7d0 con 0x7f30f406a420 2023-12-22T09:15:08.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.590+0000 7f30f9d54640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f30e006a460 0x7f30e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:08.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.591+0000 7f30f9d54640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f30e006a460 0x7f30e006c920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f30f40c6530 tx=0x7f30e8006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:08.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.594+0000 7f30f2ffd640 1 -- 172.21.15.106:0/2945941956 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f30e4076b60 con 0x7f30f406a420 2023-12-22T09:15:08.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.787+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f30f404e8d0 con 0x7f30f406a420 2023-12-22T09:15:08.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.788+0000 7f30f2ffd640 1 -- 172.21.15.106:0/2945941956 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f30e4047e90 con 0x7f30f406a420 2023-12-22T09:15:08.787 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:08.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.790+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f30e006a460 msgr2=0x7f30e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.790+0000 7f30fb557640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f30e006a460 0x7f30e006c920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f30f40c6530 tx=0x7f30e8006c90 comp rx=0 tx=0).stop 2023-12-22T09:15:08.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.790+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406a420 msgr2=0x7f30f41ea2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:08.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.790+0000 7f30fb557640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406a420 0x7f30f41ea2b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009e50 tx=0x7f30e4004a40 comp rx=0 tx=0).stop 2023-12-22T09:15:08.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.790+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 shutdown_connections 2023-12-22T09:15:08.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.790+0000 7f30fb557640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f30e006a460 0x7f30e006c920 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.791+0000 7f30fb557640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30f40c4af0 0x7f30f40bf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.791+0000 7f30fb557640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f30f406ace0 0x7f30f40aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.791+0000 7f30fb557640 1 --2- 172.21.15.106:0/2945941956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30f406a420 0x7f30f41ea2b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:08.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.791+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 >> 172.21.15.106:0/2945941956 conn(0x7f30f40c5f70 msgr2=0x7f30f40c6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:08.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.791+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 shutdown_connections 2023-12-22T09:15:08.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:08.791+0000 7f30fb557640 1 -- 172.21.15.106:0/2945941956 wait complete. 2023-12-22T09:15:08.808 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:15:09.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.021+0000 7fe87da10640 1 Processor -- start 2023-12-22T09:15:09.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.021+0000 7fe87da10640 1 -- start start 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.022+0000 7fe87da10640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe87814d980 0x7fe8781537e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.022+0000 7fe87da10640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe878071e60 0x7fe87806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe87da10640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8780c1720 con 0x7fe8780aaca0 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe87da10640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780c1a00 con 0x7fe87814d980 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe87da10640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780706d0 con 0x7fe878071e60 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe876ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe87814d980 0x7fe8781537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe876ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe87814d980 0x7fe8781537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50842/0 (socket says 172.21.15.106:50842) 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe876ffd640 1 -- 172.21.15.106:0/2824879788 learned_addr learned my addr 172.21.15.106:0/2824879788 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe8777fe640 1 --2- 172.21.15.106:0/2824879788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe878071e60 0x7fe87806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe876ffd640 1 -- 172.21.15.106:0/2824879788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe878071e60 msgr2=0x7fe87806fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe876ffd640 1 --2- 172.21.15.106:0/2824879788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe878071e60 0x7fe87806fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe876ffd640 1 -- 172.21.15.106:0/2824879788 >> v1:172.21.15.132:6789/0 conn(0x7fe8780aaca0 legacy=0x7fe878070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:09.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe876ffd640 1 -- 172.21.15.106:0/2824879788 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878153d20 con 0x7fe87814d980 2023-12-22T09:15:09.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.023+0000 7fe8777fe640 1 --2- 172.21.15.106:0/2824879788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe878071e60 0x7fe87806fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.024+0000 7fe876ffd640 1 --2- 172.21.15.106:0/2824879788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe87814d980 0x7fe8781537e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe868009850 tx=0x7fe86802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19593bb9fd5bcd6b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe8767fc640 1 -- 172.21.15.106:0/2824879788 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86802e070 con 0x7fe87814d980 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe8767fc640 1 -- 172.21.15.106:0/2824879788 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868004030 con 0x7fe87814d980 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe8767fc640 1 -- 172.21.15.106:0/2824879788 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868004420 con 0x7fe87814d980 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe87da10640 1 -- 172.21.15.106:0/2824879788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe87814d980 msgr2=0x7fe8781537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe87da10640 1 --2- 172.21.15.106:0/2824879788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe87814d980 0x7fe8781537e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe868009850 tx=0x7fe86802b840 comp rx=0 tx=0).stop 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe87da10640 1 -- 172.21.15.106:0/2824879788 shutdown_connections 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe87da10640 1 --2- 172.21.15.106:0/2824879788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe878071e60 0x7fe87806fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe87da10640 1 --2- 172.21.15.106:0/2824879788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe87814d980 0x7fe8781537e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe87da10640 1 -- 172.21.15.106:0/2824879788 >> 172.21.15.106:0/2824879788 conn(0x7fe8780c5360 msgr2=0x7fe8780c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe87da10640 1 -- 172.21.15.106:0/2824879788 shutdown_connections 2023-12-22T09:15:09.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.025+0000 7fe87da10640 1 -- 172.21.15.106:0/2824879788 wait complete. 2023-12-22T09:15:09.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.027+0000 7fe87da10640 1 Processor -- start 2023-12-22T09:15:09.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.027+0000 7fe87da10640 1 -- start start 2023-12-22T09:15:09.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.028+0000 7fe87da10640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe878071e60 0x7fe87814e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.028+0000 7fe87da10640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8780aaca0 0x7fe87814b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.028+0000 7fe87da10640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe87814d980 0x7fe8781ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.028+0000 7fe87da10640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878137930 con 0x7fe878071e60 2023-12-22T09:15:09.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.028+0000 7fe87da10640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87814f130 con 0x7fe87814d980 2023-12-22T09:15:09.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.028+0000 7fe87da10640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8781eafb0 con 0x7fe8780aaca0 2023-12-22T09:15:09.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.028+0000 7fe876ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe878071e60 0x7fe87814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.028+0000 7fe876ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe878071e60 0x7fe87814e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50846/0 (socket says 172.21.15.106:50846) 2023-12-22T09:15:09.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.028+0000 7fe876ffd640 1 -- 172.21.15.106:0/85678865 learned_addr learned my addr 172.21.15.106:0/85678865 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:09.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe86e7fc640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8780aaca0 0x7fe87814b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe8777fe640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe87814d980 0x7fe8781ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe876ffd640 1 -- 172.21.15.106:0/85678865 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8780aaca0 msgr2=0x7fe87814b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe876ffd640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8780aaca0 0x7fe87814b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe876ffd640 1 -- 172.21.15.106:0/85678865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe87814d980 msgr2=0x7fe8781ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe876ffd640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe87814d980 0x7fe8781ea2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe876ffd640 1 -- 172.21.15.106:0/85678865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009460 con 0x7fe878071e60 2023-12-22T09:15:09.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe86e7fc640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8780aaca0 0x7fe87814b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:09.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe876ffd640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe878071e60 0x7fe87814e060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe868000c00 tx=0x7fe8680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:09.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe874ff9640 1 -- 172.21.15.106:0/85678865 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868003c20 con 0x7fe878071e60 2023-12-22T09:15:09.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe874ff9640 1 -- 172.21.15.106:0/85678865 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868003d80 con 0x7fe878071e60 2023-12-22T09:15:09.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe874ff9640 1 -- 172.21.15.106:0/85678865 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868006280 con 0x7fe878071e60 2023-12-22T09:15:09.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.029+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8781375e0 con 0x7fe878071e60 2023-12-22T09:15:09.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.030+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87814fe20 con 0x7fe878071e60 2023-12-22T09:15:09.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.031+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe878073f10 con 0x7fe878071e60 2023-12-22T09:15:09.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.032+0000 7fe874ff9640 1 -- 172.21.15.106:0/85678865 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe8680063e0 con 0x7fe878071e60 2023-12-22T09:15:09.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.032+0000 7fe874ff9640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a430 0x7fe85806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.033+0000 7fe874ff9640 1 -- 172.21.15.106:0/85678865 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8680aac20 con 0x7fe878071e60 2023-12-22T09:15:09.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.033+0000 7fe86e7fc640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a430 0x7fe85806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.034+0000 7fe86e7fc640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a430 0x7fe85806c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8781545a0 tx=0x7fe860009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:09.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.038+0000 7fe874ff9640 1 -- 172.21.15.106:0/85678865 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe868075fb0 con 0x7fe878071e60 2023-12-22T09:15:09.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.263+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8780c5990 con 0x7fe878071e60 2023-12-22T09:15:09.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.264+0000 7fe874ff9640 1 -- 172.21.15.106:0/85678865 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4653 (secure 0 0 0) 0x7fe86803be60 con 0x7fe878071e60 2023-12-22T09:15:09.264 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:09.264 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:55.943828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T09:15:09.264 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a430 msgr2=0x7fe85806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a430 0x7fe85806c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8781545a0 tx=0x7fe860009040 comp rx=0 tx=0).stop 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe878071e60 msgr2=0x7fe87814e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe878071e60 0x7fe87814e060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe868000c00 tx=0x7fe8680046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 shutdown_connections 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a430 0x7fe85806c8f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe87814d980 0x7fe8781ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8780aaca0 0x7fe87814b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 --2- 172.21.15.106:0/85678865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe878071e60 0x7fe87814e060 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 >> 172.21.15.106:0/85678865 conn(0x7fe8780c5360 msgr2=0x7fe8780a8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 shutdown_connections 2023-12-22T09:15:09.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.267+0000 7fe87da10640 1 -- 172.21.15.106:0/85678865 wait complete. 2023-12-22T09:15:09.285 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:09.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.509+0000 7faec55d9640 1 Processor -- start 2023-12-22T09:15:09.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.509+0000 7faec55d9640 1 -- start start 2023-12-22T09:15:09.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.510+0000 7faec55d9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faec00c3fe0 0x7faec00c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.510+0000 7faec55d9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00bac60 0x7faec00701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.510+0000 7faec55d9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faec00c1f50 0x7faec014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.510+0000 7faec55d9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec00ad190 con 0x7faec00c3fe0 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.510+0000 7faec55d9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec00ad5f0 con 0x7faec00c1f50 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.510+0000 7faec55d9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec00c3be0 con 0x7faec00bac60 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.510+0000 7faebeffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faec00c3fe0 0x7faec00c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.510+0000 7faebeffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faec00c3fe0 0x7faec00c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50856/0 (socket says 172.21.15.106:50856) 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.510+0000 7faebeffd640 1 -- 172.21.15.106:0/886366086 learned_addr learned my addr 172.21.15.106:0/886366086 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.511+0000 7faebe7fc640 1 --2- 172.21.15.106:0/886366086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00bac60 0x7faec00701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.511+0000 7faebf7fe640 1 --2- 172.21.15.106:0/886366086 >> v2:172.21.15.132:3300/0 conn(0x7faec00c1f50 0x7faec014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.511+0000 7faebeffd640 1 -- 172.21.15.106:0/886366086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00bac60 msgr2=0x7faec00701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:09.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.511+0000 7faebeffd640 1 --2- 172.21.15.106:0/886366086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00bac60 0x7faec00701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.511+0000 7faebeffd640 1 -- 172.21.15.106:0/886366086 >> v2:172.21.15.132:3300/0 conn(0x7faec00c1f50 msgr2=0x7faec014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:09.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.511+0000 7faebeffd640 1 --2- 172.21.15.106:0/886366086 >> v2:172.21.15.132:3300/0 conn(0x7faec00c1f50 0x7faec014ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.511+0000 7faebeffd640 1 -- 172.21.15.106:0/886366086 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00c38b0 con 0x7faec00c3fe0 2023-12-22T09:15:09.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.511+0000 7faebf7fe640 1 --2- 172.21.15.106:0/886366086 >> v2:172.21.15.132:3300/0 conn(0x7faec00c1f50 0x7faec014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:09.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.512+0000 7faebeffd640 1 --2- 172.21.15.106:0/886366086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c3fe0 0x7faec00c43c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009870 tx=0x7faeb002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849c706262bcf5e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:09.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.512+0000 7faebdffb640 1 -- 172.21.15.106:0/886366086 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00317c0 con 0x7faec00c3fe0 2023-12-22T09:15:09.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.512+0000 7faebdffb640 1 -- 172.21.15.106:0/886366086 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb0031920 con 0x7faec00c3fe0 2023-12-22T09:15:09.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.512+0000 7faebdffb640 1 -- 172.21.15.106:0/886366086 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0031cb0 con 0x7faec00c3fe0 2023-12-22T09:15:09.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.513+0000 7faec55d9640 1 -- 172.21.15.106:0/886366086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c3fe0 msgr2=0x7faec00c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.513+0000 7faec55d9640 1 --2- 172.21.15.106:0/886366086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c3fe0 0x7faec00c43c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009870 tx=0x7faeb002b860 comp rx=0 tx=0).stop 2023-12-22T09:15:09.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.513+0000 7faec55d9640 1 -- 172.21.15.106:0/886366086 shutdown_connections 2023-12-22T09:15:09.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.513+0000 7faec55d9640 1 --2- 172.21.15.106:0/886366086 >> v2:172.21.15.132:3300/0 conn(0x7faec00c1f50 0x7faec014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.513+0000 7faec55d9640 1 --2- 172.21.15.106:0/886366086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00bac60 0x7faec00701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.513+0000 7faec55d9640 1 --2- 172.21.15.106:0/886366086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c3fe0 0x7faec00c43c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.513+0000 7faec55d9640 1 -- 172.21.15.106:0/886366086 >> 172.21.15.106:0/886366086 conn(0x7faec00a9160 msgr2=0x7faec00a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:09.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.513+0000 7faec55d9640 1 -- 172.21.15.106:0/886366086 shutdown_connections 2023-12-22T09:15:09.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.513+0000 7faec55d9640 1 -- 172.21.15.106:0/886366086 wait complete. 2023-12-22T09:15:09.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.515+0000 7faec55d9640 1 Processor -- start 2023-12-22T09:15:09.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.515+0000 7faec55d9640 1 -- start start 2023-12-22T09:15:09.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faec55d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faec00bac60 0x7faec0143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faec55d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c1f50 0x7faec0144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faec55d9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00c3fe0 0x7faec00c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faec55d9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec0142e20 con 0x7faec00c1f50 2023-12-22T09:15:09.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faec55d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec006ad00 con 0x7faec00bac60 2023-12-22T09:15:09.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faec55d9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec0142780 con 0x7faec00c3fe0 2023-12-22T09:15:09.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebe7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c1f50 0x7faec0144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebe7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c1f50 0x7faec0144640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50862/0 (socket says 172.21.15.106:50862) 2023-12-22T09:15:09.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebe7fc640 1 -- 172.21.15.106:0/3089643377 learned_addr learned my addr 172.21.15.106:0/3089643377 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:09.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebf7fe640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00c3fe0 0x7faec00c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebeffd640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faec00bac60 0x7faec0143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebe7fc640 1 -- 172.21.15.106:0/3089643377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00c3fe0 msgr2=0x7faec00c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebe7fc640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00c3fe0 0x7faec00c0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebe7fc640 1 -- 172.21.15.106:0/3089643377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faec00bac60 msgr2=0x7faec0143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebe7fc640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faec00bac60 0x7faec0143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.516+0000 7faebe7fc640 1 -- 172.21.15.106:0/3089643377 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb00094d0 con 0x7faec00c1f50 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.517+0000 7faebe7fc640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c1f50 0x7faec0144640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faeb400d800 tx=0x7faeb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.517+0000 7faea77fe640 1 -- 172.21.15.106:0/3089643377 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400b6c0 con 0x7faec00c1f50 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.517+0000 7faea77fe640 1 -- 172.21.15.106:0/3089643377 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb400b820 con 0x7faec00c1f50 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.517+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec0142090 con 0x7faec00c1f50 2023-12-22T09:15:09.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.517+0000 7faea77fe640 1 -- 172.21.15.106:0/3089643377 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400bbb0 con 0x7faec00c1f50 2023-12-22T09:15:09.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.517+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec01422e0 con 0x7faec00c1f50 2023-12-22T09:15:09.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.518+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec0073f10 con 0x7faec00c1f50 2023-12-22T09:15:09.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.519+0000 7faea77fe640 1 -- 172.21.15.106:0/3089643377 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faeb400bd10 con 0x7faec00c1f50 2023-12-22T09:15:09.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.520+0000 7faea77fe640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7faeac06a430 0x7faeac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.520+0000 7faea77fe640 1 -- 172.21.15.106:0/3089643377 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faeb40892b0 con 0x7faec00c1f50 2023-12-22T09:15:09.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.520+0000 7faebeffd640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7faeac06a430 0x7faeac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.521+0000 7faebeffd640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7faeac06a430 0x7faeac06c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faeb0036000 tx=0x7faeb003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:09.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.524+0000 7faea77fe640 1 -- 172.21.15.106:0/3089643377 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faeb4054450 con 0x7faec00c1f50 2023-12-22T09:15:09.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.717+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faec006fe90 con 0x7faec00c1f50 2023-12-22T09:15:09.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.719+0000 7faea77fe640 1 -- 172.21.15.106:0/3089643377 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18259 (secure 0 0 0) 0x7faeb4057a70 con 0x7faec00c1f50 2023-12-22T09:15:09.719 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:09.719 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":26,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:09.460951+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:09.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7faeac06a430 msgr2=0x7faeac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7faeac06a430 0x7faeac06c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faeb0036000 tx=0x7faeb003d040 comp rx=0 tx=0).stop 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c1f50 msgr2=0x7faec0144640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c1f50 0x7faec0144640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faeb400d800 tx=0x7faeb400dcc0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 shutdown_connections 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7faeac06a430 0x7faeac06c8f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faec00c3fe0 0x7faec00c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faec00c1f50 0x7faec0144640 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 --2- 172.21.15.106:0/3089643377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faec00bac60 0x7faec0143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 >> 172.21.15.106:0/3089643377 conn(0x7faec00a9160 msgr2=0x7faec01509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 shutdown_connections 2023-12-22T09:15:09.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.722+0000 7faec55d9640 1 -- 172.21.15.106:0/3089643377 wait complete. 2023-12-22T09:15:09.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:15:09.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.958+0000 7f355efc9640 1 Processor -- start 2023-12-22T09:15:09.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.958+0000 7f355efc9640 1 -- start start 2023-12-22T09:15:09.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.959+0000 7f355efc9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3558152680 0x7f355815c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.959+0000 7f355efc9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35580bfce0 con 0x7f3558150a80 2023-12-22T09:15:09.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.959+0000 7f355efc9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35580bffc0 con 0x7f3558069e60 2023-12-22T09:15:09.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.959+0000 7f355efc9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35580c0960 con 0x7f3558152680 2023-12-22T09:15:09.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.960+0000 7f355d566640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3558152680 0x7f355815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.960+0000 7f3557fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3558150a80 0x7f3558151f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51350/0 (socket says 172.21.15.106:51350) 2023-12-22T09:15:09.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.960+0000 7f3557fff640 1 -- 172.21.15.106:0/4260969318 learned_addr learned my addr 172.21.15.106:0/4260969318 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:09.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.960+0000 7f355d566640 1 -- 172.21.15.106:0/4260969318 >> v1:172.21.15.132:6789/0 conn(0x7f3558069e60 legacy=0x7f355814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.960+0000 7f355d566640 1 -- 172.21.15.106:0/4260969318 >> v1:172.21.15.106:6789/0 conn(0x7f3558150a80 legacy=0x7f3558151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.960+0000 7f355d566640 1 -- 172.21.15.106:0/4260969318 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580c02a0 con 0x7f3558152680 2023-12-22T09:15:09.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.960+0000 7f35577fe640 1 -- 172.21.15.106:0/4260969318 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909693488 0 0) 0x7f35580bfce0 con 0x7f3558150a80 2023-12-22T09:15:09.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.962+0000 7f355d566640 1 --2- 172.21.15.106:0/4260969318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558152680 0x7f355815c410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3550009d90 tx=0x7f355002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8863e8388cf2d92 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:09.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.962+0000 7f35577fe640 1 -- 172.21.15.106:0/4260969318 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355002cbd0 con 0x7f3558152680 2023-12-22T09:15:09.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.962+0000 7f35577fe640 1 -- 172.21.15.106:0/4260969318 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355002cd30 con 0x7f3558152680 2023-12-22T09:15:09.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.962+0000 7f35577fe640 1 -- 172.21.15.106:0/4260969318 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355002cea0 con 0x7f3558152680 2023-12-22T09:15:09.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.962+0000 7f355efc9640 1 -- 172.21.15.106:0/4260969318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558152680 msgr2=0x7f355815c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.962+0000 7f355efc9640 1 --2- 172.21.15.106:0/4260969318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558152680 0x7f355815c410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3550009d90 tx=0x7f355002be20 comp rx=0 tx=0).stop 2023-12-22T09:15:09.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.963+0000 7f355efc9640 1 -- 172.21.15.106:0/4260969318 shutdown_connections 2023-12-22T09:15:09.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.963+0000 7f355efc9640 1 --2- 172.21.15.106:0/4260969318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558152680 0x7f355815c410 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.963+0000 7f355efc9640 1 -- 172.21.15.106:0/4260969318 >> 172.21.15.106:0/4260969318 conn(0x7f35580c5360 msgr2=0x7f35580c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:09.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.963+0000 7f355efc9640 1 -- 172.21.15.106:0/4260969318 shutdown_connections 2023-12-22T09:15:09.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.963+0000 7f355efc9640 1 -- 172.21.15.106:0/4260969318 wait complete. 2023-12-22T09:15:09.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.965+0000 7f355efc9640 1 Processor -- start 2023-12-22T09:15:09.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.965+0000 7f355efc9640 1 -- start start 2023-12-22T09:15:09.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.966+0000 7f355efc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3558069e60 0x7f35580c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.966+0000 7f355efc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558150a80 0x7f35580c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.966+0000 7f355efc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3558152680 0x7f3558141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.966+0000 7f355efc9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558154fe0 con 0x7f3558150a80 2023-12-22T09:15:09.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.966+0000 7f355efc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558146c20 con 0x7f3558152680 2023-12-22T09:15:09.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.966+0000 7f355efc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35580c4e30 con 0x7f3558069e60 2023-12-22T09:15:09.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.966+0000 7f3557fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558150a80 0x7f35580c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f3557fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558150a80 0x7f35580c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50870/0 (socket says 172.21.15.106:50870) 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f3557fff640 1 -- 172.21.15.106:0/2889865356 learned_addr learned my addr 172.21.15.106:0/2889865356 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f355cd65640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3558069e60 0x7f35580c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f3557fff640 1 -- 172.21.15.106:0/2889865356 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3558069e60 msgr2=0x7f35580c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f355d566640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3558152680 0x7f3558141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f3557fff640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3558069e60 0x7f35580c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f3557fff640 1 -- 172.21.15.106:0/2889865356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3558152680 msgr2=0x7f3558141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f3557fff640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3558152680 0x7f3558141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f3557fff640 1 -- 172.21.15.106:0/2889865356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550009a70 con 0x7f3558150a80 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f3557fff640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558150a80 0x7f35580c59b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f354800c420 tx=0x7f354800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.967+0000 7f35557fa640 1 -- 172.21.15.106:0/2889865356 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35480074e0 con 0x7f3558150a80 2023-12-22T09:15:09.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.968+0000 7f35557fa640 1 -- 172.21.15.106:0/2889865356 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3548007640 con 0x7f3558150a80 2023-12-22T09:15:09.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.968+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35581462f0 con 0x7f3558150a80 2023-12-22T09:15:09.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.968+0000 7f35557fa640 1 -- 172.21.15.106:0/2889865356 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548004a20 con 0x7f3558150a80 2023-12-22T09:15:09.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.968+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35581468b0 con 0x7f3558150a80 2023-12-22T09:15:09.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.969+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3558073f10 con 0x7f3558150a80 2023-12-22T09:15:09.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.970+0000 7f35557fa640 1 -- 172.21.15.106:0/2889865356 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3548004b80 con 0x7f3558150a80 2023-12-22T09:15:09.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.971+0000 7f35557fa640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f353806a430 0x7f353806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:09.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.971+0000 7f35557fa640 1 -- 172.21.15.106:0/2889865356 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3548088b30 con 0x7f3558150a80 2023-12-22T09:15:09.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.972+0000 7f355cd65640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f353806a430 0x7f353806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:09.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.972+0000 7f355cd65640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f353806a430 0x7f353806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3540000fb0 tx=0x7f3540009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:09.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:09.976+0000 7f35557fa640 1 -- 172.21.15.106:0/2889865356 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3548053d50 con 0x7f3558150a80 2023-12-22T09:15:10.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.198+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35580aa5a0 con 0x7f3558150a80 2023-12-22T09:15:10.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.200+0000 7f35557fa640 1 -- 172.21.15.106:0/2889865356 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4653 (secure 0 0 0) 0x7f3548057370 con 0x7f3558150a80 2023-12-22T09:15:10.199 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:10.199 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:55.943828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T09:15:10.200 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f353806a430 msgr2=0x7f353806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f353806a430 0x7f353806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3540000fb0 tx=0x7f3540009040 comp rx=0 tx=0).stop 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558150a80 msgr2=0x7f35580c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558150a80 0x7f35580c59b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f354800c420 tx=0x7f354800c8e0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 shutdown_connections 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f353806a430 0x7f353806c8f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3558152680 0x7f3558141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3558150a80 0x7f35580c59b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 --2- 172.21.15.106:0/2889865356 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3558069e60 0x7f35580c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 >> 172.21.15.106:0/2889865356 conn(0x7f35580c5360 msgr2=0x7f3558071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:10.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 shutdown_connections 2023-12-22T09:15:10.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.202+0000 7f355efc9640 1 -- 172.21.15.106:0/2889865356 wait complete. 2023-12-22T09:15:10.622 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T09:14:28.433865+0000', 'modified': '2023-12-22T09:14:55.943828+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6835/4132787606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6833', 'nonce': 4132787606}, {'type': 'v1', 'addr': '172.21.15.132:6835', 'nonce': 4132787606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T09:15:10.622 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T09:15:10.622 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-22T09:15:10.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.842+0000 7fd70759e640 1 Processor -- start 2023-12-22T09:15:10.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.842+0000 7fd70759e640 1 -- start start 2023-12-22T09:15:10.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.843+0000 7fd70759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd708069e60 0x7fd708070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.843+0000 7fd70759e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080c0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.843+0000 7fd70759e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70806bc70 con 0x7fd708154f10 2023-12-22T09:15:10.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.843+0000 7fd70759e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7080713a0 con 0x7fd708069e60 2023-12-22T09:15:10.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.843+0000 7fd70759e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd708071660 con 0x7fd7080c00c0 2023-12-22T09:15:10.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.844+0000 7fd706d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.844+0000 7fd706d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080c0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:42184/0 (socket says 172.21.15.106:42184) 2023-12-22T09:15:10.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.844+0000 7fd706d9d640 1 -- 172.21.15.106:0/209947998 learned_addr learned my addr 172.21.15.106:0/209947998 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:10.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.844+0000 7fd70659c640 1 --2- 172.21.15.106:0/209947998 >> v2:172.21.15.132:3300/0 conn(0x7fd708069e60 0x7fd708070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.845+0000 7fd706d9d640 1 -- 172.21.15.106:0/209947998 >> v2:172.21.15.132:3300/0 conn(0x7fd708069e60 msgr2=0x7fd708070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:10.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.845+0000 7fd706d9d640 1 --2- 172.21.15.106:0/209947998 >> v2:172.21.15.132:3300/0 conn(0x7fd708069e60 0x7fd708070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.845+0000 7fd706d9d640 1 -- 172.21.15.106:0/209947998 >> v1:172.21.15.132:6789/0 conn(0x7fd708154f10 legacy=0x7fd70813aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.845+0000 7fd706d9d640 1 -- 172.21.15.106:0/209947998 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd708071940 con 0x7fd7080c00c0 2023-12-22T09:15:10.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.846+0000 7fd706d9d640 1 --2- 172.21.15.106:0/209947998 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080c0570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd700009e50 tx=0x7fd70002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0551e4b671dd454 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:10.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.846+0000 7fd705d9b640 1 -- 172.21.15.106:0/209947998 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70002cb00 con 0x7fd7080c00c0 2023-12-22T09:15:10.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.846+0000 7fd705d9b640 1 -- 172.21.15.106:0/209947998 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70002cc60 con 0x7fd7080c00c0 2023-12-22T09:15:10.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.846+0000 7fd705d9b640 1 -- 172.21.15.106:0/209947998 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000343f0 con 0x7fd7080c00c0 2023-12-22T09:15:10.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.847+0000 7fd70759e640 1 -- 172.21.15.106:0/209947998 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 msgr2=0x7fd7080c0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.847+0000 7fd70759e640 1 --2- 172.21.15.106:0/209947998 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080c0570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd700009e50 tx=0x7fd70002bf60 comp rx=0 tx=0).stop 2023-12-22T09:15:10.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.847+0000 7fd70759e640 1 -- 172.21.15.106:0/209947998 shutdown_connections 2023-12-22T09:15:10.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.847+0000 7fd70759e640 1 --2- 172.21.15.106:0/209947998 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080c0570 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.847+0000 7fd70759e640 1 --2- 172.21.15.106:0/209947998 >> v2:172.21.15.132:3300/0 conn(0x7fd708069e60 0x7fd708070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.847+0000 7fd70759e640 1 -- 172.21.15.106:0/209947998 >> 172.21.15.106:0/209947998 conn(0x7fd7080c5180 msgr2=0x7fd7080c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:10.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.847+0000 7fd70759e640 1 -- 172.21.15.106:0/209947998 shutdown_connections 2023-12-22T09:15:10.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.847+0000 7fd70759e640 1 -- 172.21.15.106:0/209947998 wait complete. 2023-12-22T09:15:10.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.848+0000 7fd70759e640 1 Processor -- start 2023-12-22T09:15:10.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.849+0000 7fd70759e640 1 -- start start 2023-12-22T09:15:10.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.849+0000 7fd70759e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708069e60 0x7fd70814f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70759e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080be740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd708154f10 0x7fd7080a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70759e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd708151770 con 0x7fd708069e60 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70759e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080a8e60 con 0x7fd708154f10 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70759e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080a8250 con 0x7fd7080c00c0 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708069e60 0x7fd70814f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708069e60 0x7fd70814f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50876/0 (socket says 172.21.15.106:50876) 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70659c640 1 -- 172.21.15.106:0/936161806 learned_addr learned my addr 172.21.15.106:0/936161806 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd706d9d640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd708154f10 0x7fd7080a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70659c640 1 -- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 msgr2=0x7fd7080be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd6fffff640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70659c640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080be740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70659c640 1 -- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd708154f10 msgr2=0x7fd7080a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70659c640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd708154f10 0x7fd7080a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd70659c640 1 -- 172.21.15.106:0/936161806 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700009b30 con 0x7fd708069e60 2023-12-22T09:15:10.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd706d9d640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd708154f10 0x7fd7080a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:10.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.850+0000 7fd6fffff640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:10.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.851+0000 7fd70659c640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708069e60 0x7fd70814f7d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800e9b0 tx=0x7fd6f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:10.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.851+0000 7fd6feffd640 1 -- 172.21.15.106:0/936161806 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8009670 con 0x7fd708069e60 2023-12-22T09:15:10.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.851+0000 7fd6feffd640 1 -- 172.21.15.106:0/936161806 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f800c9a0 con 0x7fd708069e60 2023-12-22T09:15:10.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.851+0000 7fd70759e640 1 -- 172.21.15.106:0/936161806 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7080a8530 con 0x7fd708069e60 2023-12-22T09:15:10.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.851+0000 7fd6feffd640 1 -- 172.21.15.106:0/936161806 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f800cd50 con 0x7fd708069e60 2023-12-22T09:15:10.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.851+0000 7fd70759e640 1 -- 172.21.15.106:0/936161806 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7080a8af0 con 0x7fd708069e60 2023-12-22T09:15:10.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.853+0000 7fd6feffd640 1 -- 172.21.15.106:0/936161806 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6f8013470 con 0x7fd708069e60 2023-12-22T09:15:10.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.854+0000 7fd6feffd640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd6e806a430 0x7fd6e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.855+0000 7fd6feffd640 1 -- 172.21.15.106:0/936161806 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd6f8089310 con 0x7fd708069e60 2023-12-22T09:15:10.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.855+0000 7fd6fffff640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd6e806a430 0x7fd6e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.855+0000 7fd70f40e740 1 Processor -- start 2023-12-22T09:15:10.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.855+0000 7fd6fffff640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd6e806a430 0x7fd6e806c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd7080aa3d0 tx=0x7fd6f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:10.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.855+0000 7fd70f40e740 1 -- start start 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.856+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64b9b0 0x55c1cf6862a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.856+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf6867e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.856+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf687810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.856+0000 7fd70f40e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf5b5f80 con 0x55c1cf64bd90 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.856+0000 7fd70f40e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf5b3710 con 0x55c1cf64ca40 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.856+0000 7fd70f40e740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf5af000 con 0x55c1cf64b9b0 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.856+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf6867e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.856+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf6867e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50880/0 (socket says 172.21.15.106:50880) 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.856+0000 7fd6fffff640 1 -- 172.21.15.106:0/2508580652 learned_addr learned my addr 172.21.15.106:0/2508580652 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd70659c640 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64b9b0 0x55c1cf6862a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd706d9d640 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf687810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd6fffff640 1 -- 172.21.15.106:0/2508580652 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64b9b0 msgr2=0x55c1cf6862a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd6fffff640 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64b9b0 0x55c1cf6862a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd6fffff640 1 -- 172.21.15.106:0/2508580652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 msgr2=0x55c1cf687810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd6fffff640 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf687810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd6fffff640 1 -- 172.21.15.106:0/2508580652 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1cf576690 con 0x55c1cf64bd90 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd706d9d640 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf687810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd6fffff640 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf6867e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00145d0 tx=0x7fd6f0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96222282ddb127f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd6e7fff640 1 -- 172.21.15.106:0/2508580652 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0007460 con 0x55c1cf64bd90 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd6e7fff640 1 -- 172.21.15.106:0/2508580652 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f00075c0 con 0x55c1cf64bd90 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.857+0000 7fd6e7fff640 1 -- 172.21.15.106:0/2508580652 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00069f0 con 0x55c1cf64bd90 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.858+0000 7fd70f40e740 1 -- 172.21.15.106:0/2508580652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 msgr2=0x55c1cf6867e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.858+0000 7fd70f40e740 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf6867e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00145d0 tx=0x7fd6f0010000 comp rx=0 tx=0).stop 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.858+0000 7fd70f40e740 1 -- 172.21.15.106:0/2508580652 shutdown_connections 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.858+0000 7fd70f40e740 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf687810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.858+0000 7fd70f40e740 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf6867e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.858+0000 7fd70f40e740 1 --2- 172.21.15.106:0/2508580652 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64b9b0 0x55c1cf6862a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.858+0000 7fd70f40e740 1 -- 172.21.15.106:0/2508580652 >> 172.21.15.106:0/2508580652 conn(0x55c1cf648080 msgr2=0x55c1cf66ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:10.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.858+0000 7fd70f40e740 1 -- 172.21.15.106:0/2508580652 shutdown_connections 2023-12-22T09:15:10.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.858+0000 7fd70f40e740 1 -- 172.21.15.106:0/2508580652 wait complete. 2023-12-22T09:15:10.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.859+0000 7fd70f40e740 1 -- start start 2023-12-22T09:15:10.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.859+0000 7fd70f40e740 1 Processor -- start 2023-12-22T09:15:10.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 0x55c1cf68d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf6492e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf6686c0 0x55c1cf666530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd70f40e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf5507d0 con 0x55c1cf6686c0 2023-12-22T09:15:10.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd70f40e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf550470 con 0x55c1cf64ca40 2023-12-22T09:15:10.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd70f40e740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf316f20 con 0x55c1cf64bd90 2023-12-22T09:15:10.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd70f40e740 10 client.0 _ll_register_callbacks cb 0x55c1cf59f1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T09:15:10.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd706d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf6686c0 0x55c1cf666530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd706d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf6686c0 0x55c1cf666530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50884/0 (socket says 172.21.15.106:50884) 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd706d9d640 1 -- 172.21.15.106:0/1014915148 learned_addr learned my addr 172.21.15.106:0/1014915148 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd6fffff640 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf6492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.860+0000 7fd70659c640 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 0x55c1cf68d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.861+0000 7fd706d9d640 1 -- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 msgr2=0x55c1cf68d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.861+0000 7fd706d9d640 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 0x55c1cf68d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.861+0000 7fd706d9d640 1 -- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 msgr2=0x55c1cf6492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.861+0000 7fd706d9d640 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf6492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.861+0000 7fd706d9d640 1 -- 172.21.15.106:0/1014915148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70806bc70 con 0x55c1cf6686c0 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.861+0000 7fd6fffff640 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf6492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.861+0000 7fd706d9d640 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf6686c0 0x55c1cf666530 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd700009f70 tx=0x7fd700004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb44285d025e0f29 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.861+0000 7fd6e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd6e57fa640 1 -- 172.21.15.106:0/1014915148 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000349b0 con 0x55c1cf6686c0 2023-12-22T09:15:10.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd6e57fa640 1 -- 172.21.15.106:0/1014915148 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd700034b10 con 0x55c1cf6686c0 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd70f40e740 1 -- 172.21.15.106:0/1014915148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1cf5d9550 con 0x55c1cf6686c0 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd6e57fa640 1 -- 172.21.15.106:0/1014915148 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd700034cd0 con 0x55c1cf6686c0 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd70f40e740 10 client.4809 fetch_fsmap learned FSMap version 8 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd70f40e740 1 -- 172.21.15.106:0/1014915148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c1cf5ad680 con 0x55c1cf6686c0 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd6e57fa640 1 -- 172.21.15.106:0/1014915148 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c1cf5d9550 con 0x55c1cf6686c0 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd6e57fa640 1 -- 172.21.15.106:0/1014915148 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd70003c040 con 0x55c1cf6686c0 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd70f40e740 10 client.4809 fetch_fsmap finished waiting for FSMap version 8 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd70f40e740 10 client.4809 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd70f40e740 20 client.4809 populate_metadata read hostname 'smithi106' 2023-12-22T09:15:10.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd70f40e740 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x55c1cf69a9d0 0x55c1cf69adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd70f40e740 4 client.4809 mds_command: new command op to 4266 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T09:15:10.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.862+0000 7fd70f40e740 1 -- 172.21.15.106:0/1014915148 --> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1cf5a1b50 con 0x55c1cf69a9d0 2023-12-22T09:15:10.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.863+0000 7fd70659c640 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x55c1cf69a9d0 0x55c1cf69adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.864+0000 7fd70659c640 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x55c1cf69a9d0 0x55c1cf69adb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c721a875c90c990 server_cookie=297647d882f53be9 in_seq=0 out_seq=0 2023-12-22T09:15:10.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.864+0000 7fd6e57fa640 10 client.4809 ms_handle_connect on v2:172.21.15.132:6833/4132787606 2023-12-22T09:15:10.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.865+0000 7fd6e57fa640 1 -- 172.21.15.106:0/1014915148 <== mds.0 v2:172.21.15.132:6833/4132787606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55c1cf5a1b50 con 0x55c1cf69a9d0 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.865+0000 7fd6e57fa640 10 client.4809 handle_command_reply: tid=0 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 client.4809 shutdown 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 -- 172.21.15.106:0/1014915148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf6686c0 msgr2=0x55c1cf666530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf6686c0 0x55c1cf666530 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd700009f70 tx=0x7fd700004ab0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 -- 172.21.15.106:0/1014915148 shutdown_connections 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x55c1cf69a9d0 0x55c1cf69adb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf6686c0 0x55c1cf666530 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf64ca40 0x55c1cf6492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 --2- 172.21.15.106:0/1014915148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 0x55c1cf68d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd6e57fa640 0 client.4809 ms_handle_reset on v2:172.21.15.132:6833/4132787606 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 -- 172.21.15.106:0/1014915148 >> 172.21.15.106:0/1014915148 conn(0x55c1cf64b9b0 msgr2=0x55c1cf68ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 -- 172.21.15.106:0/1014915148 shutdown_connections 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 1 -- 172.21.15.106:0/1014915148 wait complete. 2023-12-22T09:15:10.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.866+0000 7fd70f40e740 20 client.4809 trim_cache size 0 max 16384 2023-12-22T09:15:10.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.882+0000 7fd70f40e740 1 Processor -- start 2023-12-22T09:15:10.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.882+0000 7fd70f40e740 1 -- start start 2023-12-22T09:15:10.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf666380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64ca40 0x55c1cf6a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 0x55c1cf66c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70f40e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf66d9c0 con 0x55c1cf64bd90 2023-12-22T09:15:10.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70f40e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf686430 con 0x55c1cf6686c0 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70f40e740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf6668c0 con 0x55c1cf64ca40 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf666380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf666380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50896/0 (socket says 172.21.15.106:50896) 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70659c640 1 -- 172.21.15.106:0/4033730635 learned_addr learned my addr 172.21.15.106:0/4033730635 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70659c640 1 -- 172.21.15.106:0/4033730635 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64ca40 msgr2=0x55c1cf6a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70659c640 1 --2- 172.21.15.106:0/4033730635 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64ca40 0x55c1cf6a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70659c640 1 -- 172.21.15.106:0/4033730635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 msgr2=0x55c1cf66c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70659c640 1 --2- 172.21.15.106:0/4033730635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 0x55c1cf66c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.883+0000 7fd70659c640 1 -- 172.21.15.106:0/4033730635 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1cf54f9e0 con 0x55c1cf64bd90 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd70659c640 1 --2- 172.21.15.106:0/4033730635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf666380 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c520 tx=0x7fd6f8089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3639dfaaca2fe35a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd6fcff9640 1 -- 172.21.15.106:0/4033730635 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f805bf90 con 0x55c1cf64bd90 2023-12-22T09:15:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd6fcff9640 1 -- 172.21.15.106:0/4033730635 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f806f070 con 0x55c1cf64bd90 2023-12-22T09:15:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd6fcff9640 1 -- 172.21.15.106:0/4033730635 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8060140 con 0x55c1cf64bd90 2023-12-22T09:15:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd70f40e740 1 -- 172.21.15.106:0/4033730635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 msgr2=0x55c1cf666380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd70f40e740 1 --2- 172.21.15.106:0/4033730635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf666380 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c520 tx=0x7fd6f8089040 comp rx=0 tx=0).stop 2023-12-22T09:15:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd70f40e740 1 -- 172.21.15.106:0/4033730635 shutdown_connections 2023-12-22T09:15:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd70f40e740 1 --2- 172.21.15.106:0/4033730635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 0x55c1cf66c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd70f40e740 1 --2- 172.21.15.106:0/4033730635 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64ca40 0x55c1cf6a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd70f40e740 1 --2- 172.21.15.106:0/4033730635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64bd90 0x55c1cf666380 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.884+0000 7fd70f40e740 1 -- 172.21.15.106:0/4033730635 >> 172.21.15.106:0/4033730635 conn(0x55c1cf64b9b0 msgr2=0x55c1cf68d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.885+0000 7fd70f40e740 1 -- 172.21.15.106:0/4033730635 shutdown_connections 2023-12-22T09:15:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.885+0000 7fd70f40e740 1 -- 172.21.15.106:0/4033730635 wait complete. 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.885+0000 7fd70f40e740 1 -- start start 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.885+0000 7fd70f40e740 1 Processor -- start 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.886+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 0x55c1cf6eb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.886+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64ca40 0x55c1cf666f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.886+0000 7fd70f40e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 0x55c1cf6f1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.886+0000 7fd70f40e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf667480 con 0x55c1cf64ca40 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.886+0000 7fd70f40e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf6678e0 con 0x55c1cf6686c0 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.886+0000 7fd70f40e740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1cf6658f0 con 0x55c1cf64bd90 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.886+0000 7fd70f40e740 10 client.0 _ll_register_callbacks cb 0x7fd6f00012a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64ca40 0x55c1cf666f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64ca40 0x55c1cf666f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50912/0 (socket says 172.21.15.106:50912) 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6fffff640 1 -- 172.21.15.106:0/3952089335 learned_addr learned my addr 172.21.15.106:0/3952089335 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd706d9d640 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 0x55c1cf6f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd70659c640 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 0x55c1cf6eb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6fffff640 1 -- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 msgr2=0x55c1cf6eb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6fffff640 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 0x55c1cf6eb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6fffff640 1 -- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 msgr2=0x55c1cf6f1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6fffff640 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 0x55c1cf6f1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6fffff640 1 -- 172.21.15.106:0/3952089335 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7080a8af0 con 0x55c1cf64ca40 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd706d9d640 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 0x55c1cf6f1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6fffff640 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64ca40 0x55c1cf666f40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0014570 tx=0x7fd6f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34be1f9a895ca51 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6e57fa640 1 -- 172.21.15.106:0/3952089335 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000d590 con 0x55c1cf64ca40 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd6e57fa640 1 -- 172.21.15.106:0/3952089335 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd6f000d6f0 con 0x55c1cf64ca40 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.887+0000 7fd70f40e740 1 -- 172.21.15.106:0/3952089335 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6f00075c0 con 0x55c1cf64ca40 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd6e57fa640 1 -- 172.21.15.106:0/3952089335 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6f000d8d0 con 0x55c1cf64ca40 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd70f40e740 10 client.4815 fetch_fsmap learned FSMap version 8 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd70f40e740 1 -- 172.21.15.106:0/3952089335 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c1cf574ef0 con 0x55c1cf64ca40 2023-12-22T09:15:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd6e57fa640 1 -- 172.21.15.106:0/3952089335 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f00075c0 con 0x55c1cf64ca40 2023-12-22T09:15:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd6e57fa640 1 -- 172.21.15.106:0/3952089335 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd6f0030020 con 0x55c1cf64ca40 2023-12-22T09:15:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd70f40e740 10 client.4815 fetch_fsmap finished waiting for FSMap version 8 2023-12-22T09:15:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd70f40e740 10 client.4815 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-22T09:15:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd70f40e740 20 client.4815 populate_metadata read hostname 'smithi106' 2023-12-22T09:15:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd70f40e740 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x55c1cf688520 0x55c1cf6ede90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd70f40e740 4 client.4815 mds_command: new command op to 4266 tid=0[{"prefix": "status"}] 2023-12-22T09:15:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.888+0000 7fd70f40e740 1 -- 172.21.15.106:0/3952089335 --> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c1cf5a8080 con 0x55c1cf688520 2023-12-22T09:15:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.889+0000 7fd70659c640 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x55c1cf688520 0x55c1cf6ede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:10.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.890+0000 7fd6e57fa640 10 client.4815 ms_handle_connect on v2:172.21.15.132:6833/4132787606 2023-12-22T09:15:10.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.889+0000 7fd70659c640 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x55c1cf688520 0x55c1cf6ede90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e643607d89dddb1b server_cookie=2957be57d9c4797f in_seq=0 out_seq=0 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.890+0000 7fd6e57fa640 1 -- 172.21.15.106:0/3952089335 <== mds.0 v2:172.21.15.132:6833/4132787606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55c1cf5a8080 con 0x55c1cf688520 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.890+0000 7fd6e57fa640 10 client.4815 handle_command_reply: tid=0 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.890+0000 7fd70f40e740 1 client.4815 shutdown 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 -- 172.21.15.106:0/3952089335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64ca40 msgr2=0x55c1cf666f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64ca40 0x55c1cf666f40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0014570 tx=0x7fd6f0000ed0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 -- 172.21.15.106:0/3952089335 shutdown_connections 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:6833/4132787606,v1:172.21.15.132:6835/4132787606] conn(0x55c1cf688520 0x55c1cf6ede90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c1cf6686c0 0x55c1cf6f1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c1cf64ca40 0x55c1cf666f40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 --2- 172.21.15.106:0/3952089335 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55c1cf64bd90 0x55c1cf6eb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd6e57fa640 0 client.4815 ms_handle_reset on v2:172.21.15.132:6833/4132787606 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 -- 172.21.15.106:0/3952089335 >> 172.21.15.106:0/3952089335 conn(0x55c1cf64b9b0 msgr2=0x55c1cf6a0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 -- 172.21.15.106:0/3952089335 shutdown_connections 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 1 -- 172.21.15.106:0/3952089335 wait complete. 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.891+0000 7fd70f40e740 20 client.4815 trim_cache size 0 max 16384 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "c9422aac-a1e3-428b-87d0-2dbf321c6b46", 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4266, 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 42.451595386999998, 2023-12-22T09:15:10.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 8, 2023-12-22T09:15:10.895 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 27, 2023-12-22T09:15:10.895 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 25, 2023-12-22T09:15:10.895 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 47.488275547999997 2023-12-22T09:15:10.895 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-12-22T09:15:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 -- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd6e806a430 msgr2=0x7fd6e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd6e806a430 0x7fd6e806c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd7080aa3d0 tx=0x7fd6f0009040 comp rx=0 tx=0).stop 2023-12-22T09:15:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 -- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708069e60 msgr2=0x7fd70814f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708069e60 0x7fd70814f7d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800e9b0 tx=0x7fd6f800ee70 comp rx=0 tx=0).stop 2023-12-22T09:15:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 -- 172.21.15.106:0/936161806 shutdown_connections 2023-12-22T09:15:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd6e806a430 0x7fd6e806c8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd708154f10 0x7fd7080a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7080c00c0 0x7fd7080be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 --2- 172.21.15.106:0/936161806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd708069e60 0x7fd70814f7d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:10.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 -- 172.21.15.106:0/936161806 >> 172.21.15.106:0/936161806 conn(0x7fd7080c5180 msgr2=0x7fd708139f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:10.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 -- 172.21.15.106:0/936161806 shutdown_connections 2023-12-22T09:15:10.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:10.892+0000 7fd70759e640 1 -- 172.21.15.106:0/936161806 wait complete. 2023-12-22T09:15:10.907 INFO:teuthology.run_tasks:Running task kclient... 2023-12-22T09:15:10.920 INFO:tasks.kclient:Mounting kernel clients... 2023-12-22T09:15:10.920 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-22T09:15:10.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:10.921 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-12-22T09:15:10.969 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-22T09:15:10.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:10.970 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-22T09:15:11.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:11.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2023-12-22T09:15:11.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:11.190 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-22T09:15:11.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:11.252 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-12-22T09:15:11.352 INFO:teuthology.orchestra.run.smithi132.stderr:Cannot find device "ceph-brx" 2023-12-22T09:15:11.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:15:11.356 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-22T09:15:11.356 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-22T09:15:11.356 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T09:15:11.356 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:15:11.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.568+0000 7f921043e640 1 Processor -- start 2023-12-22T09:15:11.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.568+0000 7f921043e640 1 -- start start 2023-12-22T09:15:11.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.570+0000 7f921043e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f920813b060 0x7f920806a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:11.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.570+0000 7f921043e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9208151b30 0x7f9208151f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:11.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.570+0000 7f921043e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92080bf770 con 0x7f92080bfce0 2023-12-22T09:15:11.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.570+0000 7f921043e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9208155120 con 0x7f920813b060 2023-12-22T09:15:11.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.570+0000 7f921043e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9208155400 con 0x7f9208151b30 2023-12-22T09:15:11.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.570+0000 7f920e1da640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f920813b060 0x7f920806a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:11.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.570+0000 7f920d9d9640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f92080bfce0 0x7f9208069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51362/0 (socket says 172.21.15.106:51362) 2023-12-22T09:15:11.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.570+0000 7f920d9d9640 1 -- 172.21.15.106:0/1769945914 learned_addr learned my addr 172.21.15.106:0/1769945914 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:11.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.571+0000 7f920e9db640 1 --2- 172.21.15.106:0/1769945914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9208151b30 0x7f9208151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:11.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.571+0000 7f920e1da640 1 -- 172.21.15.106:0/1769945914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9208151b30 msgr2=0x7f9208151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:11.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.571+0000 7f920e1da640 1 --2- 172.21.15.106:0/1769945914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9208151b30 0x7f9208151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.571+0000 7f920e1da640 1 -- 172.21.15.106:0/1769945914 >> v1:172.21.15.106:6789/0 conn(0x7f92080bfce0 legacy=0x7f9208069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:11.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.571+0000 7f920e1da640 1 -- 172.21.15.106:0/1769945914 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92081556e0 con 0x7f920813b060 2023-12-22T09:15:11.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.571+0000 7f920d1d8640 1 -- 172.21.15.106:0/1769945914 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596875477 0 0) 0x7f92080bf770 con 0x7f92080bfce0 2023-12-22T09:15:11.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.572+0000 7f920e1da640 1 --2- 172.21.15.106:0/1769945914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 0x7f920806a6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9204009790 tx=0x7f920402b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9544bac45172eef5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:11.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.572+0000 7f920d1d8640 1 -- 172.21.15.106:0/1769945914 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204031770 con 0x7f920813b060 2023-12-22T09:15:11.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.572+0000 7f920d1d8640 1 -- 172.21.15.106:0/1769945914 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92040318d0 con 0x7f920813b060 2023-12-22T09:15:11.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.572+0000 7f920d1d8640 1 -- 172.21.15.106:0/1769945914 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204031c60 con 0x7f920813b060 2023-12-22T09:15:11.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.573+0000 7f921043e640 1 -- 172.21.15.106:0/1769945914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 msgr2=0x7f920806a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:11.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.573+0000 7f921043e640 1 --2- 172.21.15.106:0/1769945914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 0x7f920806a6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9204009790 tx=0x7f920402b810 comp rx=0 tx=0).stop 2023-12-22T09:15:11.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.573+0000 7f921043e640 1 -- 172.21.15.106:0/1769945914 shutdown_connections 2023-12-22T09:15:11.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.573+0000 7f921043e640 1 --2- 172.21.15.106:0/1769945914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9208151b30 0x7f9208151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.573+0000 7f921043e640 1 --2- 172.21.15.106:0/1769945914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 0x7f920806a6b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.573+0000 7f921043e640 1 -- 172.21.15.106:0/1769945914 >> 172.21.15.106:0/1769945914 conn(0x7f92080c5360 msgr2=0x7f92080c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:11.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.573+0000 7f921043e640 1 -- 172.21.15.106:0/1769945914 shutdown_connections 2023-12-22T09:15:11.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.573+0000 7f921043e640 1 -- 172.21.15.106:0/1769945914 wait complete. 2023-12-22T09:15:11.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.575+0000 7f921043e640 1 Processor -- start 2023-12-22T09:15:11.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.575+0000 7f921043e640 1 -- start start 2023-12-22T09:15:11.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f921043e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92080bfce0 0x7f92080c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:11.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f921043e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 0x7f92080c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f921043e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9208151b30 0x7f92080c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f921043e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92081e6ac0 con 0x7f920813b060 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f921043e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92080c32b0 con 0x7f9208151b30 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f921043e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92081322c0 con 0x7f92080bfce0 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920d9d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 0x7f92080c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920d9d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 0x7f92080c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50930/0 (socket says 172.21.15.106:50930) 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920d9d9640 1 -- 172.21.15.106:0/749335663 learned_addr learned my addr 172.21.15.106:0/749335663 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920e1da640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92080bfce0 0x7f92080c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920e9db640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9208151b30 0x7f92080c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920d9d9640 1 -- 172.21.15.106:0/749335663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92080bfce0 msgr2=0x7f92080c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920d9d9640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92080bfce0 0x7f92080c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920d9d9640 1 -- 172.21.15.106:0/749335663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9208151b30 msgr2=0x7f92080c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:11.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920d9d9640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9208151b30 0x7f92080c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.576+0000 7f920d9d9640 1 -- 172.21.15.106:0/749335663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040093a0 con 0x7f920813b060 2023-12-22T09:15:11.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.577+0000 7f920d9d9640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 0x7f92080c4890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c430 tx=0x7f91f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:11.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.577+0000 7f91feffd640 1 -- 172.21.15.106:0/749335663 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f80074e0 con 0x7f920813b060 2023-12-22T09:15:11.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.577+0000 7f91feffd640 1 -- 172.21.15.106:0/749335663 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f8007660 con 0x7f920813b060 2023-12-22T09:15:11.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.577+0000 7f91feffd640 1 -- 172.21.15.106:0/749335663 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8004a20 con 0x7f920813b060 2023-12-22T09:15:11.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.577+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9208154c20 con 0x7f920813b060 2023-12-22T09:15:11.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.577+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92080c2fd0 con 0x7f920813b060 2023-12-22T09:15:11.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.578+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9208073f10 con 0x7f920813b060 2023-12-22T09:15:11.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.579+0000 7f91feffd640 1 -- 172.21.15.106:0/749335663 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91f8004b80 con 0x7f920813b060 2023-12-22T09:15:11.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.580+0000 7f91feffd640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f91ec06a430 0x7f91ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:11.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.580+0000 7f91feffd640 1 -- 172.21.15.106:0/749335663 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f91f8088b60 con 0x7f920813b060 2023-12-22T09:15:11.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.580+0000 7f920e1da640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f91ec06a430 0x7f91ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:11.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.581+0000 7f920e1da640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f91ec06a430 0x7f91ec06c8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9204036000 tx=0x7f920403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:11.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.584+0000 7f91feffd640 1 -- 172.21.15.106:0/749335663 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f91f8053d80 con 0x7f920813b060 2023-12-22T09:15:11.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.813+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9208155ca0 con 0x7f920813b060 2023-12-22T09:15:11.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.814+0000 7f91feffd640 1 -- 172.21.15.106:0/749335663 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f91f80573a0 con 0x7f920813b060 2023-12-22T09:15:11.813 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-22T09:15:11.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f91ec06a430 msgr2=0x7f91ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:11.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f91ec06a430 0x7f91ec06c8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9204036000 tx=0x7f920403d040 comp rx=0 tx=0).stop 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 msgr2=0x7f92080c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 0x7f92080c4890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c430 tx=0x7f91f800c8f0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 shutdown_connections 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f91ec06a430 0x7f91ec06c8f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9208151b30 0x7f92080c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f920813b060 0x7f92080c4890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 --2- 172.21.15.106:0/749335663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92080bfce0 0x7f92080c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.816+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 >> 172.21.15.106:0/749335663 conn(0x7f92080c5360 msgr2=0x7f9208072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.817+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 shutdown_connections 2023-12-22T09:15:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:11.817+0000 7f921043e640 1 -- 172.21.15.106:0/749335663 wait complete. 2023-12-22T09:15:11.833 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T09:15:11.833 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:15:11.833 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2023-12-22T09:15:11.834 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T09:15:11.834 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T09:15:11.834 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T09:15:11.834 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T09:15:11.834 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T09:15:11.834 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:15:11.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:11.834 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2023-12-22T09:15:11.885 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:15:11.885 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:15:11.886 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:15:11.886 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:15:11.886 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-12-22T09:15:11.886 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:15:11.887 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:15:11.887 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2023-12-22T09:15:11.887 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2023-12-22T09:15:11.887 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:15:11.887 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2023-12-22T09:15:11.887 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2023-12-22T09:15:11.887 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:15:11.888 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2023-12-22T09:15:11.888 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:15:11.888 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2023-12-22T09:15:11.888 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:15:11.888 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42323sec preferred_lft 42323sec 2023-12-22T09:15:11.888 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2023-12-22T09:15:11.888 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:15:11.888 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-22T09:15:11.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:11.889 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:15:11.889 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:15:11.889 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2023-12-22T09:15:11.889 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2023-12-22T09:15:11.889 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2023-12-22T09:15:11.889 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-22T09:15:11.889 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:15:12.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:12.103 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:15:12.176 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-12-22T09:15:12.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:12.179 DEBUG:teuthology.orchestra.run.smithi106:> route 2023-12-22T09:15:12.229 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2023-12-22T09:15:12.230 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:15:12.230 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:15:12.230 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:15:12.230 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:15:12.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:12.232 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:15:12.232 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:15:12.232 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:15:12.233 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:15:12.233 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:15:12.233 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:15:12.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:12.414 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-12-22T09:15:12.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:12.466 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2023-12-22T09:15:12.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:12.519 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:15:12.519 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:15:12.519 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T09:15:12.519 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-22T09:15:12.519 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:15:12.653 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-22T09:15:12.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:12.654 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:15:12.654 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:15:12.654 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-22T09:15:12.654 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-22T09:15:12.655 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-22T09:15:12.655 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-22T09:15:12.655 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-22T09:15:12.655 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:15:12.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:12.904 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:15:12.905 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:15:12.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2023-12-22T09:15:12.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2023-12-22T09:15:12.905 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:15:13.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:15:13.061 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T09:15:13.112 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:15:13.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:15:13.113 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T09:15:13.167 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T09:15:13.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:13.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:15:13.304 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:15:13.345 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T09:15:13.345 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:15:13.750 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:15:13.750 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T09:15:13.750 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:15:13.750 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:15:13.750 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:15:13.790 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:15:13.791 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T09:15:13.791 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:15:13.791 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:15:13.791 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:15:13.791 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790" 2023-12-22T09:15:13.791 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2023-12-22T09:15:13.791 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c9422aac-a1e3-428b-87d0-2dbf321c6b46" will pass to kernel 2023-12-22T09:15:13.798 INFO:teuthology.orchestra.run.smithi106.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T09:15:13.798 INFO:teuthology.orchestra.run.smithi106.stdout: You just mounted a file system that supports labels which does not 2023-12-22T09:15:13.799 INFO:teuthology.orchestra.run.smithi106.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T09:15:13.799 INFO:teuthology.orchestra.run.smithi106.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T09:15:13.799 INFO:teuthology.orchestra.run.smithi106.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T09:15:13.804 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T09:15:13.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:13.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T09:15:13.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:13.898 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:15:13.956 INFO:teuthology.orchestra.run.smithi106.stdout:client4591 2023-12-22T09:15:13.956 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:15:13.957 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:15:14.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:14.012 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:15:14.070 INFO:teuthology.orchestra.run.smithi106.stdout:client4591 2023-12-22T09:15:14.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:14.070 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:15:14.127 INFO:teuthology.orchestra.run.smithi106.stdout:client4591 2023-12-22T09:15:14.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:14.127 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c9422aac-a1e3-428b-87d0-2dbf321c6b46.client4591/status') 2023-12-22T09:15:14.219 INFO:teuthology.orchestra.run.smithi106.stdout:instance: client.4591 (3)172.21.15.106:0/766240434 2023-12-22T09:15:14.219 INFO:teuthology.orchestra.run.smithi106.stdout:blocklisted: false 2023-12-22T09:15:14.219 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records in 2023-12-22T09:15:14.219 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records out 2023-12-22T09:15:14.219 INFO:teuthology.orchestra.run.smithi106.stderr:70 bytes copied, 6.6638e-05 s, 1.1 MB/s 2023-12-22T09:15:14.222 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-22T09:15:14.222 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-22T09:15:14.223 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T09:15:14.223 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:15:14.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.429+0000 7fabfa8b2640 1 Processor -- start 2023-12-22T09:15:14.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.429+0000 7fabfa8b2640 1 -- start start 2023-12-22T09:15:14.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.431+0000 7fabfa8b2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fabf41514b0 0x7fabf40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:14.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.431+0000 7fabfa8b2640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fabf40c4130 0x7fabf4154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:14.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.431+0000 7fabfa8b2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf40c4660 con 0x7fabf4154a80 2023-12-22T09:15:14.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.431+0000 7fabfa8b2640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf4153d60 con 0x7fabf40c4130 2023-12-22T09:15:14.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.431+0000 7fabfa8b2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf406b250 con 0x7fabf41514b0 2023-12-22T09:15:14.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.431+0000 7fabebfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fabf40c4130 0x7fabf4154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:14.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.431+0000 7fabebfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fabf40c4130 0x7fabf4154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37592/0 (socket says 172.21.15.106:37592) 2023-12-22T09:15:14.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.431+0000 7fabebfff640 1 -- 172.21.15.106:0/3664044602 learned_addr learned my addr 172.21.15.106:0/3664044602 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:14.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.432+0000 7fabf3fff640 1 --2- 172.21.15.106:0/3664044602 >> v2:172.21.15.132:3300/0 conn(0x7fabf41514b0 0x7fabf40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:14.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.432+0000 7fabebfff640 1 -- 172.21.15.106:0/3664044602 >> v2:172.21.15.132:3300/0 conn(0x7fabf41514b0 msgr2=0x7fabf40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:14.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.432+0000 7fabebfff640 1 --2- 172.21.15.106:0/3664044602 >> v2:172.21.15.132:3300/0 conn(0x7fabf41514b0 0x7fabf40c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.432+0000 7fabebfff640 1 -- 172.21.15.106:0/3664044602 >> v1:172.21.15.106:6789/0 conn(0x7fabf4154a80 legacy=0x7fabf40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:14.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.432+0000 7fabebfff640 1 -- 172.21.15.106:0/3664044602 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf406b530 con 0x7fabf40c4130 2023-12-22T09:15:14.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.432+0000 7fabf37fe640 1 -- 172.21.15.106:0/3664044602 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834830815 0 0) 0x7fabf40c4660 con 0x7fabf4154a80 2023-12-22T09:15:14.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.432+0000 7fabf3fff640 1 --2- 172.21.15.106:0/3664044602 >> v2:172.21.15.132:3300/0 conn(0x7fabf41514b0 0x7fabf40c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:14.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.433+0000 7fabebfff640 1 --2- 172.21.15.106:0/3664044602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf40c4130 0x7fabf4154540 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fabf40668d0 tx=0x7fabdc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96a84d79ac8c06a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:14.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.433+0000 7fabf37fe640 1 -- 172.21.15.106:0/3664044602 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc031870 con 0x7fabf40c4130 2023-12-22T09:15:14.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.433+0000 7fabf37fe640 1 -- 172.21.15.106:0/3664044602 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc0319d0 con 0x7fabf40c4130 2023-12-22T09:15:14.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.433+0000 7fabf37fe640 1 -- 172.21.15.106:0/3664044602 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc031d60 con 0x7fabf40c4130 2023-12-22T09:15:14.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.434+0000 7fabfa8b2640 1 -- 172.21.15.106:0/3664044602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf40c4130 msgr2=0x7fabf4154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:14.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.434+0000 7fabfa8b2640 1 --2- 172.21.15.106:0/3664044602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf40c4130 0x7fabf4154540 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fabf40668d0 tx=0x7fabdc02b910 comp rx=0 tx=0).stop 2023-12-22T09:15:14.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.434+0000 7fabfa8b2640 1 -- 172.21.15.106:0/3664044602 shutdown_connections 2023-12-22T09:15:14.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.434+0000 7fabfa8b2640 1 --2- 172.21.15.106:0/3664044602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf40c4130 0x7fabf4154540 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.434+0000 7fabfa8b2640 1 --2- 172.21.15.106:0/3664044602 >> v2:172.21.15.132:3300/0 conn(0x7fabf41514b0 0x7fabf40c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.434+0000 7fabfa8b2640 1 -- 172.21.15.106:0/3664044602 >> 172.21.15.106:0/3664044602 conn(0x7fabf40ab1a0 msgr2=0x7fabf40ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:14.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.434+0000 7fabfa8b2640 1 -- 172.21.15.106:0/3664044602 shutdown_connections 2023-12-22T09:15:14.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.434+0000 7fabfa8b2640 1 -- 172.21.15.106:0/3664044602 wait complete. 2023-12-22T09:15:14.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.435+0000 7fabfa8b2640 1 Processor -- start 2023-12-22T09:15:14.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.436+0000 7fabfa8b2640 1 -- start start 2023-12-22T09:15:14.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.436+0000 7fabfa8b2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf40c4130 0x7fabf414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:14.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.436+0000 7fabfa8b2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf41514b0 0x7fabf40aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:14.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.436+0000 7fabfa8b2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fabf414c7a0 0x7fabf40aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabfa8b2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf41ecee0 con 0x7fabf41514b0 2023-12-22T09:15:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabfa8b2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf41ec260 con 0x7fabf40c4130 2023-12-22T09:15:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabfa8b2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf41ec540 con 0x7fabf414c7a0 2023-12-22T09:15:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabebfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf41514b0 0x7fabf40aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabebfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf41514b0 0x7fabf40aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37600/0 (socket says 172.21.15.106:37600) 2023-12-22T09:15:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabebfff640 1 -- 172.21.15.106:0/796721860 learned_addr learned my addr 172.21.15.106:0/796721860 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabebfff640 1 -- 172.21.15.106:0/796721860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fabf414c7a0 msgr2=0x7fabf40aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabebfff640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fabf414c7a0 0x7fabf40aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabebfff640 1 -- 172.21.15.106:0/796721860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf40c4130 msgr2=0x7fabf414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabf3fff640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf40c4130 0x7fabf414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabebfff640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf40c4130 0x7fabf414ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.437+0000 7fabebfff640 1 -- 172.21.15.106:0/796721860 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc0094d0 con 0x7fabf41514b0 2023-12-22T09:15:14.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.438+0000 7fabebfff640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf41514b0 0x7fabf40aa0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fabdc000c00 tx=0x7fabdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:14.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.438+0000 7fabf17fa640 1 -- 172.21.15.106:0/796721860 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc031840 con 0x7fabf41514b0 2023-12-22T09:15:14.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.438+0000 7fabf17fa640 1 -- 172.21.15.106:0/796721860 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc0443f0 con 0x7fabf41514b0 2023-12-22T09:15:14.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.438+0000 7fabf17fa640 1 -- 172.21.15.106:0/796721860 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc0447a0 con 0x7fabf41514b0 2023-12-22T09:15:14.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.438+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf41ec820 con 0x7fabf41514b0 2023-12-22T09:15:14.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.438+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf40a9430 con 0x7fabf41514b0 2023-12-22T09:15:14.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.439+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf41ed020 con 0x7fabf41514b0 2023-12-22T09:15:14.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.440+0000 7fabf17fa640 1 -- 172.21.15.106:0/796721860 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fabdc04d450 con 0x7fabf41514b0 2023-12-22T09:15:14.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.441+0000 7fabf17fa640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fabd406a430 0x7fabd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:14.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.441+0000 7fabf17fa640 1 -- 172.21.15.106:0/796721860 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fabdc02d040 con 0x7fabf41514b0 2023-12-22T09:15:14.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.441+0000 7fabf3fff640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fabd406a430 0x7fabd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:14.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.442+0000 7fabf3fff640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fabd406a430 0x7fabd406c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fabe4008850 tx=0x7fabe4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:14.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.445+0000 7fabf17fa640 1 -- 172.21.15.106:0/796721860 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fabdc076730 con 0x7fabf41514b0 2023-12-22T09:15:14.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.677+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fabf4073f10 con 0x7fabf41514b0 2023-12-22T09:15:14.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.678+0000 7fabf17fa640 1 -- 172.21.15.106:0/796721860 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fabdc079d50 con 0x7fabf41514b0 2023-12-22T09:15:14.678 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-22T09:15:14.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fabd406a430 msgr2=0x7fabd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:14.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fabd406a430 0x7fabd406c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fabe4008850 tx=0x7fabe4008040 comp rx=0 tx=0).stop 2023-12-22T09:15:14.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf41514b0 msgr2=0x7fabf40aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:14.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf41514b0 0x7fabf40aa0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fabdc000c00 tx=0x7fabdc0046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 shutdown_connections 2023-12-22T09:15:14.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fabd406a430 0x7fabd406c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fabf414c7a0 0x7fabf40aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabf41514b0 0x7fabf40aa0d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 --2- 172.21.15.106:0/796721860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf40c4130 0x7fabf414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:14.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 >> 172.21.15.106:0/796721860 conn(0x7fabf40ab1a0 msgr2=0x7fabf40c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:14.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 shutdown_connections 2023-12-22T09:15:14.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:14.681+0000 7fabfa8b2640 1 -- 172.21.15.106:0/796721860 wait complete. 2023-12-22T09:15:14.699 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T09:15:14.699 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:15:14.699 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-22T09:15:14.699 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T09:15:14.699 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T09:15:14.699 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T09:15:14.699 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T09:15:14.699 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T09:15:14.699 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:15:14.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:14.699 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-22T09:15:14.759 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:15:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:15:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:15:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-22T09:15:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:15:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42320sec preferred_lft 42320sec 2023-12-22T09:15:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-22T09:15:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:15:14.762 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-22T09:15:14.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:14.762 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-22T09:15:14.762 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-22T09:15:14.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2023-12-22T09:15:14.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2023-12-22T09:15:14.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2023-12-22T09:15:14.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-22T09:15:14.762 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-22T09:15:15.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:15.241 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:15:15.316 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-22T09:15:15.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:15.319 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-22T09:15:15.365 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-22T09:15:15.366 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:15:15.366 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:15:15.366 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:15:15.366 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:15:15.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:15.366 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-22T09:15:15.366 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-22T09:15:15.366 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:15:15.366 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:15:15.366 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:15:15.366 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-22T09:15:16.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:16.184 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-22T09:15:16.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:16.238 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2023-12-22T09:15:16.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:16.290 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-22T09:15:16.290 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-22T09:15:16.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T09:15:16.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-22T09:15:16.290 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-22T09:15:16.427 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-22T09:15:16.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:16.427 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-22T09:15:16.428 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-22T09:15:16.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-22T09:15:16.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-22T09:15:16.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-22T09:15:16.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-22T09:15:16.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-22T09:15:16.428 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-22T09:15:16.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:16.697 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-22T09:15:16.697 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-22T09:15:16.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-22T09:15:16.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2023-12-22T09:15:16.697 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-22T09:15:16.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:15:16.863 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T09:15:16.914 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:15:16.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:15:16.914 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:15:16.965 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T09:15:16.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:16.965 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:15:17.114 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:15:17.114 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-22T09:15:17.114 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:15:17.540 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:15:17.540 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-22T09:15:17.540 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:15:17.540 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:15:17.540 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:15:17.573 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:15:17.573 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-22T09:15:17.573 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:15:17.573 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:15:17.574 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:15:17.574 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790" 2023-12-22T09:15:17.574 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2023-12-22T09:15:17.574 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c9422aac-a1e3-428b-87d0-2dbf321c6b46" will pass to kernel 2023-12-22T09:15:17.578 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T09:15:17.578 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-12-22T09:15:17.578 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T09:15:17.578 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T09:15:17.579 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T09:15:17.583 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T09:15:17.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:17.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:15:17.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:17.680 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:15:17.739 INFO:teuthology.orchestra.run.smithi132.stdout:client4836 2023-12-22T09:15:17.739 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:15:17.739 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:15:17.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:17.792 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:15:17.845 INFO:teuthology.orchestra.run.smithi132.stdout:client4836 2023-12-22T09:15:17.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:17.846 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:15:17.899 INFO:teuthology.orchestra.run.smithi132.stdout:client4836 2023-12-22T09:15:17.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:17.899 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c9422aac-a1e3-428b-87d0-2dbf321c6b46.client4836/status') 2023-12-22T09:15:17.984 INFO:teuthology.orchestra.run.smithi132.stdout:instance: client.4836 (3)172.21.15.132:0/760063054 2023-12-22T09:15:17.984 INFO:teuthology.orchestra.run.smithi132.stdout:blocklisted: false 2023-12-22T09:15:17.984 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2023-12-22T09:15:17.984 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2023-12-22T09:15:17.984 INFO:teuthology.orchestra.run.smithi132.stderr:70 bytes copied, 5.9988e-05 s, 1.2 MB/s 2023-12-22T09:15:17.988 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-22T09:15:18.005 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.223+0000 7facfeeaf640 1 Processor -- start 2023-12-22T09:15:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.224+0000 7facfeeaf640 1 -- start start 2023-12-22T09:15:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.225+0000 7facfeeaf640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facf8157c80 0x7facf8070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.225+0000 7facfeeaf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7facf80be700 0x7facf8071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.225+0000 7facfeeaf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf8153e90 con 0x7facf8069e60 2023-12-22T09:15:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.225+0000 7facfeeaf640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf8153c80 con 0x7facf8157c80 2023-12-22T09:15:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.225+0000 7facfeeaf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf8158240 con 0x7facf80be700 2023-12-22T09:15:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.225+0000 7facf7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facf8157c80 0x7facf8070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.226+0000 7facf7fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facf8157c80 0x7facf8070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37608/0 (socket says 172.21.15.106:37608) 2023-12-22T09:15:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.226+0000 7facf7fff640 1 -- 172.21.15.106:0/875854570 learned_addr learned my addr 172.21.15.106:0/875854570 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.226+0000 7facfd44c640 1 --2- 172.21.15.106:0/875854570 >> v2:172.21.15.132:3300/0 conn(0x7facf80be700 0x7facf8071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.226+0000 7facf7fff640 1 -- 172.21.15.106:0/875854570 >> v2:172.21.15.132:3300/0 conn(0x7facf80be700 msgr2=0x7facf8071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.226+0000 7facf7fff640 1 --2- 172.21.15.106:0/875854570 >> v2:172.21.15.132:3300/0 conn(0x7facf80be700 0x7facf8071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.226+0000 7facf7fff640 1 -- 172.21.15.106:0/875854570 >> v1:172.21.15.132:6789/0 conn(0x7facf8069e60 legacy=0x7facf813cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.226+0000 7facf7fff640 1 -- 172.21.15.106:0/875854570 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8154c10 con 0x7facf8157c80 2023-12-22T09:15:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.227+0000 7facf7fff640 1 --2- 172.21.15.106:0/875854570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf8157c80 0x7facf8070ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facf80701c0 tx=0x7face402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a217701cdac7e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.227+0000 7facf77fe640 1 -- 172.21.15.106:0/875854570 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face40317e0 con 0x7facf8157c80 2023-12-22T09:15:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.227+0000 7facf77fe640 1 -- 172.21.15.106:0/875854570 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face4031940 con 0x7facf8157c80 2023-12-22T09:15:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.227+0000 7facf77fe640 1 -- 172.21.15.106:0/875854570 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4031cd0 con 0x7facf8157c80 2023-12-22T09:15:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.228+0000 7facfeeaf640 1 -- 172.21.15.106:0/875854570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf8157c80 msgr2=0x7facf8070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.228+0000 7facfeeaf640 1 --2- 172.21.15.106:0/875854570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf8157c80 0x7facf8070ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facf80701c0 tx=0x7face402b880 comp rx=0 tx=0).stop 2023-12-22T09:15:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.228+0000 7facfeeaf640 1 -- 172.21.15.106:0/875854570 shutdown_connections 2023-12-22T09:15:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.228+0000 7facfeeaf640 1 --2- 172.21.15.106:0/875854570 >> v2:172.21.15.132:3300/0 conn(0x7facf80be700 0x7facf8071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.228+0000 7facfeeaf640 1 --2- 172.21.15.106:0/875854570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf8157c80 0x7facf8070ac0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.228+0000 7facfeeaf640 1 -- 172.21.15.106:0/875854570 >> 172.21.15.106:0/875854570 conn(0x7facf80c5360 msgr2=0x7facf80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.228+0000 7facfeeaf640 1 -- 172.21.15.106:0/875854570 shutdown_connections 2023-12-22T09:15:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.228+0000 7facfeeaf640 1 -- 172.21.15.106:0/875854570 wait complete. 2023-12-22T09:15:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.230+0000 7facfeeaf640 1 Processor -- start 2023-12-22T09:15:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.230+0000 7facfeeaf640 1 -- start start 2023-12-22T09:15:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.231+0000 7facfeeaf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf8069e60 0x7facf80a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.231+0000 7facfeeaf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf80be700 0x7facf80c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.231+0000 7facfeeaf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf8157c80 0x7facf8134e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.231+0000 7facfeeaf640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf81ec3b0 con 0x7facf80be700 2023-12-22T09:15:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.231+0000 7facfeeaf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf81ec690 con 0x7facf8069e60 2023-12-22T09:15:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.231+0000 7facfeeaf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf81ec970 con 0x7facf8157c80 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.231+0000 7facf7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf80be700 0x7facf80c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.231+0000 7facf7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf80be700 0x7facf80c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37622/0 (socket says 172.21.15.106:37622) 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.231+0000 7facf7fff640 1 -- 172.21.15.106:0/3086191618 learned_addr learned my addr 172.21.15.106:0/3086191618 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facfd44c640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf8157c80 0x7facf8134e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facfcc4b640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf8069e60 0x7facf80a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facf7fff640 1 -- 172.21.15.106:0/3086191618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf8157c80 msgr2=0x7facf8134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facf7fff640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf8157c80 0x7facf8134e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facf7fff640 1 -- 172.21.15.106:0/3086191618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf8069e60 msgr2=0x7facf80a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facf7fff640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf8069e60 0x7facf80a87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facf7fff640 1 -- 172.21.15.106:0/3086191618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40094d0 con 0x7facf80be700 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facfd44c640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf8157c80 0x7facf8134e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facf7fff640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf80be700 0x7facf80c4650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7face402b8c0 tx=0x7face40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facf57fa640 1 -- 172.21.15.106:0/3086191618 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4032880 con 0x7facf80be700 2023-12-22T09:15:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facf57fa640 1 -- 172.21.15.106:0/3086191618 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face40329e0 con 0x7facf80be700 2023-12-22T09:15:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facf57fa640 1 -- 172.21.15.106:0/3086191618 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4032d90 con 0x7facf80be700 2023-12-22T09:15:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.232+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf81ecc50 con 0x7facf80be700 2023-12-22T09:15:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.233+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf813c190 con 0x7facf80be700 2023-12-22T09:15:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.234+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf81ed170 con 0x7facf80be700 2023-12-22T09:15:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.235+0000 7facf57fa640 1 -- 172.21.15.106:0/3086191618 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7face404e450 con 0x7facf80be700 2023-12-22T09:15:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.235+0000 7facf57fa640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7facdc06a460 0x7facdc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.236+0000 7facf57fa640 1 -- 172.21.15.106:0/3086191618 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7face40aad20 con 0x7facf80be700 2023-12-22T09:15:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.236+0000 7facfcc4b640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7facdc06a460 0x7facdc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.236+0000 7facfcc4b640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7facdc06a460 0x7facdc06c920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7facf80c1050 tx=0x7facec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:18.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.240+0000 7facf57fa640 1 -- 172.21.15.106:0/3086191618 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7facf81ed170 con 0x7facf80be700 2023-12-22T09:15:18.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.430+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facf81ed170 con 0x7facf80be700 2023-12-22T09:15:18.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.433+0000 7facf57fa640 1 -- 172.21.15.106:0/3086191618 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7facf81ed170 con 0x7facf80be700 2023-12-22T09:15:18.434 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:18.434 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:18.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.435+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7facdc06a460 msgr2=0x7facdc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.435+0000 7facfeeaf640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7facdc06a460 0x7facdc06c920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7facf80c1050 tx=0x7facec009040 comp rx=0 tx=0).stop 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.435+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf80be700 msgr2=0x7facf80c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.435+0000 7facfeeaf640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf80be700 0x7facf80c4650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7face402b8c0 tx=0x7face40046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.436+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 shutdown_connections 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.436+0000 7facfeeaf640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7facdc06a460 0x7facdc06c920 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.436+0000 7facfeeaf640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7facf8157c80 0x7facf8134e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.436+0000 7facfeeaf640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facf80be700 0x7facf80c4650 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.436+0000 7facfeeaf640 1 --2- 172.21.15.106:0/3086191618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf8069e60 0x7facf80a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.436+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 >> 172.21.15.106:0/3086191618 conn(0x7facf80c5360 msgr2=0x7facf80c1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.436+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 shutdown_connections 2023-12-22T09:15:18.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.436+0000 7facfeeaf640 1 -- 172.21.15.106:0/3086191618 wait complete. 2023-12-22T09:15:18.454 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:18.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:18.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.670+0000 7feac329e640 1 Processor -- start 2023-12-22T09:15:18.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.670+0000 7feac329e640 1 -- start start 2023-12-22T09:15:18.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac329e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feabc0c1e00 0x7feabc13ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac329e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feabc06cd10 0x7feabc157e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac329e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc1572b0 con 0x7feabc153cc0 2023-12-22T09:15:18.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac329e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc0bfb00 con 0x7feabc0c1e00 2023-12-22T09:15:18.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac329e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc154240 con 0x7feabc06cd10 2023-12-22T09:15:18.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac229c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feabc0c1e00 0x7feabc13ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac229c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feabc0c1e00 0x7feabc13ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37638/0 (socket says 172.21.15.106:37638) 2023-12-22T09:15:18.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac229c640 1 -- 172.21.15.106:0/2774413223 learned_addr learned my addr 172.21.15.106:0/2774413223 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:18.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac229c640 1 -- 172.21.15.106:0/2774413223 >> v2:172.21.15.132:3300/0 conn(0x7feabc06cd10 msgr2=0x7feabc157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:18.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.672+0000 7feac2a9d640 1 --2- 172.21.15.106:0/2774413223 >> v2:172.21.15.132:3300/0 conn(0x7feabc06cd10 0x7feabc157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.673+0000 7feac229c640 1 --2- 172.21.15.106:0/2774413223 >> v2:172.21.15.132:3300/0 conn(0x7feabc06cd10 0x7feabc157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.673+0000 7feac229c640 1 -- 172.21.15.106:0/2774413223 >> v1:172.21.15.132:6789/0 conn(0x7feabc153cc0 legacy=0x7feabc157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.673+0000 7feac229c640 1 -- 172.21.15.106:0/2774413223 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc154520 con 0x7feabc0c1e00 2023-12-22T09:15:18.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.673+0000 7feac2a9d640 1 --2- 172.21.15.106:0/2774413223 >> v2:172.21.15.132:3300/0 conn(0x7feabc06cd10 0x7feabc157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:18.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.674+0000 7feac229c640 1 --2- 172.21.15.106:0/2774413223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 0x7feabc13ca00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feabc0c0c10 tx=0x7feab802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9a42c560c42398 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:18.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.674+0000 7feac129a640 1 -- 172.21.15.106:0/2774413223 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab80317e0 con 0x7feabc0c1e00 2023-12-22T09:15:18.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.674+0000 7feac129a640 1 -- 172.21.15.106:0/2774413223 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab8031940 con 0x7feabc0c1e00 2023-12-22T09:15:18.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.674+0000 7feac129a640 1 -- 172.21.15.106:0/2774413223 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8031cd0 con 0x7feabc0c1e00 2023-12-22T09:15:18.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.675+0000 7feac329e640 1 -- 172.21.15.106:0/2774413223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 msgr2=0x7feabc13ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.675+0000 7feac329e640 1 --2- 172.21.15.106:0/2774413223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 0x7feabc13ca00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feabc0c0c10 tx=0x7feab802b880 comp rx=0 tx=0).stop 2023-12-22T09:15:18.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.675+0000 7feac329e640 1 -- 172.21.15.106:0/2774413223 shutdown_connections 2023-12-22T09:15:18.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.675+0000 7feac329e640 1 --2- 172.21.15.106:0/2774413223 >> v2:172.21.15.132:3300/0 conn(0x7feabc06cd10 0x7feabc157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.675+0000 7feac329e640 1 --2- 172.21.15.106:0/2774413223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 0x7feabc13ca00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.675+0000 7feac329e640 1 -- 172.21.15.106:0/2774413223 >> 172.21.15.106:0/2774413223 conn(0x7feabc069bf0 msgr2=0x7feabc069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:18.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.675+0000 7feac329e640 1 -- 172.21.15.106:0/2774413223 shutdown_connections 2023-12-22T09:15:18.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.675+0000 7feac329e640 1 -- 172.21.15.106:0/2774413223 wait complete. 2023-12-22T09:15:18.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.677+0000 7feac329e640 1 Processor -- start 2023-12-22T09:15:18.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.677+0000 7feac329e640 1 -- start start 2023-12-22T09:15:18.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.678+0000 7feac329e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feabc06cd10 0x7feabc1e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.678+0000 7feac329e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 0x7feabc06a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.678+0000 7feac329e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feabc153cc0 0x7feabc1ec420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.678+0000 7feac329e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0a8580 con 0x7feabc0c1e00 2023-12-22T09:15:18.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.678+0000 7feac329e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc157140 con 0x7feabc06cd10 2023-12-22T09:15:18.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.678+0000 7feac329e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1ebf90 con 0x7feabc153cc0 2023-12-22T09:15:18.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.678+0000 7feac1a9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 0x7feabc06a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.678+0000 7feac1a9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 0x7feabc06a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37652/0 (socket says 172.21.15.106:37652) 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.678+0000 7feac1a9b640 1 -- 172.21.15.106:0/3722076190 learned_addr learned my addr 172.21.15.106:0/3722076190 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feac229c640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feabc06cd10 0x7feabc1e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feac2a9d640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feabc153cc0 0x7feabc1ec420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feac1a9b640 1 -- 172.21.15.106:0/3722076190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feabc153cc0 msgr2=0x7feabc1ec420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feac1a9b640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feabc153cc0 0x7feabc1ec420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feac1a9b640 1 -- 172.21.15.106:0/3722076190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feabc06cd10 msgr2=0x7feabc1e92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feac1a9b640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feabc06cd10 0x7feabc1e92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feac1a9b640 1 -- 172.21.15.106:0/3722076190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab80094d0 con 0x7feabc0c1e00 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feac1a9b640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 0x7feabc06a240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feaac00c450 tx=0x7feaac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feab2ffd640 1 -- 172.21.15.106:0/3722076190 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac0052d0 con 0x7feabc0c1e00 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feab2ffd640 1 -- 172.21.15.106:0/3722076190 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac005430 con 0x7feabc0c1e00 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feab2ffd640 1 -- 172.21.15.106:0/3722076190 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac012870 con 0x7feabc0c1e00 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.679+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc137810 con 0x7feabc0c1e00 2023-12-22T09:15:18.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.680+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc137d90 con 0x7feabc0c1e00 2023-12-22T09:15:18.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.681+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc1e9830 con 0x7feabc0c1e00 2023-12-22T09:15:18.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.682+0000 7feab2ffd640 1 -- 172.21.15.106:0/3722076190 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feaac0129d0 con 0x7feabc0c1e00 2023-12-22T09:15:18.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.683+0000 7feab2ffd640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feaa006a430 0x7feaa006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:18.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.683+0000 7feab2ffd640 1 -- 172.21.15.106:0/3722076190 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feaac088840 con 0x7feabc0c1e00 2023-12-22T09:15:18.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.683+0000 7feac229c640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feaa006a430 0x7feaa006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:18.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.684+0000 7feac229c640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feaa006a430 0x7feaa006c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feab8036000 tx=0x7feab803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:18.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.687+0000 7feab2ffd640 1 -- 172.21.15.106:0/3722076190 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feaac053a70 con 0x7feabc0c1e00 2023-12-22T09:15:18.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.879+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feabc04e8d0 con 0x7feabc0c1e00 2023-12-22T09:15:18.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.880+0000 7feab2ffd640 1 -- 172.21.15.106:0/3722076190 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7feaac057090 con 0x7feabc0c1e00 2023-12-22T09:15:18.880 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feaa006a430 msgr2=0x7feaa006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feaa006a430 0x7feaa006c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feab8036000 tx=0x7feab803d040 comp rx=0 tx=0).stop 2023-12-22T09:15:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 msgr2=0x7feabc06a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 0x7feabc06a240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feaac00c450 tx=0x7feaac00c910 comp rx=0 tx=0).stop 2023-12-22T09:15:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 shutdown_connections 2023-12-22T09:15:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7feaa006a430 0x7feaa006c8f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feabc153cc0 0x7feabc1ec420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feabc0c1e00 0x7feabc06a240 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 --2- 172.21.15.106:0/3722076190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feabc06cd10 0x7feabc1e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 >> 172.21.15.106:0/3722076190 conn(0x7feabc069bf0 msgr2=0x7feabc13b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 shutdown_connections 2023-12-22T09:15:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:18.883+0000 7feac329e640 1 -- 172.21.15.106:0/3722076190 wait complete. 2023-12-22T09:15:18.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:19.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.114+0000 7fcb5c477640 1 Processor -- start 2023-12-22T09:15:19.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.114+0000 7fcb5c477640 1 -- start start 2023-12-22T09:15:19.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.115+0000 7fcb5c477640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb540c5a30 0x7fcb540c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.115+0000 7fcb5c477640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb5406bdc0 0x7fcb541550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb5c477640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb5406c2d0 0x7fcb54155620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb5c477640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb540a90f0 con 0x7fcb5406bdc0 2023-12-22T09:15:19.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb5c477640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5414f570 con 0x7fcb5406c2d0 2023-12-22T09:15:19.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb5c477640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540c0b00 con 0x7fcb540c5a30 2023-12-22T09:15:19.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb59a12640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb5406bdc0 0x7fcb541550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb59a12640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb5406bdc0 0x7fcb541550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37656/0 (socket says 172.21.15.106:37656) 2023-12-22T09:15:19.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb59a12640 1 -- 172.21.15.106:0/4185500353 learned_addr learned my addr 172.21.15.106:0/4185500353 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:19.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb5aa14640 1 --2- 172.21.15.106:0/4185500353 >> v2:172.21.15.132:3300/0 conn(0x7fcb5406c2d0 0x7fcb54155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb5a213640 1 --2- 172.21.15.106:0/4185500353 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb540c5a30 0x7fcb540c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb59a12640 1 -- 172.21.15.106:0/4185500353 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb540c5a30 msgr2=0x7fcb540c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:19.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb59a12640 1 --2- 172.21.15.106:0/4185500353 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb540c5a30 0x7fcb540c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.116+0000 7fcb59a12640 1 -- 172.21.15.106:0/4185500353 >> v2:172.21.15.132:3300/0 conn(0x7fcb5406c2d0 msgr2=0x7fcb54155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.117+0000 7fcb59a12640 1 --2- 172.21.15.106:0/4185500353 >> v2:172.21.15.132:3300/0 conn(0x7fcb5406c2d0 0x7fcb54155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.117+0000 7fcb59a12640 1 -- 172.21.15.106:0/4185500353 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540bfd40 con 0x7fcb5406bdc0 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.117+0000 7fcb5a213640 1 --2- 172.21.15.106:0/4185500353 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb540c5a30 0x7fcb540c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.117+0000 7fcb5aa14640 1 --2- 172.21.15.106:0/4185500353 >> v2:172.21.15.132:3300/0 conn(0x7fcb5406c2d0 0x7fcb54155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.118+0000 7fcb59a12640 1 --2- 172.21.15.106:0/4185500353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406bdc0 0x7fcb541550e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb5406b820 tx=0x7fcb4402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf38e0ea618bd49f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.118+0000 7fcb59211640 1 -- 172.21.15.106:0/4185500353 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44031880 con 0x7fcb5406bdc0 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.118+0000 7fcb59211640 1 -- 172.21.15.106:0/4185500353 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb440319e0 con 0x7fcb5406bdc0 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.118+0000 7fcb59211640 1 -- 172.21.15.106:0/4185500353 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44031d70 con 0x7fcb5406bdc0 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.119+0000 7fcb5c477640 1 -- 172.21.15.106:0/4185500353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406bdc0 msgr2=0x7fcb541550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.119+0000 7fcb5c477640 1 --2- 172.21.15.106:0/4185500353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406bdc0 0x7fcb541550e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb5406b820 tx=0x7fcb4402b920 comp rx=0 tx=0).stop 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.119+0000 7fcb5c477640 1 -- 172.21.15.106:0/4185500353 shutdown_connections 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.119+0000 7fcb5c477640 1 --2- 172.21.15.106:0/4185500353 >> v2:172.21.15.132:3300/0 conn(0x7fcb5406c2d0 0x7fcb54155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.119+0000 7fcb5c477640 1 --2- 172.21.15.106:0/4185500353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406bdc0 0x7fcb541550e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.119+0000 7fcb5c477640 1 --2- 172.21.15.106:0/4185500353 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb540c5a30 0x7fcb540c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.119+0000 7fcb5c477640 1 -- 172.21.15.106:0/4185500353 >> 172.21.15.106:0/4185500353 conn(0x7fcb5406a220 msgr2=0x7fcb540c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.119+0000 7fcb5c477640 1 -- 172.21.15.106:0/4185500353 shutdown_connections 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.119+0000 7fcb5c477640 1 -- 172.21.15.106:0/4185500353 wait complete. 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.121+0000 7fcb5c477640 1 Processor -- start 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.121+0000 7fcb5c477640 1 -- start start 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb5c477640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb5406bdc0 0x7fcb54143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb5c477640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406c2d0 0x7fcb54070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb5c477640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb540c5a30 0x7fcb540bece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb5c477640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5406fe60 con 0x7fcb5406c2d0 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb5c477640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54143970 con 0x7fcb540c5a30 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb5c477640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540719d0 con 0x7fcb5406bdc0 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb59a12640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406c2d0 0x7fcb54070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb59a12640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406c2d0 0x7fcb54070b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37662/0 (socket says 172.21.15.106:37662) 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb59a12640 1 -- 172.21.15.106:0/1618277151 learned_addr learned my addr 172.21.15.106:0/1618277151 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.122+0000 7fcb5a213640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb5406bdc0 0x7fcb54143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb5aa14640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb540c5a30 0x7fcb540bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb59a12640 1 -- 172.21.15.106:0/1618277151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb5406bdc0 msgr2=0x7fcb54143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb59a12640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb5406bdc0 0x7fcb54143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb59a12640 1 -- 172.21.15.106:0/1618277151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb540c5a30 msgr2=0x7fcb540bece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb59a12640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb540c5a30 0x7fcb540bece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb59a12640 1 -- 172.21.15.106:0/1618277151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb440094d0 con 0x7fcb5406c2d0 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb5aa14640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb540c5a30 0x7fcb540bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb59a12640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406c2d0 0x7fcb54070b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb4402b960 tx=0x7fcb440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb4affd640 1 -- 172.21.15.106:0/1618277151 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44031850 con 0x7fcb5406c2d0 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb4affd640 1 -- 172.21.15.106:0/1618277151 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb440443f0 con 0x7fcb5406c2d0 2023-12-22T09:15:19.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb540700b0 con 0x7fcb5406c2d0 2023-12-22T09:15:19.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb4affd640 1 -- 172.21.15.106:0/1618277151 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb440447a0 con 0x7fcb5406c2d0 2023-12-22T09:15:19.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.123+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb54070670 con 0x7fcb5406c2d0 2023-12-22T09:15:19.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.125+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb54073f10 con 0x7fcb5406c2d0 2023-12-22T09:15:19.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.126+0000 7fcb4affd640 1 -- 172.21.15.106:0/1618277151 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb44044900 con 0x7fcb5406c2d0 2023-12-22T09:15:19.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.127+0000 7fcb4affd640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3806a430 0x7fcb3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.127+0000 7fcb4affd640 1 -- 172.21.15.106:0/1618277151 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb440ab6d0 con 0x7fcb5406c2d0 2023-12-22T09:15:19.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.127+0000 7fcb5a213640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3806a430 0x7fcb3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.128+0000 7fcb5a213640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3806a430 0x7fcb3806c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb541ea760 tx=0x7fcb50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:19.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.132+0000 7fcb4affd640 1 -- 172.21.15.106:0/1618277151 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcb44076a10 con 0x7fcb5406c2d0 2023-12-22T09:15:19.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.321+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb540c02d0 con 0x7fcb5406c2d0 2023-12-22T09:15:19.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.322+0000 7fcb4affd640 1 -- 172.21.15.106:0/1618277151 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb4407a030 con 0x7fcb5406c2d0 2023-12-22T09:15:19.323 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:19.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3806a430 msgr2=0x7fcb3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3806a430 0x7fcb3806c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb541ea760 tx=0x7fcb50008040 comp rx=0 tx=0).stop 2023-12-22T09:15:19.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406c2d0 msgr2=0x7fcb54070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406c2d0 0x7fcb54070b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb4402b960 tx=0x7fcb440046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 shutdown_connections 2023-12-22T09:15:19.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3806a430 0x7fcb3806c8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb540c5a30 0x7fcb540bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5406c2d0 0x7fcb54070b90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 --2- 172.21.15.106:0/1618277151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb5406bdc0 0x7fcb54143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 >> 172.21.15.106:0/1618277151 conn(0x7fcb5406a220 msgr2=0x7fcb5414db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:19.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 shutdown_connections 2023-12-22T09:15:19.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.325+0000 7fcb5c477640 1 -- 172.21.15.106:0/1618277151 wait complete. 2023-12-22T09:15:19.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:19.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.562+0000 7f6c2aa0e640 1 Processor -- start 2023-12-22T09:15:19.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.563+0000 7f6c2aa0e640 1 -- start start 2023-12-22T09:15:19.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.564+0000 7f6c2aa0e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c241486b0 0x7f6c240a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.564+0000 7f6c2aa0e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c24151970 con 0x7f6c240c2830 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.564+0000 7f6c2aa0e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c24151bc0 con 0x7f6c240a83c0 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.564+0000 7f6c2aa0e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240aabf0 con 0x7f6c241486b0 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c2a20d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6c240c2830 0x7f6c240aa4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53054/0 (socket says 172.21.15.106:53054) 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c2a20d640 1 -- 172.21.15.106:0/2964548511 learned_addr learned my addr 172.21.15.106:0/2964548511 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c2920b640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c241486b0 0x7f6c240a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200973562 0 0) 0x7f6c24151970 con 0x7f6c240c2830 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c10003520 con 0x7f6c240c2830 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 380523689 0 0) 0x7f6c10003520 con 0x7f6c240c2830 2023-12-22T09:15:19.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c241486b0 msgr2=0x7f6c240a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c241486b0 0x7f6c240a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 >> v1:172.21.15.132:6789/0 conn(0x7f6c240a83c0 legacy=0x7f6c24147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c24151ea0 con 0x7f6c240c2830 2023-12-22T09:15:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f6c1c0019f0 con 0x7f6c240c2830 2023-12-22T09:15:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 >> v1:172.21.15.106:6789/0 conn(0x7f6c240c2830 legacy=0x7f6c240aa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.565+0000 7f6c28a0a640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c100039a0 0x7f6c10003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c28a0a640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c241486b0 0x7f6c100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c28a0a640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c10004d00 0x7f6c10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1000bb10 con 0x7f6c100039a0 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1000bc50 con 0x7f6c10004d00 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1000be10 con 0x7f6c241486b0 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c29a0c640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c100039a0 0x7f6c10003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c2a20d640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c10004d00 0x7f6c10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c2920b640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c241486b0 0x7f6c100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c29a0c640 1 -- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c241486b0 msgr2=0x7f6c100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c29a0c640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c241486b0 0x7f6c100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c29a0c640 1 -- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c10004d00 msgr2=0x7f6c10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c29a0c640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c10004d00 0x7f6c10005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.566+0000 7f6c29a0c640 1 -- 172.21.15.106:0/2964548511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10003520 con 0x7f6c100039a0 2023-12-22T09:15:19.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.567+0000 7f6c29a0c640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c100039a0 0x7f6c10003dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c20001750 tx=0x7f6c100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18abbd5803891e65 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:19.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c200052d0 con 0x7f6c100039a0 2023-12-22T09:15:19.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2002e050 con 0x7f6c100039a0 2023-12-22T09:15:19.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c28a0a640 1 -- 172.21.15.106:0/2964548511 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c200035f0 con 0x7f6c100039a0 2023-12-22T09:15:19.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/2964548511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c100039a0 msgr2=0x7f6c10003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c2aa0e640 1 --2- 172.21.15.106:0/2964548511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c100039a0 0x7f6c10003dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c20001750 tx=0x7f6c100057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c2a20d640 1 -- 172.21.15.106:0/2964548511 reap_dead start 2023-12-22T09:15:19.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/2964548511 shutdown_connections 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/2964548511 >> 172.21.15.106:0/2964548511 conn(0x7f6c24069bf0 msgr2=0x7f6c24069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/2964548511 shutdown_connections 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.568+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/2964548511 wait complete. 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.570+0000 7f6c2aa0e640 1 Processor -- start 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.570+0000 7f6c2aa0e640 1 -- start start 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.571+0000 7f6c2aa0e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c100039a0 0x7f6c240a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.571+0000 7f6c2aa0e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2413fbe0 0x7f6c241e9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.571+0000 7f6c2aa0e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240aa4a0 0x7f6c241e98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.571+0000 7f6c2aa0e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240c0630 con 0x7f6c2413fbe0 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.571+0000 7f6c2aa0e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240be930 con 0x7f6c100039a0 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.571+0000 7f6c2aa0e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241e8ef0 con 0x7f6c240aa4a0 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.571+0000 7f6c2920b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2413fbe0 0x7f6c241e9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.571+0000 7f6c2920b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2413fbe0 0x7f6c241e9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37672/0 (socket says 172.21.15.106:37672) 2023-12-22T09:15:19.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.571+0000 7f6c2920b640 1 -- 172.21.15.106:0/3328911127 learned_addr learned my addr 172.21.15.106:0/3328911127 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:19.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.572+0000 7f6c29a0c640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c100039a0 0x7f6c240a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.572+0000 7f6c2a20d640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240aa4a0 0x7f6c241e98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.572+0000 7f6c2920b640 1 -- 172.21.15.106:0/3328911127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240aa4a0 msgr2=0x7f6c241e98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.572+0000 7f6c2920b640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240aa4a0 0x7f6c241e98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.572+0000 7f6c2920b640 1 -- 172.21.15.106:0/3328911127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c100039a0 msgr2=0x7f6c240a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.572+0000 7f6c2920b640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c100039a0 0x7f6c240a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.572+0000 7f6c2920b640 1 -- 172.21.15.106:0/3328911127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240c2290 con 0x7f6c2413fbe0 2023-12-22T09:15:19.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.572+0000 7f6c2920b640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2413fbe0 0x7f6c241e9380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400f550 tx=0x7f6c1400fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:19.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.572+0000 7f6c1a7fc640 1 -- 172.21.15.106:0/3328911127 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14004020 con 0x7f6c2413fbe0 2023-12-22T09:15:19.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.573+0000 7f6c1a7fc640 1 -- 172.21.15.106:0/3328911127 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14004180 con 0x7f6c2413fbe0 2023-12-22T09:15:19.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.573+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c240c1710 con 0x7f6c2413fbe0 2023-12-22T09:15:19.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.573+0000 7f6c1a7fc640 1 -- 172.21.15.106:0/3328911127 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14014670 con 0x7f6c2413fbe0 2023-12-22T09:15:19.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.573+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c240c1cd0 con 0x7f6c2413fbe0 2023-12-22T09:15:19.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.574+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2404e8d0 con 0x7f6c2413fbe0 2023-12-22T09:15:19.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.575+0000 7f6c1a7fc640 1 -- 172.21.15.106:0/3328911127 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c140147d0 con 0x7f6c2413fbe0 2023-12-22T09:15:19.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.576+0000 7f6c1a7fc640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c0806a430 0x7f6c0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:19.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.576+0000 7f6c1a7fc640 1 -- 172.21.15.106:0/3328911127 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c14089230 con 0x7f6c2413fbe0 2023-12-22T09:15:19.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.576+0000 7f6c29a0c640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c0806a430 0x7f6c0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:19.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.577+0000 7f6c29a0c640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c0806a430 0x7f6c0806c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6c20001750 tx=0x7f6c20009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:19.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.580+0000 7f6c1a7fc640 1 -- 172.21.15.106:0/3328911127 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6c14054460 con 0x7f6c2413fbe0 2023-12-22T09:15:19.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.770+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c240c2610 con 0x7f6c2413fbe0 2023-12-22T09:15:19.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.771+0000 7f6c1a7fc640 1 -- 172.21.15.106:0/3328911127 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c14057a80 con 0x7f6c2413fbe0 2023-12-22T09:15:19.772 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.773+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c0806a430 msgr2=0x7f6c0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.773+0000 7f6c2aa0e640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c0806a430 0x7f6c0806c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6c20001750 tx=0x7f6c20009030 comp rx=0 tx=0).stop 2023-12-22T09:15:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.773+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2413fbe0 msgr2=0x7f6c241e9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.773+0000 7f6c2aa0e640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2413fbe0 0x7f6c241e9380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400f550 tx=0x7f6c1400fa10 comp rx=0 tx=0).stop 2023-12-22T09:15:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.774+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 shutdown_connections 2023-12-22T09:15:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.774+0000 7f6c2aa0e640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c0806a430 0x7f6c0806c8f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.774+0000 7f6c2aa0e640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240aa4a0 0x7f6c241e98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.774+0000 7f6c2aa0e640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2413fbe0 0x7f6c241e9380 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.774+0000 7f6c2aa0e640 1 --2- 172.21.15.106:0/3328911127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c100039a0 0x7f6c240a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.774+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 >> 172.21.15.106:0/3328911127 conn(0x7f6c24069bf0 msgr2=0x7f6c241426a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.774+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 shutdown_connections 2023-12-22T09:15:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:19.774+0000 7f6c2aa0e640 1 -- 172.21.15.106:0/3328911127 wait complete. 2023-12-22T09:15:19.794 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:20.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.009+0000 7fbf7eb0a640 1 Processor -- start 2023-12-22T09:15:20.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.009+0000 7fbf7eb0a640 1 -- start start 2023-12-22T09:15:20.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.011+0000 7fbf7eb0a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbf7806bdc0 0x7fbf781557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.011+0000 7fbf7eb0a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbf7806c2d0 0x7fbf780c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.011+0000 7fbf7eb0a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7814f570 con 0x7fbf780c5a30 2023-12-22T09:15:20.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.011+0000 7fbf7eb0a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780a90f0 con 0x7fbf7806bdc0 2023-12-22T09:15:20.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.011+0000 7fbf7eb0a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780c0b00 con 0x7fbf7806c2d0 2023-12-22T09:15:20.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.011+0000 7fbf77fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbf7806bdc0 0x7fbf781557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.011+0000 7fbf77fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbf7806bdc0 0x7fbf781557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37674/0 (socket says 172.21.15.106:37674) 2023-12-22T09:15:20.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.011+0000 7fbf77fff640 1 -- 172.21.15.106:0/3249248742 learned_addr learned my addr 172.21.15.106:0/3249248742 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:20.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.012+0000 7fbf7d0a7640 1 --2- 172.21.15.106:0/3249248742 >> v2:172.21.15.132:3300/0 conn(0x7fbf7806c2d0 0x7fbf780c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.012+0000 7fbf77fff640 1 -- 172.21.15.106:0/3249248742 >> v2:172.21.15.132:3300/0 conn(0x7fbf7806c2d0 msgr2=0x7fbf780c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:20.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.012+0000 7fbf77fff640 1 --2- 172.21.15.106:0/3249248742 >> v2:172.21.15.132:3300/0 conn(0x7fbf7806c2d0 0x7fbf780c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.012+0000 7fbf77fff640 1 -- 172.21.15.106:0/3249248742 >> v1:172.21.15.106:6789/0 conn(0x7fbf780c5a30 legacy=0x7fbf781550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.012+0000 7fbf77fff640 1 -- 172.21.15.106:0/3249248742 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780bfd40 con 0x7fbf7806bdc0 2023-12-22T09:15:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.013+0000 7fbf77fff640 1 --2- 172.21.15.106:0/3249248742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806bdc0 0x7fbf781557f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbf780bf5b0 tx=0x7fbf6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f53327340e75d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.013+0000 7fbf777fe640 1 -- 172.21.15.106:0/3249248742 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68031870 con 0x7fbf7806bdc0 2023-12-22T09:15:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.013+0000 7fbf777fe640 1 -- 172.21.15.106:0/3249248742 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680319d0 con 0x7fbf7806bdc0 2023-12-22T09:15:20.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.013+0000 7fbf777fe640 1 -- 172.21.15.106:0/3249248742 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68031d60 con 0x7fbf7806bdc0 2023-12-22T09:15:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.014+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/3249248742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806bdc0 msgr2=0x7fbf781557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.014+0000 7fbf7eb0a640 1 --2- 172.21.15.106:0/3249248742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806bdc0 0x7fbf781557f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbf780bf5b0 tx=0x7fbf6802b910 comp rx=0 tx=0).stop 2023-12-22T09:15:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.014+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/3249248742 shutdown_connections 2023-12-22T09:15:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.014+0000 7fbf7eb0a640 1 --2- 172.21.15.106:0/3249248742 >> v2:172.21.15.132:3300/0 conn(0x7fbf7806c2d0 0x7fbf780c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.014+0000 7fbf7eb0a640 1 --2- 172.21.15.106:0/3249248742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806bdc0 0x7fbf781557f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.014+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/3249248742 >> 172.21.15.106:0/3249248742 conn(0x7fbf7806a220 msgr2=0x7fbf780c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.014+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/3249248742 shutdown_connections 2023-12-22T09:15:20.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.014+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/3249248742 wait complete. 2023-12-22T09:15:20.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.016+0000 7fbf7eb0a640 1 Processor -- start 2023-12-22T09:15:20.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.016+0000 7fbf7eb0a640 1 -- start start 2023-12-22T09:15:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf7eb0a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf7806bdc0 0x7fbf781e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf7eb0a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806c2d0 0x7fbf781ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf7eb0a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf780c5a30 0x7fbf780bc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf7eb0a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf781eccb0 con 0x7fbf7806c2d0 2023-12-22T09:15:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf7eb0a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf781ea1c0 con 0x7fbf780c5a30 2023-12-22T09:15:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf7eb0a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf781ed680 con 0x7fbf7806bdc0 2023-12-22T09:15:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf77fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806c2d0 0x7fbf781ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf77fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806c2d0 0x7fbf781ed140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37684/0 (socket says 172.21.15.106:37684) 2023-12-22T09:15:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf77fff640 1 -- 172.21.15.106:0/2318995794 learned_addr learned my addr 172.21.15.106:0/2318995794 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.017+0000 7fbf7c8a6640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf7806bdc0 0x7fbf781e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf7d0a7640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf780c5a30 0x7fbf780bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf77fff640 1 -- 172.21.15.106:0/2318995794 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf7806bdc0 msgr2=0x7fbf781e9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf77fff640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf7806bdc0 0x7fbf781e9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf77fff640 1 -- 172.21.15.106:0/2318995794 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf780c5a30 msgr2=0x7fbf780bc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf77fff640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf780c5a30 0x7fbf780bc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf77fff640 1 -- 172.21.15.106:0/2318995794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf680094d0 con 0x7fbf7806c2d0 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf7d0a7640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf780c5a30 0x7fbf780bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf77fff640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806c2d0 0x7fbf781ed140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf6802b950 tx=0x7fbf680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf757fa640 1 -- 172.21.15.106:0/2318995794 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6803ad30 con 0x7fbf7806c2d0 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf757fa640 1 -- 172.21.15.106:0/2318995794 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680443f0 con 0x7fbf7806c2d0 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf78070e60 con 0x7fbf7806c2d0 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf757fa640 1 -- 172.21.15.106:0/2318995794 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680447a0 con 0x7fbf7806c2d0 2023-12-22T09:15:20.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.018+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf78071420 con 0x7fbf7806c2d0 2023-12-22T09:15:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.020+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf78071610 con 0x7fbf7806c2d0 2023-12-22T09:15:20.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.020+0000 7fbf757fa640 1 -- 172.21.15.106:0/2318995794 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf6804d450 con 0x7fbf7806c2d0 2023-12-22T09:15:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.021+0000 7fbf757fa640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf6406a430 0x7fbf6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.021+0000 7fbf757fa640 1 -- 172.21.15.106:0/2318995794 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbf6802d040 con 0x7fbf7806c2d0 2023-12-22T09:15:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.021+0000 7fbf7c8a6640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf6406a430 0x7fbf6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.022+0000 7fbf7c8a6640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf6406a430 0x7fbf6406c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbf780c20c0 tx=0x7fbf6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:20.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.026+0000 7fbf757fa640 1 -- 172.21.15.106:0/2318995794 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbf68076560 con 0x7fbf7806c2d0 2023-12-22T09:15:20.109 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:15:20.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:15:20.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.218+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbf78073f10 con 0x7fbf7806c2d0 2023-12-22T09:15:20.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.219+0000 7fbf757fa640 1 -- 172.21.15.106:0/2318995794 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbf68035020 con 0x7fbf7806c2d0 2023-12-22T09:15:20.220 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf6406a430 msgr2=0x7fbf6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf6406a430 0x7fbf6406c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbf780c20c0 tx=0x7fbf6c009040 comp rx=0 tx=0).stop 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806c2d0 msgr2=0x7fbf781ed140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806c2d0 0x7fbf781ed140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf6802b950 tx=0x7fbf680046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 shutdown_connections 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbf6406a430 0x7fbf6406c8f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf780c5a30 0x7fbf780bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7806c2d0 0x7fbf781ed140 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 --2- 172.21.15.106:0/2318995794 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf7806bdc0 0x7fbf781e9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 >> 172.21.15.106:0/2318995794 conn(0x7fbf7806a220 msgr2=0x7fbf7806d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 shutdown_connections 2023-12-22T09:15:20.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.222+0000 7fbf7eb0a640 1 -- 172.21.15.106:0/2318995794 wait complete. 2023-12-22T09:15:20.240 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:20.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.493+0000 7fd54a155640 1 Processor -- start 2023-12-22T09:15:20.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.493+0000 7fd54a155640 1 -- start start 2023-12-22T09:15:20.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.495+0000 7fd54a155640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd54413b060 0x7fd54406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.495+0000 7fd54a155640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd544151b30 0x7fd544151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.495+0000 7fd54a155640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5440bf770 con 0x7fd5440bfce0 2023-12-22T09:15:20.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.495+0000 7fd54a155640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd544155120 con 0x7fd54413b060 2023-12-22T09:15:20.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.495+0000 7fd54a155640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd544155400 con 0x7fd544151b30 2023-12-22T09:15:20.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.495+0000 7fd5437fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd54413b060 0x7fd54406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.495+0000 7fd5437fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd54413b060 0x7fd54406a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37690/0 (socket says 172.21.15.106:37690) 2023-12-22T09:15:20.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.495+0000 7fd5437fe640 1 -- 172.21.15.106:0/2614437652 learned_addr learned my addr 172.21.15.106:0/2614437652 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:20.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.496+0000 7fd543fff640 1 --2- 172.21.15.106:0/2614437652 >> v2:172.21.15.132:3300/0 conn(0x7fd544151b30 0x7fd544151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.496+0000 7fd5437fe640 1 -- 172.21.15.106:0/2614437652 >> v2:172.21.15.132:3300/0 conn(0x7fd544151b30 msgr2=0x7fd544151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:20.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.496+0000 7fd5437fe640 1 --2- 172.21.15.106:0/2614437652 >> v2:172.21.15.132:3300/0 conn(0x7fd544151b30 0x7fd544151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.496+0000 7fd5437fe640 1 -- 172.21.15.106:0/2614437652 >> v1:172.21.15.106:6789/0 conn(0x7fd5440bfce0 legacy=0x7fd544069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.496+0000 7fd5437fe640 1 -- 172.21.15.106:0/2614437652 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5441556e0 con 0x7fd54413b060 2023-12-22T09:15:20.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.497+0000 7fd5437fe640 1 --2- 172.21.15.106:0/2614437652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 0x7fd54406a6b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd5440c02a0 tx=0x7fd53402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac08ad7e2b55997 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:20.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.497+0000 7fd542ffd640 1 -- 172.21.15.106:0/2614437652 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534004230 con 0x7fd54413b060 2023-12-22T09:15:20.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.497+0000 7fd542ffd640 1 -- 172.21.15.106:0/2614437652 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534004390 con 0x7fd54413b060 2023-12-22T09:15:20.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.497+0000 7fd542ffd640 1 -- 172.21.15.106:0/2614437652 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534003810 con 0x7fd54413b060 2023-12-22T09:15:20.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.498+0000 7fd54a155640 1 -- 172.21.15.106:0/2614437652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 msgr2=0x7fd54406a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.498+0000 7fd54a155640 1 --2- 172.21.15.106:0/2614437652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 0x7fd54406a6b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd5440c02a0 tx=0x7fd53402b8f0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.498+0000 7fd54a155640 1 -- 172.21.15.106:0/2614437652 shutdown_connections 2023-12-22T09:15:20.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.498+0000 7fd54a155640 1 --2- 172.21.15.106:0/2614437652 >> v2:172.21.15.132:3300/0 conn(0x7fd544151b30 0x7fd544151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.498+0000 7fd54a155640 1 --2- 172.21.15.106:0/2614437652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 0x7fd54406a6b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.498+0000 7fd54a155640 1 -- 172.21.15.106:0/2614437652 >> 172.21.15.106:0/2614437652 conn(0x7fd5440c5360 msgr2=0x7fd5440c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:20.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.498+0000 7fd54a155640 1 -- 172.21.15.106:0/2614437652 shutdown_connections 2023-12-22T09:15:20.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.498+0000 7fd54a155640 1 -- 172.21.15.106:0/2614437652 wait complete. 2023-12-22T09:15:20.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.500+0000 7fd54a155640 1 Processor -- start 2023-12-22T09:15:20.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.500+0000 7fd54a155640 1 -- start start 2023-12-22T09:15:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.501+0000 7fd54a155640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5440bfce0 0x7fd544136e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.501+0000 7fd54a155640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 0x7fd5441ec690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.501+0000 7fd54a155640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd544151b30 0x7fd5441ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.501+0000 7fd54a155640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544135d20 con 0x7fd54413b060 2023-12-22T09:15:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.501+0000 7fd54a155640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544135b50 con 0x7fd544151b30 2023-12-22T09:15:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.501+0000 7fd54a155640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54413a070 con 0x7fd5440bfce0 2023-12-22T09:15:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.502+0000 7fd53bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 0x7fd5441ec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.502+0000 7fd53bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 0x7fd5441ec690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37700/0 (socket says 172.21.15.106:37700) 2023-12-22T09:15:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.502+0000 7fd53bfff640 1 -- 172.21.15.106:0/1808681455 learned_addr learned my addr 172.21.15.106:0/1808681455 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.502+0000 7fd53bfff640 1 -- 172.21.15.106:0/1808681455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5440bfce0 msgr2=0x7fd544136e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.502+0000 7fd53bfff640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5440bfce0 0x7fd544136e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.502+0000 7fd53bfff640 1 -- 172.21.15.106:0/1808681455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd544151b30 msgr2=0x7fd5441ecbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.502+0000 7fd53bfff640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd544151b30 0x7fd5441ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.502+0000 7fd53bfff640 1 -- 172.21.15.106:0/1808681455 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009460 con 0x7fd54413b060 2023-12-22T09:15:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.502+0000 7fd53bfff640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 0x7fd5441ec690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c400 tx=0x7fd52c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.503+0000 7fd540ff9640 1 -- 172.21.15.106:0/1808681455 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0052d0 con 0x7fd54413b060 2023-12-22T09:15:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.503+0000 7fd540ff9640 1 -- 172.21.15.106:0/1808681455 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c005430 con 0x7fd54413b060 2023-12-22T09:15:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.503+0000 7fd540ff9640 1 -- 172.21.15.106:0/1808681455 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c003830 con 0x7fd54413b060 2023-12-22T09:15:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.503+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd544135870 con 0x7fd54413b060 2023-12-22T09:15:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.503+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5440c4ea0 con 0x7fd54413b060 2023-12-22T09:15:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.505+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5440c50c0 con 0x7fd54413b060 2023-12-22T09:15:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.505+0000 7fd540ff9640 1 -- 172.21.15.106:0/1808681455 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd52c003990 con 0x7fd54413b060 2023-12-22T09:15:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.506+0000 7fd540ff9640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd52406a460 0x7fd52406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.506+0000 7fd540ff9640 1 -- 172.21.15.106:0/1808681455 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd52c0881a0 con 0x7fd54413b060 2023-12-22T09:15:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.506+0000 7fd5437fe640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd52406a460 0x7fd52406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.507+0000 7fd5437fe640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd52406a460 0x7fd52406c920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd534035000 tx=0x7fd534030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:20.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.510+0000 7fd540ff9640 1 -- 172.21.15.106:0/1808681455 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd52c053460 con 0x7fd54413b060 2023-12-22T09:15:20.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.703+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd544073f10 con 0x7fd54413b060 2023-12-22T09:15:20.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.706+0000 7fd540ff9640 1 -- 172.21.15.106:0/1808681455 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7fd52c056a80 con 0x7fd54413b060 2023-12-22T09:15:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:20.707 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:20.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.708+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd52406a460 msgr2=0x7fd52406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.708+0000 7fd54a155640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd52406a460 0x7fd52406c920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd534035000 tx=0x7fd534030000 comp rx=0 tx=0).stop 2023-12-22T09:15:20.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.708+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 msgr2=0x7fd5441ec690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.708+0000 7fd54a155640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 0x7fd5441ec690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c400 tx=0x7fd52c00c8c0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.709+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 shutdown_connections 2023-12-22T09:15:20.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.709+0000 7fd54a155640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd52406a460 0x7fd52406c920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.709+0000 7fd54a155640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd544151b30 0x7fd5441ecbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.709+0000 7fd54a155640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd54413b060 0x7fd5441ec690 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.709+0000 7fd54a155640 1 --2- 172.21.15.106:0/1808681455 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5440bfce0 0x7fd544136e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.709+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 >> 172.21.15.106:0/1808681455 conn(0x7fd5440c5360 msgr2=0x7fd5440a86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:20.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.709+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 shutdown_connections 2023-12-22T09:15:20.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.709+0000 7fd54a155640 1 -- 172.21.15.106:0/1808681455 wait complete. 2023-12-22T09:15:20.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:20.728 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:20.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.937+0000 7f4e6b251640 1 Processor -- start 2023-12-22T09:15:20.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.937+0000 7f4e6b251640 1 -- start start 2023-12-22T09:15:20.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.939+0000 7f4e6b251640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e6414f090 0x7f4e64151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.939+0000 7f4e6b251640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4e6406b960 0x7f4e640c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.939+0000 7f4e6b251640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e64155120 con 0x7f4e640c1910 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.939+0000 7f4e6b251640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6406e080 con 0x7f4e6406b960 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.939+0000 7f4e6b251640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e64155fa0 con 0x7f4e6414f090 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.939+0000 7f4e697ee640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4e6406b960 0x7f4e640c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.939+0000 7f4e697ee640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4e6406b960 0x7f4e640c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37702/0 (socket says 172.21.15.106:37702) 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.939+0000 7f4e697ee640 1 -- 172.21.15.106:0/2967041467 learned_addr learned my addr 172.21.15.106:0/2967041467 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.940+0000 7f4e68fed640 1 --2- 172.21.15.106:0/2967041467 >> v2:172.21.15.132:3300/0 conn(0x7f4e6414f090 0x7f4e64151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.940+0000 7f4e697ee640 1 -- 172.21.15.106:0/2967041467 >> v2:172.21.15.132:3300/0 conn(0x7f4e6414f090 msgr2=0x7f4e64151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.940+0000 7f4e697ee640 1 --2- 172.21.15.106:0/2967041467 >> v2:172.21.15.132:3300/0 conn(0x7f4e6414f090 0x7f4e64151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.940+0000 7f4e697ee640 1 -- 172.21.15.106:0/2967041467 >> v1:172.21.15.132:6789/0 conn(0x7f4e640c1910 legacy=0x7f4e64155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.940+0000 7f4e697ee640 1 -- 172.21.15.106:0/2967041467 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640a8720 con 0x7f4e6406b960 2023-12-22T09:15:20.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.940+0000 7f4e68fed640 1 --2- 172.21.15.106:0/2967041467 >> v2:172.21.15.132:3300/0 conn(0x7f4e6414f090 0x7f4e64151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:20.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.941+0000 7f4e697ee640 1 --2- 172.21.15.106:0/2967041467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 0x7f4e640c2010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e640c6450 tx=0x7f4e5c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8106c37dc2000aab server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.941+0000 7f4e637fe640 1 -- 172.21.15.106:0/2967041467 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c02c9f0 con 0x7f4e6406b960 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.941+0000 7f4e637fe640 1 -- 172.21.15.106:0/2967041467 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c02cb50 con 0x7f4e6406b960 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.941+0000 7f4e637fe640 1 -- 172.21.15.106:0/2967041467 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0343f0 con 0x7f4e6406b960 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.942+0000 7f4e6b251640 1 -- 172.21.15.106:0/2967041467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 msgr2=0x7f4e640c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.942+0000 7f4e6b251640 1 --2- 172.21.15.106:0/2967041467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 0x7f4e640c2010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e640c6450 tx=0x7f4e5c02be50 comp rx=0 tx=0).stop 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.942+0000 7f4e6b251640 1 -- 172.21.15.106:0/2967041467 shutdown_connections 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.942+0000 7f4e6b251640 1 --2- 172.21.15.106:0/2967041467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 0x7f4e640c2010 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.942+0000 7f4e6b251640 1 --2- 172.21.15.106:0/2967041467 >> v2:172.21.15.132:3300/0 conn(0x7f4e6414f090 0x7f4e64151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.942+0000 7f4e6b251640 1 -- 172.21.15.106:0/2967041467 >> 172.21.15.106:0/2967041467 conn(0x7f4e64069dd0 msgr2=0x7f4e6406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.942+0000 7f4e6b251640 1 -- 172.21.15.106:0/2967041467 shutdown_connections 2023-12-22T09:15:20.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.942+0000 7f4e6b251640 1 -- 172.21.15.106:0/2967041467 wait complete. 2023-12-22T09:15:20.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.944+0000 7f4e6b251640 1 Processor -- start 2023-12-22T09:15:20.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.944+0000 7f4e6b251640 1 -- start start 2023-12-22T09:15:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.945+0000 7f4e6b251640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 0x7f4e641e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.945+0000 7f4e6b251640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4e640c1910 0x7f4e641e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.945+0000 7f4e6b251640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6414f090 0x7f4e640c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.945+0000 7f4e6b251640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6411ee20 con 0x7f4e6406b960 2023-12-22T09:15:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.945+0000 7f4e6b251640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641e9f80 con 0x7f4e6414f090 2023-12-22T09:15:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.945+0000 7f4e6b251640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641429e0 con 0x7f4e640c1910 2023-12-22T09:15:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.945+0000 7f4e68fed640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 0x7f4e641e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.945+0000 7f4e68fed640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 0x7f4e641e8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37710/0 (socket says 172.21.15.106:37710) 2023-12-22T09:15:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.945+0000 7f4e68fed640 1 -- 172.21.15.106:0/2801347781 learned_addr learned my addr 172.21.15.106:0/2801347781 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e697ee640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6414f090 0x7f4e640c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e68fed640 1 -- 172.21.15.106:0/2801347781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4e640c1910 msgr2=0x7f4e641e66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e63fff640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4e640c1910 0x7f4e641e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e68fed640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4e640c1910 0x7f4e641e66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e68fed640 1 -- 172.21.15.106:0/2801347781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6414f090 msgr2=0x7f4e640c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e68fed640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6414f090 0x7f4e640c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e68fed640 1 -- 172.21.15.106:0/2801347781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c009b30 con 0x7f4e6406b960 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e697ee640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6414f090 0x7f4e640c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e68fed640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 0x7f4e641e8ff0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c7f0 tx=0x7f4e5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e617fa640 1 -- 172.21.15.106:0/2801347781 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58007820 con 0x7f4e6406b960 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e617fa640 1 -- 172.21.15.106:0/2801347781 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58007980 con 0x7f4e6406b960 2023-12-22T09:15:20.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e64142700 con 0x7f4e6406b960 2023-12-22T09:15:20.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e617fa640 1 -- 172.21.15.106:0/2801347781 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58007cf0 con 0x7f4e6406b960 2023-12-22T09:15:20.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.946+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e641ed010 con 0x7f4e6406b960 2023-12-22T09:15:20.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.947+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e64073f10 con 0x7f4e6406b960 2023-12-22T09:15:20.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.948+0000 7f4e617fa640 1 -- 172.21.15.106:0/2801347781 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e580113f0 con 0x7f4e6406b960 2023-12-22T09:15:20.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.949+0000 7f4e617fa640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4e4806a430 0x7f4e4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:20.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.949+0000 7f4e617fa640 1 -- 172.21.15.106:0/2801347781 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e58088ff0 con 0x7f4e6406b960 2023-12-22T09:15:20.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.950+0000 7f4e63fff640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4e4806a430 0x7f4e4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:20.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.950+0000 7f4e63fff640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4e4806a430 0x7f4e4806c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e64154a30 tx=0x7f4e50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:20.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:20.954+0000 7f4e617fa640 1 -- 172.21.15.106:0/2801347781 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4e580bbc80 con 0x7f4e6406b960 2023-12-22T09:15:21.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.147+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e640c16f0 con 0x7f4e6406b960 2023-12-22T09:15:21.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.148+0000 7f4e617fa640 1 -- 172.21.15.106:0/2801347781 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e5801f0a0 con 0x7f4e6406b960 2023-12-22T09:15:21.149 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:21.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4e4806a430 msgr2=0x7f4e4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4e4806a430 0x7f4e4806c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e64154a30 tx=0x7f4e50009040 comp rx=0 tx=0).stop 2023-12-22T09:15:21.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 msgr2=0x7f4e641e8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 0x7f4e641e8ff0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c7f0 tx=0x7f4e5800ccb0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 shutdown_connections 2023-12-22T09:15:21.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4e4806a430 0x7f4e4806c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6414f090 0x7f4e640c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4e640c1910 0x7f4e641e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 --2- 172.21.15.106:0/2801347781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e6406b960 0x7f4e641e8ff0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 >> 172.21.15.106:0/2801347781 conn(0x7f4e64069dd0 msgr2=0x7f4e64155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:21.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 shutdown_connections 2023-12-22T09:15:21.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.151+0000 7f4e6b251640 1 -- 172.21.15.106:0/2801347781 wait complete. 2023-12-22T09:15:21.171 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:21.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.378+0000 7ff981d34640 1 Processor -- start 2023-12-22T09:15:21.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.378+0000 7ff981d34640 1 -- start start 2023-12-22T09:15:21.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff981d34640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c5a30 0x7ff97c0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff981d34640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff97c06c2d0 0x7ff97c1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff981d34640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c14f570 con 0x7ff97c06bdc0 2023-12-22T09:15:21.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff981d34640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c0a90f0 con 0x7ff97c06c2d0 2023-12-22T09:15:21.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff981d34640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0c0b00 con 0x7ff97c0c5a30 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff97affd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff97c06bdc0 0x7ff97c1550e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53074/0 (socket says 172.21.15.106:53074) 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff97affd640 1 -- 172.21.15.106:0/2470625735 learned_addr learned my addr 172.21.15.106:0/2470625735 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff97b7fe640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c5a30 0x7ff97c0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff97bfff640 1 --2- 172.21.15.106:0/2470625735 >> v2:172.21.15.132:3300/0 conn(0x7ff97c06c2d0 0x7ff97c1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.380+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500953899 0 0) 0x7ff97c14f570 con 0x7ff97c06bdc0 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff964003520 con 0x7ff97c06bdc0 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2277799981 0 0) 0x7ff964003520 con 0x7ff97c06bdc0 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c5a30 msgr2=0x7ff97c0c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c5a30 0x7ff97c0c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 >> v2:172.21.15.132:3300/0 conn(0x7ff97c06c2d0 msgr2=0x7ff97c1557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 --2- 172.21.15.106:0/2470625735 >> v2:172.21.15.132:3300/0 conn(0x7ff97c06c2d0 0x7ff97c1557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0bfd40 con 0x7ff97c06bdc0 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7ff970001670 con 0x7ff97c06bdc0 2023-12-22T09:15:21.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 >> v1:172.21.15.106:6789/0 conn(0x7ff97c06bdc0 legacy=0x7ff97c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff964003970 0x7ff964003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9640047c0 0x7ff964004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c5a30 0x7ff964005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0a90f0 con 0x7ff964003970 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0c0b00 con 0x7ff9640047c0 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96400b980 con 0x7ff97c0c5a30 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.381+0000 7ff97b7fe640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff964003970 0x7ff964003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.382+0000 7ff97affd640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9640047c0 0x7ff964004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.382+0000 7ff97b7fe640 1 -- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c5a30 msgr2=0x7ff964005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.382+0000 7ff97b7fe640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c5a30 0x7ff964005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.382+0000 7ff97b7fe640 1 -- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9640047c0 msgr2=0x7ff964004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.382+0000 7ff97b7fe640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9640047c0 0x7ff964004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.382+0000 7ff97b7fe640 1 -- 172.21.15.106:0/2470625735 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964003520 con 0x7ff964003970 2023-12-22T09:15:21.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.383+0000 7ff97b7fe640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff964003970 0x7ff964003d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009af0 tx=0x7ff9640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee7cf314e0a033a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:21.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.383+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c02c710 con 0x7ff964003970 2023-12-22T09:15:21.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.383+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c02c870 con 0x7ff964003970 2023-12-22T09:15:21.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.383+0000 7ff97a7fc640 1 -- 172.21.15.106:0/2470625735 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c02cc00 con 0x7ff964003970 2023-12-22T09:15:21.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.384+0000 7ff981d34640 1 -- 172.21.15.106:0/2470625735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff964003970 msgr2=0x7ff964003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.384+0000 7ff981d34640 1 --2- 172.21.15.106:0/2470625735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff964003970 0x7ff964003d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009af0 tx=0x7ff9640057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.384+0000 7ff97bfff640 1 -- 172.21.15.106:0/2470625735 reap_dead start 2023-12-22T09:15:21.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.384+0000 7ff981d34640 1 -- 172.21.15.106:0/2470625735 shutdown_connections 2023-12-22T09:15:21.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.384+0000 7ff981d34640 1 -- 172.21.15.106:0/2470625735 >> 172.21.15.106:0/2470625735 conn(0x7ff97c06a220 msgr2=0x7ff97c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:21.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.384+0000 7ff981d34640 1 -- 172.21.15.106:0/2470625735 shutdown_connections 2023-12-22T09:15:21.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.384+0000 7ff981d34640 1 -- 172.21.15.106:0/2470625735 wait complete. 2023-12-22T09:15:21.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.385+0000 7ff981d34640 1 Processor -- start 2023-12-22T09:15:21.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.386+0000 7ff981d34640 1 -- start start 2023-12-22T09:15:21.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.386+0000 7ff981d34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff964003970 0x7ff97c0b9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.386+0000 7ff981d34640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c3d40 0x7ff97c1ec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.386+0000 7ff981d34640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff97c0c4d00 0x7ff97c0be410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.386+0000 7ff981d34640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0ba3d0 con 0x7ff97c0c4d00 2023-12-22T09:15:21.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.386+0000 7ff981d34640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0bb8c0 con 0x7ff964003970 2023-12-22T09:15:21.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.386+0000 7ff981d34640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0bf3c0 con 0x7ff97c0c3d40 2023-12-22T09:15:21.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff97c0c4d00 0x7ff97c0be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff97c0c4d00 0x7ff97c0be410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37736/0 (socket says 172.21.15.106:37736) 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97bfff640 1 -- 172.21.15.106:0/4213282518 learned_addr learned my addr 172.21.15.106:0/4213282518 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97b7fe640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff964003970 0x7ff97c0b9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97affd640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c3d40 0x7ff97c1ec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97bfff640 1 -- 172.21.15.106:0/4213282518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c3d40 msgr2=0x7ff97c1ec2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97bfff640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c3d40 0x7ff97c1ec2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97bfff640 1 -- 172.21.15.106:0/4213282518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff964003970 msgr2=0x7ff97c0b9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97bfff640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff964003970 0x7ff97c0b9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97bfff640 1 -- 172.21.15.106:0/4213282518 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c1ecb70 con 0x7ff97c0c4d00 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.387+0000 7ff97affd640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c3d40 0x7ff97c1ec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.388+0000 7ff97bfff640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff97c0c4d00 0x7ff97c0be410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0bf5b0 tx=0x7ff97400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.388+0000 7ff963fff640 1 -- 172.21.15.106:0/4213282518 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974010040 con 0x7ff97c0c4d00 2023-12-22T09:15:21.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.388+0000 7ff963fff640 1 -- 172.21.15.106:0/4213282518 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97400bba0 con 0x7ff97c0c4d00 2023-12-22T09:15:21.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.388+0000 7ff963fff640 1 -- 172.21.15.106:0/4213282518 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974014400 con 0x7ff97c0c4d00 2023-12-22T09:15:21.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.388+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c1ece10 con 0x7ff97c0c4d00 2023-12-22T09:15:21.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.388+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c0bf070 con 0x7ff97c0c4d00 2023-12-22T09:15:21.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.389+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c0bba50 con 0x7ff97c0c4d00 2023-12-22T09:15:21.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.390+0000 7ff963fff640 1 -- 172.21.15.106:0/4213282518 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff974014560 con 0x7ff97c0c4d00 2023-12-22T09:15:21.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.391+0000 7ff963fff640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff96806a430 0x7ff96806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.391+0000 7ff963fff640 1 -- 172.21.15.106:0/4213282518 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff974089110 con 0x7ff97c0c4d00 2023-12-22T09:15:21.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.391+0000 7ff97b7fe640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff96806a430 0x7ff96806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.392+0000 7ff97b7fe640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff96806a430 0x7ff96806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff96c036000 tx=0x7ff96c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:21.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.395+0000 7ff963fff640 1 -- 172.21.15.106:0/4213282518 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff974054340 con 0x7ff97c0c4d00 2023-12-22T09:15:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.584+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff97c073f10 con 0x7ff97c0c4d00 2023-12-22T09:15:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.585+0000 7ff963fff640 1 -- 172.21.15.106:0/4213282518 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff974057960 con 0x7ff97c0c4d00 2023-12-22T09:15:21.586 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff96806a430 msgr2=0x7ff96806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff96806a430 0x7ff96806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff96c036000 tx=0x7ff96c030000 comp rx=0 tx=0).stop 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff97c0c4d00 msgr2=0x7ff97c0be410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff97c0c4d00 0x7ff97c0be410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0bf5b0 tx=0x7ff97400ef30 comp rx=0 tx=0).stop 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 shutdown_connections 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff96806a430 0x7ff96806c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff97c0c4d00 0x7ff97c0be410 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff97c0c3d40 0x7ff97c1ec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 --2- 172.21.15.106:0/4213282518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff964003970 0x7ff97c0b9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 >> 172.21.15.106:0/4213282518 conn(0x7ff97c06a220 msgr2=0x7ff97c0a8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 shutdown_connections 2023-12-22T09:15:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.588+0000 7ff981d34640 1 -- 172.21.15.106:0/4213282518 wait complete. 2023-12-22T09:15:21.606 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:21.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.817+0000 7fa30e2e5640 1 Processor -- start 2023-12-22T09:15:21.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.817+0000 7fa30e2e5640 1 -- start start 2023-12-22T09:15:21.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.819+0000 7fa30e2e5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa308069bf0 0x7fa308069fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.819+0000 7fa30e2e5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3080aafb0 0x7fa3080bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.819+0000 7fa30e2e5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3080c2560 con 0x7fa308071b10 2023-12-22T09:15:21.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.819+0000 7fa30e2e5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30806a510 con 0x7fa3080aafb0 2023-12-22T09:15:21.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.819+0000 7fa30e2e5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080c0ff0 con 0x7fa308069bf0 2023-12-22T09:15:21.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.819+0000 7fa30cae2640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa308071b10 0x7fa308154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53086/0 (socket says 172.21.15.106:53086) 2023-12-22T09:15:21.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.819+0000 7fa30cae2640 1 -- 172.21.15.106:0/2563746941 learned_addr learned my addr 172.21.15.106:0/2563746941 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:21.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa30d2e3640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa308069bf0 0x7fa308069fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa30dae4640 1 --2- 172.21.15.106:0/2563746941 >> v2:172.21.15.132:3300/0 conn(0x7fa3080aafb0 0x7fa3080bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205285074 0 0) 0x7fa3080c2560 con 0x7fa308071b10 2023-12-22T09:15:21.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f4003520 con 0x7fa308071b10 2023-12-22T09:15:21.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2021783368 0 0) 0x7fa2f4003520 con 0x7fa308071b10 2023-12-22T09:15:21.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa308069bf0 msgr2=0x7fa308069fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:21.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa308069bf0 0x7fa308069fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 >> v2:172.21.15.132:3300/0 conn(0x7fa3080aafb0 msgr2=0x7fa3080bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:21.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 --2- 172.21.15.106:0/2563746941 >> v2:172.21.15.132:3300/0 conn(0x7fa3080aafb0 0x7fa3080bf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080bfa20 con 0x7fa308071b10 2023-12-22T09:15:21.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fa2f8001670 con 0x7fa308071b10 2023-12-22T09:15:21.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 >> v1:172.21.15.106:6789/0 conn(0x7fa308071b10 legacy=0x7fa308154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa308069bf0 0x7fa2f4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f4003f40 0x7fa2f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f4004d00 0x7fa2f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30806a510 con 0x7fa2f4003f40 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080c0ff0 con 0x7fa2f4004d00 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.820+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f400ba30 con 0x7fa308069bf0 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.821+0000 7fa30cae2640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f4003f40 0x7fa2f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.821+0000 7fa30d2e3640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa308069bf0 0x7fa2f4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.821+0000 7fa30dae4640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f4004d00 0x7fa2f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.821+0000 7fa30cae2640 1 -- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa308069bf0 msgr2=0x7fa2f4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.821+0000 7fa30cae2640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa308069bf0 0x7fa2f4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.821+0000 7fa30cae2640 1 -- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f4004d00 msgr2=0x7fa2f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.821+0000 7fa30cae2640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f4004d00 0x7fa2f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.821+0000 7fa30cae2640 1 -- 172.21.15.106:0/2563746941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4003520 con 0x7fa2f4003f40 2023-12-22T09:15:21.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.821+0000 7fa30dae4640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f4004d00 0x7fa2f4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.822+0000 7fa30cae2640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f4003f40 0x7fa2f40047c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa308071f10 tx=0x7fa2f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d371c43e565b9bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.822+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8005ad0 con 0x7fa2f4003f40 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.822+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f8005c30 con 0x7fa2f4003f40 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.822+0000 7fa2fffff640 1 -- 172.21.15.106:0/2563746941 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f802c7c0 con 0x7fa2f4003f40 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.823+0000 7fa30e2e5640 1 -- 172.21.15.106:0/2563746941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f4003f40 msgr2=0x7fa2f40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.823+0000 7fa30e2e5640 1 --2- 172.21.15.106:0/2563746941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2f4003f40 0x7fa2f40047c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa308071f10 tx=0x7fa2f40057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.823+0000 7fa30dae4640 1 -- 172.21.15.106:0/2563746941 reap_dead start 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.823+0000 7fa30e2e5640 1 -- 172.21.15.106:0/2563746941 shutdown_connections 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.823+0000 7fa30e2e5640 1 -- 172.21.15.106:0/2563746941 >> 172.21.15.106:0/2563746941 conn(0x7fa3080c2c90 msgr2=0x7fa3080c30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.823+0000 7fa30e2e5640 1 -- 172.21.15.106:0/2563746941 shutdown_connections 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.823+0000 7fa30e2e5640 1 -- 172.21.15.106:0/2563746941 wait complete. 2023-12-22T09:15:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.825+0000 7fa30e2e5640 1 Processor -- start 2023-12-22T09:15:21.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.825+0000 7fa30e2e5640 1 -- start start 2023-12-22T09:15:21.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30e2e5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2f4003f40 0x7fa3080a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30e2e5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3081e97b0 0x7fa308146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30e2e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3081505c0 0x7fa308147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30e2e5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3081475a0 con 0x7fa3081e97b0 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30e2e5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3081e9cb0 con 0x7fa3081505c0 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30e2e5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30814eaf0 con 0x7fa2f4003f40 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30cae2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3081e97b0 0x7fa308146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30cae2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3081e97b0 0x7fa308146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37756/0 (socket says 172.21.15.106:37756) 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30cae2640 1 -- 172.21.15.106:0/1723057851 learned_addr learned my addr 172.21.15.106:0/1723057851 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30d2e3640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2f4003f40 0x7fa3080a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.826+0000 7fa30dae4640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3081505c0 0x7fa308147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30cae2640 1 -- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2f4003f40 msgr2=0x7fa3080a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30cae2640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2f4003f40 0x7fa3080a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30cae2640 1 -- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3081505c0 msgr2=0x7fa308147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30cae2640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3081505c0 0x7fa308147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30cae2640 1 -- 172.21.15.106:0/1723057851 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30814edd0 con 0x7fa3081e97b0 2023-12-22T09:15:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30d2e3640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2f4003f40 0x7fa3080a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30dae4640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3081505c0 0x7fa308147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30cae2640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3081e97b0 0x7fa308146b20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8000c00 tx=0x7fa2f8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa2fdffb640 1 -- 172.21.15.106:0/1723057851 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f803c040 con 0x7fa3081e97b0 2023-12-22T09:15:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa2fdffb640 1 -- 172.21.15.106:0/1723057851 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f802dc80 con 0x7fa3081e97b0 2023-12-22T09:15:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30814f0b0 con 0x7fa3081e97b0 2023-12-22T09:15:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa2fdffb640 1 -- 172.21.15.106:0/1723057851 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8007070 con 0x7fa3081e97b0 2023-12-22T09:15:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.827+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3080a8d70 con 0x7fa3081e97b0 2023-12-22T09:15:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.828+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30804e8d0 con 0x7fa3081e97b0 2023-12-22T09:15:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.829+0000 7fa2fdffb640 1 -- 172.21.15.106:0/1723057851 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa2f8032070 con 0x7fa3081e97b0 2023-12-22T09:15:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.830+0000 7fa2fdffb640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa2ec06a460 0x7fa2ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.830+0000 7fa2fdffb640 1 -- 172.21.15.106:0/1723057851 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa2f80aa7a0 con 0x7fa3081e97b0 2023-12-22T09:15:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.830+0000 7fa30d2e3640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa2ec06a460 0x7fa2ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.831+0000 7fa30d2e3640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa2ec06a460 0x7fa2ec06c920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa304006ce0 tx=0x7fa304008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:21.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:21.834+0000 7fa2fdffb640 1 -- 172.21.15.106:0/1723057851 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa2f80759c0 con 0x7fa3081e97b0 2023-12-22T09:15:22.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.025+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa30806f4c0 con 0x7fa3081e97b0 2023-12-22T09:15:22.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.027+0000 7fa2fdffb640 1 -- 172.21.15.106:0/1723057851 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2f8078fe0 con 0x7fa3081e97b0 2023-12-22T09:15:22.027 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:22.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa2ec06a460 msgr2=0x7fa2ec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa2ec06a460 0x7fa2ec06c920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa304006ce0 tx=0x7fa304008040 comp rx=0 tx=0).stop 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3081e97b0 msgr2=0x7fa308146b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3081e97b0 0x7fa308146b20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8000c00 tx=0x7fa2f8000fe0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 shutdown_connections 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa2ec06a460 0x7fa2ec06c920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3081505c0 0x7fa308147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3081e97b0 0x7fa308146b20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 --2- 172.21.15.106:0/1723057851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa2f4003f40 0x7fa3080a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.029+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 >> 172.21.15.106:0/1723057851 conn(0x7fa3080c2c90 msgr2=0x7fa3080bfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.030+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 shutdown_connections 2023-12-22T09:15:22.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.030+0000 7fa30e2e5640 1 -- 172.21.15.106:0/1723057851 wait complete. 2023-12-22T09:15:22.049 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.259+0000 7f519359e640 1 Processor -- start 2023-12-22T09:15:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.259+0000 7f519359e640 1 -- start start 2023-12-22T09:15:22.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.260+0000 7f519359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f519414a850 0x7f519406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.260+0000 7f519359e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5194070040 0x7f51940c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.260+0000 7f519359e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51941545c0 con 0x7f5194154a50 2023-12-22T09:15:22.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.260+0000 7f519359e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51940a8460 con 0x7f519414a850 2023-12-22T09:15:22.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.260+0000 7f519359e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51940c5d00 con 0x7f5194070040 2023-12-22T09:15:22.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.261+0000 7f5191d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5194154a50 0x7f51940c50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53092/0 (socket says 172.21.15.106:53092) 2023-12-22T09:15:22.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.261+0000 7f5191d9b640 1 -- 172.21.15.106:0/296406562 learned_addr learned my addr 172.21.15.106:0/296406562 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.261+0000 7f5192d9d640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5194070040 0x7f51940c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.261+0000 7f519259c640 1 --2- 172.21.15.106:0/296406562 >> v2:172.21.15.132:3300/0 conn(0x7f519414a850 0x7f519406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.261+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970622048 0 0) 0x7f51941545c0 con 0x7f5194154a50 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.261+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5180003520 con 0x7f5194154a50 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 701621461 0 0) 0x7f5180003520 con 0x7f5194154a50 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5194070040 msgr2=0x7f51940c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5194070040 0x7f51940c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 >> v2:172.21.15.132:3300/0 conn(0x7f519414a850 msgr2=0x7f519406fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 --2- 172.21.15.106:0/296406562 >> v2:172.21.15.132:3300/0 conn(0x7f519414a850 0x7f519406fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51940c1a60 con 0x7f5194154a50 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f517c001670 con 0x7f5194154a50 2023-12-22T09:15:22.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 >> v1:172.21.15.106:6789/0 conn(0x7f5194154a50 legacy=0x7f51940c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5180003970 0x7f5180003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5194070040 0x7f51800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5180004d00 0x7f5180005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518000b980 con 0x7f5180003970 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518000bac0 con 0x7f5180004d00 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518000bc80 con 0x7f5194070040 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519259c640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5180003970 0x7f5180003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519259c640 1 -- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5194070040 msgr2=0x7f51800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519259c640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5194070040 0x7f51800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f519259c640 1 -- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5180004d00 msgr2=0x7f5180005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.262+0000 7f5192d9d640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5180004d00 0x7f5180005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.263+0000 7f519259c640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5180004d00 0x7f5180005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.263+0000 7f519259c640 1 -- 172.21.15.106:0/296406562 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180003520 con 0x7f5180003970 2023-12-22T09:15:22.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.264+0000 7f519259c640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5180003970 0x7f5180003d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5184009fc0 tx=0x7f51800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59434d9b3e650ff server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:22.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.264+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518402cc60 con 0x7f5180003970 2023-12-22T09:15:22.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.264+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518400f040 con 0x7f5180003970 2023-12-22T09:15:22.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.264+0000 7f519159a640 1 -- 172.21.15.106:0/296406562 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184034440 con 0x7f5180003970 2023-12-22T09:15:22.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.264+0000 7f519359e640 1 -- 172.21.15.106:0/296406562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5180003970 msgr2=0x7f5180003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.264+0000 7f519359e640 1 --2- 172.21.15.106:0/296406562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5180003970 0x7f5180003d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5184009fc0 tx=0x7f51800057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.264+0000 7f5192d9d640 1 -- 172.21.15.106:0/296406562 reap_dead start 2023-12-22T09:15:22.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.265+0000 7f519359e640 1 -- 172.21.15.106:0/296406562 shutdown_connections 2023-12-22T09:15:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.265+0000 7f519359e640 1 -- 172.21.15.106:0/296406562 >> 172.21.15.106:0/296406562 conn(0x7f5194069bf0 msgr2=0x7f5194069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.265+0000 7f519359e640 1 -- 172.21.15.106:0/296406562 shutdown_connections 2023-12-22T09:15:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.265+0000 7f519359e640 1 -- 172.21.15.106:0/296406562 wait complete. 2023-12-22T09:15:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.266+0000 7f519359e640 1 Processor -- start 2023-12-22T09:15:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.266+0000 7f519359e640 1 -- start start 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.267+0000 7f519359e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5180003970 0x7f51940aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.267+0000 7f519359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f519415d820 0x7f51941e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.267+0000 7f519359e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51941ea370 0x7f5194146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.267+0000 7f519359e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519415c650 con 0x7f51941ea370 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.267+0000 7f519359e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51941ec860 con 0x7f519415d820 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.267+0000 7f519359e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51941ea7f0 con 0x7f5180003970 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5192d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51941ea370 0x7f5194146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5192d9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51941ea370 0x7f5194146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37774/0 (socket says 172.21.15.106:37774) 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5192d9d640 1 -- 172.21.15.106:0/631619310 learned_addr learned my addr 172.21.15.106:0/631619310 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f519259c640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5180003970 0x7f51940aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5191d9b640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f519415d820 0x7f51941e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5192d9d640 1 -- 172.21.15.106:0/631619310 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5180003970 msgr2=0x7f51940aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5192d9d640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5180003970 0x7f51940aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5192d9d640 1 -- 172.21.15.106:0/631619310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f519415d820 msgr2=0x7f51941e9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5192d9d640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f519415d820 0x7f51941e9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5192d9d640 1 -- 172.21.15.106:0/631619310 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519415afd0 con 0x7f51941ea370 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.268+0000 7f5192d9d640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51941ea370 0x7f5194146d40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f519406b650 tx=0x7f518c0109f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.269+0000 7f518affd640 1 -- 172.21.15.106:0/631619310 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c0148c0 con 0x7f51941ea370 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.269+0000 7f518affd640 1 -- 172.21.15.106:0/631619310 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c014a20 con 0x7f51941ea370 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.269+0000 7f518affd640 1 -- 172.21.15.106:0/631619310 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c014dd0 con 0x7f51941ea370 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.269+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519415e090 con 0x7f51941ea370 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.269+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51941ec210 con 0x7f51941ea370 2023-12-22T09:15:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.270+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519404e8d0 con 0x7f51941ea370 2023-12-22T09:15:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.271+0000 7f518affd640 1 -- 172.21.15.106:0/631619310 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f518c021460 con 0x7f51941ea370 2023-12-22T09:15:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.272+0000 7f518affd640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f517406a430 0x7f517406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.272+0000 7f518affd640 1 -- 172.21.15.106:0/631619310 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f518c088840 con 0x7f51941ea370 2023-12-22T09:15:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.272+0000 7f519259c640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f517406a430 0x7f517406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.273+0000 7f519259c640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f517406a430 0x7f517406c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5184036000 tx=0x7f518402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:22.276 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.276+0000 7f518affd640 1 -- 172.21.15.106:0/631619310 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f518c057500 con 0x7f51941ea370 2023-12-22T09:15:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.464+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5194071810 con 0x7f51941ea370 2023-12-22T09:15:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.465+0000 7f518affd640 1 -- 172.21.15.106:0/631619310 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f518c000e60 con 0x7f51941ea370 2023-12-22T09:15:22.466 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.467+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f517406a430 msgr2=0x7f517406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.467+0000 7f519359e640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f517406a430 0x7f517406c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5184036000 tx=0x7f518402e000 comp rx=0 tx=0).stop 2023-12-22T09:15:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.467+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51941ea370 msgr2=0x7f5194146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.467+0000 7f519359e640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51941ea370 0x7f5194146d40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f519406b650 tx=0x7f518c0109f0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.468+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 shutdown_connections 2023-12-22T09:15:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.468+0000 7f519359e640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f517406a430 0x7f517406c8f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.468+0000 7f519359e640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51941ea370 0x7f5194146d40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.468+0000 7f519359e640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f519415d820 0x7f51941e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.468+0000 7f519359e640 1 --2- 172.21.15.106:0/631619310 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5180003970 0x7f51940aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.468+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 >> 172.21.15.106:0/631619310 conn(0x7f5194069bf0 msgr2=0x7f519406c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.468+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 shutdown_connections 2023-12-22T09:15:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.468+0000 7f519359e640 1 -- 172.21.15.106:0/631619310 wait complete. 2023-12-22T09:15:22.486 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:22.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.685+0000 7fe803fff640 1 Processor -- start 2023-12-22T09:15:22.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.685+0000 7fe803fff640 1 -- start start 2023-12-22T09:15:22.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.686+0000 7fe803fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8040c16e0 0x7fe804154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.686+0000 7fe803fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040a82e0 0x7fe8040c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.686+0000 7fe803fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe804153f00 con 0x7fe80414df70 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.686+0000 7fe803fff640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8040aa1a0 con 0x7fe8040c16e0 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.686+0000 7fe803fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8041544c0 con 0x7fe8040a82e0 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.686+0000 7fe8027fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8040c16e0 0x7fe804154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.687+0000 7fe8027fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8040c16e0 0x7fe804154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37778/0 (socket says 172.21.15.106:37778) 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.687+0000 7fe8027fc640 1 -- 172.21.15.106:0/2139331679 learned_addr learned my addr 172.21.15.106:0/2139331679 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.687+0000 7fe8037fe640 1 --2- 172.21.15.106:0/2139331679 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040a82e0 0x7fe8040c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.687+0000 7fe8027fc640 1 -- 172.21.15.106:0/2139331679 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040a82e0 msgr2=0x7fe8040c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.687+0000 7fe8027fc640 1 --2- 172.21.15.106:0/2139331679 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040a82e0 0x7fe8040c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.687+0000 7fe8027fc640 1 -- 172.21.15.106:0/2139331679 >> v1:172.21.15.132:6789/0 conn(0x7fe80414df70 legacy=0x7fe80406b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.687+0000 7fe8027fc640 1 -- 172.21.15.106:0/2139331679 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804154e90 con 0x7fe8040c16e0 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.688+0000 7fe8027fc640 1 --2- 172.21.15.106:0/2139331679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8040c16e0 0x7fe804154950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009870 tx=0x7fe7f802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7b3b967f2103c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.688+0000 7fe801ffb640 1 -- 172.21.15.106:0/2139331679 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80317c0 con 0x7fe8040c16e0 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe801ffb640 1 -- 172.21.15.106:0/2139331679 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8031920 con 0x7fe8040c16e0 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe801ffb640 1 -- 172.21.15.106:0/2139331679 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8031cb0 con 0x7fe8040c16e0 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe803fff640 1 -- 172.21.15.106:0/2139331679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8040c16e0 msgr2=0x7fe804154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe803fff640 1 --2- 172.21.15.106:0/2139331679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8040c16e0 0x7fe804154950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009870 tx=0x7fe7f802b860 comp rx=0 tx=0).stop 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe803fff640 1 -- 172.21.15.106:0/2139331679 shutdown_connections 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe803fff640 1 --2- 172.21.15.106:0/2139331679 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040a82e0 0x7fe8040c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe803fff640 1 --2- 172.21.15.106:0/2139331679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8040c16e0 0x7fe804154950 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe803fff640 1 -- 172.21.15.106:0/2139331679 >> 172.21.15.106:0/2139331679 conn(0x7fe804069dd0 msgr2=0x7fe80406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:22.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe803fff640 1 -- 172.21.15.106:0/2139331679 shutdown_connections 2023-12-22T09:15:22.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.689+0000 7fe803fff640 1 -- 172.21.15.106:0/2139331679 wait complete. 2023-12-22T09:15:22.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.691+0000 7fe803fff640 1 Processor -- start 2023-12-22T09:15:22.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.691+0000 7fe803fff640 1 -- start start 2023-12-22T09:15:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe803fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8040a82e0 0x7fe80414d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe803fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040c16e0 0x7fe80414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe803fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80414df70 0x7fe80414edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe803fff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804140cc0 con 0x7fe80414df70 2023-12-22T09:15:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe803fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80414a5d0 con 0x7fe8040a82e0 2023-12-22T09:15:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe803fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe804150620 con 0x7fe8040c16e0 2023-12-22T09:15:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8037fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80414df70 0x7fe80414edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8037fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80414df70 0x7fe80414edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37792/0 (socket says 172.21.15.106:37792) 2023-12-22T09:15:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8037fe640 1 -- 172.21.15.106:0/2274624280 learned_addr learned my addr 172.21.15.106:0/2274624280 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe802ffd640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8040a82e0 0x7fe80414d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8027fc640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040c16e0 0x7fe80414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8037fe640 1 -- 172.21.15.106:0/2274624280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040c16e0 msgr2=0x7fe80414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8037fe640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040c16e0 0x7fe80414e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8037fe640 1 -- 172.21.15.106:0/2274624280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8040a82e0 msgr2=0x7fe80414d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8037fe640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8040a82e0 0x7fe80414d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8037fe640 1 -- 172.21.15.106:0/2274624280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f80094d0 con 0x7fe80414df70 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.692+0000 7fe8027fc640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040c16e0 0x7fe80414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.693+0000 7fe8037fe640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80414df70 0x7fe80414edc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc007e60 tx=0x7fe7fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.693+0000 7fe7eb7fe640 1 -- 172.21.15.106:0/2274624280 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc014420 con 0x7fe80414df70 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.693+0000 7fe7eb7fe640 1 -- 172.21.15.106:0/2274624280 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc0145a0 con 0x7fe80414df70 2023-12-22T09:15:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.693+0000 7fe7eb7fe640 1 -- 172.21.15.106:0/2274624280 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc014950 con 0x7fe80414df70 2023-12-22T09:15:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.693+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80414a820 con 0x7fe80414df70 2023-12-22T09:15:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.693+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe804140670 con 0x7fe80414df70 2023-12-22T09:15:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.694+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe804140e70 con 0x7fe80414df70 2023-12-22T09:15:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.695+0000 7fe7eb7fe640 1 -- 172.21.15.106:0/2274624280 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe7fc014ab0 con 0x7fe80414df70 2023-12-22T09:15:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.696+0000 7fe7eb7fe640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe7f006a460 0x7fe7f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.696+0000 7fe7eb7fe640 1 -- 172.21.15.106:0/2274624280 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe7fc089570 con 0x7fe80414df70 2023-12-22T09:15:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.696+0000 7fe802ffd640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe7f006a460 0x7fe7f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.697+0000 7fe802ffd640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe7f006a460 0x7fe7f006c920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4000f60 tx=0x7fe7f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.700+0000 7fe7eb7fe640 1 -- 172.21.15.106:0/2274624280 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe804140e70 con 0x7fe80414df70 2023-12-22T09:15:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.889+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe804140e70 con 0x7fe80414df70 2023-12-22T09:15:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.892+0000 7fe7eb7fe640 1 -- 172.21.15.106:0/2274624280 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7fe804140e70 con 0x7fe80414df70 2023-12-22T09:15:22.893 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:22.893 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe7f006a460 msgr2=0x7fe7f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe7f006a460 0x7fe7f006c920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4000f60 tx=0x7fe7f4009040 comp rx=0 tx=0).stop 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80414df70 msgr2=0x7fe80414edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80414df70 0x7fe80414edc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc007e60 tx=0x7fe7fc00e4b0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 shutdown_connections 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe7f006a460 0x7fe7f006c920 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe80414df70 0x7fe80414edc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8040c16e0 0x7fe80414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 --2- 172.21.15.106:0/2274624280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8040a82e0 0x7fe80414d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 >> 172.21.15.106:0/2274624280 conn(0x7fe804069dd0 msgr2=0x7fe8040a87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 shutdown_connections 2023-12-22T09:15:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:22.895+0000 7fe803fff640 1 -- 172.21.15.106:0/2274624280 wait complete. 2023-12-22T09:15:22.915 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:22.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:23.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.131+0000 7f14a7958640 1 Processor -- start 2023-12-22T09:15:23.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.132+0000 7f14a7958640 1 -- start start 2023-12-22T09:15:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.133+0000 7f14a7958640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14a00c6150 0x7f14a00c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.133+0000 7f14a7958640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 0x7f14a006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.133+0000 7f14a7958640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a00c4560 con 0x7f14a00c7640 2023-12-22T09:15:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.133+0000 7f14a7958640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a00c4f90 con 0x7f14a00c6150 2023-12-22T09:15:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.133+0000 7f14a7958640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0154720 con 0x7f14a006ca00 2023-12-22T09:15:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.133+0000 7f14a56f4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14a00c6150 0x7f14a00c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.133+0000 7f14a56f4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14a00c6150 0x7f14a00c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39940/0 (socket says 172.21.15.106:39940) 2023-12-22T09:15:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.133+0000 7f14a56f4640 1 -- 172.21.15.106:0/1054388964 learned_addr learned my addr 172.21.15.106:0/1054388964 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.133+0000 7f14a5ef5640 1 --2- 172.21.15.106:0/1054388964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 0x7f14a006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.134+0000 7f14a56f4640 1 -- 172.21.15.106:0/1054388964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 msgr2=0x7f14a006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.134+0000 7f14a56f4640 1 --2- 172.21.15.106:0/1054388964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 0x7f14a006b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.134+0000 7f14a56f4640 1 -- 172.21.15.106:0/1054388964 >> v1:172.21.15.132:6789/0 conn(0x7f14a00c7640 legacy=0x7f14a006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.134+0000 7f14a56f4640 1 -- 172.21.15.106:0/1054388964 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0154c50 con 0x7f14a00c6150 2023-12-22T09:15:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.135+0000 7f14a56f4640 1 --2- 172.21.15.106:0/1054388964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 0x7f14a00c6530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f149c009e50 tx=0x7f149c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e952c3654beceba9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:23.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.135+0000 7f1497fff640 1 -- 172.21.15.106:0/1054388964 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c02c9e0 con 0x7f14a00c6150 2023-12-22T09:15:23.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.135+0000 7f1497fff640 1 -- 172.21.15.106:0/1054388964 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c02cb40 con 0x7f14a00c6150 2023-12-22T09:15:23.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.135+0000 7f1497fff640 1 -- 172.21.15.106:0/1054388964 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c0343f0 con 0x7f14a00c6150 2023-12-22T09:15:23.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.136+0000 7f14a7958640 1 -- 172.21.15.106:0/1054388964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 msgr2=0x7f14a00c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.136+0000 7f14a7958640 1 --2- 172.21.15.106:0/1054388964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 0x7f14a00c6530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f149c009e50 tx=0x7f149c02be40 comp rx=0 tx=0).stop 2023-12-22T09:15:23.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.136+0000 7f14a7958640 1 -- 172.21.15.106:0/1054388964 shutdown_connections 2023-12-22T09:15:23.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.136+0000 7f14a7958640 1 --2- 172.21.15.106:0/1054388964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 0x7f14a006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.136+0000 7f14a7958640 1 --2- 172.21.15.106:0/1054388964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 0x7f14a00c6530 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.136+0000 7f14a7958640 1 -- 172.21.15.106:0/1054388964 >> 172.21.15.106:0/1054388964 conn(0x7f14a00ab330 msgr2=0x7f14a00ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:23.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.136+0000 7f14a7958640 1 -- 172.21.15.106:0/1054388964 shutdown_connections 2023-12-22T09:15:23.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.136+0000 7f14a7958640 1 -- 172.21.15.106:0/1054388964 wait complete. 2023-12-22T09:15:23.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.138+0000 7f14a7958640 1 Processor -- start 2023-12-22T09:15:23.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.138+0000 7f14a7958640 1 -- start start 2023-12-22T09:15:23.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a7958640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 0x7f14a006b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a7958640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 0x7f14a01ea720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a7958640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a00c7640 0x7f14a01eac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a7958640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a01eb1a0 con 0x7f14a00c6150 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a7958640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a01ed9c0 con 0x7f14a00c7640 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a7958640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a01edca0 con 0x7f14a006ca00 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a4ef3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 0x7f14a01ea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a4ef3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 0x7f14a01ea720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39946/0 (socket says 172.21.15.106:39946) 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a4ef3640 1 -- 172.21.15.106:0/2901028471 learned_addr learned my addr 172.21.15.106:0/2901028471 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a5ef5640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a00c7640 0x7f14a01eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a56f4640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 0x7f14a006b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a4ef3640 1 -- 172.21.15.106:0/2901028471 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 msgr2=0x7f14a006b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a4ef3640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 0x7f14a006b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a4ef3640 1 -- 172.21.15.106:0/2901028471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a00c7640 msgr2=0x7f14a01eac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a4ef3640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a00c7640 0x7f14a01eac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a4ef3640 1 -- 172.21.15.106:0/2901028471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c009b30 con 0x7f14a00c6150 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.139+0000 7f14a56f4640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 0x7f14a006b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.140+0000 7f14a4ef3640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 0x7f14a01ea720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f149000c3c0 tx=0x7f149000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.140+0000 7f1495ffb640 1 -- 172.21.15.106:0/2901028471 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14900052d0 con 0x7f14a00c6150 2023-12-22T09:15:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.140+0000 7f1495ffb640 1 -- 172.21.15.106:0/2901028471 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490005450 con 0x7f14a00c6150 2023-12-22T09:15:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.140+0000 7f1495ffb640 1 -- 172.21.15.106:0/2901028471 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490003830 con 0x7f14a00c6150 2023-12-22T09:15:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.140+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a01edf80 con 0x7f14a00c6150 2023-12-22T09:15:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.140+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a006b990 con 0x7f14a00c6150 2023-12-22T09:15:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.141+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a00666c0 con 0x7f14a00c6150 2023-12-22T09:15:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.142+0000 7f1495ffb640 1 -- 172.21.15.106:0/2901028471 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1490003990 con 0x7f14a00c6150 2023-12-22T09:15:23.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.143+0000 7f1495ffb640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f148406a430 0x7f148406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.144+0000 7f1495ffb640 1 -- 172.21.15.106:0/2901028471 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1490088130 con 0x7f14a00c6150 2023-12-22T09:15:23.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.144+0000 7f14a56f4640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f148406a430 0x7f148406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.144+0000 7f14a56f4640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f148406a430 0x7f148406c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f149c035000 tx=0x7f149c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.148+0000 7f1495ffb640 1 -- 172.21.15.106:0/2901028471 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f14900533f0 con 0x7f14a00c6150 2023-12-22T09:15:23.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.336+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14a01ee4a0 con 0x7f14a00c6150 2023-12-22T09:15:23.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.337+0000 7f1495ffb640 1 -- 172.21.15.106:0/2901028471 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1490056a10 con 0x7f14a00c6150 2023-12-22T09:15:23.338 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:23.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f148406a430 msgr2=0x7f148406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f148406a430 0x7f148406c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f149c035000 tx=0x7f149c030000 comp rx=0 tx=0).stop 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 msgr2=0x7f14a01ea720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 0x7f14a01ea720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f149000c3c0 tx=0x7f149000c880 comp rx=0 tx=0).stop 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 shutdown_connections 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f148406a430 0x7f148406c8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14a00c7640 0x7f14a01eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14a00c6150 0x7f14a01ea720 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 --2- 172.21.15.106:0/2901028471 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14a006ca00 0x7f14a006b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 >> 172.21.15.106:0/2901028471 conn(0x7f14a00ab330 msgr2=0x7f14a0153480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 shutdown_connections 2023-12-22T09:15:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.340+0000 7f14a7958640 1 -- 172.21.15.106:0/2901028471 wait complete. 2023-12-22T09:15:23.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:23.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.575+0000 7f5d39f63640 1 Processor -- start 2023-12-22T09:15:23.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.576+0000 7f5d39f63640 1 -- start start 2023-12-22T09:15:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.577+0000 7f5d39f63640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5d34151400 0x7f5d340c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.577+0000 7f5d39f63640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d3406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.577+0000 7f5d39f63640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d340bcc70 con 0x7f5d340c7620 2023-12-22T09:15:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.577+0000 7f5d39f63640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d341517e0 con 0x7f5d34151400 2023-12-22T09:15:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.577+0000 7f5d39f63640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d340c4c90 con 0x7f5d3406ca20 2023-12-22T09:15:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.578+0000 7f5d337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5d34151400 0x7f5d340c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.578+0000 7f5d32ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d3406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.578+0000 7f5d32ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d3406b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:43400/0 (socket says 172.21.15.106:43400) 2023-12-22T09:15:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.578+0000 7f5d32ffd640 1 -- 172.21.15.106:0/2783386669 learned_addr learned my addr 172.21.15.106:0/2783386669 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:23.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.579+0000 7f5d337fe640 1 -- 172.21.15.106:0/2783386669 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 msgr2=0x7f5d3406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:23.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.579+0000 7f5d337fe640 1 --2- 172.21.15.106:0/2783386669 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d3406b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.579+0000 7f5d337fe640 1 -- 172.21.15.106:0/2783386669 >> v1:172.21.15.132:6789/0 conn(0x7f5d340c7620 legacy=0x7f5d3406b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.579+0000 7f5d337fe640 1 -- 172.21.15.106:0/2783386669 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d340c42d0 con 0x7f5d34151400 2023-12-22T09:15:23.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.579+0000 7f5d32ffd640 1 --2- 172.21.15.106:0/2783386669 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d3406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:23.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.580+0000 7f5d337fe640 1 --2- 172.21.15.106:0/2783386669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 0x7f5d340c6130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009d90 tx=0x7f5d2402bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e112c077a7ef129 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:23.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d327fc640 1 -- 172.21.15.106:0/2783386669 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2402cb40 con 0x7f5d34151400 2023-12-22T09:15:23.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d327fc640 1 -- 172.21.15.106:0/2783386669 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2402cca0 con 0x7f5d34151400 2023-12-22T09:15:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d327fc640 1 -- 172.21.15.106:0/2783386669 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24034660 con 0x7f5d34151400 2023-12-22T09:15:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d39f63640 1 -- 172.21.15.106:0/2783386669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 msgr2=0x7f5d340c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d39f63640 1 --2- 172.21.15.106:0/2783386669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 0x7f5d340c6130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009d90 tx=0x7f5d2402bd90 comp rx=0 tx=0).stop 2023-12-22T09:15:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d39f63640 1 -- 172.21.15.106:0/2783386669 shutdown_connections 2023-12-22T09:15:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d39f63640 1 --2- 172.21.15.106:0/2783386669 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d3406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d39f63640 1 --2- 172.21.15.106:0/2783386669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 0x7f5d340c6130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d39f63640 1 -- 172.21.15.106:0/2783386669 >> 172.21.15.106:0/2783386669 conn(0x7f5d340ab310 msgr2=0x7f5d340ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:23.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d39f63640 1 -- 172.21.15.106:0/2783386669 shutdown_connections 2023-12-22T09:15:23.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.581+0000 7f5d39f63640 1 -- 172.21.15.106:0/2783386669 wait complete. 2023-12-22T09:15:23.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.583+0000 7f5d39f63640 1 Processor -- start 2023-12-22T09:15:23.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.583+0000 7f5d39f63640 1 -- start start 2023-12-22T09:15:23.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.584+0000 7f5d39f63640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d341ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.584+0000 7f5d39f63640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340c7620 0x7f5d340c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.584+0000 7f5d39f63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 0x7f5d341533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.584+0000 7f5d39f63640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d340c27c0 con 0x7f5d340c7620 2023-12-22T09:15:23.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.584+0000 7f5d39f63640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d341ec140 con 0x7f5d34151400 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.584+0000 7f5d39f63640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d341ed0d0 con 0x7f5d3406ca20 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.584+0000 7f5d32ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340c7620 0x7f5d340c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d32ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340c7620 0x7f5d340c1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39960/0 (socket says 172.21.15.106:39960) 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d32ffd640 1 -- 172.21.15.106:0/3197657848 learned_addr learned my addr 172.21.15.106:0/3197657848 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d337fe640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d341ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d33fff640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 0x7f5d341533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d32ffd640 1 -- 172.21.15.106:0/3197657848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 msgr2=0x7f5d341ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d32ffd640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d341ecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d32ffd640 1 -- 172.21.15.106:0/3197657848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 msgr2=0x7f5d341533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d32ffd640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 0x7f5d341533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d32ffd640 1 -- 172.21.15.106:0/3197657848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0094d0 con 0x7f5d340c7620 2023-12-22T09:15:23.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d33fff640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 0x7f5d341533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:23.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.585+0000 7f5d32ffd640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340c7620 0x7f5d340c1200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00e980 tx=0x7f5d1c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:23.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.586+0000 7f5d2bfff640 1 -- 172.21.15.106:0/3197657848 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00ca00 con 0x7f5d340c7620 2023-12-22T09:15:23.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.586+0000 7f5d2bfff640 1 -- 172.21.15.106:0/3197657848 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c00cb60 con 0x7f5d340c7620 2023-12-22T09:15:23.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.586+0000 7f5d2bfff640 1 -- 172.21.15.106:0/3197657848 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c013470 con 0x7f5d340c7620 2023-12-22T09:15:23.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.586+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d24009a70 con 0x7f5d340c7620 2023-12-22T09:15:23.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.586+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d340c21a0 con 0x7f5d340c7620 2023-12-22T09:15:23.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.587+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d340c4740 con 0x7f5d340c7620 2023-12-22T09:15:23.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.588+0000 7f5d2bfff640 1 -- 172.21.15.106:0/3197657848 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5d1c0135d0 con 0x7f5d340c7620 2023-12-22T09:15:23.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.589+0000 7f5d2bfff640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d1406a430 0x7f5d1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:23.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.589+0000 7f5d2bfff640 1 -- 172.21.15.106:0/3197657848 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5d1c089140 con 0x7f5d340c7620 2023-12-22T09:15:23.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.589+0000 7f5d337fe640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d1406a430 0x7f5d1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:23.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.590+0000 7f5d337fe640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d1406a430 0x7f5d1406c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d24036000 tx=0x7f5d24030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:23.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.593+0000 7f5d2bfff640 1 -- 172.21.15.106:0/3197657848 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5d340c4740 con 0x7f5d340c7620 2023-12-22T09:15:23.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.782+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d340c4740 con 0x7f5d340c7620 2023-12-22T09:15:23.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.783+0000 7f5d2bfff640 1 -- 172.21.15.106:0/3197657848 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5d340c4740 con 0x7f5d340c7620 2023-12-22T09:15:23.784 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.785+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d1406a430 msgr2=0x7f5d1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.785+0000 7f5d39f63640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d1406a430 0x7f5d1406c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d24036000 tx=0x7f5d24030000 comp rx=0 tx=0).stop 2023-12-22T09:15:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.785+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340c7620 msgr2=0x7f5d340c1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:23.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.785+0000 7f5d39f63640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340c7620 0x7f5d340c1200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00e980 tx=0x7f5d1c00ee40 comp rx=0 tx=0).stop 2023-12-22T09:15:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.786+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 shutdown_connections 2023-12-22T09:15:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.786+0000 7f5d39f63640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d1406a430 0x7f5d1406c8f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.786+0000 7f5d39f63640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d34151400 0x7f5d341533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.786+0000 7f5d39f63640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340c7620 0x7f5d340c1200 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.786+0000 7f5d39f63640 1 --2- 172.21.15.106:0/3197657848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d3406ca20 0x7f5d341ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.786+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 >> 172.21.15.106:0/3197657848 conn(0x7f5d340ab310 msgr2=0x7f5d3414cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.786+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 shutdown_connections 2023-12-22T09:15:23.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:23.786+0000 7f5d39f63640 1 -- 172.21.15.106:0/3197657848 wait complete. 2023-12-22T09:15:23.805 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.017+0000 7fdbaffc9640 1 Processor -- start 2023-12-22T09:15:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.018+0000 7fdbaffc9640 1 -- start start 2023-12-22T09:15:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbaffc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdba80c53d0 0x7fdba806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbaffc9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdba8153d70 0x7fdba8151090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbaffc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 0x7fdba8157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbaffc9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba8151a60 con 0x7fdba8153d70 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbaffc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba81572e0 con 0x7fdba80c53d0 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbaffc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8070350 con 0x7fdba81515d0 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbad564640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdba8153d70 0x7fdba8151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbad564640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdba8153d70 0x7fdba8151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39966/0 (socket says 172.21.15.106:39966) 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbad564640 1 -- 172.21.15.106:0/2918323157 learned_addr learned my addr 172.21.15.106:0/2918323157 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.019+0000 7fdbadd65640 1 --2- 172.21.15.106:0/2918323157 >> v2:172.21.15.132:3300/0 conn(0x7fdba80c53d0 0x7fdba806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.020+0000 7fdbad564640 1 -- 172.21.15.106:0/2918323157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 msgr2=0x7fdba8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.020+0000 7fdbae566640 1 --2- 172.21.15.106:0/2918323157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 0x7fdba8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.020+0000 7fdbad564640 1 --2- 172.21.15.106:0/2918323157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 0x7fdba8157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.020+0000 7fdbad564640 1 -- 172.21.15.106:0/2918323157 >> v2:172.21.15.132:3300/0 conn(0x7fdba80c53d0 msgr2=0x7fdba806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.020+0000 7fdbad564640 1 --2- 172.21.15.106:0/2918323157 >> v2:172.21.15.132:3300/0 conn(0x7fdba80c53d0 0x7fdba806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.020+0000 7fdbad564640 1 -- 172.21.15.106:0/2918323157 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba81542c0 con 0x7fdba8153d70 2023-12-22T09:15:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.020+0000 7fdbadd65640 1 --2- 172.21.15.106:0/2918323157 >> v2:172.21.15.132:3300/0 conn(0x7fdba80c53d0 0x7fdba806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.020+0000 7fdbae566640 1 --2- 172.21.15.106:0/2918323157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 0x7fdba8157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:24.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.021+0000 7fdbad564640 1 --2- 172.21.15.106:0/2918323157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba8153d70 0x7fdba8151090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdba80722e0 tx=0x7fdb9802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04cfcef5bb3745b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:24.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.021+0000 7fdbacd63640 1 -- 172.21.15.106:0/2918323157 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98031740 con 0x7fdba8153d70 2023-12-22T09:15:24.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.021+0000 7fdbacd63640 1 -- 172.21.15.106:0/2918323157 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb980318a0 con 0x7fdba8153d70 2023-12-22T09:15:24.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.021+0000 7fdbacd63640 1 -- 172.21.15.106:0/2918323157 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98031c30 con 0x7fdba8153d70 2023-12-22T09:15:24.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.022+0000 7fdbaffc9640 1 -- 172.21.15.106:0/2918323157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba8153d70 msgr2=0x7fdba8151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.022+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/2918323157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba8153d70 0x7fdba8151090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdba80722e0 tx=0x7fdb9802b7e0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.022+0000 7fdbaffc9640 1 -- 172.21.15.106:0/2918323157 shutdown_connections 2023-12-22T09:15:24.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.022+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/2918323157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 0x7fdba8157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.022+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/2918323157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba8153d70 0x7fdba8151090 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.022+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/2918323157 >> v2:172.21.15.132:3300/0 conn(0x7fdba80c53d0 0x7fdba806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.022+0000 7fdbaffc9640 1 -- 172.21.15.106:0/2918323157 >> 172.21.15.106:0/2918323157 conn(0x7fdba80a7be0 msgr2=0x7fdba80a7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.022+0000 7fdbaffc9640 1 -- 172.21.15.106:0/2918323157 shutdown_connections 2023-12-22T09:15:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.022+0000 7fdbaffc9640 1 -- 172.21.15.106:0/2918323157 wait complete. 2023-12-22T09:15:24.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.024+0000 7fdbaffc9640 1 Processor -- start 2023-12-22T09:15:24.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.024+0000 7fdbaffc9640 1 -- start start 2023-12-22T09:15:24.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbaffc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba80c53d0 0x7fdba81ea170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbaffc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 0x7fdba8152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbaffc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdba8153d70 0x7fdba814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbaffc9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80a6b70 con 0x7fdba80c53d0 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbaffc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80a8af0 con 0x7fdba8153d70 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbaffc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80a8dd0 con 0x7fdba81515d0 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbadd65640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba80c53d0 0x7fdba81ea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbadd65640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba80c53d0 0x7fdba81ea170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39982/0 (socket says 172.21.15.106:39982) 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbadd65640 1 -- 172.21.15.106:0/482166743 learned_addr learned my addr 172.21.15.106:0/482166743 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbae566640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdba8153d70 0x7fdba814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbadd65640 1 -- 172.21.15.106:0/482166743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 msgr2=0x7fdba8152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbadd65640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 0x7fdba8152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbadd65640 1 -- 172.21.15.106:0/482166743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdba8153d70 msgr2=0x7fdba814d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbadd65640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdba8153d70 0x7fdba814d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.025+0000 7fdbadd65640 1 -- 172.21.15.106:0/482166743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980094d0 con 0x7fdba80c53d0 2023-12-22T09:15:24.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.026+0000 7fdbadd65640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba80c53d0 0x7fdba81ea170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdba400ce00 tx=0x7fdba400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:24.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.026+0000 7fdb9e7fc640 1 -- 172.21.15.106:0/482166743 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba400f890 con 0x7fdba80c53d0 2023-12-22T09:15:24.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.026+0000 7fdb9e7fc640 1 -- 172.21.15.106:0/482166743 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba400f9f0 con 0x7fdba80c53d0 2023-12-22T09:15:24.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.026+0000 7fdb9e7fc640 1 -- 172.21.15.106:0/482166743 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba400fdc0 con 0x7fdba80c53d0 2023-12-22T09:15:24.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.026+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba81526e0 con 0x7fdba80c53d0 2023-12-22T09:15:24.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.026+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba80a65d0 con 0x7fdba80c53d0 2023-12-22T09:15:24.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.027+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba80c4170 con 0x7fdba80c53d0 2023-12-22T09:15:24.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.028+0000 7fdb9e7fc640 1 -- 172.21.15.106:0/482166743 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdba400b040 con 0x7fdba80c53d0 2023-12-22T09:15:24.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.029+0000 7fdb9e7fc640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb8c06a430 0x7fdb8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.029+0000 7fdb9e7fc640 1 -- 172.21.15.106:0/482166743 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdba4089670 con 0x7fdba80c53d0 2023-12-22T09:15:24.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.029+0000 7fdbad564640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb8c06a430 0x7fdb8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.030+0000 7fdbad564640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb8c06a430 0x7fdb8c06c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb98035000 tx=0x7fdb98030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:24.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.034+0000 7fdb9e7fc640 1 -- 172.21.15.106:0/482166743 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdba4054930 con 0x7fdba80c53d0 2023-12-22T09:15:24.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.226+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdba8073f10 con 0x7fdba80c53d0 2023-12-22T09:15:24.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.227+0000 7fdb9e7fc640 1 -- 172.21.15.106:0/482166743 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdba4057f50 con 0x7fdba80c53d0 2023-12-22T09:15:24.228 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:24.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb8c06a430 msgr2=0x7fdb8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb8c06a430 0x7fdb8c06c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb98035000 tx=0x7fdb98030000 comp rx=0 tx=0).stop 2023-12-22T09:15:24.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba80c53d0 msgr2=0x7fdba81ea170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba80c53d0 0x7fdba81ea170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdba400ce00 tx=0x7fdba400a650 comp rx=0 tx=0).stop 2023-12-22T09:15:24.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 shutdown_connections 2023-12-22T09:15:24.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb8c06a430 0x7fdb8c06c8f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdba8153d70 0x7fdba814d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdba81515d0 0x7fdba8152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 --2- 172.21.15.106:0/482166743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdba80c53d0 0x7fdba81ea170 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 >> 172.21.15.106:0/482166743 conn(0x7fdba80a7be0 msgr2=0x7fdba806a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:24.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 shutdown_connections 2023-12-22T09:15:24.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.230+0000 7fdbaffc9640 1 -- 172.21.15.106:0/482166743 wait complete. 2023-12-22T09:15:24.249 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:24.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.464+0000 7f1137137640 1 Processor -- start 2023-12-22T09:15:24.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.465+0000 7f1137137640 1 -- start start 2023-12-22T09:15:24.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.466+0000 7f1137137640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11300c4af0 0x7f1130150e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.466+0000 7f1137137640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11301548e0 0x7f11301513c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.466+0000 7f1137137640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1130153d20 con 0x7f113006ace0 2023-12-22T09:15:24.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.466+0000 7f1137137640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1130151900 con 0x7f11300c4af0 2023-12-22T09:15:24.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.466+0000 7f1137137640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300c53c0 con 0x7f11301548e0 2023-12-22T09:15:24.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.467+0000 7f1136135640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f113006ace0 0x7f11301541d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41308/0 (socket says 172.21.15.106:41308) 2023-12-22T09:15:24.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.467+0000 7f1136135640 1 -- 172.21.15.106:0/2044673844 learned_addr learned my addr 172.21.15.106:0/2044673844 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:24.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.467+0000 7f1135934640 1 --2- 172.21.15.106:0/2044673844 >> v2:172.21.15.132:3300/0 conn(0x7f11300c4af0 0x7f1130150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.467+0000 7f1136936640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11301548e0 0x7f11301513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.467+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272378398 0 0) 0x7f1130153d20 con 0x7f113006ace0 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.467+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f111c003520 con 0x7f113006ace0 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.467+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1958799791 0 0) 0x7f111c003520 con 0x7f113006ace0 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11301548e0 msgr2=0x7f11301513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11301548e0 0x7f11301513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 >> v2:172.21.15.132:3300/0 conn(0x7f11300c4af0 msgr2=0x7f1130150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 --2- 172.21.15.106:0/2044673844 >> v2:172.21.15.132:3300/0 conn(0x7f11300c4af0 0x7f1130150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300c5660 con 0x7f113006ace0 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f112c001670 con 0x7f113006ace0 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 >> v1:172.21.15.106:6789/0 conn(0x7f113006ace0 legacy=0x7f11301541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11301548e0 0x7f111c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f111c003ef0 0x7f111c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f111c004d00 0x7f111c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1130151900 con 0x7f111c003ef0 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11300c53c0 con 0x7f111c004d00 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c00b9d0 con 0x7f11301548e0 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135934640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f111c003ef0 0x7f111c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1136135640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11301548e0 0x7f111c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135934640 1 -- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11301548e0 msgr2=0x7f111c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135934640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f11301548e0 0x7f111c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135934640 1 -- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f111c004d00 msgr2=0x7f111c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.468+0000 7f1135934640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f111c004d00 0x7f111c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.469+0000 7f1135934640 1 -- 172.21.15.106:0/2044673844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c003520 con 0x7f111c003ef0 2023-12-22T09:15:24.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.470+0000 7f1135934640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f111c003ef0 0x7f111c0047c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1120009ac0 tx=0x7f111c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c875bfadb3228ec3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:24.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.470+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112002c6b0 con 0x7f111c003ef0 2023-12-22T09:15:24.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.470+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112002c810 con 0x7f111c003ef0 2023-12-22T09:15:24.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.470+0000 7f1135133640 1 -- 172.21.15.106:0/2044673844 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112002cbc0 con 0x7f111c003ef0 2023-12-22T09:15:24.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.471+0000 7f1137137640 1 -- 172.21.15.106:0/2044673844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f111c003ef0 msgr2=0x7f111c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.471+0000 7f1137137640 1 --2- 172.21.15.106:0/2044673844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f111c003ef0 0x7f111c0047c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1120009ac0 tx=0x7f111c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.471+0000 7f1136936640 1 -- 172.21.15.106:0/2044673844 reap_dead start 2023-12-22T09:15:24.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.471+0000 7f1137137640 1 -- 172.21.15.106:0/2044673844 shutdown_connections 2023-12-22T09:15:24.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.471+0000 7f1137137640 1 -- 172.21.15.106:0/2044673844 >> 172.21.15.106:0/2044673844 conn(0x7f11300c5f70 msgr2=0x7f11300c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:24.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.471+0000 7f1137137640 1 -- 172.21.15.106:0/2044673844 shutdown_connections 2023-12-22T09:15:24.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.471+0000 7f1137137640 1 -- 172.21.15.106:0/2044673844 wait complete. 2023-12-22T09:15:24.476 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.473+0000 7f1137137640 1 Processor -- start 2023-12-22T09:15:24.476 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.473+0000 7f1137137640 1 -- start start 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.474+0000 7f1137137640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f111c003ef0 0x7f11300c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.474+0000 7f1137137640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11301465a0 0x7f1130152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.474+0000 7f1137137640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11301e8c70 0x7f11301e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.474+0000 7f1137137640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11301ecd10 con 0x7f11301465a0 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.474+0000 7f1137137640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11300c34b0 con 0x7f11301e8c70 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.474+0000 7f1137137640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11301ed1a0 con 0x7f111c003ef0 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1135934640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11301465a0 0x7f1130152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1135934640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11301465a0 0x7f1130152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40002/0 (socket says 172.21.15.106:40002) 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1135934640 1 -- 172.21.15.106:0/2319705889 learned_addr learned my addr 172.21.15.106:0/2319705889 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1136135640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f111c003ef0 0x7f11300c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1136936640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11301e8c70 0x7f11301e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1135934640 1 -- 172.21.15.106:0/2319705889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f111c003ef0 msgr2=0x7f11300c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1135934640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f111c003ef0 0x7f11300c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1135934640 1 -- 172.21.15.106:0/2319705889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11301e8c70 msgr2=0x7f11301e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1135934640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11301e8c70 0x7f11301e9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1135934640 1 -- 172.21.15.106:0/2319705889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300ab1f0 con 0x7f11301465a0 2023-12-22T09:15:24.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.475+0000 7f1135934640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11301465a0 0x7f1130152f40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1120009be0 tx=0x7f1120004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:24.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.476+0000 7f1126ffd640 1 -- 172.21.15.106:0/2319705889 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120034a10 con 0x7f11301465a0 2023-12-22T09:15:24.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.476+0000 7f1126ffd640 1 -- 172.21.15.106:0/2319705889 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120034b70 con 0x7f11301465a0 2023-12-22T09:15:24.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.476+0000 7f1126ffd640 1 -- 172.21.15.106:0/2319705889 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112003e400 con 0x7f11301465a0 2023-12-22T09:15:24.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.476+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11301ec3e0 con 0x7f11301465a0 2023-12-22T09:15:24.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.476+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11301ec9a0 con 0x7f11301465a0 2023-12-22T09:15:24.479 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.477+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113008b340 con 0x7f11301465a0 2023-12-22T09:15:24.479 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.478+0000 7f1126ffd640 1 -- 172.21.15.106:0/2319705889 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f112003e560 con 0x7f11301465a0 2023-12-22T09:15:24.480 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.480+0000 7f1126ffd640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f111406a480 0x7f111406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.480 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.480+0000 7f1126ffd640 1 -- 172.21.15.106:0/2319705889 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f11200aaa70 con 0x7f11301465a0 2023-12-22T09:15:24.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.480+0000 7f1136135640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f111406a480 0x7f111406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.481+0000 7f1136135640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f111406a480 0x7f111406c940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f112c005a30 tx=0x7f112c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:24.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.485+0000 7f1126ffd640 1 -- 172.21.15.106:0/2319705889 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1120075ec0 con 0x7f11301465a0 2023-12-22T09:15:24.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.673+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f113004e8d0 con 0x7f11301465a0 2023-12-22T09:15:24.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.674+0000 7f1126ffd640 1 -- 172.21.15.106:0/2319705889 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f11200794e0 con 0x7f11301465a0 2023-12-22T09:15:24.674 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:24.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f111406a480 msgr2=0x7f111406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f111406a480 0x7f111406c940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f112c005a30 tx=0x7f112c009040 comp rx=0 tx=0).stop 2023-12-22T09:15:24.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11301465a0 msgr2=0x7f1130152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11301465a0 0x7f1130152f40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1120009be0 tx=0x7f1120004730 comp rx=0 tx=0).stop 2023-12-22T09:15:24.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 shutdown_connections 2023-12-22T09:15:24.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f111406a480 0x7f111406c940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11301e8c70 0x7f11301e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11301465a0 0x7f1130152f40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 --2- 172.21.15.106:0/2319705889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f111c003ef0 0x7f11300c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.676+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 >> 172.21.15.106:0/2319705889 conn(0x7f11300c5f70 msgr2=0x7f11301525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:24.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.677+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 shutdown_connections 2023-12-22T09:15:24.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.677+0000 7f1137137640 1 -- 172.21.15.106:0/2319705889 wait complete. 2023-12-22T09:15:24.696 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.901+0000 7f4a88f15640 1 Processor -- start 2023-12-22T09:15:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.901+0000 7f4a88f15640 1 -- start start 2023-12-22T09:15:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.902+0000 7f4a88f15640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84071510 0x7f4a8415d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.902+0000 7f4a88f15640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a84152300 con 0x7f4a8414f050 2023-12-22T09:15:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.902+0000 7f4a88f15640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8414f430 con 0x7f4a840a8150 2023-12-22T09:15:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.902+0000 7f4a88f15640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841519f0 con 0x7f4a84071510 2023-12-22T09:15:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a837fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4a8414f050 0x7f4a840c1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41318/0 (socket says 172.21.15.106:41318) 2023-12-22T09:15:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a837fe640 1 -- 172.21.15.106:0/200850280 learned_addr learned my addr 172.21.15.106:0/200850280 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553829519 0 0) 0x7f4a84152300 con 0x7f4a8414f050 2023-12-22T09:15:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a83fff640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84071510 0x7f4a8415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a70003520 con 0x7f4a8414f050 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3715813966 0 0) 0x7f4a70003520 con 0x7f4a8414f050 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84071510 msgr2=0x7f4a8415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a82ffd640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84071510 0x7f4a8415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 >> v1:172.21.15.132:6789/0 conn(0x7f4a840a8150 legacy=0x7f4a84070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840c0860 con 0x7f4a8414f050 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.903+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f4a74001670 con 0x7f4a8414f050 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 >> v1:172.21.15.106:6789/0 conn(0x7f4a8414f050 legacy=0x7f4a840c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a82ffd640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a700039a0 0x7f4a70003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a82ffd640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a700047c0 0x7f4a70004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a82ffd640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84071510 0x7f4a700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841519f0 con 0x7f4a700047c0 2023-12-22T09:15:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7000bab0 con 0x7f4a700039a0 2023-12-22T09:15:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7000bc70 con 0x7f4a84071510 2023-12-22T09:15:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a7bfff640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a700047c0 0x7f4a70004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a83fff640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84071510 0x7f4a700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a837fe640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a700039a0 0x7f4a70003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a7bfff640 1 -- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84071510 msgr2=0x7f4a700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a7bfff640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84071510 0x7f4a700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a7bfff640 1 -- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a700039a0 msgr2=0x7f4a70003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a7bfff640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a700039a0 0x7f4a70003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a7bfff640 1 -- 172.21.15.106:0/200850280 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70003520 con 0x7f4a700047c0 2023-12-22T09:15:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.904+0000 7f4a83fff640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84071510 0x7f4a700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.906+0000 7f4a7bfff640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a700047c0 0x7f4a70004c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001750 tx=0x7f4a700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615d578e68caa529 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.906+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0052d0 con 0x7f4a700047c0 2023-12-22T09:15:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.906+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c02e050 con 0x7f4a700047c0 2023-12-22T09:15:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.906+0000 7f4a82ffd640 1 -- 172.21.15.106:0/200850280 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0035f0 con 0x7f4a700047c0 2023-12-22T09:15:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.906+0000 7f4a88f15640 1 -- 172.21.15.106:0/200850280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a700047c0 msgr2=0x7f4a70004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.906+0000 7f4a88f15640 1 --2- 172.21.15.106:0/200850280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a700047c0 0x7f4a70004c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001750 tx=0x7f4a700057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.906+0000 7f4a83fff640 1 -- 172.21.15.106:0/200850280 reap_dead start 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.906+0000 7f4a88f15640 1 -- 172.21.15.106:0/200850280 shutdown_connections 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.906+0000 7f4a88f15640 1 -- 172.21.15.106:0/200850280 >> 172.21.15.106:0/200850280 conn(0x7f4a84069dd0 msgr2=0x7f4a8406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.907+0000 7f4a88f15640 1 -- 172.21.15.106:0/200850280 shutdown_connections 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.907+0000 7f4a88f15640 1 -- 172.21.15.106:0/200850280 wait complete. 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.908+0000 7f4a88f15640 1 Processor -- start 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.908+0000 7f4a88f15640 1 -- start start 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.909+0000 7f4a88f15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a700047c0 0x7f4a840a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.909+0000 7f4a88f15640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a841478b0 0x7f4a840c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.909+0000 7f4a88f15640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84152d40 0x7f4a840c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.909+0000 7f4a88f15640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841ea950 con 0x7f4a841478b0 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.909+0000 7f4a88f15640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841eaed0 con 0x7f4a700047c0 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.909+0000 7f4a88f15640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840c5ba0 con 0x7f4a84152d40 2023-12-22T09:15:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a7bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a841478b0 0x7f4a840c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a7bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a841478b0 0x7f4a840c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40016/0 (socket says 172.21.15.106:40016) 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a7bfff640 1 -- 172.21.15.106:0/1966602245 learned_addr learned my addr 172.21.15.106:0/1966602245 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a837fe640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a700047c0 0x7f4a840a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a7bfff640 1 -- 172.21.15.106:0/1966602245 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84152d40 msgr2=0x7f4a840c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a7bfff640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84152d40 0x7f4a840c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a7bfff640 1 -- 172.21.15.106:0/1966602245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a700047c0 msgr2=0x7f4a840a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a7bfff640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a700047c0 0x7f4a840a9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a7bfff640 1 -- 172.21.15.106:0/1966602245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840c5df0 con 0x7f4a841478b0 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.910+0000 7f4a7bfff640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a841478b0 0x7f4a840c43c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c008fd0 tx=0x7f4a6c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.911+0000 7f4a80ff9640 1 -- 172.21.15.106:0/1966602245 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c007a30 con 0x7f4a841478b0 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.911+0000 7f4a80ff9640 1 -- 172.21.15.106:0/1966602245 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c007640 con 0x7f4a841478b0 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.911+0000 7f4a80ff9640 1 -- 172.21.15.106:0/1966602245 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c006c40 con 0x7f4a841478b0 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.911+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a841eab60 con 0x7f4a841478b0 2023-12-22T09:15:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.911+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a840c4e40 con 0x7f4a841478b0 2023-12-22T09:15:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.912+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a840c40e0 con 0x7f4a841478b0 2023-12-22T09:15:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.913+0000 7f4a80ff9640 1 -- 172.21.15.106:0/1966602245 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4a6c0035f0 con 0x7f4a841478b0 2023-12-22T09:15:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.914+0000 7f4a80ff9640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a6406a430 0x7f4a6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.914+0000 7f4a80ff9640 1 -- 172.21.15.106:0/1966602245 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4a6c0aa8b0 con 0x7f4a841478b0 2023-12-22T09:15:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.914+0000 7f4a837fe640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a6406a430 0x7f4a6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.915+0000 7f4a837fe640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a6406a430 0x7f4a6406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4a740017a0 tx=0x7f4a74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:24.918+0000 7f4a80ff9640 1 -- 172.21.15.106:0/1966602245 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4a840c40e0 con 0x7f4a841478b0 2023-12-22T09:15:25.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.111+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a840c40e0 con 0x7f4a841478b0 2023-12-22T09:15:25.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.114+0000 7f4a80ff9640 1 -- 172.21.15.106:0/1966602245 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7f4a840c40e0 con 0x7f4a841478b0 2023-12-22T09:15:25.115 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:25.115 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:25.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.116+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a6406a430 msgr2=0x7f4a6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.116+0000 7f4a88f15640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a6406a430 0x7f4a6406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4a740017a0 tx=0x7f4a74009040 comp rx=0 tx=0).stop 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.116+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a841478b0 msgr2=0x7f4a840c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.116+0000 7f4a88f15640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a841478b0 0x7f4a840c43c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c008fd0 tx=0x7f4a6c001120 comp rx=0 tx=0).stop 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.117+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 shutdown_connections 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.117+0000 7f4a88f15640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a6406a430 0x7f4a6406c8f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.117+0000 7f4a88f15640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a84152d40 0x7f4a840c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.117+0000 7f4a88f15640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a841478b0 0x7f4a840c43c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.117+0000 7f4a88f15640 1 --2- 172.21.15.106:0/1966602245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a700047c0 0x7f4a840a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.117+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 >> 172.21.15.106:0/1966602245 conn(0x7f4a84069dd0 msgr2=0x7f4a8414f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.117+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 shutdown_connections 2023-12-22T09:15:25.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.117+0000 7f4a88f15640 1 -- 172.21.15.106:0/1966602245 wait complete. 2023-12-22T09:15:25.137 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:25.137 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:25.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.339+0000 7f70bf3c9640 1 Processor -- start 2023-12-22T09:15:25.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.340+0000 7f70bf3c9640 1 -- start start 2023-12-22T09:15:25.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.341+0000 7f70bf3c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80c75e0 0x7f70b8151070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.341+0000 7f70bf3c9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80c4660 con 0x7f70b80c4160 2023-12-22T09:15:25.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.341+0000 7f70bf3c9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b806b7a0 con 0x7f70b80c4b80 2023-12-22T09:15:25.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.341+0000 7f70bf3c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8153d90 con 0x7f70b80c75e0 2023-12-22T09:15:25.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.341+0000 7f70bd966640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f70b80c4160 0x7f70b815e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41322/0 (socket says 172.21.15.106:41322) 2023-12-22T09:15:25.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.341+0000 7f70bd966640 1 -- 172.21.15.106:0/1152004024 learned_addr learned my addr 172.21.15.106:0/1152004024 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:25.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.341+0000 7f70bc964640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80c75e0 0x7f70b8151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549598080 0 0) 0x7f70b80c4660 con 0x7f70b80c4160 2023-12-22T09:15:25.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a4003520 con 0x7f70b80c4160 2023-12-22T09:15:25.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 482011751 0 0) 0x7f70a4003520 con 0x7f70b80c4160 2023-12-22T09:15:25.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80c75e0 msgr2=0x7f70b8151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:25.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80c75e0 0x7f70b8151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 >> v1:172.21.15.132:6789/0 conn(0x7f70b80c4b80 legacy=0x7f70b81544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b806b1e0 con 0x7f70b80c4160 2023-12-22T09:15:25.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f70b00019f0 con 0x7f70b80c4160 2023-12-22T09:15:25.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 >> v1:172.21.15.106:6789/0 conn(0x7f70b80c4160 legacy=0x7f70b815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80c75e0 0x7f70a40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a4004d00 0x7f70a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a400bb10 con 0x7f70a4003f20 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a400bc50 con 0x7f70a4004d00 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.342+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a400be10 con 0x7f70b80c75e0 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.343+0000 7f70bc964640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.343+0000 7f70bc964640 1 -- 172.21.15.106:0/1152004024 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80c75e0 msgr2=0x7f70a40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.343+0000 7f70bc964640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80c75e0 0x7f70a40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.343+0000 7f70bc964640 1 -- 172.21.15.106:0/1152004024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a4004d00 msgr2=0x7f70a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.343+0000 7f70bc964640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70a4004d00 0x7f70a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.343+0000 7f70bc964640 1 -- 172.21.15.106:0/1152004024 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4003520 con 0x7f70a4003f20 2023-12-22T09:15:25.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.344+0000 7f70bc964640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70a40047c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009a90 tx=0x7f70a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dadc080fdf80a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.344+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a802c6b0 con 0x7f70a4003f20 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.344+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a802c810 con 0x7f70a4003f20 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.344+0000 7f70affff640 1 -- 172.21.15.106:0/1152004024 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a802cba0 con 0x7f70a4003f20 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.345+0000 7f70bf3c9640 1 -- 172.21.15.106:0/1152004024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 msgr2=0x7f70a40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.345+0000 7f70bf3c9640 1 --2- 172.21.15.106:0/1152004024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70a40047c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009a90 tx=0x7f70a40057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.345+0000 7f70bd966640 1 -- 172.21.15.106:0/1152004024 reap_dead start 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.345+0000 7f70bf3c9640 1 -- 172.21.15.106:0/1152004024 shutdown_connections 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.345+0000 7f70bf3c9640 1 -- 172.21.15.106:0/1152004024 >> 172.21.15.106:0/1152004024 conn(0x7f70b80ab1d0 msgr2=0x7f70b80ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.345+0000 7f70bf3c9640 1 -- 172.21.15.106:0/1152004024 shutdown_connections 2023-12-22T09:15:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.345+0000 7f70bf3c9640 1 -- 172.21.15.106:0/1152004024 wait complete. 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.347+0000 7f70bf3c9640 1 Processor -- start 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.347+0000 7f70bf3c9640 1 -- start start 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bf3c9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70b80c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bf3c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b80bedd0 0x7f70b80ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bf3c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80be810 0x7f70b80bdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bf3c9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80ae780 con 0x7f70a4003f20 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bf3c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80bf680 con 0x7f70b80bedd0 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bf3c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80bf960 con 0x7f70b80be810 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bd165640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70b80c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bd165640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70b80c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40036/0 (socket says 172.21.15.106:40036) 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bd165640 1 -- 172.21.15.106:0/409874874 learned_addr learned my addr 172.21.15.106:0/409874874 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:25.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bd165640 1 -- 172.21.15.106:0/409874874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80be810 msgr2=0x7f70b80bdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bd165640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80be810 0x7f70b80bdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bd165640 1 -- 172.21.15.106:0/409874874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b80bedd0 msgr2=0x7f70b80ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bd165640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b80bedd0 0x7f70b80ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.348+0000 7f70bd165640 1 -- 172.21.15.106:0/409874874 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80bd2b0 con 0x7f70a4003f20 2023-12-22T09:15:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.349+0000 7f70bd165640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70b80c07b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c500 tx=0x7f70b400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.349+0000 7f70adffb640 1 -- 172.21.15.106:0/409874874 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40052d0 con 0x7f70a4003f20 2023-12-22T09:15:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.349+0000 7f70adffb640 1 -- 172.21.15.106:0/409874874 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4005430 con 0x7f70a4003f20 2023-12-22T09:15:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.349+0000 7f70adffb640 1 -- 172.21.15.106:0/409874874 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4012870 con 0x7f70a4003f20 2023-12-22T09:15:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.349+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b80bd590 con 0x7f70a4003f20 2023-12-22T09:15:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.349+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b80aedf0 con 0x7f70a4003f20 2023-12-22T09:15:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.350+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b8073f10 con 0x7f70a4003f20 2023-12-22T09:15:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.351+0000 7f70adffb640 1 -- 172.21.15.106:0/409874874 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f70b40129d0 con 0x7f70a4003f20 2023-12-22T09:15:25.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.352+0000 7f70adffb640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f709c06a460 0x7f709c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.352+0000 7f70adffb640 1 -- 172.21.15.106:0/409874874 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f70b4088900 con 0x7f70a4003f20 2023-12-22T09:15:25.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.352+0000 7f70bc964640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f709c06a460 0x7f709c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.353+0000 7f70bc964640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f709c06a460 0x7f709c06c920 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009a90 tx=0x7f70a802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:25.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.356+0000 7f70adffb640 1 -- 172.21.15.106:0/409874874 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70b4053b20 con 0x7f70a4003f20 2023-12-22T09:15:25.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.529+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70b80c8a60 con 0x7f70a4003f20 2023-12-22T09:15:25.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.530+0000 7f70adffb640 1 -- 172.21.15.106:0/409874874 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70b4057140 con 0x7f70a4003f20 2023-12-22T09:15:25.531 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:25.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f709c06a460 msgr2=0x7f709c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f709c06a460 0x7f709c06c920 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009a90 tx=0x7f70a802e000 comp rx=0 tx=0).stop 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 msgr2=0x7f70b80c07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70b80c07b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c500 tx=0x7f70b400c9c0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 shutdown_connections 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f709c06a460 0x7f709c06c920 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70b80be810 0x7f70b80bdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b80bedd0 0x7f70b80ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 --2- 172.21.15.106:0/409874874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a4003f20 0x7f70b80c07b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.532+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 >> 172.21.15.106:0/409874874 conn(0x7f70b80ab1d0 msgr2=0x7f70b8150100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.533+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 shutdown_connections 2023-12-22T09:15:25.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.533+0000 7f70bf3c9640 1 -- 172.21.15.106:0/409874874 wait complete. 2023-12-22T09:15:25.549 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.744+0000 7f28ab739640 1 Processor -- start 2023-12-22T09:15:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.745+0000 7f28ab739640 1 -- start start 2023-12-22T09:15:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.746+0000 7f28ab739640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f28a4151400 0x7f28a40c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.746+0000 7f28ab739640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a40bcc70 con 0x7f28a40c7620 2023-12-22T09:15:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.746+0000 7f28ab739640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a40c42d0 con 0x7f28a406ca20 2023-12-22T09:15:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.746+0000 7f28ab739640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a41517e0 con 0x7f28a4151400 2023-12-22T09:15:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.746+0000 7f28a9cd6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f28a40c7620 0x7f28a415e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41330/0 (socket says 172.21.15.106:41330) 2023-12-22T09:15:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.746+0000 7f28a9cd6640 1 -- 172.21.15.106:0/266764463 learned_addr learned my addr 172.21.15.106:0/266764463 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f28a94d5640 1 --2- 172.21.15.106:0/266764463 >> v2:172.21.15.132:3300/0 conn(0x7f28a4151400 0x7f28a40c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486845236 0 0) 0x7f28a40bcc70 con 0x7f28a40c7620 2023-12-22T09:15:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2890003520 con 0x7f28a40c7620 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3428348025 0 0) 0x7f2890003520 con 0x7f28a40c7620 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 >> v2:172.21.15.132:3300/0 conn(0x7f28a4151400 msgr2=0x7f28a40c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 --2- 172.21.15.106:0/266764463 >> v2:172.21.15.132:3300/0 conn(0x7f28a4151400 0x7f28a40c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 >> v1:172.21.15.132:6789/0 conn(0x7f28a406ca20 legacy=0x7f28a406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a40c4760 con 0x7f28a40c7620 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f289c0019f0 con 0x7f28a40c7620 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 >> v1:172.21.15.106:6789/0 conn(0x7f28a40c7620 legacy=0x7f28a415e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2890003970 0x7f2890003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900047c0 0x7f2890004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28900052a0 0x7f289000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a41517e0 con 0x7f28900052a0 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289000c170 con 0x7f2890003970 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.747+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289000c330 con 0x7f28900047c0 2023-12-22T09:15:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.748+0000 7f28a9cd6640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28900052a0 0x7f289000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.748+0000 7f28a94d5640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2890003970 0x7f2890003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.748+0000 7f28a8cd4640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900047c0 0x7f2890004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.748+0000 7f28a9cd6640 1 -- 172.21.15.106:0/266764463 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900047c0 msgr2=0x7f2890004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.748+0000 7f28a9cd6640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900047c0 0x7f2890004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.748+0000 7f28a9cd6640 1 -- 172.21.15.106:0/266764463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2890003970 msgr2=0x7f2890003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.748+0000 7f28a9cd6640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2890003970 0x7f2890003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.748+0000 7f28a9cd6640 1 -- 172.21.15.106:0/266764463 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890003520 con 0x7f28900052a0 2023-12-22T09:15:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.748+0000 7f28a8cd4640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900047c0 0x7f2890004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.749+0000 7f28a9cd6640 1 -- 172.21.15.106:0/266764463 reap_dead start 2023-12-22T09:15:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.749+0000 7f28a9cd6640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28900052a0 0x7f289000b980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f289c00a800 tx=0x7f28900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e9831e0b9b9811 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.749+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c0072d0 con 0x7f28900052a0 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.749+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c02f070 con 0x7f28900052a0 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.749+0000 7f289bfff640 1 -- 172.21.15.106:0/266764463 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c007670 con 0x7f28900052a0 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.750+0000 7f28ab739640 1 -- 172.21.15.106:0/266764463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28900052a0 msgr2=0x7f289000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.750+0000 7f28ab739640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28900052a0 0x7f289000b980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f289c00a800 tx=0x7f28900057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.750+0000 7f28ab739640 1 -- 172.21.15.106:0/266764463 shutdown_connections 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.750+0000 7f28ab739640 1 --2- 172.21.15.106:0/266764463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28900052a0 0x7f289000b980 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.750+0000 7f28ab739640 1 -- 172.21.15.106:0/266764463 >> 172.21.15.106:0/266764463 conn(0x7f28a40ab310 msgr2=0x7f28a40ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.750+0000 7f28ab739640 1 -- 172.21.15.106:0/266764463 shutdown_connections 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.750+0000 7f28ab739640 1 -- 172.21.15.106:0/266764463 wait complete. 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.752+0000 7f28ab739640 1 Processor -- start 2023-12-22T09:15:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.752+0000 7f28ab739640 1 -- start start 2023-12-22T09:15:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28ab739640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900052a0 0x7f28a41ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28ab739640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a41520e0 0x7f28a40aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28ab739640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a40c7f10 0x7f28a41e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28ab739640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a41ec770 con 0x7f28a41520e0 2023-12-22T09:15:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28ab739640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40ca400 con 0x7f28a40c7f10 2023-12-22T09:15:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28ab739640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a4150510 con 0x7f28900052a0 2023-12-22T09:15:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28a8cd4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a41520e0 0x7f28a40aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28a8cd4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a41520e0 0x7f28a40aaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40052/0 (socket says 172.21.15.106:40052) 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28a8cd4640 1 -- 172.21.15.106:0/1082523693 learned_addr learned my addr 172.21.15.106:0/1082523693 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28a94d5640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900052a0 0x7f28a41ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.753+0000 7f28a9cd6640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a40c7f10 0x7f28a41e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f28a8cd4640 1 -- 172.21.15.106:0/1082523693 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900052a0 msgr2=0x7f28a41ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f28a8cd4640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900052a0 0x7f28a41ecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f28a8cd4640 1 -- 172.21.15.106:0/1082523693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a40c7f10 msgr2=0x7f28a41e8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f28a8cd4640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a40c7f10 0x7f28a41e8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f28a8cd4640 1 -- 172.21.15.106:0/1082523693 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a41ec140 con 0x7f28a41520e0 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f28a9cd6640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a40c7f10 0x7f28a41e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f28a8cd4640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a41520e0 0x7f28a40aaa30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f289400d540 tx=0x7f289400da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f2899ffb640 1 -- 172.21.15.106:0/1082523693 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894005480 con 0x7f28a41520e0 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f2899ffb640 1 -- 172.21.15.106:0/1082523693 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2894003610 con 0x7f28a41520e0 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f2899ffb640 1 -- 172.21.15.106:0/1082523693 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894003a00 con 0x7f28a41520e0 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a4150760 con 0x7f28a41520e0 2023-12-22T09:15:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.754+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a41ec390 con 0x7f28a41520e0 2023-12-22T09:15:25.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.755+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a41ec8b0 con 0x7f28a41520e0 2023-12-22T09:15:25.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.756+0000 7f2899ffb640 1 -- 172.21.15.106:0/1082523693 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2894003b60 con 0x7f28a41520e0 2023-12-22T09:15:25.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.757+0000 7f2899ffb640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f288806a460 0x7f288806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.757+0000 7f2899ffb640 1 -- 172.21.15.106:0/1082523693 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2894088b90 con 0x7f28a41520e0 2023-12-22T09:15:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.758+0000 7f28a94d5640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f288806a460 0x7f288806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.758+0000 7f28a94d5640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f288806a460 0x7f288806c920 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009990 tx=0x7f28a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:25.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.762+0000 7f2899ffb640 1 -- 172.21.15.106:0/1082523693 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f28a41ec8b0 con 0x7f28a41520e0 2023-12-22T09:15:25.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.948+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28a41ec8b0 con 0x7f28a41520e0 2023-12-22T09:15:25.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.949+0000 7f2899ffb640 1 -- 172.21.15.106:0/1082523693 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28a41ec8b0 con 0x7f28a41520e0 2023-12-22T09:15:25.950 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:25.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f288806a460 msgr2=0x7f288806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f288806a460 0x7f288806c920 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009990 tx=0x7f28a0008040 comp rx=0 tx=0).stop 2023-12-22T09:15:25.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a41520e0 msgr2=0x7f28a40aaa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:25.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a41520e0 0x7f28a40aaa30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f289400d540 tx=0x7f289400da00 comp rx=0 tx=0).stop 2023-12-22T09:15:25.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 shutdown_connections 2023-12-22T09:15:25.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f288806a460 0x7f288806c920 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a40c7f10 0x7f28a41e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a41520e0 0x7f28a40aaa30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 --2- 172.21.15.106:0/1082523693 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28900052a0 0x7f28a41ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:25.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 >> 172.21.15.106:0/1082523693 conn(0x7f28a40ab310 msgr2=0x7f28a414aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:25.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.952+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 shutdown_connections 2023-12-22T09:15:25.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:25.953+0000 7f28ab739640 1 -- 172.21.15.106:0/1082523693 wait complete. 2023-12-22T09:15:25.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:26.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.186+0000 7fbe01f47640 1 Processor -- start 2023-12-22T09:15:26.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.187+0000 7fbe01f47640 1 -- start start 2023-12-22T09:15:26.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.188+0000 7fbe01f47640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbdfc14f090 0x7fbdfc151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.188+0000 7fbe01f47640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbdfc0c1910 0x7fbdfc155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.188+0000 7fbe01f47640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc155120 con 0x7fbdfc155dd0 2023-12-22T09:15:26.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.188+0000 7fbe01f47640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc06e080 con 0x7fbdfc14f090 2023-12-22T09:15:26.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.188+0000 7fbe01f47640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc0a8720 con 0x7fbdfc0c1910 2023-12-22T09:15:26.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfbfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbdfc155dd0 0x7fbdfc0c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41340/0 (socket says 172.21.15.106:41340) 2023-12-22T09:15:26.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfb7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbdfc14f090 0x7fbdfc151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfbfff640 1 -- 172.21.15.106:0/2136316257 learned_addr learned my addr 172.21.15.106:0/2136316257 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:26.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfaffd640 1 --2- 172.21.15.106:0/2136316257 >> v2:172.21.15.132:3300/0 conn(0x7fbdfc0c1910 0x7fbdfc155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfa7fc640 1 -- 172.21.15.106:0/2136316257 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636536887 0 0) 0x7fbdfc155120 con 0x7fbdfc155dd0 2023-12-22T09:15:26.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfa7fc640 1 -- 172.21.15.106:0/2136316257 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde4003520 con 0x7fbdfc155dd0 2023-12-22T09:15:26.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfb7fe640 1 -- 172.21.15.106:0/2136316257 >> v2:172.21.15.132:3300/0 conn(0x7fbdfc0c1910 msgr2=0x7fbdfc155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:26.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfb7fe640 1 --2- 172.21.15.106:0/2136316257 >> v2:172.21.15.132:3300/0 conn(0x7fbdfc0c1910 0x7fbdfc155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfb7fe640 1 -- 172.21.15.106:0/2136316257 >> v1:172.21.15.106:6789/0 conn(0x7fbdfc155dd0 legacy=0x7fbdfc0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.189+0000 7fbdfb7fe640 1 -- 172.21.15.106:0/2136316257 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0a8a00 con 0x7fbdfc14f090 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.190+0000 7fbdfb7fe640 1 --2- 172.21.15.106:0/2136316257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc14f090 0x7fbdfc151b30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0c2ef0 tx=0x7fbdec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c394020b489429 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbdfa7fc640 1 -- 172.21.15.106:0/2136316257 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec02e070 con 0x7fbdfc14f090 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbdfa7fc640 1 -- 172.21.15.106:0/2136316257 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec0315a0 con 0x7fbdfc14f090 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbdfa7fc640 1 -- 172.21.15.106:0/2136316257 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec031930 con 0x7fbdfc14f090 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbe01f47640 1 -- 172.21.15.106:0/2136316257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc14f090 msgr2=0x7fbdfc151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbe01f47640 1 --2- 172.21.15.106:0/2136316257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc14f090 0x7fbdfc151b30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0c2ef0 tx=0x7fbdec02b840 comp rx=0 tx=0).stop 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbe01f47640 1 -- 172.21.15.106:0/2136316257 shutdown_connections 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbe01f47640 1 --2- 172.21.15.106:0/2136316257 >> v2:172.21.15.132:3300/0 conn(0x7fbdfc0c1910 0x7fbdfc155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbe01f47640 1 --2- 172.21.15.106:0/2136316257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc14f090 0x7fbdfc151b30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbe01f47640 1 -- 172.21.15.106:0/2136316257 >> 172.21.15.106:0/2136316257 conn(0x7fbdfc069dd0 msgr2=0x7fbdfc06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbe01f47640 1 -- 172.21.15.106:0/2136316257 shutdown_connections 2023-12-22T09:15:26.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.191+0000 7fbe01f47640 1 -- 172.21.15.106:0/2136316257 wait complete. 2023-12-22T09:15:26.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.193+0000 7fbe01f47640 1 Processor -- start 2023-12-22T09:15:26.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.193+0000 7fbe01f47640 1 -- start start 2023-12-22T09:15:26.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.194+0000 7fbe01f47640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc0c1910 0x7fbdfc140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.194+0000 7fbe01f47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc14f090 0x7fbdfc0c0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.194+0000 7fbe01f47640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc140c90 0x7fbdfc1e9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.194+0000 7fbe01f47640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc1e90d0 con 0x7fbdfc0c1910 2023-12-22T09:15:26.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.194+0000 7fbe01f47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc1514a0 con 0x7fbdfc14f090 2023-12-22T09:15:26.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.194+0000 7fbe01f47640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc0702f0 con 0x7fbdfc140c90 2023-12-22T09:15:26.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.194+0000 7fbdfb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc0c1910 0x7fbdfc140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.194+0000 7fbdfb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc0c1910 0x7fbdfc140750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40080/0 (socket says 172.21.15.106:40080) 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.194+0000 7fbdfb7fe640 1 -- 172.21.15.106:0/3197790324 learned_addr learned my addr 172.21.15.106:0/3197790324 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbdfaffd640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc14f090 0x7fbdfc0c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbdfbfff640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc140c90 0x7fbdfc1e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbdfb7fe640 1 -- 172.21.15.106:0/3197790324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc140c90 msgr2=0x7fbdfc1e9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbdfb7fe640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc140c90 0x7fbdfc1e9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbdfb7fe640 1 -- 172.21.15.106:0/3197790324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc14f090 msgr2=0x7fbdfc0c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbdfb7fe640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc14f090 0x7fbdfc0c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbdfb7fe640 1 -- 172.21.15.106:0/3197790324 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec009400 con 0x7fbdfc0c1910 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbdfaffd640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc14f090 0x7fbdfc0c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbdfb7fe640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc0c1910 0x7fbdfc140750 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009860 tx=0x7fbdec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbde3fff640 1 -- 172.21.15.106:0/3197790324 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec032840 con 0x7fbdfc0c1910 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbde3fff640 1 -- 172.21.15.106:0/3197790324 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec0329a0 con 0x7fbdfc0c1910 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc06fd30 con 0x7fbdfc0c1910 2023-12-22T09:15:26.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.195+0000 7fbde3fff640 1 -- 172.21.15.106:0/3197790324 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec032d50 con 0x7fbdfc0c1910 2023-12-22T09:15:26.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.196+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc154100 con 0x7fbdfc0c1910 2023-12-22T09:15:26.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.197+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc1e8ec0 con 0x7fbdfc0c1910 2023-12-22T09:15:26.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.197+0000 7fbde3fff640 1 -- 172.21.15.106:0/3197790324 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbdec0453f0 con 0x7fbdfc0c1910 2023-12-22T09:15:26.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.198+0000 7fbde3fff640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbde806a430 0x7fbde806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.198+0000 7fbde3fff640 1 -- 172.21.15.106:0/3197790324 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbdec0aac20 con 0x7fbdfc0c1910 2023-12-22T09:15:26.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.199+0000 7fbdfaffd640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbde806a430 0x7fbde806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.199+0000 7fbdfaffd640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbde806a430 0x7fbde806c8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc1e6ab0 tx=0x7fbdf0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:26.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.203+0000 7fbde3fff640 1 -- 172.21.15.106:0/3197790324 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbdec075e40 con 0x7fbdfc0c1910 2023-12-22T09:15:26.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.392+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbdfc073f10 con 0x7fbdfc0c1910 2023-12-22T09:15:26.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.392+0000 7fbde3fff640 1 -- 172.21.15.106:0/3197790324 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbdec079460 con 0x7fbdfc0c1910 2023-12-22T09:15:26.393 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:26.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbde806a430 msgr2=0x7fbde806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbde806a430 0x7fbde806c8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc1e6ab0 tx=0x7fbdf0008040 comp rx=0 tx=0).stop 2023-12-22T09:15:26.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc0c1910 msgr2=0x7fbdfc140750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc0c1910 0x7fbdfc140750 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009860 tx=0x7fbdec0046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 shutdown_connections 2023-12-22T09:15:26.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbde806a430 0x7fbde806c8f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc140c90 0x7fbdfc1e9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc14f090 0x7fbdfc0c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 --2- 172.21.15.106:0/3197790324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdfc0c1910 0x7fbdfc140750 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 >> 172.21.15.106:0/3197790324 conn(0x7fbdfc069dd0 msgr2=0x7fbdfc0c4400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:26.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 shutdown_connections 2023-12-22T09:15:26.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.395+0000 7fbe01f47640 1 -- 172.21.15.106:0/3197790324 wait complete. 2023-12-22T09:15:26.414 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:26.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.629+0000 7f0665dd2640 1 Processor -- start 2023-12-22T09:15:26.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.630+0000 7f0665dd2640 1 -- start start 2023-12-22T09:15:26.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.631+0000 7f0665dd2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06600c1960 0x7f06601573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.631+0000 7f0665dd2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06600ab040 con 0x7f0660151640 2023-12-22T09:15:26.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.631+0000 7f0665dd2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066006bdc0 con 0x7f06600705a0 2023-12-22T09:15:26.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.631+0000 7f0665dd2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066006caf0 con 0x7f06600c1960 2023-12-22T09:15:26.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.631+0000 7f065f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0660151640 0x7f06600c5a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41352/0 (socket says 172.21.15.106:41352) 2023-12-22T09:15:26.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.631+0000 7f065f7fe640 1 -- 172.21.15.106:0/929659737 learned_addr learned my addr 172.21.15.106:0/929659737 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:26.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f0657fff640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06600c1960 0x7f06601573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527791708 0 0) 0x7f0650001110 con 0x7f0660151640 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f064c003520 con 0x7f0660151640 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141216024 0 0) 0x7f064c003520 con 0x7f0660151640 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06600c1960 msgr2=0x7f06601573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06600c1960 0x7f06601573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 >> v1:172.21.15.132:6789/0 conn(0x7f06600705a0 legacy=0x7f0660157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066006d890 con 0x7f0660151640 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f0650001800 con 0x7f0660151640 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 >> v1:172.21.15.106:6789/0 conn(0x7f0660151640 legacy=0x7f06600c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06600c1960 0x7f064c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c003f20 0x7f064c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c004d00 0x7f064c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066006caf0 con 0x7f064c003f20 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c00bbc0 con 0x7f064c004d00 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.632+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c00bd80 con 0x7f06600c1960 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f0657fff640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c003f20 0x7f064c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f065f7fe640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06600c1960 0x7f064c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f0657fff640 1 -- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06600c1960 msgr2=0x7f064c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f0657fff640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06600c1960 0x7f064c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f0657fff640 1 -- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c004d00 msgr2=0x7f064c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f065ffff640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c004d00 0x7f064c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f0657fff640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c004d00 0x7f064c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f0657fff640 1 -- 172.21.15.106:0/929659737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c003520 con 0x7f064c003f20 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f065ffff640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c004d00 0x7f064c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.633+0000 7f065f7fe640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06600c1960 0x7f064c0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:26.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.634+0000 7f0657fff640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c003f20 0x7f064c0047c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0648009ac0 tx=0x7f064c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e246e7d3b39b53 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:26.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064802c6b0 con 0x7f064c003f20 2023-12-22T09:15:26.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064802c810 con 0x7f064c003f20 2023-12-22T09:15:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f065effd640 1 -- 172.21.15.106:0/929659737 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064802cba0 con 0x7f064c003f20 2023-12-22T09:15:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f0665dd2640 1 -- 172.21.15.106:0/929659737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c003f20 msgr2=0x7f064c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f0665dd2640 1 --2- 172.21.15.106:0/929659737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f064c003f20 0x7f064c0047c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0648009ac0 tx=0x7f064c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f065ffff640 1 -- 172.21.15.106:0/929659737 reap_dead start 2023-12-22T09:15:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f0665dd2640 1 -- 172.21.15.106:0/929659737 shutdown_connections 2023-12-22T09:15:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f0665dd2640 1 -- 172.21.15.106:0/929659737 >> 172.21.15.106:0/929659737 conn(0x7f066006a220 msgr2=0x7f06600c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f0665dd2640 1 -- 172.21.15.106:0/929659737 shutdown_connections 2023-12-22T09:15:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.635+0000 7f0665dd2640 1 -- 172.21.15.106:0/929659737 wait complete. 2023-12-22T09:15:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.637+0000 7f0665dd2640 1 Processor -- start 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.637+0000 7f0665dd2640 1 -- start start 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.638+0000 7f0665dd2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064c003f20 0x7f06601ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.638+0000 7f0665dd2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06600a96a0 0x7f0660149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.638+0000 7f0665dd2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0660149660 0x7f06601e9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.638+0000 7f0665dd2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0660156670 con 0x7f06600a96a0 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.638+0000 7f0665dd2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0660157400 con 0x7f0660149660 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.638+0000 7f0665dd2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0660156880 con 0x7f064c003f20 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.638+0000 7f0657fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06600a96a0 0x7f0660149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f0657fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06600a96a0 0x7f0660149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40098/0 (socket says 172.21.15.106:40098) 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f0657fff640 1 -- 172.21.15.106:0/3428294896 learned_addr learned my addr 172.21.15.106:0/3428294896 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f065ffff640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0660149660 0x7f06601e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f0657fff640 1 -- 172.21.15.106:0/3428294896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064c003f20 msgr2=0x7f06601ecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f065f7fe640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064c003f20 0x7f06601ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f0657fff640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064c003f20 0x7f06601ecd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f0657fff640 1 -- 172.21.15.106:0/3428294896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0660149660 msgr2=0x7f06601e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f0657fff640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0660149660 0x7f06601e9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f0657fff640 1 -- 172.21.15.106:0/3428294896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660156b60 con 0x7f06600a96a0 2023-12-22T09:15:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f0657fff640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06600a96a0 0x7f0660149120 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0648037040 tx=0x7f0648004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f065cff9640 1 -- 172.21.15.106:0/3428294896 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648003810 con 0x7f06600a96a0 2023-12-22T09:15:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.639+0000 7f065cff9640 1 -- 172.21.15.106:0/3428294896 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648003970 con 0x7f06600a96a0 2023-12-22T09:15:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.640+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0660156e40 con 0x7f06600a96a0 2023-12-22T09:15:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.640+0000 7f065cff9640 1 -- 172.21.15.106:0/3428294896 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648003ce0 con 0x7f06600a96a0 2023-12-22T09:15:26.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.640+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0660157720 con 0x7f06600a96a0 2023-12-22T09:15:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.641+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0660073f10 con 0x7f06600a96a0 2023-12-22T09:15:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.642+0000 7f065cff9640 1 -- 172.21.15.106:0/3428294896 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0648047450 con 0x7f06600a96a0 2023-12-22T09:15:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.642+0000 7f065cff9640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f064006a430 0x7f064006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.643+0000 7f065cff9640 1 -- 172.21.15.106:0/3428294896 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06480ab0c0 con 0x7f06600a96a0 2023-12-22T09:15:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.643+0000 7f065f7fe640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f064006a430 0x7f064006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:26.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.643+0000 7f065f7fe640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f064006a430 0x7f064006c8f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0650001390 tx=0x7f0650009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:26.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.646+0000 7f065cff9640 1 -- 172.21.15.106:0/3428294896 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0648076420 con 0x7f06600a96a0 2023-12-22T09:15:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.837+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f06601e8da0 con 0x7f06600a96a0 2023-12-22T09:15:26.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.838+0000 7f065cff9640 1 -- 172.21.15.106:0/3428294896 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f06480044e0 con 0x7f06600a96a0 2023-12-22T09:15:26.839 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:26.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.840+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f064006a430 msgr2=0x7f064006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.840+0000 7f0665dd2640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f064006a430 0x7f064006c8f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0650001390 tx=0x7f0650009040 comp rx=0 tx=0).stop 2023-12-22T09:15:26.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.840+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06600a96a0 msgr2=0x7f0660149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.840+0000 7f0665dd2640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06600a96a0 0x7f0660149120 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0648037040 tx=0x7f0648004730 comp rx=0 tx=0).stop 2023-12-22T09:15:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.841+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 shutdown_connections 2023-12-22T09:15:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.841+0000 7f0665dd2640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f064006a430 0x7f064006c8f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.841+0000 7f0665dd2640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0660149660 0x7f06601e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.841+0000 7f0665dd2640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06600a96a0 0x7f0660149120 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.841+0000 7f0665dd2640 1 --2- 172.21.15.106:0/3428294896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064c003f20 0x7f06601ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.841+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 >> 172.21.15.106:0/3428294896 conn(0x7f066006a220 msgr2=0x7f066014fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.841+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 shutdown_connections 2023-12-22T09:15:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:26.841+0000 7f0665dd2640 1 -- 172.21.15.106:0/3428294896 wait complete. 2023-12-22T09:15:26.869 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-22T09:15:26.869 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.085+0000 7f0c057d9640 1 Processor -- start 2023-12-22T09:15:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.086+0000 7f0c057d9640 1 -- start start 2023-12-22T09:15:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.087+0000 7f0c057d9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 0x7f0c000c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.087+0000 7f0c057d9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0c000c4130 0x7f0c00154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.087+0000 7f0c057d9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c000c4660 con 0x7f0c00154a80 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.087+0000 7f0c057d9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c00153d60 con 0x7f0c000c4130 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.087+0000 7f0c057d9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0006b250 con 0x7f0c001514b0 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.088+0000 7f0bfe7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0c000c4130 0x7f0c00154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.088+0000 7f0bfe7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0c000c4130 0x7f0c00154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40114/0 (socket says 172.21.15.106:40114) 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.088+0000 7f0bfe7fc640 1 -- 172.21.15.106:0/1684658537 learned_addr learned my addr 172.21.15.106:0/1684658537 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.088+0000 7f0bfeffd640 1 --2- 172.21.15.106:0/1684658537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 0x7f0c000c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.088+0000 7f0bfe7fc640 1 -- 172.21.15.106:0/1684658537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 msgr2=0x7f0c000c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.088+0000 7f0bfe7fc640 1 --2- 172.21.15.106:0/1684658537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 0x7f0c000c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.088+0000 7f0bfe7fc640 1 -- 172.21.15.106:0/1684658537 >> v1:172.21.15.132:6789/0 conn(0x7f0c00154a80 legacy=0x7f0c000c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.088+0000 7f0bfe7fc640 1 -- 172.21.15.106:0/1684658537 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0006b530 con 0x7f0c000c4130 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.089+0000 7f0bfe7fc640 1 --2- 172.21.15.106:0/1684658537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 0x7f0c00154540 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009870 tx=0x7f0be802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e761b3e3e153c77 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.089+0000 7f0bfdffb640 1 -- 172.21.15.106:0/1684658537 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80317c0 con 0x7f0c000c4130 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.089+0000 7f0bfdffb640 1 -- 172.21.15.106:0/1684658537 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8031920 con 0x7f0c000c4130 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.089+0000 7f0bfdffb640 1 -- 172.21.15.106:0/1684658537 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8031cb0 con 0x7f0c000c4130 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.090+0000 7f0c057d9640 1 -- 172.21.15.106:0/1684658537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 msgr2=0x7f0c00154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.090+0000 7f0c057d9640 1 --2- 172.21.15.106:0/1684658537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 0x7f0c00154540 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009870 tx=0x7f0be802b860 comp rx=0 tx=0).stop 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.090+0000 7f0c057d9640 1 -- 172.21.15.106:0/1684658537 shutdown_connections 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.090+0000 7f0c057d9640 1 --2- 172.21.15.106:0/1684658537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 0x7f0c00154540 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.090+0000 7f0c057d9640 1 --2- 172.21.15.106:0/1684658537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 0x7f0c000c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.090+0000 7f0c057d9640 1 -- 172.21.15.106:0/1684658537 >> 172.21.15.106:0/1684658537 conn(0x7f0c000ab1a0 msgr2=0x7f0c000ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.090+0000 7f0c057d9640 1 -- 172.21.15.106:0/1684658537 shutdown_connections 2023-12-22T09:15:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.090+0000 7f0c057d9640 1 -- 172.21.15.106:0/1684658537 wait complete. 2023-12-22T09:15:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.092+0000 7f0c057d9640 1 Processor -- start 2023-12-22T09:15:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.092+0000 7f0c057d9640 1 -- start start 2023-12-22T09:15:27.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.093+0000 7f0c057d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 0x7f0c000c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.093+0000 7f0c057d9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 0x7f0c0014c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.093+0000 7f0c057d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c0014cf10 0x7f0c001ec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.093+0000 7f0c057d9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000bd400 con 0x7f0c000c4130 2023-12-22T09:15:27.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.093+0000 7f0c057d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000c3840 con 0x7f0c0014cf10 2023-12-22T09:15:27.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.093+0000 7f0c057d9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000bffa0 con 0x7f0c001514b0 2023-12-22T09:15:27.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.093+0000 7f0bfeffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 0x7f0c000c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.093+0000 7f0bfeffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 0x7f0c000c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40122/0 (socket says 172.21.15.106:40122) 2023-12-22T09:15:27.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.093+0000 7f0bfeffd640 1 -- 172.21.15.106:0/2945665407 learned_addr learned my addr 172.21.15.106:0/2945665407 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bfe7fc640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 0x7f0c0014c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bfeffd640 1 -- 172.21.15.106:0/2945665407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 msgr2=0x7f0c0014c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bfeffd640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 0x7f0c0014c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bfeffd640 1 -- 172.21.15.106:0/2945665407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c0014cf10 msgr2=0x7f0c001ec2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bff7fe640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c0014cf10 0x7f0c001ec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bfeffd640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c0014cf10 0x7f0c001ec2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bfeffd640 1 -- 172.21.15.106:0/2945665407 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be80094d0 con 0x7f0c000c4130 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bfe7fc640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 0x7f0c0014c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bfeffd640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 0x7f0c000c3300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000d800 tx=0x7f0bf000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bf77fe640 1 -- 172.21.15.106:0/2945665407 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000b6c0 con 0x7f0c000c4130 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bf77fe640 1 -- 172.21.15.106:0/2945665407 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000b820 con 0x7f0c000c4130 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0bf77fe640 1 -- 172.21.15.106:0/2945665407 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000bbb0 con 0x7f0c000c4130 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c001e8e60 con 0x7f0c000c4130 2023-12-22T09:15:27.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.094+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c001e9420 con 0x7f0c000c4130 2023-12-22T09:15:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.096+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c00073f10 con 0x7f0c000c4130 2023-12-22T09:15:27.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.096+0000 7f0bf77fe640 1 -- 172.21.15.106:0/2945665407 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0bf000bd10 con 0x7f0c000c4130 2023-12-22T09:15:27.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.097+0000 7f0bf77fe640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0be006a460 0x7f0be006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.097+0000 7f0bf77fe640 1 -- 172.21.15.106:0/2945665407 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0bf00891b0 con 0x7f0c000c4130 2023-12-22T09:15:27.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.098+0000 7f0bfe7fc640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0be006a460 0x7f0be006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.098+0000 7f0bfe7fc640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0be006a460 0x7f0be006c920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0be8036000 tx=0x7f0be803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:27.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.101+0000 7f0bf77fe640 1 -- 172.21.15.106:0/2945665407 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0bf0054410 con 0x7f0c000c4130 2023-12-22T09:15:27.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.291+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c0008a280 con 0x7f0c000c4130 2023-12-22T09:15:27.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.294+0000 7f0bf77fe640 1 -- 172.21.15.106:0/2945665407 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7f0bf0057a30 con 0x7f0c000c4130 2023-12-22T09:15:27.295 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:27.295 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:27.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.296+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0be006a460 msgr2=0x7f0be006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.296+0000 7f0c057d9640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0be006a460 0x7f0be006c920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0be8036000 tx=0x7f0be803d040 comp rx=0 tx=0).stop 2023-12-22T09:15:27.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.296+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 msgr2=0x7f0c000c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.296+0000 7f0c057d9640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 0x7f0c000c3300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000d800 tx=0x7f0bf000dcc0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.297+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 shutdown_connections 2023-12-22T09:15:27.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.297+0000 7f0c057d9640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0be006a460 0x7f0be006c920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.297+0000 7f0c057d9640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c0014cf10 0x7f0c001ec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.297+0000 7f0c057d9640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0c001514b0 0x7f0c0014c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.297+0000 7f0c057d9640 1 --2- 172.21.15.106:0/2945665407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c000c4130 0x7f0c000c3300 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.297+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 >> 172.21.15.106:0/2945665407 conn(0x7f0c000ab1a0 msgr2=0x7f0c00152350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:27.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.297+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 shutdown_connections 2023-12-22T09:15:27.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.297+0000 7f0c057d9640 1 -- 172.21.15.106:0/2945665407 wait complete. 2023-12-22T09:15:27.317 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:27.317 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:27.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.537+0000 7f9f2541a640 1 Processor -- start 2023-12-22T09:15:27.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.538+0000 7f9f2541a640 1 -- start start 2023-12-22T09:15:27.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.539+0000 7f9f2541a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9f200aeed0 0x7f9f20154880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.539+0000 7f9f2541a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c7630 0x7f9f2006c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.539+0000 7f9f2541a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9f200c40b0 0x7f9f200c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.539+0000 7f9f2541a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f200af2b0 con 0x7f9f200c40b0 2023-12-22T09:15:27.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.539+0000 7f9f2541a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f200c7a90 con 0x7f9f200aeed0 2023-12-22T09:15:27.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.539+0000 7f9f2541a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200c6ac0 con 0x7f9f200c7630 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.539+0000 7f9f1f7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9f200c40b0 0x7f9f200c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.539+0000 7f9f1f7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9f200c40b0 0x7f9f200c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40124/0 (socket says 172.21.15.106:40124) 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.539+0000 7f9f1f7fe640 1 -- 172.21.15.106:0/2611000426 learned_addr learned my addr 172.21.15.106:0/2611000426 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.540+0000 7f9f1e7fc640 1 --2- 172.21.15.106:0/2611000426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c7630 0x7f9f2006c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.540+0000 7f9f1effd640 1 --2- 172.21.15.106:0/2611000426 >> v2:172.21.15.132:3300/0 conn(0x7f9f200aeed0 0x7f9f20154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.540+0000 7f9f1f7fe640 1 -- 172.21.15.106:0/2611000426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c7630 msgr2=0x7f9f2006c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.540+0000 7f9f1f7fe640 1 --2- 172.21.15.106:0/2611000426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c7630 0x7f9f2006c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.540+0000 7f9f1f7fe640 1 -- 172.21.15.106:0/2611000426 >> v2:172.21.15.132:3300/0 conn(0x7f9f200aeed0 msgr2=0x7f9f20154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.540+0000 7f9f1f7fe640 1 --2- 172.21.15.106:0/2611000426 >> v2:172.21.15.132:3300/0 conn(0x7f9f200aeed0 0x7f9f20154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.540+0000 7f9f1f7fe640 1 -- 172.21.15.106:0/2611000426 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200c6500 con 0x7f9f200c40b0 2023-12-22T09:15:27.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.540+0000 7f9f1effd640 1 --2- 172.21.15.106:0/2611000426 >> v2:172.21.15.132:3300/0 conn(0x7f9f200aeed0 0x7f9f20154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.541+0000 7f9f1f7fe640 1 --2- 172.21.15.106:0/2611000426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c40b0 0x7f9f200c4540 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9f200a8f60 tx=0x7f9f1802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656d89145ed08c10 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.541+0000 7f9f1dffb640 1 -- 172.21.15.106:0/2611000426 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18031860 con 0x7f9f200c40b0 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.541+0000 7f9f1dffb640 1 -- 172.21.15.106:0/2611000426 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f180319c0 con 0x7f9f200c40b0 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.541+0000 7f9f1dffb640 1 -- 172.21.15.106:0/2611000426 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18031d50 con 0x7f9f200c40b0 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.542+0000 7f9f2541a640 1 -- 172.21.15.106:0/2611000426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c40b0 msgr2=0x7f9f200c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.542+0000 7f9f2541a640 1 --2- 172.21.15.106:0/2611000426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c40b0 0x7f9f200c4540 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9f200a8f60 tx=0x7f9f1802b900 comp rx=0 tx=0).stop 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.542+0000 7f9f2541a640 1 -- 172.21.15.106:0/2611000426 shutdown_connections 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.542+0000 7f9f2541a640 1 --2- 172.21.15.106:0/2611000426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c40b0 0x7f9f200c4540 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.542+0000 7f9f2541a640 1 --2- 172.21.15.106:0/2611000426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c7630 0x7f9f2006c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.542+0000 7f9f2541a640 1 --2- 172.21.15.106:0/2611000426 >> v2:172.21.15.132:3300/0 conn(0x7f9f200aeed0 0x7f9f20154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.542+0000 7f9f2541a640 1 -- 172.21.15.106:0/2611000426 >> 172.21.15.106:0/2611000426 conn(0x7f9f200c9730 msgr2=0x7f9f200c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.542+0000 7f9f2541a640 1 -- 172.21.15.106:0/2611000426 shutdown_connections 2023-12-22T09:15:27.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.542+0000 7f9f2541a640 1 -- 172.21.15.106:0/2611000426 wait complete. 2023-12-22T09:15:27.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.544+0000 7f9f2541a640 1 Processor -- start 2023-12-22T09:15:27.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.544+0000 7f9f2541a640 1 -- start start 2023-12-22T09:15:27.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.545+0000 7f9f2541a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f200aeed0 0x7f9f200c1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.545+0000 7f9f2541a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c40b0 0x7f9f20152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.545+0000 7f9f2541a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c7630 0x7f9f20152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.545+0000 7f9f2541a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200c2270 con 0x7f9f200c7630 2023-12-22T09:15:27.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.545+0000 7f9f2541a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f20152cb0 con 0x7f9f200aeed0 2023-12-22T09:15:27.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.545+0000 7f9f2541a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f201e9d90 con 0x7f9f200c40b0 2023-12-22T09:15:27.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.545+0000 7f9f1f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c7630 0x7f9f20152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.545+0000 7f9f1f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c7630 0x7f9f20152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40126/0 (socket says 172.21.15.106:40126) 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.545+0000 7f9f1f7fe640 1 -- 172.21.15.106:0/3973936555 learned_addr learned my addr 172.21.15.106:0/3973936555 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f1effd640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f200aeed0 0x7f9f200c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f1e7fc640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c40b0 0x7f9f20152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f1f7fe640 1 -- 172.21.15.106:0/3973936555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c40b0 msgr2=0x7f9f20152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f1f7fe640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c40b0 0x7f9f20152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f1f7fe640 1 -- 172.21.15.106:0/3973936555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f200aeed0 msgr2=0x7f9f200c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f1f7fe640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f200aeed0 0x7f9f200c1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f1f7fe640 1 -- 172.21.15.106:0/3973936555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f180094d0 con 0x7f9f200c7630 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f1effd640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f200aeed0 0x7f9f200c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f1f7fe640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c7630 0x7f9f20152770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9f180090b0 tx=0x7f9f180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:27.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f177fe640 1 -- 172.21.15.106:0/3973936555 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1803ac60 con 0x7f9f200c7630 2023-12-22T09:15:27.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f177fe640 1 -- 172.21.15.106:0/3973936555 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1803adc0 con 0x7f9f200c7630 2023-12-22T09:15:27.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f177fe640 1 -- 172.21.15.106:0/3973936555 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18044630 con 0x7f9f200c7630 2023-12-22T09:15:27.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f201e91c0 con 0x7f9f200c7630 2023-12-22T09:15:27.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.546+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f201e9740 con 0x7f9f200c7630 2023-12-22T09:15:27.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.547+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f200c5510 con 0x7f9f200c7630 2023-12-22T09:15:27.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.548+0000 7f9f177fe640 1 -- 172.21.15.106:0/3973936555 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9f1804d450 con 0x7f9f200c7630 2023-12-22T09:15:27.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.549+0000 7f9f177fe640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9f0006a430 0x7f9f0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.549+0000 7f9f177fe640 1 -- 172.21.15.106:0/3973936555 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9f180ab260 con 0x7f9f200c7630 2023-12-22T09:15:27.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.549+0000 7f9f1effd640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9f0006a430 0x7f9f0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.550+0000 7f9f1effd640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9f0006a430 0x7f9f0006c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9f10007f40 tx=0x7f9f10007490 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:27.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.553+0000 7f9f177fe640 1 -- 172.21.15.106:0/3973936555 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9f18076480 con 0x7f9f200c7630 2023-12-22T09:15:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.743+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f200c67e0 con 0x7f9f200c7630 2023-12-22T09:15:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.744+0000 7f9f177fe640 1 -- 172.21.15.106:0/3973936555 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f18079aa0 con 0x7f9f200c7630 2023-12-22T09:15:27.745 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9f0006a430 msgr2=0x7f9f0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9f0006a430 0x7f9f0006c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9f10007f40 tx=0x7f9f10007490 comp rx=0 tx=0).stop 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c7630 msgr2=0x7f9f20152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c7630 0x7f9f20152770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9f180090b0 tx=0x7f9f180046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 shutdown_connections 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9f0006a430 0x7f9f0006c8f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f200c7630 0x7f9f20152770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9f200c40b0 0x7f9f20152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 --2- 172.21.15.106:0/3973936555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f200aeed0 0x7f9f200c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 >> 172.21.15.106:0/3973936555 conn(0x7f9f200c9730 msgr2=0x7f9f201539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 shutdown_connections 2023-12-22T09:15:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.747+0000 7f9f2541a640 1 -- 172.21.15.106:0/3973936555 wait complete. 2023-12-22T09:15:27.768 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:27.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.976+0000 7f8a3d637640 1 Processor -- start 2023-12-22T09:15:27.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.976+0000 7f8a3d637640 1 -- start start 2023-12-22T09:15:27.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.978+0000 7f8a3d637640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a380c65b0 0x7f8a381571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.978+0000 7f8a3d637640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a380aed00 0x7f8a381576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.978+0000 7f8a3d637640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3806c2f0 con 0x7f8a381545f0 2023-12-22T09:15:27.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.978+0000 7f8a3d637640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3806c560 con 0x7f8a380c65b0 2023-12-22T09:15:27.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.978+0000 7f8a3d637640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3806c840 con 0x7f8a380aed00 2023-12-22T09:15:27.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.978+0000 7f8a37fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a380c65b0 0x7f8a381571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.979+0000 7f8a37fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a380c65b0 0x7f8a381571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:48596/0 (socket says 172.21.15.106:48596) 2023-12-22T09:15:27.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.979+0000 7f8a37fff640 1 -- 172.21.15.106:0/900956445 learned_addr learned my addr 172.21.15.106:0/900956445 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:27.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.979+0000 7f8a3ce36640 1 --2- 172.21.15.106:0/900956445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a380aed00 0x7f8a381576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.979+0000 7f8a37fff640 1 -- 172.21.15.106:0/900956445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a380aed00 msgr2=0x7f8a381576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:27.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.979+0000 7f8a37fff640 1 --2- 172.21.15.106:0/900956445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a380aed00 0x7f8a381576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.979+0000 7f8a37fff640 1 -- 172.21.15.106:0/900956445 >> v1:172.21.15.132:6789/0 conn(0x7f8a381545f0 legacy=0x7f8a380ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.979+0000 7f8a37fff640 1 -- 172.21.15.106:0/900956445 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380c3ef0 con 0x7f8a380c65b0 2023-12-22T09:15:27.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.981+0000 7f8a37fff640 1 --2- 172.21.15.106:0/900956445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a380c65b0 0x7f8a381571b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8a280098a0 tx=0x7f8a2802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cb5b152a643cea1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:27.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.981+0000 7f8a36ffd640 1 -- 172.21.15.106:0/900956445 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28031640 con 0x7f8a380c65b0 2023-12-22T09:15:27.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.981+0000 7f8a36ffd640 1 -- 172.21.15.106:0/900956445 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a280317a0 con 0x7f8a380c65b0 2023-12-22T09:15:27.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.981+0000 7f8a36ffd640 1 -- 172.21.15.106:0/900956445 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28031b30 con 0x7f8a380c65b0 2023-12-22T09:15:27.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.982+0000 7f8a3d637640 1 -- 172.21.15.106:0/900956445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a380c65b0 msgr2=0x7f8a381571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.982+0000 7f8a3d637640 1 --2- 172.21.15.106:0/900956445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a380c65b0 0x7f8a381571b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8a280098a0 tx=0x7f8a2802b8f0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.982+0000 7f8a3d637640 1 -- 172.21.15.106:0/900956445 shutdown_connections 2023-12-22T09:15:27.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.982+0000 7f8a3d637640 1 --2- 172.21.15.106:0/900956445 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a380aed00 0x7f8a381576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.982+0000 7f8a3d637640 1 --2- 172.21.15.106:0/900956445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a380c65b0 0x7f8a381571b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.982+0000 7f8a3d637640 1 -- 172.21.15.106:0/900956445 >> 172.21.15.106:0/900956445 conn(0x7f8a38071500 msgr2=0x7f8a38071910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:27.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.982+0000 7f8a3d637640 1 -- 172.21.15.106:0/900956445 shutdown_connections 2023-12-22T09:15:27.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.982+0000 7f8a3d637640 1 -- 172.21.15.106:0/900956445 wait complete. 2023-12-22T09:15:27.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.984+0000 7f8a3d637640 1 Processor -- start 2023-12-22T09:15:27.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.984+0000 7f8a3d637640 1 -- start start 2023-12-22T09:15:27.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.985+0000 7f8a3d637640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a380aed00 0x7f8a381e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.985+0000 7f8a3d637640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a380c65b0 0x7f8a380aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.985+0000 7f8a3d637640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a381545f0 0x7f8a3814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.985+0000 7f8a3d637640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380a9e30 con 0x7f8a380aed00 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.985+0000 7f8a3d637640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a381ea280 con 0x7f8a380c65b0 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.985+0000 7f8a3d637640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380aa800 con 0x7f8a381545f0 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.985+0000 7f8a37fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a380aed00 0x7f8a381e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.985+0000 7f8a37fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a380aed00 0x7f8a381e9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40128/0 (socket says 172.21.15.106:40128) 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.985+0000 7f8a37fff640 1 -- 172.21.15.106:0/2378271220 learned_addr learned my addr 172.21.15.106:0/2378271220 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.986+0000 7f8a3ce36640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a381545f0 0x7f8a3814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.986+0000 7f8a37fff640 1 -- 172.21.15.106:0/2378271220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a381545f0 msgr2=0x7f8a3814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.986+0000 7f8a37fff640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a381545f0 0x7f8a3814a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.986+0000 7f8a37fff640 1 -- 172.21.15.106:0/2378271220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a380c65b0 msgr2=0x7f8a380aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.986+0000 7f8a37fff640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a380c65b0 0x7f8a380aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.986+0000 7f8a37fff640 1 -- 172.21.15.106:0/2378271220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a280094d0 con 0x7f8a380aed00 2023-12-22T09:15:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.986+0000 7f8a37fff640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a380aed00 0x7f8a381e9d40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8a28000c00 tx=0x7f8a280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.987+0000 7f8a34ff9640 1 -- 172.21.15.106:0/2378271220 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2803a930 con 0x7f8a380aed00 2023-12-22T09:15:27.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.987+0000 7f8a34ff9640 1 -- 172.21.15.106:0/2378271220 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2803aa90 con 0x7f8a380aed00 2023-12-22T09:15:27.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.987+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a380bce50 con 0x7f8a380aed00 2023-12-22T09:15:27.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.987+0000 7f8a34ff9640 1 -- 172.21.15.106:0/2378271220 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2803ae40 con 0x7f8a380aed00 2023-12-22T09:15:27.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.987+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a380aae30 con 0x7f8a380aed00 2023-12-22T09:15:27.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.988+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a380c8d90 con 0x7f8a380aed00 2023-12-22T09:15:27.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.989+0000 7f8a34ff9640 1 -- 172.21.15.106:0/2378271220 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a2802f050 con 0x7f8a380aed00 2023-12-22T09:15:27.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.990+0000 7f8a34ff9640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8a2406a430 0x7f8a2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:27.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.990+0000 7f8a34ff9640 1 -- 172.21.15.106:0/2378271220 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8a280aaa40 con 0x7f8a380aed00 2023-12-22T09:15:27.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.990+0000 7f8a377fe640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8a2406a430 0x7f8a2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:27.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.991+0000 7f8a377fe640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8a2406a430 0x7f8a2406c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c000f60 tx=0x7f8a2c0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:27.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:27.995+0000 7f8a34ff9640 1 -- 172.21.15.106:0/2378271220 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a280ace60 con 0x7f8a380aed00 2023-12-22T09:15:28.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.183+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a3804e8d0 con 0x7f8a380aed00 2023-12-22T09:15:28.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.183+0000 7f8a34ff9640 1 -- 172.21.15.106:0/2378271220 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a28035020 con 0x7f8a380aed00 2023-12-22T09:15:28.184 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:28.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8a2406a430 msgr2=0x7f8a2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8a2406a430 0x7f8a2406c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c000f60 tx=0x7f8a2c0079b0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a380aed00 msgr2=0x7f8a381e9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a380aed00 0x7f8a381e9d40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8a28000c00 tx=0x7f8a280046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 shutdown_connections 2023-12-22T09:15:28.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8a2406a430 0x7f8a2406c8f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8a381545f0 0x7f8a3814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a380c65b0 0x7f8a380aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 --2- 172.21.15.106:0/2378271220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a380aed00 0x7f8a381e9d40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 >> 172.21.15.106:0/2378271220 conn(0x7f8a38071500 msgr2=0x7f8a380ada90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:28.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 shutdown_connections 2023-12-22T09:15:28.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.186+0000 7f8a3d637640 1 -- 172.21.15.106:0/2378271220 wait complete. 2023-12-22T09:15:28.205 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:28.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.421+0000 7ff1208ec640 1 Processor -- start 2023-12-22T09:15:28.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.421+0000 7ff1208ec640 1 -- start start 2023-12-22T09:15:28.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.422+0000 7ff1208ec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c071e20 0x7ff11c070930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.422+0000 7ff1208ec640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c06fff0 con 0x7ff11c14da50 2023-12-22T09:15:28.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.422+0000 7ff1208ec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c0c0730 con 0x7ff11c070e70 2023-12-22T09:15:28.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.422+0000 7ff1208ec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0a86e0 con 0x7ff11c071e20 2023-12-22T09:15:28.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.422+0000 7ff11a59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff11c14da50 0x7ff11c0bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41368/0 (socket says 172.21.15.106:41368) 2023-12-22T09:15:28.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.422+0000 7ff11a59c640 1 -- 172.21.15.106:0/2851770155 learned_addr learned my addr 172.21.15.106:0/2851770155 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:28.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff113fff640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c071e20 0x7ff11c070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369784787 0 0) 0x7ff11c06fff0 con 0x7ff11c14da50 2023-12-22T09:15:28.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff108003420 con 0x7ff11c14da50 2023-12-22T09:15:28.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3448219608 0 0) 0x7ff108003420 con 0x7ff11c14da50 2023-12-22T09:15:28.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c071e20 msgr2=0x7ff11c070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:28.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c071e20 0x7ff11c070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 >> v1:172.21.15.132:6789/0 conn(0x7ff11c070e70 legacy=0x7ff11c15acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c1547b0 con 0x7ff11c14da50 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7ff10c001670 con 0x7ff11c14da50 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 >> v1:172.21.15.106:6789/0 conn(0x7ff11c14da50 legacy=0x7ff11c0bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff108004a80 0x7ff108004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff108003660 0x7ff108003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c071e20 0x7ff10800fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0a86e0 con 0x7ff108004a80 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080043d0 con 0x7ff108003660 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.423+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080100b0 con 0x7ff11c071e20 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.424+0000 7ff11a59c640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff108004a80 0x7ff108004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.424+0000 7ff11a59c640 1 -- 172.21.15.106:0/2851770155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c071e20 msgr2=0x7ff10800fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:28.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.424+0000 7ff11a59c640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c071e20 0x7ff10800fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.424+0000 7ff11a59c640 1 -- 172.21.15.106:0/2851770155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff108003660 msgr2=0x7ff108003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:28.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.424+0000 7ff11a59c640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff108003660 0x7ff108003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.424+0000 7ff11a59c640 1 -- 172.21.15.106:0/2851770155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108003420 con 0x7ff108004a80 2023-12-22T09:15:28.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.425+0000 7ff11a59c640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff108004a80 0x7ff108004ea0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00c210 tx=0x7ff1080046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbab6716f54f5f57 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:28.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.425+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c02cae0 con 0x7ff108004a80 2023-12-22T09:15:28.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.425+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c02cc40 con 0x7ff108004a80 2023-12-22T09:15:28.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.425+0000 7ff119d9b640 1 -- 172.21.15.106:0/2851770155 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0058d0 con 0x7ff108004a80 2023-12-22T09:15:28.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.426+0000 7ff1208ec640 1 -- 172.21.15.106:0/2851770155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff108004a80 msgr2=0x7ff108004ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.426+0000 7ff1208ec640 1 --2- 172.21.15.106:0/2851770155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff108004a80 0x7ff108004ea0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00c210 tx=0x7ff1080046e0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.426+0000 7ff11ad9d640 1 -- 172.21.15.106:0/2851770155 reap_dead start 2023-12-22T09:15:28.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.426+0000 7ff1208ec640 1 -- 172.21.15.106:0/2851770155 shutdown_connections 2023-12-22T09:15:28.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.426+0000 7ff1208ec640 1 -- 172.21.15.106:0/2851770155 >> 172.21.15.106:0/2851770155 conn(0x7ff11c069dd0 msgr2=0x7ff11c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:28.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.426+0000 7ff1208ec640 1 -- 172.21.15.106:0/2851770155 shutdown_connections 2023-12-22T09:15:28.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.426+0000 7ff1208ec640 1 -- 172.21.15.106:0/2851770155 wait complete. 2023-12-22T09:15:28.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.428+0000 7ff1208ec640 1 Processor -- start 2023-12-22T09:15:28.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.428+0000 7ff1208ec640 1 -- start start 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff1208ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff108004a80 0x7ff11c1da3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff1208ec640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff11c152770 0x7ff11c1e4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff1208ec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c150920 0x7ff11c150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff1208ec640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c1d9990 con 0x7ff11c152770 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff1208ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c150520 con 0x7ff108004a80 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff1208ec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c152cc0 con 0x7ff11c150920 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff113fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff11c152770 0x7ff11c1e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff113fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff11c152770 0x7ff11c1e4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40152/0 (socket says 172.21.15.106:40152) 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff113fff640 1 -- 172.21.15.106:0/3185354560 learned_addr learned my addr 172.21.15.106:0/3185354560 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff113fff640 1 -- 172.21.15.106:0/3185354560 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c150920 msgr2=0x7ff11c150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff113fff640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c150920 0x7ff11c150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff113fff640 1 -- 172.21.15.106:0/3185354560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff108004a80 msgr2=0x7ff11c1da3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff113fff640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff108004a80 0x7ff11c1da3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.429+0000 7ff113fff640 1 -- 172.21.15.106:0/3185354560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c152fa0 con 0x7ff11c152770 2023-12-22T09:15:28.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.430+0000 7ff113fff640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff11c152770 0x7ff11c1e4730 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff10400e930 tx=0x7ff10400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:28.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.430+0000 7ff112ffd640 1 -- 172.21.15.106:0/3185354560 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104009680 con 0x7ff11c152770 2023-12-22T09:15:28.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.430+0000 7ff112ffd640 1 -- 172.21.15.106:0/3185354560 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10400c940 con 0x7ff11c152770 2023-12-22T09:15:28.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.430+0000 7ff112ffd640 1 -- 172.21.15.106:0/3185354560 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10400cd10 con 0x7ff11c152770 2023-12-22T09:15:28.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.430+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11c1d9be0 con 0x7ff11c152770 2023-12-22T09:15:28.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.430+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c1e4c70 con 0x7ff11c152770 2023-12-22T09:15:28.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.431+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11c1e4e90 con 0x7ff11c152770 2023-12-22T09:15:28.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.432+0000 7ff112ffd640 1 -- 172.21.15.106:0/3185354560 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff104013470 con 0x7ff11c152770 2023-12-22T09:15:28.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.433+0000 7ff112ffd640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff0fc06a460 0x7ff0fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.433+0000 7ff112ffd640 1 -- 172.21.15.106:0/3185354560 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff104088dc0 con 0x7ff11c152770 2023-12-22T09:15:28.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.433+0000 7ff11a59c640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff0fc06a460 0x7ff0fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.434+0000 7ff11a59c640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff0fc06a460 0x7ff0fc06c920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff10c034000 tx=0x7ff10c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:28.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.437+0000 7ff112ffd640 1 -- 172.21.15.106:0/3185354560 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff11c1e4e90 con 0x7ff11c152770 2023-12-22T09:15:28.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.629+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff11c1e4e90 con 0x7ff11c152770 2023-12-22T09:15:28.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.630+0000 7ff112ffd640 1 -- 172.21.15.106:0/3185354560 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff11c1e4e90 con 0x7ff11c152770 2023-12-22T09:15:28.631 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff0fc06a460 msgr2=0x7ff0fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff0fc06a460 0x7ff0fc06c920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff10c034000 tx=0x7ff10c007000 comp rx=0 tx=0).stop 2023-12-22T09:15:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff11c152770 msgr2=0x7ff11c1e4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff11c152770 0x7ff11c1e4730 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff10400e930 tx=0x7ff10400edf0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 shutdown_connections 2023-12-22T09:15:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff0fc06a460 0x7ff0fc06c920 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff11c150920 0x7ff11c150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff11c152770 0x7ff11c1e4730 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 --2- 172.21.15.106:0/3185354560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff108004a80 0x7ff11c1da3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.632+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 >> 172.21.15.106:0/3185354560 conn(0x7ff11c069dd0 msgr2=0x7ff11c0c4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:28.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.633+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 shutdown_connections 2023-12-22T09:15:28.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.633+0000 7ff1208ec640 1 -- 172.21.15.106:0/3185354560 wait complete. 2023-12-22T09:15:28.652 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:28.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.863+0000 7f5c2301a640 1 Processor -- start 2023-12-22T09:15:28.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.864+0000 7f5c2301a640 1 -- start start 2023-12-22T09:15:28.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.865+0000 7f5c2301a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c1c0c5a30 0x7f5c1c0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.865+0000 7f5c2301a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 0x7f5c1c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.865+0000 7f5c2301a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1c14f570 con 0x7f5c1c06c2d0 2023-12-22T09:15:28.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.865+0000 7f5c2301a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c0a90f0 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.865+0000 7f5c2301a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0c0b00 con 0x7f5c1c06bdc0 2023-12-22T09:15:28.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.866+0000 7f5c20db6640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c1c0c5a30 0x7f5c1c0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.866+0000 7f5c20db6640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c1c0c5a30 0x7f5c1c0c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40166/0 (socket says 172.21.15.106:40166) 2023-12-22T09:15:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.866+0000 7f5c20db6640 1 -- 172.21.15.106:0/1976339951 learned_addr learned my addr 172.21.15.106:0/1976339951 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.866+0000 7f5c1bfff640 1 --2- 172.21.15.106:0/1976339951 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 0x7f5c1c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.866+0000 7f5c20db6640 1 -- 172.21.15.106:0/1976339951 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 msgr2=0x7f5c1c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.866+0000 7f5c20db6640 1 --2- 172.21.15.106:0/1976339951 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 0x7f5c1c1550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.866+0000 7f5c20db6640 1 -- 172.21.15.106:0/1976339951 >> v1:172.21.15.132:6789/0 conn(0x7f5c1c06c2d0 legacy=0x7f5c1c155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:28.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.866+0000 7f5c20db6640 1 -- 172.21.15.106:0/1976339951 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c0bfd40 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.868+0000 7f5c20db6640 1 --2- 172.21.15.106:0/1976339951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 0x7f5c1c0c5e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009870 tx=0x7f5c1002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2648c1d64c711bd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:28.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.868+0000 7f5c1b7fe640 1 -- 172.21.15.106:0/1976339951 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100317c0 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.868+0000 7f5c1b7fe640 1 -- 172.21.15.106:0/1976339951 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c10031920 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.868+0000 7f5c1b7fe640 1 -- 172.21.15.106:0/1976339951 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10031cb0 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.869+0000 7f5c2301a640 1 -- 172.21.15.106:0/1976339951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 msgr2=0x7f5c1c0c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.869+0000 7f5c2301a640 1 --2- 172.21.15.106:0/1976339951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 0x7f5c1c0c5e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009870 tx=0x7f5c1002b860 comp rx=0 tx=0).stop 2023-12-22T09:15:28.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.869+0000 7f5c2301a640 1 -- 172.21.15.106:0/1976339951 shutdown_connections 2023-12-22T09:15:28.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.869+0000 7f5c2301a640 1 --2- 172.21.15.106:0/1976339951 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 0x7f5c1c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.869+0000 7f5c2301a640 1 --2- 172.21.15.106:0/1976339951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 0x7f5c1c0c5e10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.869+0000 7f5c2301a640 1 -- 172.21.15.106:0/1976339951 >> 172.21.15.106:0/1976339951 conn(0x7f5c1c06a220 msgr2=0x7f5c1c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:28.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.869+0000 7f5c2301a640 1 -- 172.21.15.106:0/1976339951 shutdown_connections 2023-12-22T09:15:28.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.869+0000 7f5c2301a640 1 -- 172.21.15.106:0/1976339951 wait complete. 2023-12-22T09:15:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.871+0000 7f5c2301a640 1 Processor -- start 2023-12-22T09:15:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.871+0000 7f5c2301a640 1 -- start start 2023-12-22T09:15:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c2301a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 0x7f5c1c071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c2301a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c1c06c2d0 0x7f5c1c14b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c2301a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 0x7f5c1c0b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c2301a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c071070 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c2301a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c070740 con 0x7f5c1c06c2d0 2023-12-22T09:15:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c2301a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c070a20 con 0x7f5c1c06bdc0 2023-12-22T09:15:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c215b7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 0x7f5c1c0b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c215b7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 0x7f5c1c0b7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40176/0 (socket says 172.21.15.106:40176) 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c215b7640 1 -- 172.21.15.106:0/2476121506 learned_addr learned my addr 172.21.15.106:0/2476121506 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c1bfff640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c1c06c2d0 0x7f5c1c14b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c20db6640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 0x7f5c1c071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c215b7640 1 -- 172.21.15.106:0/2476121506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 msgr2=0x7f5c1c071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c215b7640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 0x7f5c1c071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c215b7640 1 -- 172.21.15.106:0/2476121506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c1c06c2d0 msgr2=0x7f5c1c14b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c215b7640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c1c06c2d0 0x7f5c1c14b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c215b7640 1 -- 172.21.15.106:0/2476121506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100094d0 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.872+0000 7f5c20db6640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 0x7f5c1c071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.873+0000 7f5c215b7640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 0x7f5c1c0b7970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400c780 tx=0x7f5c1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.873+0000 7f5c197fa640 1 -- 172.21.15.106:0/2476121506 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14004b10 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.873+0000 7f5c197fa640 1 -- 172.21.15.106:0/2476121506 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c14004c70 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.873+0000 7f5c197fa640 1 -- 172.21.15.106:0/2476121506 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1400aa90 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.873+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1c070d00 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.873+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c14bbc0 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.874+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c0bc3f0 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.875+0000 7f5c197fa640 1 -- 172.21.15.106:0/2476121506 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c1400abf0 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.876+0000 7f5c197fa640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c0006a460 0x7f5c0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:28.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.876+0000 7f5c197fa640 1 -- 172.21.15.106:0/2476121506 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c14088e50 con 0x7f5c1c0c5a30 2023-12-22T09:15:28.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.876+0000 7f5c20db6640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c0006a460 0x7f5c0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:28.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.877+0000 7f5c20db6640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c0006a460 0x7f5c0006c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5c10036000 tx=0x7f5c1003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:28.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:28.880+0000 7f5c197fa640 1 -- 172.21.15.106:0/2476121506 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5c1c0bc3f0 con 0x7f5c1c0c5a30 2023-12-22T09:15:29.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.069+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5c1c0bc3f0 con 0x7f5c1c0c5a30 2023-12-22T09:15:29.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.070+0000 7f5c197fa640 1 -- 172.21.15.106:0/2476121506 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5c1c0bc3f0 con 0x7f5c1c0c5a30 2023-12-22T09:15:29.071 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c0006a460 msgr2=0x7f5c0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c0006a460 0x7f5c0006c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5c10036000 tx=0x7f5c1003d040 comp rx=0 tx=0).stop 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 msgr2=0x7f5c1c0b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 0x7f5c1c0b7970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400c780 tx=0x7f5c1400cc40 comp rx=0 tx=0).stop 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 shutdown_connections 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c0006a460 0x7f5c0006c920 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c1c0c5a30 0x7f5c1c0b7970 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c1c06c2d0 0x7f5c1c14b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 --2- 172.21.15.106:0/2476121506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c1c06bdc0 0x7f5c1c071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 >> 172.21.15.106:0/2476121506 conn(0x7f5c1c06a220 msgr2=0x7f5c1c0c5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:29.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 shutdown_connections 2023-12-22T09:15:29.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.073+0000 7f5c2301a640 1 -- 172.21.15.106:0/2476121506 wait complete. 2023-12-22T09:15:29.092 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-22T09:15:29.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.308+0000 7f4614cf7640 1 Processor -- start 2023-12-22T09:15:29.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.308+0000 7f4614cf7640 1 -- start start 2023-12-22T09:15:29.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f4614cf7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f461013b060 0x7f461006a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:29.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f4614cf7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f46100bfce0 0x7f4610069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:29.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f4614cf7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46100bf770 con 0x7f461006a130 2023-12-22T09:15:29.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f4614cf7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4610155120 con 0x7f46100bfce0 2023-12-22T09:15:29.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f4614cf7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4610155400 con 0x7f461013b060 2023-12-22T09:15:29.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f460ed9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f461006a130 0x7f4610151b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41382/0 (socket says 172.21.15.106:41382) 2023-12-22T09:15:29.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f460ed9d640 1 -- 172.21.15.106:0/1135468349 learned_addr learned my addr 172.21.15.106:0/1135468349 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:29.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f460e59c640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f461013b060 0x7f461006a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:29.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f4605d9b640 1 --2- 172.21.15.106:0/1135468349 >> v2:172.21.15.132:3300/0 conn(0x7f46100bfce0 0x7f4610069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:29.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670985414 0 0) 0x7f46100bf770 con 0x7f461006a130 2023-12-22T09:15:29.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.310+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45fc003520 con 0x7f461006a130 2023-12-22T09:15:29.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2171531159 0 0) 0x7f45fc003520 con 0x7f461006a130 2023-12-22T09:15:29.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f461013b060 msgr2=0x7f461006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:29.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f461013b060 0x7f461006a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 >> v2:172.21.15.132:3300/0 conn(0x7f46100bfce0 msgr2=0x7f4610069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:29.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 --2- 172.21.15.106:0/1135468349 >> v2:172.21.15.132:3300/0 conn(0x7f46100bfce0 0x7f4610069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46101556e0 con 0x7f461006a130 2023-12-22T09:15:29.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f46080019f0 con 0x7f461006a130 2023-12-22T09:15:29.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 >> v1:172.21.15.106:6789/0 conn(0x7f461006a130 legacy=0x7f4610151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45fc003970 0x7f45fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f45fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f461013b060 0x7f45fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4610155120 con 0x7f45fc0047c0 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4610155400 con 0x7f45fc003970 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc00ba30 con 0x7f461013b060 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f4605d9b640 1 --2- 172.21.15.106:0/1135468349 >> v2:172.21.15.132:3300/0 conn(0x7f46100bfce0 0x7f4610069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f4605d9b640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f45fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.311+0000 7f460e59c640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45fc003970 0x7f45fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.312+0000 7f460ed9d640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f461013b060 0x7f45fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.312+0000 7f4605d9b640 1 -- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f461013b060 msgr2=0x7f45fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.312+0000 7f4605d9b640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f461013b060 0x7f45fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.312+0000 7f4605d9b640 1 -- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45fc003970 msgr2=0x7f45fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:29.316 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.312+0000 7f4605d9b640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45fc003970 0x7f45fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.316 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.312+0000 7f4605d9b640 1 -- 172.21.15.106:0/1135468349 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc003520 con 0x7f45fc0047c0 2023-12-22T09:15:29.316 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.312+0000 7f460ed9d640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f461013b060 0x7f45fc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:29.316 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.313+0000 7f4605d9b640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f45fc004c40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f45f8006fd0 tx=0x7f45fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cb5b177c670bf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:29.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.313+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8031640 con 0x7f45fc0047c0 2023-12-22T09:15:29.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.313+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f80317a0 con 0x7f45fc0047c0 2023-12-22T09:15:29.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.313+0000 7f460dd9b640 1 -- 172.21.15.106:0/1135468349 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8031b10 con 0x7f45fc0047c0 2023-12-22T09:15:29.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.314+0000 7f4614cf7640 1 -- 172.21.15.106:0/1135468349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 msgr2=0x7f45fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:29.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.314+0000 7f4614cf7640 1 --2- 172.21.15.106:0/1135468349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f45fc004c40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f45f8006fd0 tx=0x7f45fc0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.314+0000 7f460ed9d640 1 -- 172.21.15.106:0/1135468349 reap_dead start 2023-12-22T09:15:29.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.314+0000 7f4614cf7640 1 -- 172.21.15.106:0/1135468349 shutdown_connections 2023-12-22T09:15:29.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.314+0000 7f4614cf7640 1 -- 172.21.15.106:0/1135468349 >> 172.21.15.106:0/1135468349 conn(0x7f46100c5360 msgr2=0x7f46100c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:29.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.314+0000 7f4614cf7640 1 -- 172.21.15.106:0/1135468349 shutdown_connections 2023-12-22T09:15:29.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.314+0000 7f4614cf7640 1 -- 172.21.15.106:0/1135468349 wait complete. 2023-12-22T09:15:29.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.316+0000 7f4614cf7640 1 Processor -- start 2023-12-22T09:15:29.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.316+0000 7f4614cf7640 1 -- start start 2023-12-22T09:15:29.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f4614cf7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f4610133390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:29.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f4614cf7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4610133a50 0x7f46100be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:29.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f4614cf7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46100bebf0 0x7f46100c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:29.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f4614cf7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46101338d0 con 0x7f45fc0047c0 2023-12-22T09:15:29.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f4614cf7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4610070b70 con 0x7f46100bebf0 2023-12-22T09:15:29.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f4614cf7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46101519f0 con 0x7f4610133a50 2023-12-22T09:15:29.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f460e59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f4610133390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:29.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f460e59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f4610133390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40180/0 (socket says 172.21.15.106:40180) 2023-12-22T09:15:29.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f460e59c640 1 -- 172.21.15.106:0/905360788 learned_addr learned my addr 172.21.15.106:0/905360788 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:29.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f460e59c640 1 -- 172.21.15.106:0/905360788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4610133a50 msgr2=0x7f46100be6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:29.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f460e59c640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4610133a50 0x7f46100be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f460e59c640 1 -- 172.21.15.106:0/905360788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46100bebf0 msgr2=0x7f46100c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:29.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f460e59c640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46100bebf0 0x7f46100c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.317+0000 7f460e59c640 1 -- 172.21.15.106:0/905360788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46101ed200 con 0x7f45fc0047c0 2023-12-22T09:15:29.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.318+0000 7f460e59c640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f4610133390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f46000115e0 tx=0x7f4600011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:29.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.318+0000 7f46077fe640 1 -- 172.21.15.106:0/905360788 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600005da0 con 0x7f45fc0047c0 2023-12-22T09:15:29.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.318+0000 7f46077fe640 1 -- 172.21.15.106:0/905360788 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600006050 con 0x7f45fc0047c0 2023-12-22T09:15:29.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.318+0000 7f46077fe640 1 -- 172.21.15.106:0/905360788 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000063c0 con 0x7f45fc0047c0 2023-12-22T09:15:29.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.318+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4610070dc0 con 0x7f45fc0047c0 2023-12-22T09:15:29.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.318+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4610150e70 con 0x7f45fc0047c0 2023-12-22T09:15:29.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.319+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461006ad90 con 0x7f45fc0047c0 2023-12-22T09:15:29.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.320+0000 7f46077fe640 1 -- 172.21.15.106:0/905360788 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4600006520 con 0x7f45fc0047c0 2023-12-22T09:15:29.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.321+0000 7f46077fe640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f45f006a460 0x7f45f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:29.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.321+0000 7f46077fe640 1 -- 172.21.15.106:0/905360788 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4600089270 con 0x7f45fc0047c0 2023-12-22T09:15:29.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.321+0000 7f4605d9b640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f45f006a460 0x7f45f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:29.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.322+0000 7f4605d9b640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f45f006a460 0x7f45f006c920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f45f8036000 tx=0x7f45f8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:29.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.326+0000 7f46077fe640 1 -- 172.21.15.106:0/905360788 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4600054490 con 0x7f45fc0047c0 2023-12-22T09:15:29.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.589+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f4610073f10 con 0x7f45fc0047c0 2023-12-22T09:15:29.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.983+0000 7f46077fe640 1 -- 172.21.15.106:0/905360788 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v76) v1 ==== 162+0+0 (secure 0 0 0) 0x7f4600057ab0 con 0x7f45fc0047c0 2023-12-22T09:15:29.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f45f006a460 msgr2=0x7f45f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:29.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f45f006a460 0x7f45f006c920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f45f8036000 tx=0x7f45f8030000 comp rx=0 tx=0).stop 2023-12-22T09:15:29.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 msgr2=0x7f4610133390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:29.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f4610133390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f46000115e0 tx=0x7f4600011aa0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 shutdown_connections 2023-12-22T09:15:29.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f45f006a460 0x7f45f006c920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46100bebf0 0x7f46100c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4610133a50 0x7f46100be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 --2- 172.21.15.106:0/905360788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45fc0047c0 0x7f4610133390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:29.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 >> 172.21.15.106:0/905360788 conn(0x7f46100c5360 msgr2=0x7f46100aa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:29.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 shutdown_connections 2023-12-22T09:15:29.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:29.987+0000 7f4614cf7640 1 -- 172.21.15.106:0/905360788 wait complete. 2023-12-22T09:15:30.007 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T09:15:30.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.220+0000 7fa78830a640 1 Processor -- start 2023-12-22T09:15:30.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.220+0000 7fa78830a640 1 -- start start 2023-12-22T09:15:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.221+0000 7fa78830a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa78014f090 0x7fa780151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.221+0000 7fa78830a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 0x7fa7800c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.221+0000 7fa78830a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa780155120 con 0x7fa7800c1910 2023-12-22T09:15:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.221+0000 7fa78830a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78006e080 con 0x7fa78014f090 2023-12-22T09:15:30.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.221+0000 7fa78830a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa780155fa0 con 0x7fa78006b960 2023-12-22T09:15:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.222+0000 7fa7860a6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa78014f090 0x7fa780151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.222+0000 7fa7860a6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa78014f090 0x7fa780151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:48666/0 (socket says 172.21.15.106:48666) 2023-12-22T09:15:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.222+0000 7fa7860a6640 1 -- 172.21.15.106:0/4290496207 learned_addr learned my addr 172.21.15.106:0/4290496207 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.222+0000 7fa7858a5640 1 --1- 172.21.15.106:0/4290496207 >> v1:172.21.15.132:6789/0 conn(0x7fa7800c1910 0x7fa780155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:38408/0 (socket says 172.21.15.106:38408) 2023-12-22T09:15:30.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.222+0000 7fa7868a7640 1 --2- 172.21.15.106:0/4290496207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 0x7fa7800c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.223+0000 7fa7860a6640 1 -- 172.21.15.106:0/4290496207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 msgr2=0x7fa7800c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.223+0000 7fa7860a6640 1 --2- 172.21.15.106:0/4290496207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 0x7fa7800c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.223+0000 7fa7860a6640 1 -- 172.21.15.106:0/4290496207 >> v1:172.21.15.132:6789/0 conn(0x7fa7800c1910 legacy=0x7fa780155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.223+0000 7fa7860a6640 1 -- 172.21.15.106:0/4290496207 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7800a8720 con 0x7fa78014f090 2023-12-22T09:15:30.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.224+0000 7fa7860a6640 1 --2- 172.21.15.106:0/4290496207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa78014f090 0x7fa780151b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa774009870 tx=0x7fa77402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ed7de62613417db server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:30.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.225+0000 7fa7850a4640 1 -- 172.21.15.106:0/4290496207 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774031640 con 0x7fa78014f090 2023-12-22T09:15:30.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.225+0000 7fa7850a4640 1 -- 172.21.15.106:0/4290496207 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7740317a0 con 0x7fa78014f090 2023-12-22T09:15:30.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.225+0000 7fa7850a4640 1 -- 172.21.15.106:0/4290496207 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774031b30 con 0x7fa78014f090 2023-12-22T09:15:30.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.226+0000 7fa78830a640 1 -- 172.21.15.106:0/4290496207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa78014f090 msgr2=0x7fa780151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.226+0000 7fa78830a640 1 --2- 172.21.15.106:0/4290496207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa78014f090 0x7fa780151b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa774009870 tx=0x7fa77402b8f0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.226+0000 7fa78830a640 1 -- 172.21.15.106:0/4290496207 shutdown_connections 2023-12-22T09:15:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.226+0000 7fa78830a640 1 --2- 172.21.15.106:0/4290496207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 0x7fa7800c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.226+0000 7fa78830a640 1 --2- 172.21.15.106:0/4290496207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa78014f090 0x7fa780151b30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.226+0000 7fa78830a640 1 -- 172.21.15.106:0/4290496207 >> 172.21.15.106:0/4290496207 conn(0x7fa780069dd0 msgr2=0x7fa78006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.226+0000 7fa78830a640 1 -- 172.21.15.106:0/4290496207 shutdown_connections 2023-12-22T09:15:30.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.226+0000 7fa78830a640 1 -- 172.21.15.106:0/4290496207 wait complete. 2023-12-22T09:15:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.227+0000 7fa78830a640 1 Processor -- start 2023-12-22T09:15:30.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.228+0000 7fa78830a640 1 -- start start 2023-12-22T09:15:30.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.228+0000 7fa78830a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 0x7fa780151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:30.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.228+0000 7fa78830a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7800c1910 0x7fa78014be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:30.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.228+0000 7fa78830a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78014f090 0x7fa780142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:30.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.228+0000 7fa78830a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7800c5170 con 0x7fa78014f090 2023-12-22T09:15:30.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.228+0000 7fa78830a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7801524f0 con 0x7fa7800c1910 2023-12-22T09:15:30.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.228+0000 7fa78830a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7800c4bf0 con 0x7fa78006b960 2023-12-22T09:15:30.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7868a7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78014f090 0x7fa780142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:30.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7868a7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78014f090 0x7fa780142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40196/0 (socket says 172.21.15.106:40196) 2023-12-22T09:15:30.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7868a7640 1 -- 172.21.15.106:0/3960779527 learned_addr learned my addr 172.21.15.106:0/3960779527 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:30.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7860a6640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 0x7fa780151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:30.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7858a5640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7800c1910 0x7fa78014be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:30.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7868a7640 1 -- 172.21.15.106:0/3960779527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 msgr2=0x7fa780151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:30.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7868a7640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 0x7fa780151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7868a7640 1 -- 172.21.15.106:0/3960779527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7800c1910 msgr2=0x7fa78014be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:30.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7868a7640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7800c1910 0x7fa78014be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.229+0000 7fa7868a7640 1 -- 172.21.15.106:0/3960779527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740094d0 con 0x7fa78014f090 2023-12-22T09:15:30.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.230+0000 7fa7868a7640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78014f090 0x7fa780142c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa77800e930 tx=0x7fa77800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:30.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.230+0000 7fa772ffd640 1 -- 172.21.15.106:0/3960779527 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778009690 con 0x7fa78014f090 2023-12-22T09:15:30.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.230+0000 7fa772ffd640 1 -- 172.21.15.106:0/3960779527 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77800c980 con 0x7fa78014f090 2023-12-22T09:15:30.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.230+0000 7fa772ffd640 1 -- 172.21.15.106:0/3960779527 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77800cd30 con 0x7fa78014f090 2023-12-22T09:15:30.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.230+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78014f9a0 con 0x7fa78014f090 2023-12-22T09:15:30.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.230+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7800c4e90 con 0x7fa78014f090 2023-12-22T09:15:30.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.231+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa780073f10 con 0x7fa78014f090 2023-12-22T09:15:30.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.232+0000 7fa772ffd640 1 -- 172.21.15.106:0/3960779527 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa778013470 con 0x7fa78014f090 2023-12-22T09:15:30.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.233+0000 7fa772ffd640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa76406a430 0x7fa76406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:30.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.234+0000 7fa772ffd640 1 -- 172.21.15.106:0/3960779527 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa778088ea0 con 0x7fa78014f090 2023-12-22T09:15:30.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.234+0000 7fa7860a6640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa76406a430 0x7fa76406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:30.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.234+0000 7fa7860a6640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa76406a430 0x7fa76406c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa774036000 tx=0x7fa77403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:30.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.238+0000 7fa772ffd640 1 -- 172.21.15.106:0/3960779527 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa778054220 con 0x7fa78014f090 2023-12-22T09:15:30.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.433+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa7800c16f0 con 0x7fa78014f090 2023-12-22T09:15:30.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.441+0000 7fa772ffd640 1 -- 172.21.15.106:0/3960779527 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7780170c0 con 0x7fa78014f090 2023-12-22T09:15:30.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa76406a430 msgr2=0x7fa76406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:30.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa76406a430 0x7fa76406c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa774036000 tx=0x7fa77403c040 comp rx=0 tx=0).stop 2023-12-22T09:15:30.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78014f090 msgr2=0x7fa780142c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:30.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78014f090 0x7fa780142c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa77800e930 tx=0x7fa77800edf0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 shutdown_connections 2023-12-22T09:15:30.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa76406a430 0x7fa76406c8f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78014f090 0x7fa780142c50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7800c1910 0x7fa78014be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 --2- 172.21.15.106:0/3960779527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa78006b960 0x7fa780151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:30.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 >> 172.21.15.106:0/3960779527 conn(0x7fa780069dd0 msgr2=0x7fa780072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:30.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 shutdown_connections 2023-12-22T09:15:30.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:30.444+0000 7fa78830a640 1 -- 172.21.15.106:0/3960779527 wait complete. 2023-12-22T09:15:30.464 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T09:15:30.464 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T09:15:30.583 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T09:15:30.709 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T09:15:30.710 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:15:30.710 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:15:30.769 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:15:30.769 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:15:30.825 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:15:30.826 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:15:30.879 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:31.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.142+0000 7fbcb86af640 1 Processor -- start 2023-12-22T09:15:31.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.142+0000 7fbcb86af640 1 -- start start 2023-12-22T09:15:31.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.143+0000 7fbcb86af640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb013b060 0x7fbcb006a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.143+0000 7fbcb86af640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb00bf770 con 0x7fbcb00bfce0 2023-12-22T09:15:31.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.144+0000 7fbcb86af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb0155120 con 0x7fbcb0151b30 2023-12-22T09:15:31.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.144+0000 7fbcb86af640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb0155400 con 0x7fbcb013b060 2023-12-22T09:15:31.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.144+0000 7fbcb5c4a640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbcb00bfce0 0x7fbcb0069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41386/0 (socket says 172.21.15.106:41386) 2023-12-22T09:15:31.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.144+0000 7fbcb5c4a640 1 -- 172.21.15.106:0/4126737007 learned_addr learned my addr 172.21.15.106:0/4126737007 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:31.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.144+0000 7fbcb644b640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb013b060 0x7fbcb006a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483302812 0 0) 0x7fbcb00bf770 con 0x7fbcb00bfce0 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc9c003520 con 0x7fbcb00bfce0 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1464342700 0 0) 0x7fbc9c003520 con 0x7fbcb00bfce0 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb013b060 msgr2=0x7fbcb006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb013b060 0x7fbcb006a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 >> v1:172.21.15.132:6789/0 conn(0x7fbcb0151b30 legacy=0x7fbcb0151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb01556e0 con 0x7fbcb00bfce0 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fbca0001670 con 0x7fbcb00bfce0 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 >> v1:172.21.15.106:6789/0 conn(0x7fbcb00bfce0 legacy=0x7fbcb0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc9c0039a0 0x7fbc9c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb013b060 0x7fbc9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c004d00 0x7fbc9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb0155400 con 0x7fbc9c004d00 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c00ba30 con 0x7fbc9c0039a0 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c00bbf0 con 0x7fbcb013b060 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.145+0000 7fbcb6c4c640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c004d00 0x7fbc9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.146+0000 7fbcb644b640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc9c0039a0 0x7fbc9c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.146+0000 7fbcb5c4a640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb013b060 0x7fbc9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.146+0000 7fbcb6c4c640 1 -- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb013b060 msgr2=0x7fbc9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.146+0000 7fbcb6c4c640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb013b060 0x7fbc9c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.146+0000 7fbcb6c4c640 1 -- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc9c0039a0 msgr2=0x7fbc9c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.146+0000 7fbcb6c4c640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc9c0039a0 0x7fbc9c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.146+0000 7fbcb6c4c640 1 -- 172.21.15.106:0/4126737007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c003520 con 0x7fbc9c004d00 2023-12-22T09:15:31.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.147+0000 7fbcb6c4c640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c004d00 0x7fbc9c005180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbca8001f60 tx=0x7fbc9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ddfecaff8de1d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.147+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca802d6f0 con 0x7fbc9c004d00 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.147+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca802d870 con 0x7fbc9c004d00 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.147+0000 7fbcb5449640 1 -- 172.21.15.106:0/4126737007 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca802dc20 con 0x7fbc9c004d00 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.148+0000 7fbcb86af640 1 -- 172.21.15.106:0/4126737007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c004d00 msgr2=0x7fbc9c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.148+0000 7fbcb86af640 1 --2- 172.21.15.106:0/4126737007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c004d00 0x7fbc9c005180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbca8001f60 tx=0x7fbc9c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.148+0000 7fbcb6c4c640 1 -- 172.21.15.106:0/4126737007 reap_dead start 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.148+0000 7fbcb86af640 1 -- 172.21.15.106:0/4126737007 shutdown_connections 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.148+0000 7fbcb86af640 1 -- 172.21.15.106:0/4126737007 >> 172.21.15.106:0/4126737007 conn(0x7fbcb00c5360 msgr2=0x7fbcb00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.148+0000 7fbcb86af640 1 -- 172.21.15.106:0/4126737007 shutdown_connections 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.148+0000 7fbcb86af640 1 -- 172.21.15.106:0/4126737007 wait complete. 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.150+0000 7fbcb86af640 1 Processor -- start 2023-12-22T09:15:31.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.150+0000 7fbcb86af640 1 -- start start 2023-12-22T09:15:31.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb86af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc9c004d00 0x7fbcb01e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb86af640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcb0154a70 0x7fbcb0150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb86af640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb01e8b60 0x7fbcb0071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb86af640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00c4940 con 0x7fbcb0154a70 2023-12-22T09:15:31.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb86af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00c4ca0 con 0x7fbc9c004d00 2023-12-22T09:15:31.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb86af640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb01e83f0 con 0x7fbcb01e8b60 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb5c4a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcb0154a70 0x7fbcb0150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb5c4a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcb0154a70 0x7fbcb0150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40222/0 (socket says 172.21.15.106:40222) 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb5c4a640 1 -- 172.21.15.106:0/1596781896 learned_addr learned my addr 172.21.15.106:0/1596781896 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb6c4c640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb01e8b60 0x7fbcb0071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.151+0000 7fbcb644b640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc9c004d00 0x7fbcb01e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbcb5c4a640 1 -- 172.21.15.106:0/1596781896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb01e8b60 msgr2=0x7fbcb0071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbcb5c4a640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb01e8b60 0x7fbcb0071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbcb5c4a640 1 -- 172.21.15.106:0/1596781896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc9c004d00 msgr2=0x7fbcb01e4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbcb5c4a640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc9c004d00 0x7fbcb01e4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbcb5c4a640 1 -- 172.21.15.106:0/1596781896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00c41b0 con 0x7fbcb0154a70 2023-12-22T09:15:31.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbcb5c4a640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcb0154a70 0x7fbcb0150d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbca0000fd0 tx=0x7fbca000dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:31.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbca6ffd640 1 -- 172.21.15.106:0/1596781896 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00074e0 con 0x7fbcb0154a70 2023-12-22T09:15:31.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbca6ffd640 1 -- 172.21.15.106:0/1596781896 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca0007640 con 0x7fbcb0154a70 2023-12-22T09:15:31.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbca6ffd640 1 -- 172.21.15.106:0/1596781896 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0004a00 con 0x7fbcb0154a70 2023-12-22T09:15:31.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb00c4490 con 0x7fbcb0154a70 2023-12-22T09:15:31.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.152+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb01512d0 con 0x7fbcb0154a70 2023-12-22T09:15:31.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.154+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb0073f10 con 0x7fbcb0154a70 2023-12-22T09:15:31.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.155+0000 7fbca6ffd640 1 -- 172.21.15.106:0/1596781896 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbca0004b60 con 0x7fbcb0154a70 2023-12-22T09:15:31.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.155+0000 7fbca6ffd640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbc9406a430 0x7fbc9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.156+0000 7fbca6ffd640 1 -- 172.21.15.106:0/1596781896 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbca0088580 con 0x7fbcb0154a70 2023-12-22T09:15:31.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.156+0000 7fbcb644b640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbc9406a430 0x7fbc9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.157+0000 7fbcb644b640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbc9406a430 0x7fbc9406c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009a00 tx=0x7fbcac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.160+0000 7fbca6ffd640 1 -- 172.21.15.106:0/1596781896 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbca00537b0 con 0x7fbcb0154a70 2023-12-22T09:15:31.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.351+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcb00c29e0 con 0x7fbcb0154a70 2023-12-22T09:15:31.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.354+0000 7fbca6ffd640 1 -- 172.21.15.106:0/1596781896 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7fbca000de60 con 0x7fbcb0154a70 2023-12-22T09:15:31.355 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:31.355 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:31.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbc9406a430 msgr2=0x7fbc9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbc9406a430 0x7fbc9406c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009a00 tx=0x7fbcac008040 comp rx=0 tx=0).stop 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcb0154a70 msgr2=0x7fbcb0150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcb0154a70 0x7fbcb0150d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbca0000fd0 tx=0x7fbca000dc70 comp rx=0 tx=0).stop 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 shutdown_connections 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbc9406a430 0x7fbc9406c8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcb01e8b60 0x7fbcb0071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcb0154a70 0x7fbcb0150d90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 --2- 172.21.15.106:0/1596781896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc9c004d00 0x7fbcb01e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 >> 172.21.15.106:0/1596781896 conn(0x7fbcb00c5360 msgr2=0x7fbcb00a8360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 shutdown_connections 2023-12-22T09:15:31.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.357+0000 7fbcb86af640 1 -- 172.21.15.106:0/1596781896 wait complete. 2023-12-22T09:15:31.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:31.376 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:31.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.593+0000 7ff1aca10640 1 Processor -- start 2023-12-22T09:15:31.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.593+0000 7ff1aca10640 1 -- start start 2023-12-22T09:15:31.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.595+0000 7ff1aca10640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1a80c0790 0x7ff1a80c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.595+0000 7ff1aca10640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80c1c40 con 0x7ff1a80aa290 2023-12-22T09:15:31.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.595+0000 7ff1aca10640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80708b0 con 0x7ff1a81543f0 2023-12-22T09:15:31.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.595+0000 7ff1aca10640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a80706c0 con 0x7ff1a80c0790 2023-12-22T09:15:31.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.595+0000 7ff1a659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff1a80aa290 0x7ff1a80c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41390/0 (socket says 172.21.15.106:41390) 2023-12-22T09:15:31.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.595+0000 7ff1a659c640 1 -- 172.21.15.106:0/903701580 learned_addr learned my addr 172.21.15.106:0/903701580 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:31.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.595+0000 7ff19ffff640 1 --2- 172.21.15.106:0/903701580 >> v2:172.21.15.132:3300/0 conn(0x7ff1a80c0790 0x7ff1a80c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.595+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682017842 0 0) 0x7ff1a80c1c40 con 0x7ff1a80aa290 2023-12-22T09:15:31.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff194003520 con 0x7ff1a80aa290 2023-12-22T09:15:31.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2429086820 0 0) 0x7ff194003520 con 0x7ff1a80aa290 2023-12-22T09:15:31.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 >> v2:172.21.15.132:3300/0 conn(0x7ff1a80c0790 msgr2=0x7ff1a80c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:31.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 --2- 172.21.15.106:0/903701580 >> v2:172.21.15.132:3300/0 conn(0x7ff1a80c0790 0x7ff1a80c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 >> v1:172.21.15.132:6789/0 conn(0x7ff1a81543f0 legacy=0x7ff1a815e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a8070b50 con 0x7ff1a80aa290 2023-12-22T09:15:31.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7ff198001670 con 0x7ff1a80aa290 2023-12-22T09:15:31.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 >> v1:172.21.15.106:6789/0 conn(0x7ff1a80aa290 legacy=0x7ff1a80c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1940039c0 0x7ff194003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940047c0 0x7ff194004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1940051d0 0x7ff19400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19400c0f0 con 0x7ff1940051d0 2023-12-22T09:15:31.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19400c260 con 0x7ff1940047c0 2023-12-22T09:15:31.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19400c420 con 0x7ff1940039c0 2023-12-22T09:15:31.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.596+0000 7ff1a6d9d640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1940051d0 0x7ff19400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.597+0000 7ff19ffff640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940047c0 0x7ff194004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.597+0000 7ff1a659c640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1940039c0 0x7ff194003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.597+0000 7ff1a6d9d640 1 -- 172.21.15.106:0/903701580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1940039c0 msgr2=0x7ff194003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:31.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.597+0000 7ff1a6d9d640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1940039c0 0x7ff194003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.597+0000 7ff1a6d9d640 1 -- 172.21.15.106:0/903701580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940047c0 msgr2=0x7ff194004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:31.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.597+0000 7ff1a6d9d640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940047c0 0x7ff194004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.597+0000 7ff1a6d9d640 1 -- 172.21.15.106:0/903701580 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194003520 con 0x7ff1940051d0 2023-12-22T09:15:31.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.597+0000 7ff19ffff640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940047c0 0x7ff194004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:15:31.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.598+0000 7ff1a6d9d640 1 -- 172.21.15.106:0/903701580 reap_dead start 2023-12-22T09:15:31.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.598+0000 7ff1a6d9d640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1940051d0 0x7ff19400b980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0001e20 tx=0x7ff1940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134c16c903a7c68c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:31.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.598+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0003b70 con 0x7ff1940051d0 2023-12-22T09:15:31.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.598+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a0003cd0 con 0x7ff1940051d0 2023-12-22T09:15:31.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.598+0000 7ff1a5d9b640 1 -- 172.21.15.106:0/903701580 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00052f0 con 0x7ff1940051d0 2023-12-22T09:15:31.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.599+0000 7ff1aca10640 1 -- 172.21.15.106:0/903701580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1940051d0 msgr2=0x7ff19400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.599+0000 7ff1aca10640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1940051d0 0x7ff19400b980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0001e20 tx=0x7ff1940057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.599+0000 7ff1aca10640 1 -- 172.21.15.106:0/903701580 shutdown_connections 2023-12-22T09:15:31.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.599+0000 7ff1aca10640 1 --2- 172.21.15.106:0/903701580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1940051d0 0x7ff19400b980 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.599+0000 7ff1aca10640 1 -- 172.21.15.106:0/903701580 >> 172.21.15.106:0/903701580 conn(0x7ff1a8069dd0 msgr2=0x7ff1a806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:31.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.599+0000 7ff1aca10640 1 -- 172.21.15.106:0/903701580 shutdown_connections 2023-12-22T09:15:31.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.599+0000 7ff1aca10640 1 -- 172.21.15.106:0/903701580 wait complete. 2023-12-22T09:15:31.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.601+0000 7ff1aca10640 1 Processor -- start 2023-12-22T09:15:31.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.601+0000 7ff1aca10640 1 -- start start 2023-12-22T09:15:31.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff1aca10640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940051d0 0x7ff1a81e9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff1aca10640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1a80c4550 0x7ff1a8153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff1aca10640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1a81ec350 0x7ff1a81ec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff1aca10640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81e9da0 con 0x7ff1a80c4550 2023-12-22T09:15:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff1aca10640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81e93d0 con 0x7ff1940051d0 2023-12-22T09:15:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff1aca10640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81e8de0 con 0x7ff1a81ec350 2023-12-22T09:15:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff19ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1a80c4550 0x7ff1a8153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff19ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1a80c4550 0x7ff1a8153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40234/0 (socket says 172.21.15.106:40234) 2023-12-22T09:15:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff19ffff640 1 -- 172.21.15.106:0/4274413011 learned_addr learned my addr 172.21.15.106:0/4274413011 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff19ffff640 1 -- 172.21.15.106:0/4274413011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1a81ec350 msgr2=0x7ff1a81ec7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff19ffff640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1a81ec350 0x7ff1a81ec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff1a659c640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940051d0 0x7ff1a81e9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff19ffff640 1 -- 172.21.15.106:0/4274413011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940051d0 msgr2=0x7ff1a81e9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.602+0000 7ff19ffff640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940051d0 0x7ff1a81e9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.603+0000 7ff19ffff640 1 -- 172.21.15.106:0/4274413011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a81ecdd0 con 0x7ff1a80c4550 2023-12-22T09:15:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.603+0000 7ff19ffff640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1a80c4550 0x7ff1a8153640 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff190011540 tx=0x7ff190011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.603+0000 7ff19effd640 1 -- 172.21.15.106:0/4274413011 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190015870 con 0x7ff1a80c4550 2023-12-22T09:15:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.603+0000 7ff19effd640 1 -- 172.21.15.106:0/4274413011 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1900159d0 con 0x7ff1a80c4550 2023-12-22T09:15:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.603+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a81ed0b0 con 0x7ff1a80c4550 2023-12-22T09:15:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.603+0000 7ff19effd640 1 -- 172.21.15.106:0/4274413011 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190015d40 con 0x7ff1a80c4550 2023-12-22T09:15:31.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.603+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a81525a0 con 0x7ff1a80c4550 2023-12-22T09:15:31.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.604+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a80c62c0 con 0x7ff1a80c4550 2023-12-22T09:15:31.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.605+0000 7ff19effd640 1 -- 172.21.15.106:0/4274413011 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff19000f460 con 0x7ff1a80c4550 2023-12-22T09:15:31.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.606+0000 7ff19effd640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff18806a430 0x7ff18806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:31.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.606+0000 7ff19effd640 1 -- 172.21.15.106:0/4274413011 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff190089440 con 0x7ff1a80c4550 2023-12-22T09:15:31.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.606+0000 7ff1a659c640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff18806a430 0x7ff18806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:31.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.607+0000 7ff1a659c640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff18806a430 0x7ff18806c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff1980017a0 tx=0x7ff198009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.610+0000 7ff19effd640 1 -- 172.21.15.106:0/4274413011 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff190054700 con 0x7ff1a80c4550 2023-12-22T09:15:31.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.802+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1a8073f10 con 0x7ff1a80c4550 2023-12-22T09:15:31.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.802+0000 7ff19effd640 1 -- 172.21.15.106:0/4274413011 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff190057d20 con 0x7ff1a80c4550 2023-12-22T09:15:31.804 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:31.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff18806a430 msgr2=0x7ff18806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff18806a430 0x7ff18806c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff1980017a0 tx=0x7ff198009040 comp rx=0 tx=0).stop 2023-12-22T09:15:31.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1a80c4550 msgr2=0x7ff1a8153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:31.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1a80c4550 0x7ff1a8153640 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff190011540 tx=0x7ff190011a00 comp rx=0 tx=0).stop 2023-12-22T09:15:31.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 shutdown_connections 2023-12-22T09:15:31.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff18806a430 0x7ff18806c8f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1a81ec350 0x7ff1a81ec7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1a80c4550 0x7ff1a8153640 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 --2- 172.21.15.106:0/4274413011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1940051d0 0x7ff1a81e9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:31.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.805+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 >> 172.21.15.106:0/4274413011 conn(0x7ff1a8069dd0 msgr2=0x7ff1a806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:31.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.806+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 shutdown_connections 2023-12-22T09:15:31.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:31.806+0000 7ff1aca10640 1 -- 172.21.15.106:0/4274413011 wait complete. 2023-12-22T09:15:31.824 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:32.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.042+0000 7f08b8dfd640 1 Processor -- start 2023-12-22T09:15:32.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.042+0000 7f08b8dfd640 1 -- start start 2023-12-22T09:15:32.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.043+0000 7f08b8dfd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 0x7f08b40a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.043+0000 7f08b8dfd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b41550b0 con 0x7f08b40bfb40 2023-12-22T09:15:32.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.043+0000 7f08b8dfd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b4155390 con 0x7f08b40c0050 2023-12-22T09:15:32.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.044+0000 7f08b8dfd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40a93d0 con 0x7f08b40a8360 2023-12-22T09:15:32.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.044+0000 7f08aaffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f08b40bfb40 0x7f08b4151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41392/0 (socket says 172.21.15.106:41392) 2023-12-22T09:15:32.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.044+0000 7f08aaffd640 1 -- 172.21.15.106:0/2049006892 learned_addr learned my addr 172.21.15.106:0/2049006892 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:32.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.044+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750459837 0 0) 0x7f08b41550b0 con 0x7f08b40bfb40 2023-12-22T09:15:32.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.044+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a0003520 con 0x7f08b40bfb40 2023-12-22T09:15:32.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.044+0000 7f08b37fe640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 0x7f08b40a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115679644 0 0) 0x7f08a0003520 con 0x7f08b40bfb40 2023-12-22T09:15:32.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 msgr2=0x7f08b40a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:32.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 0x7f08b40a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 >> v1:172.21.15.132:6789/0 conn(0x7f08b40c0050 legacy=0x7f08b4152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4155670 con 0x7f08b40bfb40 2023-12-22T09:15:32.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f089c001670 con 0x7f08b40bfb40 2023-12-22T09:15:32.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b37fe640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 0x7f08b40a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:15:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 >> v1:172.21.15.106:6789/0 conn(0x7f08b40bfb40 legacy=0x7f08b4151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 0x7f08a00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08a0004d00 0x7f08a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40a93d0 con 0x7f08a0003f90 2023-12-22T09:15:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a000bc10 con 0x7f08a0004d00 2023-12-22T09:15:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a000bdd0 con 0x7f08b40a8360 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08aaffd640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b37fe640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 0x7f08a00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b3fff640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08a0004d00 0x7f08a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08aaffd640 1 -- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 msgr2=0x7f08a00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08aaffd640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 0x7f08a00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08aaffd640 1 -- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08a0004d00 msgr2=0x7f08a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08aaffd640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08a0004d00 0x7f08a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08aaffd640 1 -- 172.21.15.106:0/2049006892 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a0003520 con 0x7f08a0003f90 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.045+0000 7f08b37fe640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b40a8360 0x7f08a00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.046+0000 7f08b3fff640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08a0004d00 0x7f08a0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.047+0000 7f08aaffd640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08a00047c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f089c00c240 tx=0x7f08a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408350535810f9c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.047+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c005ad0 con 0x7f08a0003f90 2023-12-22T09:15:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.047+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c005c30 con 0x7f08a0003f90 2023-12-22T09:15:32.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.047+0000 7f08b2ffd640 1 -- 172.21.15.106:0/2049006892 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c02caf0 con 0x7f08a0003f90 2023-12-22T09:15:32.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.047+0000 7f08b8dfd640 1 -- 172.21.15.106:0/2049006892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 msgr2=0x7f08a00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.047+0000 7f08b8dfd640 1 --2- 172.21.15.106:0/2049006892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08a00047c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f089c00c240 tx=0x7f08a00057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.047+0000 7f08b3fff640 1 -- 172.21.15.106:0/2049006892 reap_dead start 2023-12-22T09:15:32.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.047+0000 7f08b8dfd640 1 -- 172.21.15.106:0/2049006892 shutdown_connections 2023-12-22T09:15:32.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.047+0000 7f08b8dfd640 1 -- 172.21.15.106:0/2049006892 >> 172.21.15.106:0/2049006892 conn(0x7f08b4069bf0 msgr2=0x7f08b4069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:32.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.048+0000 7f08b8dfd640 1 -- 172.21.15.106:0/2049006892 shutdown_connections 2023-12-22T09:15:32.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.048+0000 7f08b8dfd640 1 -- 172.21.15.106:0/2049006892 wait complete. 2023-12-22T09:15:32.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.049+0000 7f08b8dfd640 1 Processor -- start 2023-12-22T09:15:32.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.049+0000 7f08b8dfd640 1 -- start start 2023-12-22T09:15:32.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.050+0000 7f08b8dfd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08b41ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.050+0000 7f08b8dfd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b41ec9e0 0x7f08b40c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.050+0000 7f08b8dfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b41ece60 0x7f08b4142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.050+0000 7f08b8dfd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b4154980 con 0x7f08a0003f90 2023-12-22T09:15:32.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.050+0000 7f08b8dfd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b41e9bd0 con 0x7f08b41ece60 2023-12-22T09:15:32.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.050+0000 7f08b8dfd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b41e9580 con 0x7f08b41ec9e0 2023-12-22T09:15:32.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.051+0000 7f08b37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08b41ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.051+0000 7f08b37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08b41ea060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40252/0 (socket says 172.21.15.106:40252) 2023-12-22T09:15:32.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.051+0000 7f08b37fe640 1 -- 172.21.15.106:0/3264747230 learned_addr learned my addr 172.21.15.106:0/3264747230 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.051+0000 7f08b37fe640 1 -- 172.21.15.106:0/3264747230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b41ec9e0 msgr2=0x7f08b40c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.051+0000 7f08b37fe640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b41ec9e0 0x7f08b40c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.051+0000 7f08b37fe640 1 -- 172.21.15.106:0/3264747230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b41ece60 msgr2=0x7f08b4142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.051+0000 7f08b37fe640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b41ece60 0x7f08b4142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.051+0000 7f08b37fe640 1 -- 172.21.15.106:0/3264747230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b41e9860 con 0x7f08a0003f90 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.051+0000 7f08b37fe640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08b41ea060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08a400f580 tx=0x7f08a400fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.052+0000 7f08b0ff9640 1 -- 172.21.15.106:0/3264747230 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4014890 con 0x7f08a0003f90 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.052+0000 7f08b0ff9640 1 -- 172.21.15.106:0/3264747230 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a400c030 con 0x7f08a0003f90 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.052+0000 7f08b0ff9640 1 -- 172.21.15.106:0/3264747230 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4014bf0 con 0x7f08a0003f90 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.052+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b4154590 con 0x7f08a0003f90 2023-12-22T09:15:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.052+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b40c0cb0 con 0x7f08a0003f90 2023-12-22T09:15:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.053+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b41e99f0 con 0x7f08a0003f90 2023-12-22T09:15:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.054+0000 7f08b0ff9640 1 -- 172.21.15.106:0/3264747230 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f08a4014d50 con 0x7f08a0003f90 2023-12-22T09:15:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.055+0000 7f08b0ff9640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f089406a430 0x7f089406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.055+0000 7f08b0ff9640 1 -- 172.21.15.106:0/3264747230 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f08a4089000 con 0x7f08a0003f90 2023-12-22T09:15:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.055+0000 7f08aaffd640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f089406a430 0x7f089406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.056+0000 7f08aaffd640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f089406a430 0x7f089406c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f089c034000 tx=0x7f089c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.059+0000 7f08b0ff9640 1 -- 172.21.15.106:0/3264747230 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f08a4054240 con 0x7f08a0003f90 2023-12-22T09:15:32.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.247+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08b40ab220 con 0x7f08a0003f90 2023-12-22T09:15:32.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.248+0000 7f08b0ff9640 1 -- 172.21.15.106:0/3264747230 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08a4057860 con 0x7f08a0003f90 2023-12-22T09:15:32.248 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f089406a430 msgr2=0x7f089406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f089406a430 0x7f089406c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f089c034000 tx=0x7f089c007000 comp rx=0 tx=0).stop 2023-12-22T09:15:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 msgr2=0x7f08b41ea060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08b41ea060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08a400f580 tx=0x7f08a400fa40 comp rx=0 tx=0).stop 2023-12-22T09:15:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 shutdown_connections 2023-12-22T09:15:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f089406a430 0x7f089406c8f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b41ece60 0x7f08b4142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08b41ec9e0 0x7f08b40c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 --2- 172.21.15.106:0/3264747230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0003f90 0x7f08b41ea060 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.250+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 >> 172.21.15.106:0/3264747230 conn(0x7f08b4069bf0 msgr2=0x7f08b40be570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.251+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 shutdown_connections 2023-12-22T09:15:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.251+0000 7f08b8dfd640 1 -- 172.21.15.106:0/3264747230 wait complete. 2023-12-22T09:15:32.271 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.487+0000 7f1b25bfd640 1 Processor -- start 2023-12-22T09:15:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.487+0000 7f1b25bfd640 1 -- start start 2023-12-22T09:15:32.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.488+0000 7f1b25bfd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b2014dfd0 0x7f1b20150880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b25bfd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b200bfb00 0x7f1b200c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b25bfd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b200c0c10 con 0x7f1b200c20d0 2023-12-22T09:15:32.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b25bfd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b20071940 con 0x7f1b200bfb00 2023-12-22T09:15:32.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b25bfd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c0000 con 0x7f1b2014dfd0 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b253fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1b200c20d0 0x7f1b20151fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41404/0 (socket says 172.21.15.106:41404) 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b253fc640 1 -- 172.21.15.106:0/3145312158 learned_addr learned my addr 172.21.15.106:0/3145312158 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b1ffff640 1 --2- 172.21.15.106:0/3145312158 >> v2:172.21.15.132:3300/0 conn(0x7f1b200bfb00 0x7f1b200c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173186611 0 0) 0x7f1b200c0c10 con 0x7f1b200c20d0 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b24bfb640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b2014dfd0 0x7f1b20150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.489+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b0c003520 con 0x7f1b200c20d0 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3370593787 0 0) 0x7f1b0c003520 con 0x7f1b200c20d0 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b2014dfd0 msgr2=0x7f1b20150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b2014dfd0 0x7f1b20150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 >> v2:172.21.15.132:3300/0 conn(0x7f1b200bfb00 msgr2=0x7f1b200c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 --2- 172.21.15.106:0/3145312158 >> v2:172.21.15.132:3300/0 conn(0x7f1b200bfb00 0x7f1b200c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200c02e0 con 0x7f1b200c20d0 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f1b10001670 con 0x7f1b200c20d0 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 >> v1:172.21.15.106:6789/0 conn(0x7f1b200c20d0 legacy=0x7f1b20151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b0c003970 0x7f1b0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b0c0047c0 0x7f1b0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b2014dfd0 0x7f1b0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c0000 con 0x7f1b0c003970 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c00b980 con 0x7f1b0c0047c0 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c00bb10 con 0x7f1b2014dfd0 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.490+0000 7f1b24bfb640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b0c003970 0x7f1b0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.491+0000 7f1b1ffff640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b0c0047c0 0x7f1b0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.491+0000 7f1b253fc640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b2014dfd0 0x7f1b0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.491+0000 7f1b24bfb640 1 -- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b2014dfd0 msgr2=0x7f1b0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:32.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.491+0000 7f1b24bfb640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b2014dfd0 0x7f1b0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.491+0000 7f1b24bfb640 1 -- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b0c0047c0 msgr2=0x7f1b0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:32.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.491+0000 7f1b24bfb640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b0c0047c0 0x7f1b0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.491+0000 7f1b24bfb640 1 -- 172.21.15.106:0/3145312158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c003520 con 0x7f1b0c003970 2023-12-22T09:15:32.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.491+0000 7f1b1ffff640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b0c0047c0 0x7f1b0c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:32.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.491+0000 7f1b253fc640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b2014dfd0 0x7f1b0c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:32.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.492+0000 7f1b24bfb640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b0c003970 0x7f1b0c003d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800e170 tx=0x7f1b0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f64b28bda7b0b63 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:32.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.492+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1802cbf0 con 0x7f1b0c003970 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.492+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1800f040 con 0x7f1b0c003970 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.492+0000 7f1b1f7fe640 1 -- 172.21.15.106:0/3145312158 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18034440 con 0x7f1b0c003970 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.493+0000 7f1b25bfd640 1 -- 172.21.15.106:0/3145312158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b0c003970 msgr2=0x7f1b0c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.493+0000 7f1b25bfd640 1 --2- 172.21.15.106:0/3145312158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b0c003970 0x7f1b0c003d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800e170 tx=0x7f1b0c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.493+0000 7f1b253fc640 1 -- 172.21.15.106:0/3145312158 reap_dead start 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.493+0000 7f1b25bfd640 1 -- 172.21.15.106:0/3145312158 shutdown_connections 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.493+0000 7f1b25bfd640 1 -- 172.21.15.106:0/3145312158 >> 172.21.15.106:0/3145312158 conn(0x7f1b20069bf0 msgr2=0x7f1b20069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.493+0000 7f1b25bfd640 1 -- 172.21.15.106:0/3145312158 shutdown_connections 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.493+0000 7f1b25bfd640 1 -- 172.21.15.106:0/3145312158 wait complete. 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.495+0000 7f1b25bfd640 1 Processor -- start 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.495+0000 7f1b25bfd640 1 -- start start 2023-12-22T09:15:32.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b25bfd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b0c003970 0x7f1b201ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b25bfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b201e9cc0 0x7f1b200be740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b25bfd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b2006ff70 0x7f1b20070420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b25bfd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b201e8fd0 con 0x7f1b2006ff70 2023-12-22T09:15:32.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b25bfd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b201e9830 con 0x7f1b201e9cc0 2023-12-22T09:15:32.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b25bfd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b201ed490 con 0x7f1b0c003970 2023-12-22T09:15:32.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b253fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b2006ff70 0x7f1b20070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b253fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b2006ff70 0x7f1b20070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40268/0 (socket says 172.21.15.106:40268) 2023-12-22T09:15:32.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b253fc640 1 -- 172.21.15.106:0/2133507909 learned_addr learned my addr 172.21.15.106:0/2133507909 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b24bfb640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b0c003970 0x7f1b201ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b253fc640 1 -- 172.21.15.106:0/2133507909 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b0c003970 msgr2=0x7f1b201ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b1ffff640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b201e9cc0 0x7f1b200be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b253fc640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b0c003970 0x7f1b201ecf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b253fc640 1 -- 172.21.15.106:0/2133507909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b201e9cc0 msgr2=0x7f1b200be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b253fc640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b201e9cc0 0x7f1b200be740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.496+0000 7f1b253fc640 1 -- 172.21.15.106:0/2133507909 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200715e0 con 0x7f1b2006ff70 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.497+0000 7f1b253fc640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b2006ff70 0x7f1b20070420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1b200c2c40 tx=0x7f1b1000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.497+0000 7f1b1d7fa640 1 -- 172.21.15.106:0/2133507909 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100074e0 con 0x7f1b2006ff70 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.497+0000 7f1b1d7fa640 1 -- 172.21.15.106:0/2133507909 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10007640 con 0x7f1b2006ff70 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.497+0000 7f1b1d7fa640 1 -- 172.21.15.106:0/2133507909 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100049e0 con 0x7f1b2006ff70 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.497+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b201e91e0 con 0x7f1b2006ff70 2023-12-22T09:15:32.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.497+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b200bec80 con 0x7f1b2006ff70 2023-12-22T09:15:32.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.498+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b201e99e0 con 0x7f1b2006ff70 2023-12-22T09:15:32.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.499+0000 7f1b1d7fa640 1 -- 172.21.15.106:0/2133507909 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1b10004b40 con 0x7f1b2006ff70 2023-12-22T09:15:32.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.500+0000 7f1b1d7fa640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b0006a450 0x7f1b0006c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.500+0000 7f1b1d7fa640 1 -- 172.21.15.106:0/2133507909 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b100888b0 con 0x7f1b2006ff70 2023-12-22T09:15:32.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.500+0000 7f1b24bfb640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b0006a450 0x7f1b0006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.501+0000 7f1b24bfb640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b0006a450 0x7f1b0006c910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1b18036000 tx=0x7f1b1802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:32.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.504+0000 7f1b1d7fa640 1 -- 172.21.15.106:0/2133507909 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1b201e99e0 con 0x7f1b2006ff70 2023-12-22T09:15:32.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.691+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b201e99e0 con 0x7f1b2006ff70 2023-12-22T09:15:32.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.692+0000 7f1b1d7fa640 1 -- 172.21.15.106:0/2133507909 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b201e99e0 con 0x7f1b2006ff70 2023-12-22T09:15:32.694 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:32.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b0006a450 msgr2=0x7f1b0006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b0006a450 0x7f1b0006c910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1b18036000 tx=0x7f1b1802e000 comp rx=0 tx=0).stop 2023-12-22T09:15:32.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b2006ff70 msgr2=0x7f1b20070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b2006ff70 0x7f1b20070420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1b200c2c40 tx=0x7f1b1000d9d0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 shutdown_connections 2023-12-22T09:15:32.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b0006a450 0x7f1b0006c910 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b2006ff70 0x7f1b20070420 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b201e9cc0 0x7f1b200be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 --2- 172.21.15.106:0/2133507909 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b0c003970 0x7f1b201ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.695+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 >> 172.21.15.106:0/2133507909 conn(0x7f1b20069bf0 msgr2=0x7f1b2014af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:32.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.696+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 shutdown_connections 2023-12-22T09:15:32.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.696+0000 7f1b25bfd640 1 -- 172.21.15.106:0/2133507909 wait complete. 2023-12-22T09:15:32.715 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:32.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.929+0000 7f89f1081640 1 Processor -- start 2023-12-22T09:15:32.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.929+0000 7f89f1081640 1 -- start start 2023-12-22T09:15:32.932 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.931+0000 7f89f1081640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89ec071e30 0x7f89ec150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.932 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.931+0000 7f89f1081640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89ec06bdc0 0x7f89ec14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.931+0000 7f89f1081640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec070000 con 0x7f89ec0c5ca0 2023-12-22T09:15:32.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.931+0000 7f89f1081640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec0702e0 con 0x7f89ec06bdc0 2023-12-22T09:15:32.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.931+0000 7f89f1081640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec0705c0 con 0x7f89ec071e30 2023-12-22T09:15:32.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.931+0000 7f89ead9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f89ec0c5ca0 0x7f89ec0710a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33104/0 (socket says 172.21.15.106:33104) 2023-12-22T09:15:32.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.931+0000 7f89ead9d640 1 -- 172.21.15.106:0/3104330605 learned_addr learned my addr 172.21.15.106:0/3104330605 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:32.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.931+0000 7f89eb59e640 1 --2- 172.21.15.106:0/3104330605 >> v2:172.21.15.106:3300/0 conn(0x7f89ec06bdc0 0x7f89ec14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.931+0000 7f89ea59c640 1 --2- 172.21.15.106:0/3104330605 >> v2:172.21.15.132:3300/0 conn(0x7f89ec071e30 0x7f89ec150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.932+0000 7f89eb59e640 1 -- 172.21.15.106:0/3104330605 >> v2:172.21.15.132:3300/0 conn(0x7f89ec071e30 msgr2=0x7f89ec150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:32.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.932+0000 7f89eb59e640 1 --2- 172.21.15.106:0/3104330605 >> v2:172.21.15.132:3300/0 conn(0x7f89ec071e30 0x7f89ec150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.932+0000 7f89eb59e640 1 -- 172.21.15.106:0/3104330605 >> v1:172.21.15.106:6789/0 conn(0x7f89ec0c5ca0 legacy=0x7f89ec0710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.932+0000 7f89eb59e640 1 -- 172.21.15.106:0/3104330605 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec0708a0 con 0x7f89ec06bdc0 2023-12-22T09:15:32.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.932+0000 7f89e9d9b640 1 -- 172.21.15.106:0/3104330605 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649360177 0 0) 0x7f89ec070000 con 0x7f89ec0c5ca0 2023-12-22T09:15:32.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.933+0000 7f89eb59e640 1 --2- 172.21.15.106:0/3104330605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec06bdc0 0x7f89ec14a5f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0ab490 tx=0x7f89e402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1451d7c1c453b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:32.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.933+0000 7f89e9d9b640 1 -- 172.21.15.106:0/3104330605 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e402cbf0 con 0x7f89ec06bdc0 2023-12-22T09:15:32.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.933+0000 7f89e9d9b640 1 -- 172.21.15.106:0/3104330605 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e402cd50 con 0x7f89ec06bdc0 2023-12-22T09:15:32.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.933+0000 7f89e9d9b640 1 -- 172.21.15.106:0/3104330605 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4034660 con 0x7f89ec06bdc0 2023-12-22T09:15:32.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.934+0000 7f89f1081640 1 -- 172.21.15.106:0/3104330605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec06bdc0 msgr2=0x7f89ec14a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.934+0000 7f89f1081640 1 --2- 172.21.15.106:0/3104330605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec06bdc0 0x7f89ec14a5f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0ab490 tx=0x7f89e402be40 comp rx=0 tx=0).stop 2023-12-22T09:15:32.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.934+0000 7f89f1081640 1 -- 172.21.15.106:0/3104330605 shutdown_connections 2023-12-22T09:15:32.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.934+0000 7f89f1081640 1 --2- 172.21.15.106:0/3104330605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec06bdc0 0x7f89ec14a5f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.934+0000 7f89f1081640 1 --2- 172.21.15.106:0/3104330605 >> v2:172.21.15.132:3300/0 conn(0x7f89ec071e30 0x7f89ec150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.934+0000 7f89f1081640 1 -- 172.21.15.106:0/3104330605 >> 172.21.15.106:0/3104330605 conn(0x7f89ec06a220 msgr2=0x7f89ec0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:32.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.934+0000 7f89f1081640 1 -- 172.21.15.106:0/3104330605 shutdown_connections 2023-12-22T09:15:32.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.934+0000 7f89f1081640 1 -- 172.21.15.106:0/3104330605 wait complete. 2023-12-22T09:15:32.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.936+0000 7f89f1081640 1 Processor -- start 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.936+0000 7f89f1081640 1 -- start start 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.936+0000 7f89f1081640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ec06bdc0 0x7f89ec0bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89f1081640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec071e30 0x7f89ec1414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89f1081640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ec0c5ca0 0x7f89ec153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89f1081640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0bce00 con 0x7f89ec071e30 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89f1081640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0bd3c0 con 0x7f89ec0c5ca0 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89f1081640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0bf270 con 0x7f89ec06bdc0 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89ea59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec071e30 0x7f89ec1414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89ea59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec071e30 0x7f89ec1414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44654/0 (socket says 172.21.15.106:44654) 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89ea59c640 1 -- 172.21.15.106:0/3081368896 learned_addr learned my addr 172.21.15.106:0/3081368896 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89ea59c640 1 -- 172.21.15.106:0/3081368896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ec06bdc0 msgr2=0x7f89ec0bec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89ea59c640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ec06bdc0 0x7f89ec0bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89ea59c640 1 -- 172.21.15.106:0/3081368896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ec0c5ca0 msgr2=0x7f89ec153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89ea59c640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ec0c5ca0 0x7f89ec153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.937+0000 7f89ea59c640 1 -- 172.21.15.106:0/3081368896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4009a70 con 0x7f89ec071e30 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.938+0000 7f89ea59c640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec071e30 0x7f89ec1414a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d830 tx=0x7f89e000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.938+0000 7f89d37fe640 1 -- 172.21.15.106:0/3081368896 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e000b6c0 con 0x7f89ec071e30 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.938+0000 7f89d37fe640 1 -- 172.21.15.106:0/3081368896 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e000b820 con 0x7f89ec071e30 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.938+0000 7f89d37fe640 1 -- 172.21.15.106:0/3081368896 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e000bbd0 con 0x7f89ec071e30 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.938+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec0bd050 con 0x7f89ec071e30 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.938+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec0bd6a0 con 0x7f89ec071e30 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.939+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec073f10 con 0x7f89ec071e30 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.940+0000 7f89d37fe640 1 -- 172.21.15.106:0/3081368896 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f89e001e460 con 0x7f89ec071e30 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.941+0000 7f89d37fe640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f89d806a430 0x7f89d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.941+0000 7f89d37fe640 1 -- 172.21.15.106:0/3081368896 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f89e0089490 con 0x7f89ec071e30 2023-12-22T09:15:32.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.941+0000 7f89ead9d640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f89d806a430 0x7f89d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:32.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.942+0000 7f89ead9d640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f89d806a430 0x7f89d806c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89dc007fd0 tx=0x7f89dc007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:32.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:32.945+0000 7f89d37fe640 1 -- 172.21.15.106:0/3081368896 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f89e00546b0 con 0x7f89ec071e30 2023-12-22T09:15:33.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.138+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f89ec070b50 con 0x7f89ec071e30 2023-12-22T09:15:33.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.138+0000 7f89d37fe640 1 -- 172.21.15.106:0/3081368896 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f89e0057cd0 con 0x7f89ec071e30 2023-12-22T09:15:33.139 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:33.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.141+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f89d806a430 msgr2=0x7f89d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:33.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.141+0000 7f89f1081640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f89d806a430 0x7f89d806c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89dc007fd0 tx=0x7f89dc007960 comp rx=0 tx=0).stop 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.141+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec071e30 msgr2=0x7f89ec1414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.141+0000 7f89f1081640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec071e30 0x7f89ec1414a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d830 tx=0x7f89e000dcf0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.141+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 shutdown_connections 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.142+0000 7f89f1081640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f89d806a430 0x7f89d806c8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.142+0000 7f89f1081640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89ec0c5ca0 0x7f89ec153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.142+0000 7f89f1081640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89ec071e30 0x7f89ec1414a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.142+0000 7f89f1081640 1 --2- 172.21.15.106:0/3081368896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89ec06bdc0 0x7f89ec0bec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.142+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 >> 172.21.15.106:0/3081368896 conn(0x7f89ec06a220 msgr2=0x7f89ec1511e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.142+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 shutdown_connections 2023-12-22T09:15:33.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.142+0000 7f89f1081640 1 -- 172.21.15.106:0/3081368896 wait complete. 2023-12-22T09:15:33.162 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T09:15:33.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.376+0000 7fe431423640 1 Processor -- start 2023-12-22T09:15:33.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.377+0000 7fe431423640 1 -- start start 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.378+0000 7fe431423640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe42c0c5790 0x7fe42c0c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.378+0000 7fe431423640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe42c06ae80 0x7fe42c0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.378+0000 7fe431423640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c45b0 0x7fe42c151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.378+0000 7fe431423640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c06aa60 con 0x7fe42c06ae80 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.378+0000 7fe431423640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c06a6c0 con 0x7fe42c0c5790 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.378+0000 7fe431423640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0c5060 con 0x7fe42c0c45b0 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.379+0000 7fe42a7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe42c06ae80 0x7fe42c0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.379+0000 7fe42a7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe42c06ae80 0x7fe42c0c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44656/0 (socket says 172.21.15.106:44656) 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.379+0000 7fe42a7fc640 1 -- 172.21.15.106:0/984025234 learned_addr learned my addr 172.21.15.106:0/984025234 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.379+0000 7fe42a7fc640 1 -- 172.21.15.106:0/984025234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c45b0 msgr2=0x7fe42c151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.379+0000 7fe42a7fc640 1 --2- 172.21.15.106:0/984025234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c45b0 0x7fe42c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.379+0000 7fe42a7fc640 1 -- 172.21.15.106:0/984025234 >> v2:172.21.15.132:3300/0 conn(0x7fe42c0c5790 msgr2=0x7fe42c0c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:33.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.379+0000 7fe42affd640 1 --2- 172.21.15.106:0/984025234 >> v2:172.21.15.132:3300/0 conn(0x7fe42c0c5790 0x7fe42c0c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:33.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.379+0000 7fe42a7fc640 1 --2- 172.21.15.106:0/984025234 >> v2:172.21.15.132:3300/0 conn(0x7fe42c0c5790 0x7fe42c0c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.379+0000 7fe42a7fc640 1 -- 172.21.15.106:0/984025234 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0c4aa0 con 0x7fe42c06ae80 2023-12-22T09:15:33.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.380+0000 7fe42a7fc640 1 --2- 172.21.15.106:0/984025234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 0x7fe42c0c4070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe42c067040 tx=0x7fe41402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2514be6656e0b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:33.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.380+0000 7fe429ffb640 1 -- 172.21.15.106:0/984025234 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414031870 con 0x7fe42c06ae80 2023-12-22T09:15:33.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe429ffb640 1 -- 172.21.15.106:0/984025234 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4140319d0 con 0x7fe42c06ae80 2023-12-22T09:15:33.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe429ffb640 1 -- 172.21.15.106:0/984025234 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414031d60 con 0x7fe42c06ae80 2023-12-22T09:15:33.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe431423640 1 -- 172.21.15.106:0/984025234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 msgr2=0x7fe42c0c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:33.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe431423640 1 --2- 172.21.15.106:0/984025234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 0x7fe42c0c4070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe42c067040 tx=0x7fe41402b910 comp rx=0 tx=0).stop 2023-12-22T09:15:33.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe431423640 1 -- 172.21.15.106:0/984025234 shutdown_connections 2023-12-22T09:15:33.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe431423640 1 --2- 172.21.15.106:0/984025234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c45b0 0x7fe42c151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe431423640 1 --2- 172.21.15.106:0/984025234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 0x7fe42c0c4070 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe431423640 1 --2- 172.21.15.106:0/984025234 >> v2:172.21.15.132:3300/0 conn(0x7fe42c0c5790 0x7fe42c0c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe431423640 1 -- 172.21.15.106:0/984025234 >> 172.21.15.106:0/984025234 conn(0x7fe42c0c96f0 msgr2=0x7fe42c0c9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:33.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe431423640 1 -- 172.21.15.106:0/984025234 shutdown_connections 2023-12-22T09:15:33.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.381+0000 7fe431423640 1 -- 172.21.15.106:0/984025234 wait complete. 2023-12-22T09:15:33.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.383+0000 7fe431423640 1 Processor -- start 2023-12-22T09:15:33.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.384+0000 7fe431423640 1 -- start start 2023-12-22T09:15:33.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe431423640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 0x7fe42c1e90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:33.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe431423640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42c0c45b0 0x7fe42c1e95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:33.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe431423640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c5790 0x7fe42c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:33.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe431423640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c1e8c20 con 0x7fe42c06ae80 2023-12-22T09:15:33.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe431423640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c14e460 con 0x7fe42c0c45b0 2023-12-22T09:15:33.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe431423640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c14e180 con 0x7fe42c0c5790 2023-12-22T09:15:33.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe42affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 0x7fe42c1e90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:33.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe42affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 0x7fe42c1e90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44666/0 (socket says 172.21.15.106:44666) 2023-12-22T09:15:33.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe42affd640 1 -- 172.21.15.106:0/920325054 learned_addr learned my addr 172.21.15.106:0/920325054 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:33.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.385+0000 7fe42a7fc640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42c0c45b0 0x7fe42c1e95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe42b7fe640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c5790 0x7fe42c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe42affd640 1 -- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c5790 msgr2=0x7fe42c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe42affd640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c5790 0x7fe42c0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe42affd640 1 -- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42c0c45b0 msgr2=0x7fe42c1e95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe42affd640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42c0c45b0 0x7fe42c1e95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe42affd640 1 -- 172.21.15.106:0/920325054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140094d0 con 0x7fe42c06ae80 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe42b7fe640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c5790 0x7fe42c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe42a7fc640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42c0c45b0 0x7fe42c1e95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe42affd640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 0x7fe42c1e90b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00ce10 tx=0x7fe41c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe4237fe640 1 -- 172.21.15.106:0/920325054 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c003b90 con 0x7fe42c06ae80 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe4237fe640 1 -- 172.21.15.106:0/920325054 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c003cf0 con 0x7fe42c06ae80 2023-12-22T09:15:33.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c0bd970 con 0x7fe42c06ae80 2023-12-22T09:15:33.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe4237fe640 1 -- 172.21.15.106:0/920325054 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c003ea0 con 0x7fe42c06ae80 2023-12-22T09:15:33.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.386+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c14ef30 con 0x7fe42c06ae80 2023-12-22T09:15:33.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.387+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c073f10 con 0x7fe42c06ae80 2023-12-22T09:15:33.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.388+0000 7fe4237fe640 1 -- 172.21.15.106:0/920325054 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe41c004240 con 0x7fe42c06ae80 2023-12-22T09:15:33.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.389+0000 7fe4237fe640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe40c06a430 0x7fe40c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:33.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.390+0000 7fe4237fe640 1 -- 172.21.15.106:0/920325054 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe41c012070 con 0x7fe42c06ae80 2023-12-22T09:15:33.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.390+0000 7fe42a7fc640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe40c06a430 0x7fe40c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:33.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.390+0000 7fe42a7fc640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe40c06a430 0x7fe40c06c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe414036000 tx=0x7fe41403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:33.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.393+0000 7fe4237fe640 1 -- 172.21.15.106:0/920325054 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe41c0549a0 con 0x7fe42c06ae80 2023-12-22T09:15:33.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.592+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe42c069f10 con 0x7fe42c06ae80 2023-12-22T09:15:33.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.593+0000 7fe4237fe640 1 -- 172.21.15.106:0/920325054 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe41c057fc0 con 0x7fe42c06ae80 2023-12-22T09:15:33.595 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-12-22T09:15:33.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.595+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe40c06a430 msgr2=0x7fe40c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:33.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.595+0000 7fe431423640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe40c06a430 0x7fe40c06c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe414036000 tx=0x7fe41403c040 comp rx=0 tx=0).stop 2023-12-22T09:15:33.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.595+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 msgr2=0x7fe42c1e90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:33.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.595+0000 7fe431423640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 0x7fe42c1e90b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00ce10 tx=0x7fe41c00a660 comp rx=0 tx=0).stop 2023-12-22T09:15:33.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.596+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 shutdown_connections 2023-12-22T09:15:33.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.596+0000 7fe431423640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe40c06a430 0x7fe40c06c8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.596+0000 7fe431423640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe42c0c5790 0x7fe42c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.596+0000 7fe431423640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe42c0c45b0 0x7fe42c1e95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.596+0000 7fe431423640 1 --2- 172.21.15.106:0/920325054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe42c06ae80 0x7fe42c1e90b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:33.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.596+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 >> 172.21.15.106:0/920325054 conn(0x7fe42c0c96f0 msgr2=0x7fe42c154310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:33.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.596+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 shutdown_connections 2023-12-22T09:15:33.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:33.596+0000 7fe431423640 1 -- 172.21.15.106:0/920325054 wait complete. 2023-12-22T09:15:33.615 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T09:15:33.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:33.616 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-22T09:15:33.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2023-12-22T09:15:33.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:33.717 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T09:15:33.769 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:15:33.769 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:15:33.826 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:15:33.827 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:15:33.881 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:15:33.881 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:15:33.934 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:34.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.151+0000 7f5d2484a640 1 Processor -- start 2023-12-22T09:15:34.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.151+0000 7f5d2484a640 1 -- start start 2023-12-22T09:15:34.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.153+0000 7f5d2484a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5d200c2090 0x7f5d200bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.153+0000 7f5d2484a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2006b760 0x7f5d20153c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.153+0000 7f5d2484a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d20157550 con 0x7f5d201579e0 2023-12-22T09:15:34.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.153+0000 7f5d2484a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d201544b0 con 0x7f5d200c2090 2023-12-22T09:15:34.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.153+0000 7f5d2484a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20154790 con 0x7f5d2006b760 2023-12-22T09:15:34.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.153+0000 7f5d1f59e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5d201579e0 0x7f5d20150de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33108/0 (socket says 172.21.15.106:33108) 2023-12-22T09:15:34.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.153+0000 7f5d1f59e640 1 -- 172.21.15.106:0/3193550490 learned_addr learned my addr 172.21.15.106:0/3193550490 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:34.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d17fff640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2006b760 0x7f5d20153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1ed9d640 1 --2- 172.21.15.106:0/3193550490 >> v2:172.21.15.132:3300/0 conn(0x7f5d200c2090 0x7f5d200bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60344227 0 0) 0x7f5d20157550 con 0x7f5d201579e0 2023-12-22T09:15:34.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d0c003520 con 0x7f5d201579e0 2023-12-22T09:15:34.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2119781064 0 0) 0x7f5d0c003520 con 0x7f5d201579e0 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2006b760 msgr2=0x7f5d20153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2006b760 0x7f5d20153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 >> v2:172.21.15.132:3300/0 conn(0x7f5d200c2090 msgr2=0x7f5d200bfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 --2- 172.21.15.106:0/3193550490 >> v2:172.21.15.132:3300/0 conn(0x7f5d200c2090 0x7f5d200bfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20154a70 con 0x7f5d201579e0 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f5d180019f0 con 0x7f5d201579e0 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 >> v1:172.21.15.106:6789/0 conn(0x7f5d201579e0 legacy=0x7f5d20150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d0c0047c0 0x7f5d0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.154+0000 7f5d1e59c640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2006b760 0x7f5d0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.155+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d201544b0 con 0x7f5d0c003970 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.155+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20154790 con 0x7f5d0c0047c0 2023-12-22T09:15:34.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.155+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c00b9d0 con 0x7f5d2006b760 2023-12-22T09:15:34.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.155+0000 7f5d1ed9d640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.155+0000 7f5d1ed9d640 1 -- 172.21.15.106:0/3193550490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2006b760 msgr2=0x7f5d0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:34.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.155+0000 7f5d1ed9d640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d2006b760 0x7f5d0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.155+0000 7f5d1ed9d640 1 -- 172.21.15.106:0/3193550490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d0c0047c0 msgr2=0x7f5d0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:34.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.155+0000 7f5d1ed9d640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d0c0047c0 0x7f5d0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.155+0000 7f5d1ed9d640 1 -- 172.21.15.106:0/3193550490 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c003520 con 0x7f5d0c003970 2023-12-22T09:15:34.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.156+0000 7f5d1ed9d640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d0c003d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009af0 tx=0x7f5d0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abcdeb4609127f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:34.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.156+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1002c710 con 0x7f5d0c003970 2023-12-22T09:15:34.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.156+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1002c870 con 0x7f5d0c003970 2023-12-22T09:15:34.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.156+0000 7f5d1e59c640 1 -- 172.21.15.106:0/3193550490 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1002cc00 con 0x7f5d0c003970 2023-12-22T09:15:34.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.157+0000 7f5d2484a640 1 -- 172.21.15.106:0/3193550490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 msgr2=0x7f5d0c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.157+0000 7f5d2484a640 1 --2- 172.21.15.106:0/3193550490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d0c003d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009af0 tx=0x7f5d0c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.157+0000 7f5d1f59e640 1 -- 172.21.15.106:0/3193550490 reap_dead start 2023-12-22T09:15:34.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.157+0000 7f5d2484a640 1 -- 172.21.15.106:0/3193550490 shutdown_connections 2023-12-22T09:15:34.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.157+0000 7f5d2484a640 1 -- 172.21.15.106:0/3193550490 >> 172.21.15.106:0/3193550490 conn(0x7f5d20069dd0 msgr2=0x7f5d2006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:34.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.157+0000 7f5d2484a640 1 -- 172.21.15.106:0/3193550490 shutdown_connections 2023-12-22T09:15:34.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.157+0000 7f5d2484a640 1 -- 172.21.15.106:0/3193550490 wait complete. 2023-12-22T09:15:34.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.159+0000 7f5d2484a640 1 Processor -- start 2023-12-22T09:15:34.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.159+0000 7f5d2484a640 1 -- start start 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d2484a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d2006fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d2484a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d201e94b0 0x7f5d20151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d2484a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d20151fa0 0x7f5d201ec250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d2484a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20070370 con 0x7f5d0c003970 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d2484a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d201ebdc0 con 0x7f5d20151fa0 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d2484a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2014fc30 con 0x7f5d201e94b0 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d1ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d2006fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d1ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d2006fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44690/0 (socket says 172.21.15.106:44690) 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d1ed9d640 1 -- 172.21.15.106:0/3598624838 learned_addr learned my addr 172.21.15.106:0/3598624838 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d1ed9d640 1 -- 172.21.15.106:0/3598624838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d201e94b0 msgr2=0x7f5d20151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d1ed9d640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d201e94b0 0x7f5d20151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d1ed9d640 1 -- 172.21.15.106:0/3598624838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d20151fa0 msgr2=0x7f5d201ec250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d1ed9d640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d20151fa0 0x7f5d201ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.160+0000 7f5d1ed9d640 1 -- 172.21.15.106:0/3598624838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2014ff10 con 0x7f5d0c003970 2023-12-22T09:15:34.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.161+0000 7f5d1ed9d640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d2006fe30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5d10037040 tx=0x7f5d10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:34.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.161+0000 7f5d177fe640 1 -- 172.21.15.106:0/3598624838 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10003810 con 0x7f5d0c003970 2023-12-22T09:15:34.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.161+0000 7f5d177fe640 1 -- 172.21.15.106:0/3598624838 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1002de90 con 0x7f5d0c003970 2023-12-22T09:15:34.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.161+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d201501f0 con 0x7f5d0c003970 2023-12-22T09:15:34.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.161+0000 7f5d177fe640 1 -- 172.21.15.106:0/3598624838 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10003b90 con 0x7f5d0c003970 2023-12-22T09:15:34.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.161+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2014b380 con 0x7f5d0c003970 2023-12-22T09:15:34.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.162+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2004e8d0 con 0x7f5d0c003970 2023-12-22T09:15:34.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.163+0000 7f5d177fe640 1 -- 172.21.15.106:0/3598624838 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5d10003cf0 con 0x7f5d0c003970 2023-12-22T09:15:34.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.164+0000 7f5d177fe640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d0006a460 0x7f5d0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.164+0000 7f5d177fe640 1 -- 172.21.15.106:0/3598624838 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5d100aabc0 con 0x7f5d0c003970 2023-12-22T09:15:34.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.164+0000 7f5d17fff640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d0006a460 0x7f5d0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.165+0000 7f5d17fff640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d0006a460 0x7f5d0006c920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5d08006a90 tx=0x7f5d08006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:34.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.168+0000 7f5d177fe640 1 -- 172.21.15.106:0/3598624838 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5d10075d50 con 0x7f5d0c003970 2023-12-22T09:15:34.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.345+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d2006fa00 con 0x7f5d0c003970 2023-12-22T09:15:34.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.348+0000 7f5d177fe640 1 -- 172.21.15.106:0/3598624838 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7f5d10079370 con 0x7f5d0c003970 2023-12-22T09:15:34.349 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:34.349 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:34.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d0006a460 msgr2=0x7f5d0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d0006a460 0x7f5d0006c920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5d08006a90 tx=0x7f5d08006a20 comp rx=0 tx=0).stop 2023-12-22T09:15:34.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 msgr2=0x7f5d2006fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d2006fe30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5d10037040 tx=0x7f5d10004730 comp rx=0 tx=0).stop 2023-12-22T09:15:34.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 shutdown_connections 2023-12-22T09:15:34.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5d0006a460 0x7f5d0006c920 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d20151fa0 0x7f5d201ec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5d201e94b0 0x7f5d20151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 --2- 172.21.15.106:0/3598624838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d0c003970 0x7f5d2006fe30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 >> 172.21.15.106:0/3598624838 conn(0x7f5d20069dd0 msgr2=0x7f5d2006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:34.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 shutdown_connections 2023-12-22T09:15:34.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.351+0000 7f5d2484a640 1 -- 172.21.15.106:0/3598624838 wait complete. 2023-12-22T09:15:34.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:34.369 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.569+0000 7fb09fd7e640 1 Processor -- start 2023-12-22T09:15:34.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.569+0000 7fb09fd7e640 1 -- start start 2023-12-22T09:15:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.571+0000 7fb09fd7e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0980c75e0 0x7fb098151070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.571+0000 7fb09fd7e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0980c4660 con 0x7fb0980c4b80 2023-12-22T09:15:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.571+0000 7fb09fd7e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09806b7a0 con 0x7fb0980c4160 2023-12-22T09:15:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.571+0000 7fb09fd7e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb098153d90 con 0x7fb0980c75e0 2023-12-22T09:15:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.571+0000 7fb09db1a640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb0980c4b80 0x7fb0981544a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33124/0 (socket says 172.21.15.106:33124) 2023-12-22T09:15:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.571+0000 7fb09db1a640 1 -- 172.21.15.106:0/2144656848 learned_addr learned my addr 172.21.15.106:0/2144656848 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.571+0000 7fb09d319640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0980c75e0 0x7fb098151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.571+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636070972 0 0) 0x7fb0980c4660 con 0x7fb0980c4b80 2023-12-22T09:15:34.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.571+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb084003520 con 0x7fb0980c4b80 2023-12-22T09:15:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2132320890 0 0) 0x7fb084003520 con 0x7fb0980c4b80 2023-12-22T09:15:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0980c75e0 msgr2=0x7fb098151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0980c75e0 0x7fb098151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 >> v1:172.21.15.132:6789/0 conn(0x7fb0980c4160 legacy=0x7fb09815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09806b1e0 con 0x7fb0980c4b80 2023-12-22T09:15:34.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fb094001670 con 0x7fb0980c4b80 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 >> v1:172.21.15.106:6789/0 conn(0x7fb0980c4b80 legacy=0x7fb0981544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0840039a0 0x7fb084003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0840047c0 0x7fb084004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0980c75e0 0x7fb08400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840054b0 con 0x7fb0840039a0 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb084005620 con 0x7fb0840047c0 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08400bec0 con 0x7fb0980c75e0 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.572+0000 7fb09db1a640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0840039a0 0x7fb084003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.573+0000 7fb09db1a640 1 -- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0980c75e0 msgr2=0x7fb08400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.573+0000 7fb09db1a640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0980c75e0 0x7fb08400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.573+0000 7fb09db1a640 1 -- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0840047c0 msgr2=0x7fb084004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.573+0000 7fb09d319640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0840047c0 0x7fb084004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.573+0000 7fb09db1a640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0840047c0 0x7fb084004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.573+0000 7fb09db1a640 1 -- 172.21.15.106:0/2144656848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb084003520 con 0x7fb0840039a0 2023-12-22T09:15:34.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.574+0000 7fb09db1a640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0840039a0 0x7fb084003dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb09400c240 tx=0x7fb0840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b77e37eea126f99 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:34.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.574+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094005ad0 con 0x7fb0840039a0 2023-12-22T09:15:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.574+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb094005c30 con 0x7fb0840039a0 2023-12-22T09:15:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.574+0000 7fb09cb18640 1 -- 172.21.15.106:0/2144656848 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09402c8b0 con 0x7fb0840039a0 2023-12-22T09:15:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.575+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2144656848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0840039a0 msgr2=0x7fb084003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.575+0000 7fb09fd7e640 1 --2- 172.21.15.106:0/2144656848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0840039a0 0x7fb084003dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb09400c240 tx=0x7fb0840057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.575+0000 7fb09e31b640 1 -- 172.21.15.106:0/2144656848 reap_dead start 2023-12-22T09:15:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.575+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2144656848 shutdown_connections 2023-12-22T09:15:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.575+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2144656848 >> 172.21.15.106:0/2144656848 conn(0x7fb0980ab1d0 msgr2=0x7fb0980ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.575+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2144656848 shutdown_connections 2023-12-22T09:15:34.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.575+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2144656848 wait complete. 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.577+0000 7fb09fd7e640 1 Processor -- start 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.577+0000 7fb09fd7e640 1 -- start start 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09fd7e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0840039a0 0x7fb0980be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09fd7e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0980c3230 0x7fb0980c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09fd7e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0981ec420 0x7fb0981ec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09fd7e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980c0f40 con 0x7fb0981ec420 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09fd7e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0981ecde0 con 0x7fb0980c3230 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09fd7e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0981ed320 con 0x7fb0840039a0 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09e31b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0981ec420 0x7fb0981ec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09e31b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0981ec420 0x7fb0981ec8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44712/0 (socket says 172.21.15.106:44712) 2023-12-22T09:15:34.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09e31b640 1 -- 172.21.15.106:0/2356202895 learned_addr learned my addr 172.21.15.106:0/2356202895 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09e31b640 1 -- 172.21.15.106:0/2356202895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0840039a0 msgr2=0x7fb0980be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09e31b640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0840039a0 0x7fb0980be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09e31b640 1 -- 172.21.15.106:0/2356202895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0980c3230 msgr2=0x7fb0980c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09e31b640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0980c3230 0x7fb0980c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.578+0000 7fb09e31b640 1 -- 172.21.15.106:0/2356202895 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09814aae0 con 0x7fb0981ec420 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.579+0000 7fb09e31b640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0981ec420 0x7fb0981ec8a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb09808ae90 tx=0x7fb09000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.579+0000 7fb08e7fc640 1 -- 172.21.15.106:0/2356202895 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090005d40 con 0x7fb0981ec420 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.579+0000 7fb08e7fc640 1 -- 172.21.15.106:0/2356202895 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09000ced0 con 0x7fb0981ec420 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.579+0000 7fb08e7fc640 1 -- 172.21.15.106:0/2356202895 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09000a850 con 0x7fb0981ec420 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.579+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09814ad80 con 0x7fb0981ec420 2023-12-22T09:15:34.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.579+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0980c8970 con 0x7fb0981ec420 2023-12-22T09:15:34.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.580+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb098073f10 con 0x7fb0981ec420 2023-12-22T09:15:34.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.581+0000 7fb08e7fc640 1 -- 172.21.15.106:0/2356202895 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb09000a9b0 con 0x7fb0981ec420 2023-12-22T09:15:34.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.582+0000 7fb08e7fc640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb07c06a430 0x7fb07c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:34.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.582+0000 7fb08e7fc640 1 -- 172.21.15.106:0/2356202895 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb090087e40 con 0x7fb0981ec420 2023-12-22T09:15:34.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.582+0000 7fb09db1a640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb07c06a430 0x7fb07c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:34.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.583+0000 7fb09db1a640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb07c06a430 0x7fb07c06c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb094034000 tx=0x7fb094007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:34.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.587+0000 7fb08e7fc640 1 -- 172.21.15.106:0/2356202895 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb090053060 con 0x7fb0981ec420 2023-12-22T09:15:34.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.776+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb098150300 con 0x7fb0981ec420 2023-12-22T09:15:34.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.777+0000 7fb08e7fc640 1 -- 172.21.15.106:0/2356202895 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0900170a0 con 0x7fb0981ec420 2023-12-22T09:15:34.777 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:34.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.779+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb07c06a430 msgr2=0x7fb07c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.779+0000 7fb09fd7e640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb07c06a430 0x7fb07c06c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb094034000 tx=0x7fb094007000 comp rx=0 tx=0).stop 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.779+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0981ec420 msgr2=0x7fb0981ec8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.779+0000 7fb09fd7e640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0981ec420 0x7fb0981ec8a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb09808ae90 tx=0x7fb09000cb90 comp rx=0 tx=0).stop 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.780+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 shutdown_connections 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.780+0000 7fb09fd7e640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb07c06a430 0x7fb07c06c8f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.780+0000 7fb09fd7e640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0981ec420 0x7fb0981ec8a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.780+0000 7fb09fd7e640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0980c3230 0x7fb0980c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.780+0000 7fb09fd7e640 1 --2- 172.21.15.106:0/2356202895 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0840039a0 0x7fb0980be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.780+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 >> 172.21.15.106:0/2356202895 conn(0x7fb0980ab1d0 msgr2=0x7fb09814f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.780+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 shutdown_connections 2023-12-22T09:15:34.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:34.780+0000 7fb09fd7e640 1 -- 172.21.15.106:0/2356202895 wait complete. 2023-12-22T09:15:34.799 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.015+0000 7f2ec6147640 1 Processor -- start 2023-12-22T09:15:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.015+0000 7f2ec6147640 1 -- start start 2023-12-22T09:15:35.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.016+0000 7f2ec6147640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ec006bdc0 0x7f2ec0150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.016+0000 7f2ec6147640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec0070000 con 0x7f2ec00c5ca0 2023-12-22T09:15:35.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.016+0000 7f2ec6147640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec00702e0 con 0x7f2ec0071e30 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.016+0000 7f2ec6147640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec00705c0 con 0x7f2ec006bdc0 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.016+0000 7f2ebf7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2ec00c5ca0 0x7f2ec00710a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33132/0 (socket says 172.21.15.106:33132) 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.016+0000 7f2ebf7fe640 1 -- 172.21.15.106:0/1787143912 learned_addr learned my addr 172.21.15.106:0/1787143912 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497454436 0 0) 0x7f2ec0070000 con 0x7f2ec00c5ca0 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eac005730 con 0x7f2ec00c5ca0 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebffff640 1 --2- 172.21.15.106:0/1787143912 >> v2:172.21.15.132:3300/0 conn(0x7f2ec006bdc0 0x7f2ec0150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3655212454 0 0) 0x7f2eac005730 con 0x7f2ec00c5ca0 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 >> v2:172.21.15.132:3300/0 conn(0x7f2ec006bdc0 msgr2=0x7f2ec0150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 --2- 172.21.15.106:0/1787143912 >> v2:172.21.15.132:3300/0 conn(0x7f2ec006bdc0 0x7f2ec0150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 >> v1:172.21.15.132:6789/0 conn(0x7f2ec0071e30 legacy=0x7f2ec014a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00708a0 con 0x7f2ec00c5ca0 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f2eb0001670 con 0x7f2ec00c5ca0 2023-12-22T09:15:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 >> v1:172.21.15.106:6789/0 conn(0x7f2ec00c5ca0 legacy=0x7f2ec00710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eac005b80 0x7f2eac005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2eac006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eac0074b0 0x7f2eac00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00705c0 con 0x7f2eac0069d0 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac00e360 con 0x7f2eac0074b0 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac00e520 con 0x7f2eac005b80 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.017+0000 7f2eb6ffd640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2eac006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.018+0000 7f2ebf7fe640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eac005b80 0x7f2eac005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.018+0000 7f2ebffff640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eac0074b0 0x7f2eac00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.018+0000 7f2eb6ffd640 1 -- 172.21.15.106:0/1787143912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eac005b80 msgr2=0x7f2eac005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.018+0000 7f2eb6ffd640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2eac005b80 0x7f2eac005f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.018+0000 7f2eb6ffd640 1 -- 172.21.15.106:0/1787143912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eac0074b0 msgr2=0x7f2eac00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.018+0000 7f2eb6ffd640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eac0074b0 0x7f2eac00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.018+0000 7f2eb6ffd640 1 -- 172.21.15.106:0/1787143912 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac005730 con 0x7f2eac0069d0 2023-12-22T09:15:35.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.018+0000 7f2ebffff640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2eac0074b0 0x7f2eac00db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:35.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.018+0000 7f2ebffff640 1 -- 172.21.15.106:0/1787143912 reap_dead start 2023-12-22T09:15:35.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.019+0000 7f2eb6ffd640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2eac006e50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2ec01551a0 tx=0x7f2eac007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48d97cea5a05a2d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:35.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.019+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8032600 con 0x7f2eac0069d0 2023-12-22T09:15:35.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.019+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea802e050 con 0x7f2eac0069d0 2023-12-22T09:15:35.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.019+0000 7f2ebeffd640 1 -- 172.21.15.106:0/1787143912 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80329c0 con 0x7f2eac0069d0 2023-12-22T09:15:35.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.020+0000 7f2ec6147640 1 -- 172.21.15.106:0/1787143912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 msgr2=0x7f2eac006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.020+0000 7f2ec6147640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2eac006e50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2ec01551a0 tx=0x7f2eac007a00 comp rx=0 tx=0).stop 2023-12-22T09:15:35.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.020+0000 7f2ec6147640 1 -- 172.21.15.106:0/1787143912 shutdown_connections 2023-12-22T09:15:35.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.020+0000 7f2ec6147640 1 --2- 172.21.15.106:0/1787143912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2eac006e50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.020+0000 7f2ec6147640 1 -- 172.21.15.106:0/1787143912 >> 172.21.15.106:0/1787143912 conn(0x7f2ec006a220 msgr2=0x7f2ec00c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:35.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.020+0000 7f2ec6147640 1 -- 172.21.15.106:0/1787143912 shutdown_connections 2023-12-22T09:15:35.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.020+0000 7f2ec6147640 1 -- 172.21.15.106:0/1787143912 wait complete. 2023-12-22T09:15:35.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.022+0000 7f2ec6147640 1 Processor -- start 2023-12-22T09:15:35.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.022+0000 7f2ec6147640 1 -- start start 2023-12-22T09:15:35.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ec6147640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2ec0143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ec6147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ec014f9b0 0x7f2ec01e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ec6147640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ec01e9330 0x7f2ec013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ec6147640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0143870 con 0x7f2eac0069d0 2023-12-22T09:15:35.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ec6147640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec01404e0 con 0x7f2ec014f9b0 2023-12-22T09:15:35.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ec6147640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0142ea0 con 0x7f2ec01e9330 2023-12-22T09:15:35.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ebf7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2ec0143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ebf7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2ec0143330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44724/0 (socket says 172.21.15.106:44724) 2023-12-22T09:15:35.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ebf7fe640 1 -- 172.21.15.106:0/1985222934 learned_addr learned my addr 172.21.15.106:0/1985222934 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:35.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ebf7fe640 1 -- 172.21.15.106:0/1985222934 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ec01e9330 msgr2=0x7f2ec013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ebf7fe640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ec01e9330 0x7f2ec013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ebf7fe640 1 -- 172.21.15.106:0/1985222934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ec014f9b0 msgr2=0x7f2ec01e8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ebf7fe640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ec014f9b0 0x7f2ec01e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ebf7fe640 1 -- 172.21.15.106:0/1985222934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec01e97b0 con 0x7f2eac0069d0 2023-12-22T09:15:35.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.023+0000 7f2ebf7fe640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2ec0143330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000d7a0 tx=0x7f2eb000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:35.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.024+0000 7f2ebcff9640 1 -- 172.21.15.106:0/1985222934 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00074e0 con 0x7f2eac0069d0 2023-12-22T09:15:35.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.024+0000 7f2ebcff9640 1 -- 172.21.15.106:0/1985222934 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb0007640 con 0x7f2eac0069d0 2023-12-22T09:15:35.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.024+0000 7f2ebcff9640 1 -- 172.21.15.106:0/1985222934 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0004a00 con 0x7f2eac0069d0 2023-12-22T09:15:35.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.024+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec01418a0 con 0x7f2eac0069d0 2023-12-22T09:15:35.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.024+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec0142b30 con 0x7f2eac0069d0 2023-12-22T09:15:35.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.025+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec0073f10 con 0x7f2eac0069d0 2023-12-22T09:15:35.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.026+0000 7f2ebcff9640 1 -- 172.21.15.106:0/1985222934 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2eb0004b60 con 0x7f2eac0069d0 2023-12-22T09:15:35.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.027+0000 7f2ebcff9640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ea006a430 0x7f2ea006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.027+0000 7f2ebcff9640 1 -- 172.21.15.106:0/1985222934 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2eb00885b0 con 0x7f2eac0069d0 2023-12-22T09:15:35.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.027+0000 7f2eb6ffd640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ea006a430 0x7f2ea006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.028+0000 7f2eb6ffd640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ea006a430 0x7f2ea006c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8034000 tx=0x7f2ea802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:35.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.031+0000 7f2ebcff9640 1 -- 172.21.15.106:0/1985222934 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2eb00537d0 con 0x7f2eac0069d0 2023-12-22T09:15:35.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.219+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ec00bff20 con 0x7f2eac0069d0 2023-12-22T09:15:35.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.220+0000 7f2ebcff9640 1 -- 172.21.15.106:0/1985222934 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2eb0056df0 con 0x7f2eac0069d0 2023-12-22T09:15:35.221 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:35.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ea006a430 msgr2=0x7f2ea006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ea006a430 0x7f2ea006c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8034000 tx=0x7f2ea802f000 comp rx=0 tx=0).stop 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 msgr2=0x7f2ec0143330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2ec0143330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000d7a0 tx=0x7f2eb000dc60 comp rx=0 tx=0).stop 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 shutdown_connections 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ea006a430 0x7f2ea006c8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2ec01e9330 0x7f2ec013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ec014f9b0 0x7f2ec01e8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 --2- 172.21.15.106:0/1985222934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2eac0069d0 0x7f2ec0143330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 >> 172.21.15.106:0/1985222934 conn(0x7f2ec006a220 msgr2=0x7f2ec00c3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 shutdown_connections 2023-12-22T09:15:35.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.223+0000 7f2ec6147640 1 -- 172.21.15.106:0/1985222934 wait complete. 2023-12-22T09:15:35.244 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:35.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.460+0000 7f5cc8963640 1 Processor -- start 2023-12-22T09:15:35.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.460+0000 7f5cc8963640 1 -- start start 2023-12-22T09:15:35.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.461+0000 7f5cc8963640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5cc414f090 0x7f5cc4151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.461+0000 7f5cc8963640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc406b960 0x7f5cc40c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.461+0000 7f5cc8963640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc4155120 con 0x7f5cc40c1910 2023-12-22T09:15:35.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.461+0000 7f5cc8963640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc406e080 con 0x7f5cc414f090 2023-12-22T09:15:35.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.461+0000 7f5cc8963640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4155fa0 con 0x7f5cc406b960 2023-12-22T09:15:35.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.462+0000 7f5cc2d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc406b960 0x7f5cc40c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.462+0000 7f5cc259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5cc414f090 0x7f5cc4151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.462+0000 7f5cc1d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5cc40c1910 0x7f5cc4155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:32864/0 (socket says 172.21.15.106:32864) 2023-12-22T09:15:35.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.462+0000 7f5cc1d9b640 1 -- 172.21.15.106:0/2962187038 learned_addr learned my addr 172.21.15.106:0/2962187038 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:35.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.463+0000 7f5cc259c640 1 -- 172.21.15.106:0/2962187038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc406b960 msgr2=0x7f5cc40c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:35.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.463+0000 7f5cc259c640 1 --2- 172.21.15.106:0/2962187038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc406b960 0x7f5cc40c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.463+0000 7f5cc259c640 1 -- 172.21.15.106:0/2962187038 >> v1:172.21.15.132:6789/0 conn(0x7f5cc40c1910 legacy=0x7f5cc4155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.463+0000 7f5cc259c640 1 -- 172.21.15.106:0/2962187038 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc40a8720 con 0x7f5cc414f090 2023-12-22T09:15:35.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.464+0000 7f5cc259c640 1 --2- 172.21.15.106:0/2962187038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cc414f090 0x7f5cc4151b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0097a0 tx=0x7f5cac02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aa869ed62e59156 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:35.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.464+0000 7f5cc159a640 1 -- 172.21.15.106:0/2962187038 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac031780 con 0x7f5cc414f090 2023-12-22T09:15:35.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.464+0000 7f5cc159a640 1 -- 172.21.15.106:0/2962187038 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac0318e0 con 0x7f5cc414f090 2023-12-22T09:15:35.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.464+0000 7f5cc159a640 1 -- 172.21.15.106:0/2962187038 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac031c70 con 0x7f5cc414f090 2023-12-22T09:15:35.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.465+0000 7f5cc8963640 1 -- 172.21.15.106:0/2962187038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cc414f090 msgr2=0x7f5cc4151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.465+0000 7f5cc8963640 1 --2- 172.21.15.106:0/2962187038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cc414f090 0x7f5cc4151b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0097a0 tx=0x7f5cac02b820 comp rx=0 tx=0).stop 2023-12-22T09:15:35.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.465+0000 7f5cc8963640 1 -- 172.21.15.106:0/2962187038 shutdown_connections 2023-12-22T09:15:35.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.465+0000 7f5cc8963640 1 --2- 172.21.15.106:0/2962187038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc406b960 0x7f5cc40c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.465+0000 7f5cc8963640 1 --2- 172.21.15.106:0/2962187038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cc414f090 0x7f5cc4151b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.465+0000 7f5cc8963640 1 -- 172.21.15.106:0/2962187038 >> 172.21.15.106:0/2962187038 conn(0x7f5cc4069dd0 msgr2=0x7f5cc406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:35.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.465+0000 7f5cc8963640 1 -- 172.21.15.106:0/2962187038 shutdown_connections 2023-12-22T09:15:35.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.465+0000 7f5cc8963640 1 -- 172.21.15.106:0/2962187038 wait complete. 2023-12-22T09:15:35.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.467+0000 7f5cc8963640 1 Processor -- start 2023-12-22T09:15:35.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.467+0000 7f5cc8963640 1 -- start start 2023-12-22T09:15:35.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc8963640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc406b960 0x7f5cc40c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc8963640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc40c1910 0x7f5cc41ded60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc8963640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cc414f090 0x7f5cc41df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc8963640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc41519c0 con 0x7f5cc406b960 2023-12-22T09:15:35.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc8963640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4150a10 con 0x7f5cc414f090 2023-12-22T09:15:35.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc8963640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4150450 con 0x7f5cc40c1910 2023-12-22T09:15:35.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc406b960 0x7f5cc40c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc406b960 0x7f5cc40c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44740/0 (socket says 172.21.15.106:44740) 2023-12-22T09:15:35.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc259c640 1 -- 172.21.15.106:0/4114280824 learned_addr learned my addr 172.21.15.106:0/4114280824 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:35.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc1d9b640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc40c1910 0x7f5cc41ded60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.468+0000 7f5cc2d9d640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cc414f090 0x7f5cc41df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cc259c640 1 -- 172.21.15.106:0/4114280824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc40c1910 msgr2=0x7f5cc41ded60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cc259c640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc40c1910 0x7f5cc41ded60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cc259c640 1 -- 172.21.15.106:0/4114280824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cc414f090 msgr2=0x7f5cc41df2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cc259c640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cc414f090 0x7f5cc41df2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cc259c640 1 -- 172.21.15.106:0/4114280824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac009400 con 0x7f5cc406b960 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cc259c640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc406b960 0x7f5cc40c49b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5cac034040 tx=0x7f5cac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cbaffd640 1 -- 172.21.15.106:0/4114280824 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac032820 con 0x7f5cc406b960 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cbaffd640 1 -- 172.21.15.106:0/4114280824 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac0329a0 con 0x7f5cc406b960 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cbaffd640 1 -- 172.21.15.106:0/4114280824 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac032d50 con 0x7f5cc406b960 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.469+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc4150730 con 0x7f5cc406b960 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.470+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc40c4ef0 con 0x7f5cc406b960 2023-12-22T09:15:35.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.471+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc4073f10 con 0x7f5cc406b960 2023-12-22T09:15:35.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.472+0000 7f5cbaffd640 1 -- 172.21.15.106:0/4114280824 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5cac04e440 con 0x7f5cc406b960 2023-12-22T09:15:35.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.473+0000 7f5cbaffd640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ca406a430 0x7f5ca406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.473+0000 7f5cbaffd640 1 -- 172.21.15.106:0/4114280824 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5cac0aaf20 con 0x7f5cc406b960 2023-12-22T09:15:35.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.473+0000 7f5cc1d9b640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ca406a430 0x7f5ca406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.473+0000 7f5cc1d9b640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ca406a430 0x7f5ca406c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40c5280 tx=0x7f5cb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:35.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.477+0000 7f5cbaffd640 1 -- 172.21.15.106:0/4114280824 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5cac0760b0 con 0x7f5cc406b960 2023-12-22T09:15:35.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.668+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5cc40c16f0 con 0x7f5cc406b960 2023-12-22T09:15:35.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.669+0000 7f5cbaffd640 1 -- 172.21.15.106:0/4114280824 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5cac0796d0 con 0x7f5cc406b960 2023-12-22T09:15:35.669 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:35.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ca406a430 msgr2=0x7f5ca406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ca406a430 0x7f5ca406c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40c5280 tx=0x7f5cb4009040 comp rx=0 tx=0).stop 2023-12-22T09:15:35.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc406b960 msgr2=0x7f5cc40c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc406b960 0x7f5cc40c49b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5cac034040 tx=0x7f5cac0046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 shutdown_connections 2023-12-22T09:15:35.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5ca406a430 0x7f5ca406c8f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5cc414f090 0x7f5cc41df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5cc40c1910 0x7f5cc41ded60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 --2- 172.21.15.106:0/4114280824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cc406b960 0x7f5cc40c49b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.671+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 >> 172.21.15.106:0/4114280824 conn(0x7f5cc4069dd0 msgr2=0x7f5cc40a9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:35.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.672+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 shutdown_connections 2023-12-22T09:15:35.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.672+0000 7f5cc8963640 1 -- 172.21.15.106:0/4114280824 wait complete. 2023-12-22T09:15:35.691 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:35.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.904+0000 7f61722c4640 1 Processor -- start 2023-12-22T09:15:35.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.904+0000 7f61722c4640 1 -- start start 2023-12-22T09:15:35.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.905+0000 7f61722c4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f616c0c5ca0 0x7f616c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.905+0000 7f61722c4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f616c06bdc0 0x7f616c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.905+0000 7f61722c4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c070000 con 0x7f616c071e30 2023-12-22T09:15:35.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.905+0000 7f61722c4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c0702e0 con 0x7f616c06bdc0 2023-12-22T09:15:35.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.905+0000 7f61722c4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c0705c0 con 0x7f616c0c5ca0 2023-12-22T09:15:35.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f616b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f616c071e30 0x7f616c0710a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33134/0 (socket says 172.21.15.106:33134) 2023-12-22T09:15:35.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f616b7fe640 1 -- 172.21.15.106:0/1598101261 learned_addr learned my addr 172.21.15.106:0/1598101261 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:35.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f6170861640 1 --2- 172.21.15.106:0/1598101261 >> v2:172.21.15.106:3300/0 conn(0x7f616c06bdc0 0x7f616c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f616bfff640 1 --2- 172.21.15.106:0/1598101261 >> v2:172.21.15.132:3300/0 conn(0x7f616c0c5ca0 0x7f616c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f616affd640 1 -- 172.21.15.106:0/1598101261 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269624097 0 0) 0x7f616c070000 con 0x7f616c071e30 2023-12-22T09:15:35.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f616affd640 1 -- 172.21.15.106:0/1598101261 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6154003520 con 0x7f616c071e30 2023-12-22T09:15:35.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f6170861640 1 -- 172.21.15.106:0/1598101261 >> v2:172.21.15.132:3300/0 conn(0x7f616c0c5ca0 msgr2=0x7f616c150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:35.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f6170861640 1 --2- 172.21.15.106:0/1598101261 >> v2:172.21.15.132:3300/0 conn(0x7f616c0c5ca0 0x7f616c150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f6170861640 1 -- 172.21.15.106:0/1598101261 >> v1:172.21.15.106:6789/0 conn(0x7f616c071e30 legacy=0x7f616c0710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.906+0000 7f6170861640 1 -- 172.21.15.106:0/1598101261 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0708a0 con 0x7f616c06bdc0 2023-12-22T09:15:35.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f6170861640 1 --2- 172.21.15.106:0/1598101261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c06bdc0 0x7f616c14a5f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f616c14e930 tx=0x7f616402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4619e1c702056707 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:35.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f616affd640 1 -- 172.21.15.106:0/1598101261 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616402cbf0 con 0x7f616c06bdc0 2023-12-22T09:15:35.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f616affd640 1 -- 172.21.15.106:0/1598101261 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616402cd50 con 0x7f616c06bdc0 2023-12-22T09:15:35.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f616affd640 1 -- 172.21.15.106:0/1598101261 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164034660 con 0x7f616c06bdc0 2023-12-22T09:15:35.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f61722c4640 1 -- 172.21.15.106:0/1598101261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c06bdc0 msgr2=0x7f616c14a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f61722c4640 1 --2- 172.21.15.106:0/1598101261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c06bdc0 0x7f616c14a5f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f616c14e930 tx=0x7f616402be40 comp rx=0 tx=0).stop 2023-12-22T09:15:35.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f61722c4640 1 -- 172.21.15.106:0/1598101261 shutdown_connections 2023-12-22T09:15:35.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f61722c4640 1 --2- 172.21.15.106:0/1598101261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c06bdc0 0x7f616c14a5f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f61722c4640 1 --2- 172.21.15.106:0/1598101261 >> v2:172.21.15.132:3300/0 conn(0x7f616c0c5ca0 0x7f616c150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.908+0000 7f61722c4640 1 -- 172.21.15.106:0/1598101261 >> 172.21.15.106:0/1598101261 conn(0x7f616c06a220 msgr2=0x7f616c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:35.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.909+0000 7f61722c4640 1 -- 172.21.15.106:0/1598101261 shutdown_connections 2023-12-22T09:15:35.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.909+0000 7f61722c4640 1 -- 172.21.15.106:0/1598101261 wait complete. 2023-12-22T09:15:35.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.910+0000 7f61722c4640 1 Processor -- start 2023-12-22T09:15:35.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.910+0000 7f61722c4640 1 -- start start 2023-12-22T09:15:35.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.911+0000 7f61722c4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f616c06bdc0 0x7f616c0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.911+0000 7f61722c4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c071e30 0x7f616c1ec670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.911+0000 7f61722c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616c0c5ca0 0x7f616c1ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.911+0000 7f61722c4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0ab1d0 con 0x7f616c071e30 2023-12-22T09:15:35.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.911+0000 7f61722c4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c1ed0f0 con 0x7f616c0c5ca0 2023-12-22T09:15:35.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.911+0000 7f61722c4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c1ec190 con 0x7f616c06bdc0 2023-12-22T09:15:35.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.911+0000 7f616b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c071e30 0x7f616c1ec670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f616b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c071e30 0x7f616c1ec670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44756/0 (socket says 172.21.15.106:44756) 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f616b7fe640 1 -- 172.21.15.106:0/4142402840 learned_addr learned my addr 172.21.15.106:0/4142402840 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f616bfff640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f616c06bdc0 0x7f616c0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f6170861640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616c0c5ca0 0x7f616c1ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f616b7fe640 1 -- 172.21.15.106:0/4142402840 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f616c06bdc0 msgr2=0x7f616c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f616b7fe640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f616c06bdc0 0x7f616c0c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f616b7fe640 1 -- 172.21.15.106:0/4142402840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616c0c5ca0 msgr2=0x7f616c1ecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f616b7fe640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616c0c5ca0 0x7f616c1ecbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f616b7fe640 1 -- 172.21.15.106:0/4142402840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6164009a70 con 0x7f616c071e30 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f616b7fe640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c071e30 0x7f616c1ec670 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f616000c480 tx=0x7f616000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f6168ff9640 1 -- 172.21.15.106:0/4142402840 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160005ce0 con 0x7f616c071e30 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.912+0000 7f6168ff9640 1 -- 172.21.15.106:0/4142402840 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160005e40 con 0x7f616c071e30 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.913+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c0bc150 con 0x7f616c071e30 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.913+0000 7f6168ff9640 1 -- 172.21.15.106:0/4142402840 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600072b0 con 0x7f616c071e30 2023-12-22T09:15:35.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.913+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c140830 con 0x7f616c071e30 2023-12-22T09:15:35.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.914+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c073f10 con 0x7f616c071e30 2023-12-22T09:15:35.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.915+0000 7f6168ff9640 1 -- 172.21.15.106:0/4142402840 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61600074d0 con 0x7f616c071e30 2023-12-22T09:15:35.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.916+0000 7f6168ff9640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f615806a430 0x7f615806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:35.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.916+0000 7f6168ff9640 1 -- 172.21.15.106:0/4142402840 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6160088290 con 0x7f616c071e30 2023-12-22T09:15:35.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.916+0000 7f616bfff640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f615806a430 0x7f615806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:35.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.916+0000 7f616bfff640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f615806a430 0x7f615806c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f615c006fd0 tx=0x7f615c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:35.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:35.920+0000 7f6168ff9640 1 -- 172.21.15.106:0/4142402840 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6160053610 con 0x7f616c071e30 2023-12-22T09:15:36.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.110+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f616c06c560 con 0x7f616c071e30 2023-12-22T09:15:36.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.111+0000 7f6168ff9640 1 -- 172.21.15.106:0/4142402840 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6160056c30 con 0x7f616c071e30 2023-12-22T09:15:36.111 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:36.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f615806a430 msgr2=0x7f615806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f615806a430 0x7f615806c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f615c006fd0 tx=0x7f615c008040 comp rx=0 tx=0).stop 2023-12-22T09:15:36.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c071e30 msgr2=0x7f616c1ec670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c071e30 0x7f616c1ec670 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f616000c480 tx=0x7f616000c940 comp rx=0 tx=0).stop 2023-12-22T09:15:36.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 shutdown_connections 2023-12-22T09:15:36.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f615806a430 0x7f615806c8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616c0c5ca0 0x7f616c1ecbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c071e30 0x7f616c1ec670 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 --2- 172.21.15.106:0/4142402840 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f616c06bdc0 0x7f616c0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.113+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 >> 172.21.15.106:0/4142402840 conn(0x7f616c06a220 msgr2=0x7f616c1470c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:36.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.114+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 shutdown_connections 2023-12-22T09:15:36.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.114+0000 7f61722c4640 1 -- 172.21.15.106:0/4142402840 wait complete. 2023-12-22T09:15:36.131 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T09:15:36.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.335+0000 7f269f87d640 1 Processor -- start 2023-12-22T09:15:36.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.335+0000 7f269f87d640 1 -- start start 2023-12-22T09:15:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.337+0000 7f269f87d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26981514b0 0x7f26980c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.337+0000 7f269f87d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26980c4130 0x7f2698154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.337+0000 7f269f87d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26980c4660 con 0x7f2698154a80 2023-12-22T09:15:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.337+0000 7f269f87d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2698153d60 con 0x7f26981514b0 2023-12-22T09:15:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.337+0000 7f269f87d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269806b250 con 0x7f26980c4130 2023-12-22T09:15:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.337+0000 7f269de1a640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2698154a80 0x7f26980c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33136/0 (socket says 172.21.15.106:33136) 2023-12-22T09:15:36.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.337+0000 7f269de1a640 1 -- 172.21.15.106:0/1527320843 learned_addr learned my addr 172.21.15.106:0/1527320843 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f269d619640 1 --2- 172.21.15.106:0/1527320843 >> v2:172.21.15.132:3300/0 conn(0x7f26981514b0 0x7f26980c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f269ce18640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26980c4130 0x7f2698154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493163526 0 0) 0x7f26980c4660 con 0x7f2698154a80 2023-12-22T09:15:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2684003520 con 0x7f2698154a80 2023-12-22T09:15:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3175602079 0 0) 0x7f2684003520 con 0x7f2698154a80 2023-12-22T09:15:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26980c4130 msgr2=0x7f2698154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26980c4130 0x7f2698154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 >> v2:172.21.15.132:3300/0 conn(0x7f26981514b0 msgr2=0x7f26980c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 --2- 172.21.15.106:0/1527320843 >> v2:172.21.15.132:3300/0 conn(0x7f26981514b0 0x7f26980c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269806b530 con 0x7f2698154a80 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f26900019f0 con 0x7f2698154a80 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 >> v1:172.21.15.106:6789/0 conn(0x7f2698154a80 legacy=0x7f26980c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2684003970 0x7f2684003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26840047c0 0x7f2684004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26980c4130 0x7f2684005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698153d60 con 0x7f26840047c0 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269806b250 con 0x7f2684003970 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.338+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268400b980 con 0x7f26980c4130 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.339+0000 7f269ce18640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26840047c0 0x7f2684004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.339+0000 7f269d619640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2684003970 0x7f2684003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.339+0000 7f269ce18640 1 -- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26980c4130 msgr2=0x7f2684005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.339+0000 7f269ce18640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26980c4130 0x7f2684005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.339+0000 7f269ce18640 1 -- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2684003970 msgr2=0x7f2684003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.339+0000 7f269ce18640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2684003970 0x7f2684003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.339+0000 7f269ce18640 1 -- 172.21.15.106:0/1527320843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684003520 con 0x7f26840047c0 2023-12-22T09:15:36.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.340+0000 7f269ce18640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26840047c0 0x7f2684004c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2688009ac0 tx=0x7f26840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9494277ec6d0c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.340+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268802c6b0 con 0x7f26840047c0 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.340+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268802c810 con 0x7f26840047c0 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.340+0000 7f268ffff640 1 -- 172.21.15.106:0/1527320843 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268802cba0 con 0x7f26840047c0 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.341+0000 7f269f87d640 1 -- 172.21.15.106:0/1527320843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26840047c0 msgr2=0x7f2684004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.341+0000 7f269f87d640 1 --2- 172.21.15.106:0/1527320843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26840047c0 0x7f2684004c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2688009ac0 tx=0x7f26840057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.341+0000 7f269de1a640 1 -- 172.21.15.106:0/1527320843 reap_dead start 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.341+0000 7f269f87d640 1 -- 172.21.15.106:0/1527320843 shutdown_connections 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.341+0000 7f269f87d640 1 -- 172.21.15.106:0/1527320843 >> 172.21.15.106:0/1527320843 conn(0x7f26980ab1a0 msgr2=0x7f26980ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.341+0000 7f269f87d640 1 -- 172.21.15.106:0/1527320843 shutdown_connections 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.341+0000 7f269f87d640 1 -- 172.21.15.106:0/1527320843 wait complete. 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.343+0000 7f269f87d640 1 Processor -- start 2023-12-22T09:15:36.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.343+0000 7f269f87d640 1 -- start start 2023-12-22T09:15:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.344+0000 7f269f87d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26840047c0 0x7f26981e95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.344+0000 7f269f87d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2698143730 0x7f26981462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.344+0000 7f269f87d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2698145190 0x7f269814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.344+0000 7f269f87d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698146830 con 0x7f2698143730 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.344+0000 7f269f87d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26981e8b30 con 0x7f26840047c0 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.344+0000 7f269f87d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26981ecb20 con 0x7f2698145190 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.344+0000 7f269ce18640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2698143730 0x7f26981462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.344+0000 7f269ce18640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2698143730 0x7f26981462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44778/0 (socket says 172.21.15.106:44778) 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.344+0000 7f269ce18640 1 -- 172.21.15.106:0/3013754489 learned_addr learned my addr 172.21.15.106:0/3013754489 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269de1a640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2698145190 0x7f269814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269d619640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26840047c0 0x7f26981e95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269ce18640 1 -- 172.21.15.106:0/3013754489 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2698145190 msgr2=0x7f269814c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269ce18640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2698145190 0x7f269814c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269ce18640 1 -- 172.21.15.106:0/3013754489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26840047c0 msgr2=0x7f26981e95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269ce18640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26840047c0 0x7f26981e95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269ce18640 1 -- 172.21.15.106:0/3013754489 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26981e8dd0 con 0x7f2698143730 2023-12-22T09:15:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269d619640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26840047c0 0x7f26981e95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269ce18640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2698143730 0x7f26981462f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f268802c250 tx=0x7f2688004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f268dffb640 1 -- 172.21.15.106:0/3013754489 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688003810 con 0x7f2698143730 2023-12-22T09:15:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f268dffb640 1 -- 172.21.15.106:0/3013754489 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688003970 con 0x7f2698143730 2023-12-22T09:15:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f268dffb640 1 -- 172.21.15.106:0/3013754489 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688003d20 con 0x7f2698143730 2023-12-22T09:15:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.345+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26981e90b0 con 0x7f2698143730 2023-12-22T09:15:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.346+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26981469e0 con 0x7f2698143730 2023-12-22T09:15:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.347+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26980bcba0 con 0x7f2698143730 2023-12-22T09:15:36.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.348+0000 7f268dffb640 1 -- 172.21.15.106:0/3013754489 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2688040450 con 0x7f2698143730 2023-12-22T09:15:36.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.348+0000 7f268dffb640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f267c06a460 0x7f267c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.349+0000 7f268dffb640 1 -- 172.21.15.106:0/3013754489 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f26880aac30 con 0x7f2698143730 2023-12-22T09:15:36.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.349+0000 7f269d619640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f267c06a460 0x7f267c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.349+0000 7f269d619640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f267c06a460 0x7f267c06c920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2694009a80 tx=0x7f2694008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:36.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.353+0000 7f268dffb640 1 -- 172.21.15.106:0/3013754489 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2688075dc0 con 0x7f2698143730 2023-12-22T09:15:36.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.560+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26981e9240 con 0x7f2698143730 2023-12-22T09:15:36.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.560+0000 7f268dffb640 1 -- 172.21.15.106:0/3013754489 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2688044080 con 0x7f2698143730 2023-12-22T09:15:36.561 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-12-22T09:15:36.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f267c06a460 msgr2=0x7f267c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f267c06a460 0x7f267c06c920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2694009a80 tx=0x7f2694008040 comp rx=0 tx=0).stop 2023-12-22T09:15:36.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2698143730 msgr2=0x7f26981462f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2698143730 0x7f26981462f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f268802c250 tx=0x7f2688004730 comp rx=0 tx=0).stop 2023-12-22T09:15:36.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 shutdown_connections 2023-12-22T09:15:36.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f267c06a460 0x7f267c06c920 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2698145190 0x7f269814c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2698143730 0x7f26981462f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 --2- 172.21.15.106:0/3013754489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26840047c0 0x7f26981e95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 >> 172.21.15.106:0/3013754489 conn(0x7f26980ab1a0 msgr2=0x7f26980c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:36.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.563+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 shutdown_connections 2023-12-22T09:15:36.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.564+0000 7f269f87d640 1 -- 172.21.15.106:0/3013754489 wait complete. 2023-12-22T09:15:36.583 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T09:15:36.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:36.583 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-22T09:15:36.695 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T09:15:36.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:15:36.695 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T09:15:36.751 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-22T09:15:36.751 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:15:36.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.969+0000 7fb292e18640 1 Processor -- start 2023-12-22T09:15:36.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.969+0000 7fb292e18640 1 -- start start 2023-12-22T09:15:36.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.970+0000 7fb292e18640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb28c14df70 0x7fb28c154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.970+0000 7fb292e18640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c0c16e0 0x7fb28c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.970+0000 7fb292e18640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb28c0a82e0 0x7fb28c0c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.970+0000 7fb292e18640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c0aa1a0 con 0x7fb28c0a82e0 2023-12-22T09:15:36.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.970+0000 7fb292e18640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c153f00 con 0x7fb28c14df70 2023-12-22T09:15:36.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.970+0000 7fb292e18640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c1544c0 con 0x7fb28c0c16e0 2023-12-22T09:15:36.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb292617640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb28c0a82e0 0x7fb28c0c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb292617640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb28c0a82e0 0x7fb28c0c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44786/0 (socket says 172.21.15.106:44786) 2023-12-22T09:15:36.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb292617640 1 -- 172.21.15.106:0/1205875003 learned_addr learned my addr 172.21.15.106:0/1205875003 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:36.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb291e16640 1 --2- 172.21.15.106:0/1205875003 >> v2:172.21.15.132:3300/0 conn(0x7fb28c14df70 0x7fb28c154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb291615640 1 --2- 172.21.15.106:0/1205875003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c0c16e0 0x7fb28c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb292617640 1 -- 172.21.15.106:0/1205875003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c0c16e0 msgr2=0x7fb28c06b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:36.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb292617640 1 --2- 172.21.15.106:0/1205875003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c0c16e0 0x7fb28c06b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb292617640 1 -- 172.21.15.106:0/1205875003 >> v2:172.21.15.132:3300/0 conn(0x7fb28c14df70 msgr2=0x7fb28c154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:36.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb292617640 1 --2- 172.21.15.106:0/1205875003 >> v2:172.21.15.132:3300/0 conn(0x7fb28c14df70 0x7fb28c154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.971+0000 7fb292617640 1 -- 172.21.15.106:0/1205875003 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c154e90 con 0x7fb28c0a82e0 2023-12-22T09:15:36.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.972+0000 7fb292617640 1 --2- 172.21.15.106:0/1205875003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0a82e0 0x7fb28c0c1e20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0c11f0 tx=0x7fb28402dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55900a6ff0fbb2bd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:36.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb290e14640 1 -- 172.21.15.106:0/1205875003 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28402eb60 con 0x7fb28c0a82e0 2023-12-22T09:15:36.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb290e14640 1 -- 172.21.15.106:0/1205875003 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28402ecc0 con 0x7fb28c0a82e0 2023-12-22T09:15:36.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb290e14640 1 -- 172.21.15.106:0/1205875003 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284036610 con 0x7fb28c0a82e0 2023-12-22T09:15:36.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb292e18640 1 -- 172.21.15.106:0/1205875003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0a82e0 msgr2=0x7fb28c0c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb292e18640 1 --2- 172.21.15.106:0/1205875003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0a82e0 0x7fb28c0c1e20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0c11f0 tx=0x7fb28402dfc0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb292e18640 1 -- 172.21.15.106:0/1205875003 shutdown_connections 2023-12-22T09:15:36.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb292e18640 1 --2- 172.21.15.106:0/1205875003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0a82e0 0x7fb28c0c1e20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb292e18640 1 --2- 172.21.15.106:0/1205875003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c0c16e0 0x7fb28c06b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb292e18640 1 --2- 172.21.15.106:0/1205875003 >> v2:172.21.15.132:3300/0 conn(0x7fb28c14df70 0x7fb28c154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb292e18640 1 -- 172.21.15.106:0/1205875003 >> 172.21.15.106:0/1205875003 conn(0x7fb28c069dd0 msgr2=0x7fb28c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:36.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb292e18640 1 -- 172.21.15.106:0/1205875003 shutdown_connections 2023-12-22T09:15:36.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.973+0000 7fb292e18640 1 -- 172.21.15.106:0/1205875003 wait complete. 2023-12-22T09:15:36.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.975+0000 7fb292e18640 1 Processor -- start 2023-12-22T09:15:36.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.975+0000 7fb292e18640 1 -- start start 2023-12-22T09:15:36.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.976+0000 7fb292e18640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb28c0a82e0 0x7fb28c0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.976+0000 7fb292e18640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0c16e0 0x7fb28c1ebd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.976+0000 7fb292e18640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c14df70 0x7fb28c1457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.976+0000 7fb292e18640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c1e8e90 con 0x7fb28c0c16e0 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.976+0000 7fb292e18640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c148410 con 0x7fb28c0a82e0 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.976+0000 7fb292e18640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c14d160 con 0x7fb28c14df70 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.976+0000 7fb291615640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0c16e0 0x7fb28c1ebd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291615640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0c16e0 0x7fb28c1ebd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44792/0 (socket says 172.21.15.106:44792) 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291615640 1 -- 172.21.15.106:0/3511392880 learned_addr learned my addr 172.21.15.106:0/3511392880 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291e16640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb28c0a82e0 0x7fb28c0c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb292617640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c14df70 0x7fb28c1457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291615640 1 -- 172.21.15.106:0/3511392880 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c14df70 msgr2=0x7fb28c1457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291615640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c14df70 0x7fb28c1457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291615640 1 -- 172.21.15.106:0/3511392880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb28c0a82e0 msgr2=0x7fb28c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291615640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb28c0a82e0 0x7fb28c0c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:36.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291615640 1 -- 172.21.15.106:0/3511392880 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb284009b30 con 0x7fb28c0c16e0 2023-12-22T09:15:36.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291e16640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb28c0a82e0 0x7fb28c0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:36.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb291615640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0c16e0 0x7fb28c1ebd00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb28000c570 tx=0x7fb28000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:36.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.977+0000 7fb27e7fc640 1 -- 172.21.15.106:0/3511392880 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280004220 con 0x7fb28c0c16e0 2023-12-22T09:15:36.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.978+0000 7fb27e7fc640 1 -- 172.21.15.106:0/3511392880 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb280004380 con 0x7fb28c0c16e0 2023-12-22T09:15:36.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.978+0000 7fb27e7fc640 1 -- 172.21.15.106:0/3511392880 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280003850 con 0x7fb28c0c16e0 2023-12-22T09:15:36.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.978+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c14d440 con 0x7fb28c0c16e0 2023-12-22T09:15:36.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.978+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c1e8840 con 0x7fb28c0c16e0 2023-12-22T09:15:36.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.979+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28c1e9000 con 0x7fb28c0c16e0 2023-12-22T09:15:36.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.980+0000 7fb27e7fc640 1 -- 172.21.15.106:0/3511392880 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb2800039b0 con 0x7fb28c0c16e0 2023-12-22T09:15:36.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.981+0000 7fb27e7fc640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb27006a430 0x7fb27006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:36.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.982+0000 7fb27e7fc640 1 -- 172.21.15.106:0/3511392880 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb280088970 con 0x7fb28c0c16e0 2023-12-22T09:15:36.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.982+0000 7fb291e16640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb27006a430 0x7fb27006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:36.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.982+0000 7fb291e16640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb27006a430 0x7fb27006c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb288006fd0 tx=0x7fb288008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:36.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:36.986+0000 7fb27e7fc640 1 -- 172.21.15.106:0/3511392880 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb280053b80 con 0x7fb28c0c16e0 2023-12-22T09:15:37.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.218+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb28c04e8d0 con 0x7fb28c0c16e0 2023-12-22T09:15:37.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.219+0000 7fb27e7fc640 1 -- 172.21.15.106:0/3511392880 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4653 (secure 0 0 0) 0x7fb28001e090 con 0x7fb28c0c16e0 2023-12-22T09:15:37.219 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:37.220 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:55.943828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T09:15:37.220 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-12-22T09:15:37.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb27006a430 msgr2=0x7fb27006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb27006a430 0x7fb27006c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb288006fd0 tx=0x7fb288008040 comp rx=0 tx=0).stop 2023-12-22T09:15:37.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0c16e0 msgr2=0x7fb28c1ebd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0c16e0 0x7fb28c1ebd00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb28000c570 tx=0x7fb28000ca30 comp rx=0 tx=0).stop 2023-12-22T09:15:37.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 shutdown_connections 2023-12-22T09:15:37.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb27006a430 0x7fb27006c8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb28c14df70 0x7fb28c1457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb28c0c16e0 0x7fb28c1ebd00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 --2- 172.21.15.106:0/3511392880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb28c0a82e0 0x7fb28c0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.221+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 >> 172.21.15.106:0/3511392880 conn(0x7fb28c069dd0 msgr2=0x7fb28c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:37.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.222+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 shutdown_connections 2023-12-22T09:15:37.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.222+0000 7fb292e18640 1 -- 172.21.15.106:0/3511392880 wait complete. 2023-12-22T09:15:37.240 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:37.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.439+0000 7fd2de43e640 1 Processor -- start 2023-12-22T09:15:37.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.439+0000 7fd2de43e640 1 -- start start 2023-12-22T09:15:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.440+0000 7fd2de43e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2d80bfce0 0x7fd2d806a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2de43e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d8151b30 0x7fd2d8151f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2de43e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80bf770 con 0x7fd2d813b060 2023-12-22T09:15:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2de43e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d8155120 con 0x7fd2d80bfce0 2023-12-22T09:15:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2de43e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8155400 con 0x7fd2d8151b30 2023-12-22T09:15:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2cffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2d80bfce0 0x7fd2d806a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2cffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2d80bfce0 0x7fd2d806a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44802/0 (socket says 172.21.15.106:44802) 2023-12-22T09:15:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2cffff640 1 -- 172.21.15.106:0/2353087850 learned_addr learned my addr 172.21.15.106:0/2353087850 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:37.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2cffff640 1 -- 172.21.15.106:0/2353087850 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d8151b30 msgr2=0x7fd2d8151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:37.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2dc9db640 1 --2- 172.21.15.106:0/2353087850 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d8151b30 0x7fd2d8151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:37.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2cffff640 1 --2- 172.21.15.106:0/2353087850 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d8151b30 0x7fd2d8151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2cffff640 1 -- 172.21.15.106:0/2353087850 >> v1:172.21.15.132:6789/0 conn(0x7fd2d813b060 legacy=0x7fd2d8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:37.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.441+0000 7fd2cffff640 1 -- 172.21.15.106:0/2353087850 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d81556e0 con 0x7fd2d80bfce0 2023-12-22T09:15:37.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.442+0000 7fd2cffff640 1 --2- 172.21.15.106:0/2353087850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 0x7fd2d806a6b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009870 tx=0x7fd2c002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09dc5e349e26736 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:37.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.443+0000 7fd2d77fe640 1 -- 172.21.15.106:0/2353087850 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c00317c0 con 0x7fd2d80bfce0 2023-12-22T09:15:37.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.443+0000 7fd2d77fe640 1 -- 172.21.15.106:0/2353087850 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c0031920 con 0x7fd2d80bfce0 2023-12-22T09:15:37.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.443+0000 7fd2d77fe640 1 -- 172.21.15.106:0/2353087850 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0031cb0 con 0x7fd2d80bfce0 2023-12-22T09:15:37.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.443+0000 7fd2de43e640 1 -- 172.21.15.106:0/2353087850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 msgr2=0x7fd2d806a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.443+0000 7fd2de43e640 1 --2- 172.21.15.106:0/2353087850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 0x7fd2d806a6b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009870 tx=0x7fd2c002b860 comp rx=0 tx=0).stop 2023-12-22T09:15:37.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.444+0000 7fd2de43e640 1 -- 172.21.15.106:0/2353087850 shutdown_connections 2023-12-22T09:15:37.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.444+0000 7fd2de43e640 1 --2- 172.21.15.106:0/2353087850 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d8151b30 0x7fd2d8151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.444+0000 7fd2de43e640 1 --2- 172.21.15.106:0/2353087850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 0x7fd2d806a6b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.444+0000 7fd2de43e640 1 -- 172.21.15.106:0/2353087850 >> 172.21.15.106:0/2353087850 conn(0x7fd2d80c5360 msgr2=0x7fd2d80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:37.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.444+0000 7fd2de43e640 1 -- 172.21.15.106:0/2353087850 shutdown_connections 2023-12-22T09:15:37.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.444+0000 7fd2de43e640 1 -- 172.21.15.106:0/2353087850 wait complete. 2023-12-22T09:15:37.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.445+0000 7fd2de43e640 1 Processor -- start 2023-12-22T09:15:37.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.446+0000 7fd2de43e640 1 -- start start 2023-12-22T09:15:37.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.446+0000 7fd2de43e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 0x7fd2d80c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.446+0000 7fd2de43e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2d813b060 0x7fd2d8153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.446+0000 7fd2de43e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d8151b30 0x7fd2d81e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2de43e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80ba500 con 0x7fd2d80bfce0 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2de43e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d81e81e0 con 0x7fd2d813b060 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2de43e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80c2fd0 con 0x7fd2d8151b30 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 0x7fd2d80c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 0x7fd2d80c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44808/0 (socket says 172.21.15.106:44808) 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2d7fff640 1 -- 172.21.15.106:0/1590876230 learned_addr learned my addr 172.21.15.106:0/1590876230 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2d7fff640 1 -- 172.21.15.106:0/1590876230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d8151b30 msgr2=0x7fd2d81e7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2d7fff640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d8151b30 0x7fd2d81e7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2d7fff640 1 -- 172.21.15.106:0/1590876230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2d813b060 msgr2=0x7fd2d8153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2d7fff640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2d813b060 0x7fd2d8153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2d7fff640 1 -- 172.21.15.106:0/1590876230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c00094d0 con 0x7fd2d80bfce0 2023-12-22T09:15:37.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.447+0000 7fd2d7fff640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 0x7fd2d80c4510 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800b3e0 tx=0x7fd2c800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:37.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.448+0000 7fd2d57fa640 1 -- 172.21.15.106:0/1590876230 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8011830 con 0x7fd2d80bfce0 2023-12-22T09:15:37.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.448+0000 7fd2d57fa640 1 -- 172.21.15.106:0/1590876230 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c80119b0 con 0x7fd2d80bfce0 2023-12-22T09:15:37.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.448+0000 7fd2d57fa640 1 -- 172.21.15.106:0/1590876230 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8011d60 con 0x7fd2d80bfce0 2023-12-22T09:15:37.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.448+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d80c4af0 con 0x7fd2d80bfce0 2023-12-22T09:15:37.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.448+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d80c3240 con 0x7fd2d80bfce0 2023-12-22T09:15:37.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.449+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d80c3430 con 0x7fd2d80bfce0 2023-12-22T09:15:37.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.450+0000 7fd2d57fa640 1 -- 172.21.15.106:0/1590876230 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2c801a410 con 0x7fd2d80bfce0 2023-12-22T09:15:37.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.451+0000 7fd2d57fa640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd2b806a430 0x7fd2b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.451+0000 7fd2d57fa640 1 -- 172.21.15.106:0/1590876230 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd2c8088d20 con 0x7fd2d80bfce0 2023-12-22T09:15:37.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.451+0000 7fd2cffff640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd2b806a430 0x7fd2b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:37.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.452+0000 7fd2cffff640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd2b806a430 0x7fd2b806c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0036000 tx=0x7fd2c0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:37.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.455+0000 7fd2d57fa640 1 -- 172.21.15.106:0/1590876230 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd2c8053eb0 con 0x7fd2d80bfce0 2023-12-22T09:15:37.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.645+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2d8073f10 con 0x7fd2d80bfce0 2023-12-22T09:15:37.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.648+0000 7fd2d57fa640 1 -- 172.21.15.106:0/1590876230 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7fd2c8015020 con 0x7fd2d80bfce0 2023-12-22T09:15:37.649 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:37.649 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd2b806a430 msgr2=0x7fd2b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd2b806a430 0x7fd2b806c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0036000 tx=0x7fd2c0030000 comp rx=0 tx=0).stop 2023-12-22T09:15:37.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 msgr2=0x7fd2d80c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 0x7fd2d80c4510 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800b3e0 tx=0x7fd2c800b8a0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 shutdown_connections 2023-12-22T09:15:37.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd2b806a430 0x7fd2b806c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd2d8151b30 0x7fd2d81e7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2d813b060 0x7fd2d8153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 --2- 172.21.15.106:0/1590876230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2d80bfce0 0x7fd2d80c4510 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.650+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 >> 172.21.15.106:0/1590876230 conn(0x7fd2d80c5360 msgr2=0x7fd2d8151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:37.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.651+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 shutdown_connections 2023-12-22T09:15:37.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.651+0000 7fd2de43e640 1 -- 172.21.15.106:0/1590876230 wait complete. 2023-12-22T09:15:37.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:14:26.323764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:14:27.442193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-22T09:14:30.508922+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T09:15:37.670 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:37.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.881+0000 7f9042cf7640 1 Processor -- start 2023-12-22T09:15:37.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.881+0000 7f9042cf7640 1 -- start start 2023-12-22T09:15:37.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.883+0000 7f9042cf7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f903c14f090 0x7f903c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.883+0000 7f9042cf7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c155120 con 0x7f903c0c1910 2023-12-22T09:15:37.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.883+0000 7f9042cf7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c155fa0 con 0x7f903c06b960 2023-12-22T09:15:37.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.883+0000 7f9042cf7640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c06e080 con 0x7f903c14f090 2023-12-22T09:15:37.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.883+0000 7f9040a93640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f903c14f090 0x7f903c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:37.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.883+0000 7f9040a93640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f903c14f090 0x7f903c151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44818/0 (socket says 172.21.15.106:44818) 2023-12-22T09:15:37.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.883+0000 7f9040a93640 1 -- 172.21.15.106:0/221111959 learned_addr learned my addr 172.21.15.106:0/221111959 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:37.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.883+0000 7f903bfff640 1 --1- 172.21.15.106:0/221111959 >> v1:172.21.15.106:6789/0 conn(0x7f903c0c1910 0x7f903c155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33138/0 (socket says 172.21.15.106:33138) 2023-12-22T09:15:37.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.883+0000 7f9040a93640 1 -- 172.21.15.106:0/221111959 >> v1:172.21.15.132:6789/0 conn(0x7f903c06b960 legacy=0x7f903c0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:37.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.884+0000 7f9040a93640 1 -- 172.21.15.106:0/221111959 >> v1:172.21.15.106:6789/0 conn(0x7f903c0c1910 legacy=0x7f903c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.884+0000 7f9040a93640 1 -- 172.21.15.106:0/221111959 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0a8720 con 0x7f903c14f090 2023-12-22T09:15:37.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.885+0000 7f9040a93640 1 --2- 172.21.15.106:0/221111959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c14f090 0x7f903c151b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9030009870 tx=0x7f903002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84dfe43dfa8607c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:37.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.885+0000 7f903b7fe640 1 -- 172.21.15.106:0/221111959 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030031870 con 0x7f903c14f090 2023-12-22T09:15:37.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.885+0000 7f903b7fe640 1 -- 172.21.15.106:0/221111959 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90300319d0 con 0x7f903c14f090 2023-12-22T09:15:37.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.885+0000 7f903b7fe640 1 -- 172.21.15.106:0/221111959 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030031d60 con 0x7f903c14f090 2023-12-22T09:15:37.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.885+0000 7f9042cf7640 1 -- 172.21.15.106:0/221111959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c14f090 msgr2=0x7f903c151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.885+0000 7f9042cf7640 1 --2- 172.21.15.106:0/221111959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c14f090 0x7f903c151b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9030009870 tx=0x7f903002b910 comp rx=0 tx=0).stop 2023-12-22T09:15:37.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.886+0000 7f9042cf7640 1 -- 172.21.15.106:0/221111959 shutdown_connections 2023-12-22T09:15:37.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.886+0000 7f9042cf7640 1 --2- 172.21.15.106:0/221111959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c14f090 0x7f903c151b30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.886+0000 7f9042cf7640 1 -- 172.21.15.106:0/221111959 >> 172.21.15.106:0/221111959 conn(0x7f903c069dd0 msgr2=0x7f903c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:37.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.886+0000 7f9042cf7640 1 -- 172.21.15.106:0/221111959 shutdown_connections 2023-12-22T09:15:37.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.886+0000 7f9042cf7640 1 -- 172.21.15.106:0/221111959 wait complete. 2023-12-22T09:15:37.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.887+0000 7f9042cf7640 1 Processor -- start 2023-12-22T09:15:37.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.887+0000 7f9042cf7640 1 -- start start 2023-12-22T09:15:37.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.888+0000 7f9042cf7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c06b960 0x7f903c14f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.888+0000 7f9042cf7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f903c0c1910 0x7f903c0c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.888+0000 7f9042cf7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f903c14f090 0x7f903c149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.888+0000 7f9042cf7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1db5f0 con 0x7f903c06b960 2023-12-22T09:15:37.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.888+0000 7f9042cf7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c070e40 con 0x7f903c0c1910 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.888+0000 7f9042cf7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0718f0 con 0x7f903c14f090 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.889+0000 7f9040a93640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c06b960 0x7f903c14f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.889+0000 7f9040a93640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c06b960 0x7f903c14f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44822/0 (socket says 172.21.15.106:44822) 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.889+0000 7f9040a93640 1 -- 172.21.15.106:0/426277202 learned_addr learned my addr 172.21.15.106:0/426277202 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.889+0000 7f9040a93640 1 -- 172.21.15.106:0/426277202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f903c14f090 msgr2=0x7f903c149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.889+0000 7f9040a93640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f903c14f090 0x7f903c149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.889+0000 7f9040a93640 1 -- 172.21.15.106:0/426277202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f903c0c1910 msgr2=0x7f903c0c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.889+0000 7f9040a93640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f903c0c1910 0x7f903c0c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.889+0000 7f9040a93640 1 -- 172.21.15.106:0/426277202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90300094d0 con 0x7f903c06b960 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.889+0000 7f9040a93640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c06b960 0x7f903c14f9a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9030009870 tx=0x7f90300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.890+0000 7f90397fa640 1 -- 172.21.15.106:0/426277202 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030031820 con 0x7f903c06b960 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.890+0000 7f90397fa640 1 -- 172.21.15.106:0/426277202 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90300443f0 con 0x7f903c06b960 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.890+0000 7f90397fa640 1 -- 172.21.15.106:0/426277202 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90300447a0 con 0x7f903c06b960 2023-12-22T09:15:37.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.890+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c0705a0 con 0x7f903c06b960 2023-12-22T09:15:37.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.890+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c070b60 con 0x7f903c06b960 2023-12-22T09:15:37.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.891+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c0c14a0 con 0x7f903c06b960 2023-12-22T09:15:37.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.892+0000 7f90397fa640 1 -- 172.21.15.106:0/426277202 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f903004d450 con 0x7f903c06b960 2023-12-22T09:15:37.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.893+0000 7f90397fa640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f902006a430 0x7f902006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:37.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.893+0000 7f90397fa640 1 -- 172.21.15.106:0/426277202 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f903002d040 con 0x7f903c06b960 2023-12-22T09:15:37.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.893+0000 7f903bfff640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f902006a430 0x7f902006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:37.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.894+0000 7f903bfff640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f902006a430 0x7f902006c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f903c14a780 tx=0x7f90280079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:37.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:37.897+0000 7f90397fa640 1 -- 172.21.15.106:0/426277202 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9030076730 con 0x7f903c06b960 2023-12-22T09:15:38.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.086+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f903c155bd0 con 0x7f903c06b960 2023-12-22T09:15:38.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.087+0000 7f90397fa640 1 -- 172.21.15.106:0/426277202 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9030079d50 con 0x7f903c06b960 2023-12-22T09:15:38.088 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:38.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f902006a430 msgr2=0x7f902006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f902006a430 0x7f902006c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f903c14a780 tx=0x7f90280079c0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c06b960 msgr2=0x7f903c14f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c06b960 0x7f903c14f9a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9030009870 tx=0x7f90300046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 shutdown_connections 2023-12-22T09:15:38.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f902006a430 0x7f902006c8f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f903c14f090 0x7f903c149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f903c0c1910 0x7f903c0c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 --2- 172.21.15.106:0/426277202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f903c06b960 0x7f903c14f9a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 >> 172.21.15.106:0/426277202 conn(0x7f903c069dd0 msgr2=0x7f903c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:38.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 shutdown_connections 2023-12-22T09:15:38.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.090+0000 7f9042cf7640 1 -- 172.21.15.106:0/426277202 wait complete. 2023-12-22T09:15:38.110 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:15:38.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.321+0000 7fcb54a70640 1 Processor -- start 2023-12-22T09:15:38.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.322+0000 7fcb54a70640 1 -- start start 2023-12-22T09:15:38.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.323+0000 7fcb54a70640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb500c5ca0 0x7fcb50150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.323+0000 7fcb54a70640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb50071e30 0x7fcb500710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.323+0000 7fcb54a70640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb50070000 con 0x7fcb5006bdc0 2023-12-22T09:15:38.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.323+0000 7fcb54a70640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb500702e0 con 0x7fcb500c5ca0 2023-12-22T09:15:38.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.323+0000 7fcb54a70640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb500705c0 con 0x7fcb50071e30 2023-12-22T09:15:38.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.324+0000 7fcb47fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb50071e30 0x7fcb500710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.324+0000 7fcb4e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb500c5ca0 0x7fcb50150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.324+0000 7fcb4ed9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcb5006bdc0 0x7fcb5014a5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:32884/0 (socket says 172.21.15.106:32884) 2023-12-22T09:15:38.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.324+0000 7fcb4ed9d640 1 -- 172.21.15.106:0/3172071401 learned_addr learned my addr 172.21.15.106:0/3172071401 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:38.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.325+0000 7fcb4e59c640 1 -- 172.21.15.106:0/3172071401 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb50071e30 msgr2=0x7fcb500710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:38.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.325+0000 7fcb4e59c640 1 --2- 172.21.15.106:0/3172071401 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb50071e30 0x7fcb500710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.325+0000 7fcb4e59c640 1 -- 172.21.15.106:0/3172071401 >> v1:172.21.15.132:6789/0 conn(0x7fcb5006bdc0 legacy=0x7fcb5014a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.325+0000 7fcb4e59c640 1 -- 172.21.15.106:0/3172071401 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb500708a0 con 0x7fcb500c5ca0 2023-12-22T09:15:38.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.326+0000 7fcb4e59c640 1 --2- 172.21.15.106:0/3172071401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb500c5ca0 0x7fcb50150af0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb400097a0 tx=0x7fcb4002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeaea12f5af9ad32 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:38.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.327+0000 7fcb4dd9b640 1 -- 172.21.15.106:0/3172071401 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40031780 con 0x7fcb500c5ca0 2023-12-22T09:15:38.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.327+0000 7fcb4dd9b640 1 -- 172.21.15.106:0/3172071401 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb400318e0 con 0x7fcb500c5ca0 2023-12-22T09:15:38.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.327+0000 7fcb4dd9b640 1 -- 172.21.15.106:0/3172071401 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40031c70 con 0x7fcb500c5ca0 2023-12-22T09:15:38.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.327+0000 7fcb54a70640 1 -- 172.21.15.106:0/3172071401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb500c5ca0 msgr2=0x7fcb50150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.327+0000 7fcb54a70640 1 --2- 172.21.15.106:0/3172071401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb500c5ca0 0x7fcb50150af0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb400097a0 tx=0x7fcb4002b820 comp rx=0 tx=0).stop 2023-12-22T09:15:38.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.327+0000 7fcb54a70640 1 -- 172.21.15.106:0/3172071401 shutdown_connections 2023-12-22T09:15:38.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.327+0000 7fcb54a70640 1 --2- 172.21.15.106:0/3172071401 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb50071e30 0x7fcb500710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.327+0000 7fcb54a70640 1 --2- 172.21.15.106:0/3172071401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb500c5ca0 0x7fcb50150af0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.327+0000 7fcb54a70640 1 -- 172.21.15.106:0/3172071401 >> 172.21.15.106:0/3172071401 conn(0x7fcb5006a220 msgr2=0x7fcb500c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:38.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.328+0000 7fcb54a70640 1 -- 172.21.15.106:0/3172071401 shutdown_connections 2023-12-22T09:15:38.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.328+0000 7fcb54a70640 1 -- 172.21.15.106:0/3172071401 wait complete. 2023-12-22T09:15:38.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.330+0000 7fcb54a70640 1 Processor -- start 2023-12-22T09:15:38.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.330+0000 7fcb54a70640 1 -- start start 2023-12-22T09:15:38.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.331+0000 7fcb54a70640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5006bdc0 0x7fcb501eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.331+0000 7fcb54a70640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb50071e30 0x7fcb50150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.331+0000 7fcb54a70640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb500c5ca0 0x7fcb500bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.331+0000 7fcb54a70640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5014f2c0 con 0x7fcb5006bdc0 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.331+0000 7fcb54a70640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5014ec40 con 0x7fcb50071e30 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.331+0000 7fcb54a70640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501eb660 con 0x7fcb500c5ca0 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.331+0000 7fcb4e59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5006bdc0 0x7fcb501eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.331+0000 7fcb4e59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5006bdc0 0x7fcb501eaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44830/0 (socket says 172.21.15.106:44830) 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.331+0000 7fcb4e59c640 1 -- 172.21.15.106:0/1956339523 learned_addr learned my addr 172.21.15.106:0/1956339523 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.332+0000 7fcb47fff640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb50071e30 0x7fcb50150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.332+0000 7fcb4e59c640 1 -- 172.21.15.106:0/1956339523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb500c5ca0 msgr2=0x7fcb500bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.332+0000 7fcb4e59c640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb500c5ca0 0x7fcb500bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.332+0000 7fcb4e59c640 1 -- 172.21.15.106:0/1956339523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb50071e30 msgr2=0x7fcb50150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.332+0000 7fcb4e59c640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb50071e30 0x7fcb50150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.332+0000 7fcb4e59c640 1 -- 172.21.15.106:0/1956339523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009400 con 0x7fcb5006bdc0 2023-12-22T09:15:38.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.332+0000 7fcb47fff640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb50071e30 0x7fcb50150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:38.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.332+0000 7fcb4e59c640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5006bdc0 0x7fcb501eaa00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcb40034040 tx=0x7fcb400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:38.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.333+0000 7fcb46ffd640 1 -- 172.21.15.106:0/1956339523 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40032820 con 0x7fcb5006bdc0 2023-12-22T09:15:38.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.333+0000 7fcb46ffd640 1 -- 172.21.15.106:0/1956339523 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb40032980 con 0x7fcb5006bdc0 2023-12-22T09:15:38.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.333+0000 7fcb46ffd640 1 -- 172.21.15.106:0/1956339523 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40032d30 con 0x7fcb5006bdc0 2023-12-22T09:15:38.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.333+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5014e960 con 0x7fcb5006bdc0 2023-12-22T09:15:38.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.333+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb501eb380 con 0x7fcb5006bdc0 2023-12-22T09:15:38.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.334+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5013e930 con 0x7fcb5006bdc0 2023-12-22T09:15:38.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.335+0000 7fcb46ffd640 1 -- 172.21.15.106:0/1956339523 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb4004e440 con 0x7fcb5006bdc0 2023-12-22T09:15:38.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.336+0000 7fcb46ffd640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a430 0x7fcb3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.336+0000 7fcb46ffd640 1 -- 172.21.15.106:0/1956339523 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb400aad80 con 0x7fcb5006bdc0 2023-12-22T09:15:38.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.336+0000 7fcb47fff640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a430 0x7fcb3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.337+0000 7fcb47fff640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a430 0x7fcb3006c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb5006cdf0 tx=0x7fcb38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:38.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.340+0000 7fcb46ffd640 1 -- 172.21.15.106:0/1956339523 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcb5013e930 con 0x7fcb5006bdc0 2023-12-22T09:15:38.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.528+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb500bce00 con 0x7fcb5006bdc0 2023-12-22T09:15:38.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.529+0000 7fcb46ffd640 1 -- 172.21.15.106:0/1956339523 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb500bce00 con 0x7fcb5006bdc0 2023-12-22T09:15:38.530 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:38.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.531+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a430 msgr2=0x7fcb3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.531+0000 7fcb54a70640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a430 0x7fcb3006c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb5006cdf0 tx=0x7fcb38008040 comp rx=0 tx=0).stop 2023-12-22T09:15:38.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.531+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5006bdc0 msgr2=0x7fcb501eaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.531+0000 7fcb54a70640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5006bdc0 0x7fcb501eaa00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcb40034040 tx=0x7fcb400046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.531+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 shutdown_connections 2023-12-22T09:15:38.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.531+0000 7fcb54a70640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcb3006a430 0x7fcb3006c8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.531+0000 7fcb54a70640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcb500c5ca0 0x7fcb500bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.531+0000 7fcb54a70640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb50071e30 0x7fcb50150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.532+0000 7fcb54a70640 1 --2- 172.21.15.106:0/1956339523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb5006bdc0 0x7fcb501eaa00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.532+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 >> 172.21.15.106:0/1956339523 conn(0x7fcb5006a220 msgr2=0x7fcb500c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:38.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.532+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 shutdown_connections 2023-12-22T09:15:38.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.532+0000 7fcb54a70640 1 -- 172.21.15.106:0/1956339523 wait complete. 2023-12-22T09:15:38.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:15:38.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.760+0000 7f1c785ab640 1 Processor -- start 2023-12-22T09:15:38.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.760+0000 7f1c785ab640 1 -- start start 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c785ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c7014f090 0x7f1c70151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c785ab640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c700c1910 0x7f1c70155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c785ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c70155dd0 0x7f1c700c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c785ab640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7006e080 con 0x7f1c700c1910 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c785ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c70155120 con 0x7f1c7014f090 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c785ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700a8720 con 0x7f1c70155dd0 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c75b46640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c700c1910 0x7f1c70155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c75b46640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c700c1910 0x7f1c70155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44832/0 (socket says 172.21.15.106:44832) 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c75b46640 1 -- 172.21.15.106:0/3805945900 learned_addr learned my addr 172.21.15.106:0/3805945900 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:38.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c76347640 1 --2- 172.21.15.106:0/3805945900 >> v2:172.21.15.132:3300/0 conn(0x7f1c7014f090 0x7f1c70151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c76b48640 1 --2- 172.21.15.106:0/3805945900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c70155dd0 0x7f1c700c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c75b46640 1 -- 172.21.15.106:0/3805945900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c70155dd0 msgr2=0x7f1c700c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:38.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c75b46640 1 --2- 172.21.15.106:0/3805945900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c70155dd0 0x7f1c700c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c75b46640 1 -- 172.21.15.106:0/3805945900 >> v2:172.21.15.132:3300/0 conn(0x7f1c7014f090 msgr2=0x7f1c70151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:38.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c75b46640 1 --2- 172.21.15.106:0/3805945900 >> v2:172.21.15.132:3300/0 conn(0x7f1c7014f090 0x7f1c70151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.763+0000 7f1c75b46640 1 -- 172.21.15.106:0/3805945900 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c700a8a00 con 0x7f1c700c1910 2023-12-22T09:15:38.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.764+0000 7f1c75b46640 1 --2- 172.21.15.106:0/3805945900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c700c1910 0x7f1c70155890 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1c700c6450 tx=0x7f1c6002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc94b1c51a0000e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:38.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.764+0000 7f1c75345640 1 -- 172.21.15.106:0/3805945900 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600317e0 con 0x7f1c700c1910 2023-12-22T09:15:38.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.764+0000 7f1c75345640 1 -- 172.21.15.106:0/3805945900 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c60031940 con 0x7f1c700c1910 2023-12-22T09:15:38.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.764+0000 7f1c75345640 1 -- 172.21.15.106:0/3805945900 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60031cd0 con 0x7f1c700c1910 2023-12-22T09:15:38.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.765+0000 7f1c785ab640 1 -- 172.21.15.106:0/3805945900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c700c1910 msgr2=0x7f1c70155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.765+0000 7f1c785ab640 1 --2- 172.21.15.106:0/3805945900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c700c1910 0x7f1c70155890 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1c700c6450 tx=0x7f1c6002b880 comp rx=0 tx=0).stop 2023-12-22T09:15:38.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.765+0000 7f1c785ab640 1 -- 172.21.15.106:0/3805945900 shutdown_connections 2023-12-22T09:15:38.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.765+0000 7f1c785ab640 1 --2- 172.21.15.106:0/3805945900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c70155dd0 0x7f1c700c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.765+0000 7f1c785ab640 1 --2- 172.21.15.106:0/3805945900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c700c1910 0x7f1c70155890 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.765+0000 7f1c785ab640 1 --2- 172.21.15.106:0/3805945900 >> v2:172.21.15.132:3300/0 conn(0x7f1c7014f090 0x7f1c70151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.765+0000 7f1c785ab640 1 -- 172.21.15.106:0/3805945900 >> 172.21.15.106:0/3805945900 conn(0x7f1c70069dd0 msgr2=0x7f1c7006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:38.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.765+0000 7f1c785ab640 1 -- 172.21.15.106:0/3805945900 shutdown_connections 2023-12-22T09:15:38.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.765+0000 7f1c785ab640 1 -- 172.21.15.106:0/3805945900 wait complete. 2023-12-22T09:15:38.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.767+0000 7f1c785ab640 1 Processor -- start 2023-12-22T09:15:38.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.767+0000 7f1c785ab640 1 -- start start 2023-12-22T09:15:38.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c785ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700c1910 0x7f1c701467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c785ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c7014f090 0x7f1c701543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c785ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701ea2d0 0x7f1c7014aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c785ab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700ba470 con 0x7f1c7014f090 2023-12-22T09:15:38.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c785ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c701ea760 con 0x7f1c701ea2d0 2023-12-22T09:15:38.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c785ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c701eaa40 con 0x7f1c700c1910 2023-12-22T09:15:38.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c75b46640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c7014f090 0x7f1c701543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c75b46640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c7014f090 0x7f1c701543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44834/0 (socket says 172.21.15.106:44834) 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c75b46640 1 -- 172.21.15.106:0/2107804894 learned_addr learned my addr 172.21.15.106:0/2107804894 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c76b48640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701ea2d0 0x7f1c7014aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c75b46640 1 -- 172.21.15.106:0/2107804894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700c1910 msgr2=0x7f1c701467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c76347640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700c1910 0x7f1c701467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c75b46640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700c1910 0x7f1c701467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c75b46640 1 -- 172.21.15.106:0/2107804894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701ea2d0 msgr2=0x7f1c7014aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c75b46640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701ea2d0 0x7f1c7014aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c75b46640 1 -- 172.21.15.106:0/2107804894 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600094d0 con 0x7f1c7014f090 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.768+0000 7f1c76b48640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701ea2d0 0x7f1c7014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:38.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.769+0000 7f1c75b46640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c7014f090 0x7f1c701543a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c60000c00 tx=0x7f1c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:38.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.769+0000 7f1c66ffd640 1 -- 172.21.15.106:0/2107804894 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60032880 con 0x7f1c7014f090 2023-12-22T09:15:38.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.769+0000 7f1c66ffd640 1 -- 172.21.15.106:0/2107804894 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c60032a20 con 0x7f1c7014f090 2023-12-22T09:15:38.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.769+0000 7f1c66ffd640 1 -- 172.21.15.106:0/2107804894 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60032dd0 con 0x7f1c7014f090 2023-12-22T09:15:38.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.769+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c701ead20 con 0x7f1c7014f090 2023-12-22T09:15:38.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.769+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c701dea40 con 0x7f1c7014f090 2023-12-22T09:15:38.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.770+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c70073f10 con 0x7f1c7014f090 2023-12-22T09:15:38.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.771+0000 7f1c66ffd640 1 -- 172.21.15.106:0/2107804894 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c6004e450 con 0x7f1c7014f090 2023-12-22T09:15:38.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.772+0000 7f1c66ffd640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c5406a460 0x7f1c5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:38.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.772+0000 7f1c66ffd640 1 -- 172.21.15.106:0/2107804894 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c600aae70 con 0x7f1c7014f090 2023-12-22T09:15:38.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.772+0000 7f1c76347640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c5406a460 0x7f1c5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:38.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.773+0000 7f1c76347640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c5406a460 0x7f1c5406c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c006fd0 tx=0x7f1c6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:38.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.777+0000 7f1c66ffd640 1 -- 172.21.15.106:0/2107804894 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c600760c0 con 0x7f1c7014f090 2023-12-22T09:15:38.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.966+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c700a82f0 con 0x7f1c7014f090 2023-12-22T09:15:38.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.967+0000 7f1c66ffd640 1 -- 172.21.15.106:0/2107804894 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c600796e0 con 0x7f1c7014f090 2023-12-22T09:15:38.967 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:15:38.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c5406a460 msgr2=0x7f1c5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c5406a460 0x7f1c5406c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c006fd0 tx=0x7f1c6c008040 comp rx=0 tx=0).stop 2023-12-22T09:15:38.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c7014f090 msgr2=0x7f1c701543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:38.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c7014f090 0x7f1c701543a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c60000c00 tx=0x7f1c600046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 shutdown_connections 2023-12-22T09:15:38.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c5406a460 0x7f1c5406c920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c701ea2d0 0x7f1c7014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c7014f090 0x7f1c701543a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 --2- 172.21.15.106:0/2107804894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c700c1910 0x7f1c701467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:38.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 >> 172.21.15.106:0/2107804894 conn(0x7f1c70069dd0 msgr2=0x7f1c7006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:38.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.969+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 shutdown_connections 2023-12-22T09:15:38.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:38.970+0000 7f1c785ab640 1 -- 172.21.15.106:0/2107804894 wait complete. 2023-12-22T09:15:38.989 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-22T09:15:39.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.204+0000 7fc224e0b640 1 Processor -- start 2023-12-22T09:15:39.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.204+0000 7fc224e0b640 1 -- start start 2023-12-22T09:15:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.205+0000 7fc224e0b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc220071e30 0x7fc220150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.205+0000 7fc224e0b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22006bdc0 0x7fc22014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.205+0000 7fc224e0b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc220070000 con 0x7fc2200c5ca0 2023-12-22T09:15:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.205+0000 7fc224e0b640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2200702e0 con 0x7fc220071e30 2023-12-22T09:15:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.205+0000 7fc224e0b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200705c0 con 0x7fc22006bdc0 2023-12-22T09:15:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.207+0000 7fc217fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc220071e30 0x7fc220150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.207+0000 7fc217fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc220071e30 0x7fc220150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44842/0 (socket says 172.21.15.106:44842) 2023-12-22T09:15:39.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.207+0000 7fc217fff640 1 -- 172.21.15.106:0/4165377158 learned_addr learned my addr 172.21.15.106:0/4165377158 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:39.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.207+0000 7fc21ed9d640 1 --2- 172.21.15.106:0/4165377158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22006bdc0 0x7fc22014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.207+0000 7fc217fff640 1 -- 172.21.15.106:0/4165377158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22006bdc0 msgr2=0x7fc22014a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:39.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.207+0000 7fc217fff640 1 --2- 172.21.15.106:0/4165377158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22006bdc0 0x7fc22014a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.207+0000 7fc217fff640 1 -- 172.21.15.106:0/4165377158 >> v1:172.21.15.132:6789/0 conn(0x7fc2200c5ca0 legacy=0x7fc2200710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.207+0000 7fc217fff640 1 -- 172.21.15.106:0/4165377158 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2200708a0 con 0x7fc220071e30 2023-12-22T09:15:39.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.208+0000 7fc217fff640 1 --2- 172.21.15.106:0/4165377158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 0x7fc220150af0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc208009870 tx=0x7fc20802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecdd15e19a2f69a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:39.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.208+0000 7fc21dd9b640 1 -- 172.21.15.106:0/4165377158 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208031640 con 0x7fc220071e30 2023-12-22T09:15:39.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.208+0000 7fc21dd9b640 1 -- 172.21.15.106:0/4165377158 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2080317a0 con 0x7fc220071e30 2023-12-22T09:15:39.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.208+0000 7fc21dd9b640 1 -- 172.21.15.106:0/4165377158 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208031b30 con 0x7fc220071e30 2023-12-22T09:15:39.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.209+0000 7fc224e0b640 1 -- 172.21.15.106:0/4165377158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 msgr2=0x7fc220150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.209+0000 7fc224e0b640 1 --2- 172.21.15.106:0/4165377158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 0x7fc220150af0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc208009870 tx=0x7fc20802b8f0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.209+0000 7fc224e0b640 1 -- 172.21.15.106:0/4165377158 shutdown_connections 2023-12-22T09:15:39.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.209+0000 7fc224e0b640 1 --2- 172.21.15.106:0/4165377158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc22006bdc0 0x7fc22014a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.209+0000 7fc224e0b640 1 --2- 172.21.15.106:0/4165377158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 0x7fc220150af0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.209+0000 7fc224e0b640 1 -- 172.21.15.106:0/4165377158 >> 172.21.15.106:0/4165377158 conn(0x7fc22006a220 msgr2=0x7fc2200c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:39.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.209+0000 7fc224e0b640 1 -- 172.21.15.106:0/4165377158 shutdown_connections 2023-12-22T09:15:39.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.209+0000 7fc224e0b640 1 -- 172.21.15.106:0/4165377158 wait complete. 2023-12-22T09:15:39.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.210+0000 7fc224e0b640 1 Processor -- start 2023-12-22T09:15:39.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.211+0000 7fc224e0b640 1 -- start start 2023-12-22T09:15:39.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc224e0b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22006bdc0 0x7fc2200b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc224e0b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 0x7fc2201ec8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc224e0b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc2200c5ca0 0x7fc2200c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc224e0b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200b95f0 con 0x7fc220071e30 2023-12-22T09:15:39.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc224e0b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2201ecdf0 con 0x7fc22006bdc0 2023-12-22T09:15:39.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc224e0b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2201ebe60 con 0x7fc2200c5ca0 2023-12-22T09:15:39.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc217fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 0x7fc2201ec8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc217fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 0x7fc2201ec8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44852/0 (socket says 172.21.15.106:44852) 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc217fff640 1 -- 172.21.15.106:0/2674013510 learned_addr learned my addr 172.21.15.106:0/2674013510 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc21ed9d640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc2200c5ca0 0x7fc2200c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc217fff640 1 -- 172.21.15.106:0/2674013510 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc2200c5ca0 msgr2=0x7fc2200c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc217fff640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc2200c5ca0 0x7fc2200c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc217fff640 1 -- 172.21.15.106:0/2674013510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22006bdc0 msgr2=0x7fc2200b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc21e59c640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22006bdc0 0x7fc2200b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc217fff640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22006bdc0 0x7fc2200b8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.212+0000 7fc217fff640 1 -- 172.21.15.106:0/2674013510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2080094d0 con 0x7fc220071e30 2023-12-22T09:15:39.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.213+0000 7fc217fff640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 0x7fc2201ec8b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc208000c00 tx=0x7fc2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:39.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.213+0000 7fc216ffd640 1 -- 172.21.15.106:0/2674013510 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20803ac60 con 0x7fc220071e30 2023-12-22T09:15:39.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.213+0000 7fc216ffd640 1 -- 172.21.15.106:0/2674013510 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20803adc0 con 0x7fc220071e30 2023-12-22T09:15:39.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.213+0000 7fc216ffd640 1 -- 172.21.15.106:0/2674013510 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208044630 con 0x7fc220071e30 2023-12-22T09:15:39.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.213+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2200ba5f0 con 0x7fc220071e30 2023-12-22T09:15:39.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.213+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2200b9310 con 0x7fc220071e30 2023-12-22T09:15:39.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.214+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc220073f10 con 0x7fc220071e30 2023-12-22T09:15:39.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.215+0000 7fc216ffd640 1 -- 172.21.15.106:0/2674013510 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc20802f050 con 0x7fc220071e30 2023-12-22T09:15:39.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.216+0000 7fc216ffd640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc20006a430 0x7fc20006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.216+0000 7fc216ffd640 1 -- 172.21.15.106:0/2674013510 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc2080aac50 con 0x7fc220071e30 2023-12-22T09:15:39.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.216+0000 7fc21e59c640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc20006a430 0x7fc20006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.217+0000 7fc21e59c640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc20006a430 0x7fc20006c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc210000f60 tx=0x7fc210009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:39.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.221+0000 7fc216ffd640 1 -- 172.21.15.106:0/2674013510 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc208075de0 con 0x7fc220071e30 2023-12-22T09:15:39.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.411+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc2200c3e70 con 0x7fc220071e30 2023-12-22T09:15:39.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.412+0000 7fc216ffd640 1 -- 172.21.15.106:0/2674013510 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc2080350a0 con 0x7fc220071e30 2023-12-22T09:15:39.411 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc20006a430 msgr2=0x7fc20006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc20006a430 0x7fc20006c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc210000f60 tx=0x7fc210009040 comp rx=0 tx=0).stop 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 msgr2=0x7fc2201ec8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 0x7fc2201ec8b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc208000c00 tx=0x7fc2080046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 shutdown_connections 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc20006a430 0x7fc20006c8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc2200c5ca0 0x7fc2200c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc220071e30 0x7fc2201ec8b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 --2- 172.21.15.106:0/2674013510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22006bdc0 0x7fc2200b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 >> 172.21.15.106:0/2674013510 conn(0x7fc22006a220 msgr2=0x7fc2200c4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 shutdown_connections 2023-12-22T09:15:39.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.414+0000 7fc224e0b640 1 -- 172.21.15.106:0/2674013510 wait complete. 2023-12-22T09:15:39.433 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:15:39.645 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.646+0000 7f8f6973c640 1 Processor -- start 2023-12-22T09:15:39.645 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.646+0000 7f8f6973c640 1 -- start start 2023-12-22T09:15:39.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.647+0000 7f8f6973c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f640c4130 0x7f8f640c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.647+0000 7f8f6973c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8f6406aad0 0x7f8f640c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.647+0000 7f8f6973c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f640c4660 con 0x7f8f641514b0 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.647+0000 7f8f6973c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f64153d60 con 0x7f8f6406aad0 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.647+0000 7f8f6973c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64154c50 con 0x7f8f640c4130 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f62ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8f641514b0 0x7f8f64154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33142/0 (socket says 172.21.15.106:33142) 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f62ffd640 1 -- 172.21.15.106:0/3899032067 learned_addr learned my addr 172.21.15.106:0/3899032067 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f637fe640 1 --2- 172.21.15.106:0/3899032067 >> v2:172.21.15.106:3300/0 conn(0x7f8f6406aad0 0x7f8f640c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f627fc640 1 -- 172.21.15.106:0/3899032067 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067190481 0 0) 0x7f8f640c4660 con 0x7f8f641514b0 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f5bfff640 1 --2- 172.21.15.106:0/3899032067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f640c4130 0x7f8f640c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f627fc640 1 -- 172.21.15.106:0/3899032067 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f50003520 con 0x7f8f641514b0 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f637fe640 1 -- 172.21.15.106:0/3899032067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f640c4130 msgr2=0x7f8f640c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f637fe640 1 --2- 172.21.15.106:0/3899032067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f640c4130 0x7f8f640c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f637fe640 1 -- 172.21.15.106:0/3899032067 >> v1:172.21.15.106:6789/0 conn(0x7f8f641514b0 legacy=0x7f8f64154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f637fe640 1 -- 172.21.15.106:0/3899032067 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6406b250 con 0x7f8f6406aad0 2023-12-22T09:15:39.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.648+0000 7f8f5bfff640 1 --2- 172.21.15.106:0/3899032067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f640c4130 0x7f8f640c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:39.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.649+0000 7f8f637fe640 1 --2- 172.21.15.106:0/3899032067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f6406aad0 0x7f8f640c48e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009d90 tx=0x7f8f5c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6c5f3e0a12f2a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:39.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.649+0000 7f8f627fc640 1 -- 172.21.15.106:0/3899032067 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c02cbc0 con 0x7f8f6406aad0 2023-12-22T09:15:39.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f627fc640 1 -- 172.21.15.106:0/3899032067 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c02cd20 con 0x7f8f6406aad0 2023-12-22T09:15:39.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f627fc640 1 -- 172.21.15.106:0/3899032067 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c034660 con 0x7f8f6406aad0 2023-12-22T09:15:39.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f6973c640 1 -- 172.21.15.106:0/3899032067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f6406aad0 msgr2=0x7f8f640c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f6973c640 1 --2- 172.21.15.106:0/3899032067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f6406aad0 0x7f8f640c48e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009d90 tx=0x7f8f5c02be10 comp rx=0 tx=0).stop 2023-12-22T09:15:39.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f6973c640 1 -- 172.21.15.106:0/3899032067 shutdown_connections 2023-12-22T09:15:39.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f6973c640 1 --2- 172.21.15.106:0/3899032067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f6406aad0 0x7f8f640c48e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f6973c640 1 --2- 172.21.15.106:0/3899032067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f640c4130 0x7f8f640c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f6973c640 1 -- 172.21.15.106:0/3899032067 >> 172.21.15.106:0/3899032067 conn(0x7f8f640ab1a0 msgr2=0x7f8f640ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:39.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f6973c640 1 -- 172.21.15.106:0/3899032067 shutdown_connections 2023-12-22T09:15:39.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.650+0000 7f8f6973c640 1 -- 172.21.15.106:0/3899032067 wait complete. 2023-12-22T09:15:39.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.652+0000 7f8f6973c640 1 Processor -- start 2023-12-22T09:15:39.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.652+0000 7f8f6973c640 1 -- start start 2023-12-22T09:15:39.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.653+0000 7f8f6973c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f6406aad0 0x7f8f6414e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.653+0000 7f8f6973c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f640c4130 0x7f8f6414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.653+0000 7f8f6973c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f641514b0 0x7f8f64150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.653+0000 7f8f6973c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640bc7f0 con 0x7f8f641514b0 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.653+0000 7f8f6973c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6414be20 con 0x7f8f640c4130 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.653+0000 7f8f6973c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640bca00 con 0x7f8f6406aad0 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.653+0000 7f8f637fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f641514b0 0x7f8f64150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.653+0000 7f8f637fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f641514b0 0x7f8f64150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44870/0 (socket says 172.21.15.106:44870) 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f637fe640 1 -- 172.21.15.106:0/310560981 learned_addr learned my addr 172.21.15.106:0/310560981 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f5bfff640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f640c4130 0x7f8f6414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f62ffd640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f6406aad0 0x7f8f6414e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f637fe640 1 -- 172.21.15.106:0/310560981 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f6406aad0 msgr2=0x7f8f6414e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f637fe640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f6406aad0 0x7f8f6414e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f637fe640 1 -- 172.21.15.106:0/310560981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f640c4130 msgr2=0x7f8f6414c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f637fe640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f640c4130 0x7f8f6414c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f637fe640 1 -- 172.21.15.106:0/310560981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c009a70 con 0x7f8f641514b0 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f5bfff640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f640c4130 0x7f8f6414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:39.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f637fe640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f641514b0 0x7f8f64150600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009d90 tx=0x7f8f5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:39.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f5b7fe640 1 -- 172.21.15.106:0/310560981 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c03e610 con 0x7f8f641514b0 2023-12-22T09:15:39.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f5b7fe640 1 -- 172.21.15.106:0/310560981 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c02ce90 con 0x7f8f641514b0 2023-12-22T09:15:39.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.654+0000 7f8f5b7fe640 1 -- 172.21.15.106:0/310560981 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c03e9f0 con 0x7f8f641514b0 2023-12-22T09:15:39.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.655+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6414ff30 con 0x7f8f641514b0 2023-12-22T09:15:39.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.655+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f640aaa50 con 0x7f8f641514b0 2023-12-22T09:15:39.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.656+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f640bcbc0 con 0x7f8f641514b0 2023-12-22T09:15:39.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.657+0000 7f8f5b7fe640 1 -- 172.21.15.106:0/310560981 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f5c03b050 con 0x7f8f641514b0 2023-12-22T09:15:39.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.658+0000 7f8f5b7fe640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8f4406a460 0x7f8f4406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:39.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.658+0000 7f8f5b7fe640 1 -- 172.21.15.106:0/310560981 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8f5c0ab610 con 0x7f8f641514b0 2023-12-22T09:15:39.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.658+0000 7f8f62ffd640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8f4406a460 0x7f8f4406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:39.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.658+0000 7f8f62ffd640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8f4406a460 0x7f8f4406c920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f540011e0 tx=0x7f8f54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:39.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.662+0000 7f8f5b7fe640 1 -- 172.21.15.106:0/310560981 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f5c0768c0 con 0x7f8f641514b0 2023-12-22T09:15:39.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.887+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f64150120 con 0x7f8f641514b0 2023-12-22T09:15:39.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.888+0000 7f8f5b7fe640 1 -- 172.21.15.106:0/310560981 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4653 (secure 0 0 0) 0x7f8f5c009450 con 0x7f8f641514b0 2023-12-22T09:15:39.888 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:39.888 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:55.943828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T09:15:39.888 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-12-22T09:15:39.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8f4406a460 msgr2=0x7f8f4406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8f4406a460 0x7f8f4406c920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f540011e0 tx=0x7f8f54009040 comp rx=0 tx=0).stop 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f641514b0 msgr2=0x7f8f64150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f641514b0 0x7f8f64150600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009d90 tx=0x7f8f5c004a40 comp rx=0 tx=0).stop 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 shutdown_connections 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8f4406a460 0x7f8f4406c920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f641514b0 0x7f8f64150600 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f640c4130 0x7f8f6414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 --2- 172.21.15.106:0/310560981 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f6406aad0 0x7f8f6414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 >> 172.21.15.106:0/310560981 conn(0x7f8f640ab1a0 msgr2=0x7f8f641deba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 shutdown_connections 2023-12-22T09:15:39.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:39.891+0000 7f8f6973c640 1 -- 172.21.15.106:0/310560981 wait complete. 2023-12-22T09:15:39.910 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:40.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.111+0000 7fe0190a1640 1 Processor -- start 2023-12-22T09:15:40.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.112+0000 7fe0190a1640 1 -- start start 2023-12-22T09:15:40.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.113+0000 7fe0190a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01406c9f0 0x7fe014157a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.113+0000 7fe0190a1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0140c7870 con 0x7fe0141547c0 2023-12-22T09:15:40.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.113+0000 7fe0190a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0140c4260 con 0x7fe0140aed10 2023-12-22T09:15:40.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.113+0000 7fe0190a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140c47e0 con 0x7fe01406c9f0 2023-12-22T09:15:40.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.113+0000 7fe01259c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe0141547c0 0x7fe014157310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33156/0 (socket says 172.21.15.106:33156) 2023-12-22T09:15:40.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.113+0000 7fe01259c640 1 -- 172.21.15.106:0/1345032286 learned_addr learned my addr 172.21.15.106:0/1345032286 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:40.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe01359e640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01406c9f0 0x7fe014157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407006379 0 0) 0x7fe0140c7870 con 0x7fe0141547c0 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdffc003520 con 0x7fe0141547c0 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171490464 0 0) 0x7fdffc003520 con 0x7fe0141547c0 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01406c9f0 msgr2=0x7fe014157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01406c9f0 0x7fe014157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 >> v1:172.21.15.132:6789/0 conn(0x7fe0140aed10 legacy=0x7fe0140c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0140c7d00 con 0x7fe0141547c0 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fe008001670 con 0x7fe0141547c0 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 >> v1:172.21.15.106:6789/0 conn(0x7fe0141547c0 legacy=0x7fe014157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01406c9f0 0x7fdffc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdffc003f20 0x7fdffc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdffc004d00 0x7fdffc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140c47e0 con 0x7fdffc003f20 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc00bb10 con 0x7fdffc004d00 2023-12-22T09:15:40.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.114+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc00bcd0 con 0x7fe01406c9f0 2023-12-22T09:15:40.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.115+0000 7fe01259c640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdffc003f20 0x7fdffc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.115+0000 7fe012d9d640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01406c9f0 0x7fdffc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.115+0000 7fe01259c640 1 -- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01406c9f0 msgr2=0x7fdffc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:40.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.115+0000 7fe01259c640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01406c9f0 0x7fdffc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.115+0000 7fe01259c640 1 -- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdffc004d00 msgr2=0x7fdffc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:40.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.115+0000 7fe01259c640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdffc004d00 0x7fdffc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.115+0000 7fe01259c640 1 -- 172.21.15.106:0/1345032286 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc003520 con 0x7fdffc003f20 2023-12-22T09:15:40.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.116+0000 7fe01259c640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdffc003f20 0x7fdffc0047c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c240 tx=0x7fdffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b1bbfd06969729 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:40.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.116+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008005ad0 con 0x7fdffc003f20 2023-12-22T09:15:40.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.116+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe008005c30 con 0x7fdffc003f20 2023-12-22T09:15:40.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.116+0000 7fe011d9b640 1 -- 172.21.15.106:0/1345032286 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00802c8b0 con 0x7fdffc003f20 2023-12-22T09:15:40.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.117+0000 7fe0190a1640 1 -- 172.21.15.106:0/1345032286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdffc003f20 msgr2=0x7fdffc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.117+0000 7fe0190a1640 1 --2- 172.21.15.106:0/1345032286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdffc003f20 0x7fdffc0047c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c240 tx=0x7fdffc0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.117+0000 7fe01359e640 1 -- 172.21.15.106:0/1345032286 reap_dead start 2023-12-22T09:15:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.117+0000 7fe0190a1640 1 -- 172.21.15.106:0/1345032286 shutdown_connections 2023-12-22T09:15:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.117+0000 7fe0190a1640 1 -- 172.21.15.106:0/1345032286 >> 172.21.15.106:0/1345032286 conn(0x7fe0140ab330 msgr2=0x7fe0140ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.117+0000 7fe0190a1640 1 -- 172.21.15.106:0/1345032286 shutdown_connections 2023-12-22T09:15:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.117+0000 7fe0190a1640 1 -- 172.21.15.106:0/1345032286 wait complete. 2023-12-22T09:15:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.119+0000 7fe0190a1640 1 Processor -- start 2023-12-22T09:15:40.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.119+0000 7fe0190a1640 1 -- start start 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe0190a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdffc003f20 0x7fe0140c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe0190a1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0140c1db0 0x7fe01414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe0190a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01414d280 0x7fe0141ec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe0190a1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe014150100 con 0x7fe0140c1db0 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe0190a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0141506e0 con 0x7fdffc003f20 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe0190a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01406b730 con 0x7fe01414d280 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe01259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0140c1db0 0x7fe01414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe01259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0140c1db0 0x7fe01414cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44894/0 (socket says 172.21.15.106:44894) 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe01259c640 1 -- 172.21.15.106:0/2774806891 learned_addr learned my addr 172.21.15.106:0/2774806891 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe012d9d640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdffc003f20 0x7fe0140c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe01259c640 1 -- 172.21.15.106:0/2774806891 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01414d280 msgr2=0x7fe0141ec580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe01259c640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01414d280 0x7fe0141ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe01259c640 1 -- 172.21.15.106:0/2774806891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdffc003f20 msgr2=0x7fe0140c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe01259c640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdffc003f20 0x7fe0140c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.120+0000 7fe01259c640 1 -- 172.21.15.106:0/2774806891 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01414fa40 con 0x7fe0140c1db0 2023-12-22T09:15:40.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.121+0000 7fe01259c640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0140c1db0 0x7fe01414cd40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c360 tx=0x7fe008001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.121+0000 7fdffb7fe640 1 -- 172.21.15.106:0/2774806891 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00802ccc0 con 0x7fe0140c1db0 2023-12-22T09:15:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.121+0000 7fdffb7fe640 1 -- 172.21.15.106:0/2774806891 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00802ce20 con 0x7fe0140c1db0 2023-12-22T09:15:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.121+0000 7fdffb7fe640 1 -- 172.21.15.106:0/2774806891 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008007290 con 0x7fe0140c1db0 2023-12-22T09:15:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.121+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01414fd20 con 0x7fe0140c1db0 2023-12-22T09:15:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.121+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe014150930 con 0x7fe0140c1db0 2023-12-22T09:15:40.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.122+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0140c6980 con 0x7fe0140c1db0 2023-12-22T09:15:40.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.123+0000 7fdffb7fe640 1 -- 172.21.15.106:0/2774806891 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe008032070 con 0x7fe0140c1db0 2023-12-22T09:15:40.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.124+0000 7fdffb7fe640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe00006a430 0x7fe00006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.124+0000 7fdffb7fe640 1 -- 172.21.15.106:0/2774806891 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe00803c040 con 0x7fe0140c1db0 2023-12-22T09:15:40.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.124+0000 7fe012d9d640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe00006a430 0x7fe00006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.125+0000 7fe012d9d640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe00006a430 0x7fe00006c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe004007fd0 tx=0x7fe004009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:40.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.128+0000 7fdffb7fe640 1 -- 172.21.15.106:0/2774806891 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe0080753e0 con 0x7fe0140c1db0 2023-12-22T09:15:40.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.321+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe014073f10 con 0x7fe0140c1db0 2023-12-22T09:15:40.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.323+0000 7fdffb7fe640 1 -- 172.21.15.106:0/2774806891 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7fe008078a00 con 0x7fe0140c1db0 2023-12-22T09:15:40.323 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:40.324 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe00006a430 msgr2=0x7fe00006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe00006a430 0x7fe00006c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe004007fd0 tx=0x7fe004009040 comp rx=0 tx=0).stop 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0140c1db0 msgr2=0x7fe01414cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0140c1db0 0x7fe01414cd40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c360 tx=0x7fe008001a00 comp rx=0 tx=0).stop 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 shutdown_connections 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe00006a430 0x7fe00006c8f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe01414d280 0x7fe0141ec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0140c1db0 0x7fe01414cd40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 --2- 172.21.15.106:0/2774806891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdffc003f20 0x7fe0140c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 >> 172.21.15.106:0/2774806891 conn(0x7fe0140ab330 msgr2=0x7fe0140ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:40.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 shutdown_connections 2023-12-22T09:15:40.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.326+0000 7fe0190a1640 1 -- 172.21.15.106:0/2774806891 wait complete. 2023-12-22T09:15:40.344 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T09:15:40.345 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:15:40.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.555+0000 7fa847fff640 1 Processor -- start 2023-12-22T09:15:40.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.556+0000 7fa847fff640 1 -- start start 2023-12-22T09:15:40.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.557+0000 7fa847fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa84814df70 0x7fa848154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.557+0000 7fa847fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8480c16e0 0x7fa84806b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.557+0000 7fa847fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa848153f00 con 0x7fa8480a82e0 2023-12-22T09:15:40.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.557+0000 7fa847fff640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480aa1a0 con 0x7fa8480c16e0 2023-12-22T09:15:40.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.557+0000 7fa847fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8481544c0 con 0x7fa84814df70 2023-12-22T09:15:40.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.557+0000 7fa8467fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8480c16e0 0x7fa84806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.557+0000 7fa8467fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8480c16e0 0x7fa84806b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44902/0 (socket says 172.21.15.106:44902) 2023-12-22T09:15:40.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.557+0000 7fa8467fc640 1 -- 172.21.15.106:0/2056188864 learned_addr learned my addr 172.21.15.106:0/2056188864 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:40.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.558+0000 7fa8467fc640 1 -- 172.21.15.106:0/2056188864 >> v2:172.21.15.132:3300/0 conn(0x7fa84814df70 msgr2=0x7fa848154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:40.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.558+0000 7fa8467fc640 1 --2- 172.21.15.106:0/2056188864 >> v2:172.21.15.132:3300/0 conn(0x7fa84814df70 0x7fa848154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.558+0000 7fa8467fc640 1 -- 172.21.15.106:0/2056188864 >> v1:172.21.15.132:6789/0 conn(0x7fa8480a82e0 legacy=0x7fa8480c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:40.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.558+0000 7fa8467fc640 1 -- 172.21.15.106:0/2056188864 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa848154e90 con 0x7fa8480c16e0 2023-12-22T09:15:40.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.559+0000 7fa8467fc640 1 --2- 172.21.15.106:0/2056188864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8480c16e0 0x7fa84806b760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa8480c11f0 tx=0x7fa83c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4561fc363263d760 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:40.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.559+0000 7fa845ffb640 1 -- 172.21.15.106:0/2056188864 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c031750 con 0x7fa8480c16e0 2023-12-22T09:15:40.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.559+0000 7fa845ffb640 1 -- 172.21.15.106:0/2056188864 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c0318b0 con 0x7fa8480c16e0 2023-12-22T09:15:40.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.559+0000 7fa845ffb640 1 -- 172.21.15.106:0/2056188864 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c031c40 con 0x7fa8480c16e0 2023-12-22T09:15:40.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.560+0000 7fa847fff640 1 -- 172.21.15.106:0/2056188864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8480c16e0 msgr2=0x7fa84806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.560+0000 7fa847fff640 1 --2- 172.21.15.106:0/2056188864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8480c16e0 0x7fa84806b760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa8480c11f0 tx=0x7fa83c02b7f0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.560+0000 7fa847fff640 1 -- 172.21.15.106:0/2056188864 shutdown_connections 2023-12-22T09:15:40.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.560+0000 7fa847fff640 1 --2- 172.21.15.106:0/2056188864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8480c16e0 0x7fa84806b760 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.560+0000 7fa847fff640 1 --2- 172.21.15.106:0/2056188864 >> v2:172.21.15.132:3300/0 conn(0x7fa84814df70 0x7fa848154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.560+0000 7fa847fff640 1 -- 172.21.15.106:0/2056188864 >> 172.21.15.106:0/2056188864 conn(0x7fa848069dd0 msgr2=0x7fa84806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:40.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.560+0000 7fa847fff640 1 -- 172.21.15.106:0/2056188864 shutdown_connections 2023-12-22T09:15:40.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.560+0000 7fa847fff640 1 -- 172.21.15.106:0/2056188864 wait complete. 2023-12-22T09:15:40.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.562+0000 7fa847fff640 1 Processor -- start 2023-12-22T09:15:40.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.562+0000 7fa847fff640 1 -- start start 2023-12-22T09:15:40.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.563+0000 7fa847fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8480a82e0 0x7fa8481e9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.563+0000 7fa847fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8480c16e0 0x7fa84806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.563+0000 7fa847fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84814df70 0x7fa8481de5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.563+0000 7fa847fff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8481e8c00 con 0x7fa84814df70 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.563+0000 7fa847fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8481e9b70 con 0x7fa8480c16e0 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.563+0000 7fa847fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa848148210 con 0x7fa8480a82e0 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8477fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84814df70 0x7fa8481de5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8477fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84814df70 0x7fa8481de5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44914/0 (socket says 172.21.15.106:44914) 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8477fe640 1 -- 172.21.15.106:0/1214077131 learned_addr learned my addr 172.21.15.106:0/1214077131 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa846ffd640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8480a82e0 0x7fa8481e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8467fc640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8480c16e0 0x7fa84806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8477fe640 1 -- 172.21.15.106:0/1214077131 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8480a82e0 msgr2=0x7fa8481e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8477fe640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8480a82e0 0x7fa8481e9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8477fe640 1 -- 172.21.15.106:0/1214077131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8480c16e0 msgr2=0x7fa84806fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8477fe640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8480c16e0 0x7fa84806fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8477fe640 1 -- 172.21.15.106:0/1214077131 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0094d0 con 0x7fa84814df70 2023-12-22T09:15:40.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa846ffd640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8480a82e0 0x7fa8481e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:40.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.564+0000 7fa8477fe640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84814df70 0x7fa8481de5f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa84000b990 tx=0x7fa84000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:40.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.565+0000 7fa82ffff640 1 -- 172.21.15.106:0/1214077131 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84000cba0 con 0x7fa84814df70 2023-12-22T09:15:40.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.565+0000 7fa82ffff640 1 -- 172.21.15.106:0/1214077131 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84000cd00 con 0x7fa84814df70 2023-12-22T09:15:40.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.565+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8481484f0 con 0x7fa84814df70 2023-12-22T09:15:40.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.565+0000 7fa82ffff640 1 -- 172.21.15.106:0/1214077131 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840014680 con 0x7fa84814df70 2023-12-22T09:15:40.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.565+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8481e9110 con 0x7fa84814df70 2023-12-22T09:15:40.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.566+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8481e9300 con 0x7fa84814df70 2023-12-22T09:15:40.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.567+0000 7fa82ffff640 1 -- 172.21.15.106:0/1214077131 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa8400147e0 con 0x7fa84814df70 2023-12-22T09:15:40.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.568+0000 7fa82ffff640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa83406a430 0x7fa83406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:40.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.568+0000 7fa82ffff640 1 -- 172.21.15.106:0/1214077131 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa840088d20 con 0x7fa84814df70 2023-12-22T09:15:40.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.568+0000 7fa846ffd640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa83406a430 0x7fa83406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:40.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.568+0000 7fa846ffd640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa83406a430 0x7fa83406c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa83800a870 tx=0x7fa838008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:40.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.572+0000 7fa82ffff640 1 -- 172.21.15.106:0/1214077131 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa840053eb0 con 0x7fa84814df70 2023-12-22T09:15:40.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.801+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa84804e8d0 con 0x7fa84814df70 2023-12-22T09:15:40.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.802+0000 7fa82ffff640 1 -- 172.21.15.106:0/1214077131 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4653 (secure 0 0 0) 0x7fa840019090 con 0x7fa84814df70 2023-12-22T09:15:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:40.802 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:55.943828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T09:15:40.802 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-12-22T09:15:40.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa83406a430 msgr2=0x7fa83406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa83406a430 0x7fa83406c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa83800a870 tx=0x7fa838008040 comp rx=0 tx=0).stop 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84814df70 msgr2=0x7fa8481de5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84814df70 0x7fa8481de5f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa84000b990 tx=0x7fa84000be50 comp rx=0 tx=0).stop 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 shutdown_connections 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa83406a430 0x7fa83406c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84814df70 0x7fa8481de5f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8480c16e0 0x7fa84806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 --2- 172.21.15.106:0/1214077131 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8480a82e0 0x7fa8481e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 >> 172.21.15.106:0/1214077131 conn(0x7fa848069dd0 msgr2=0x7fa84806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 shutdown_connections 2023-12-22T09:15:40.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:40.805+0000 7fa847fff640 1 -- 172.21.15.106:0/1214077131 wait complete. 2023-12-22T09:15:40.824 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:15:41.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.033+0000 7f6d249ab640 1 Processor -- start 2023-12-22T09:15:41.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.034+0000 7f6d249ab640 1 -- start start 2023-12-22T09:15:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.035+0000 7f6d249ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d200bac60 0x7f6d200c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.035+0000 7f6d249ab640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d200c3be0 con 0x7f6d200c3fe0 2023-12-22T09:15:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.035+0000 7f6d249ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d200c38b0 con 0x7f6d200c1f50 2023-12-22T09:15:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.035+0000 7f6d249ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200ad190 con 0x7f6d200bac60 2023-12-22T09:15:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.035+0000 7f6d1e59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6d200c3fe0 0x7f6d200701b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33166/0 (socket says 172.21.15.106:33166) 2023-12-22T09:15:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.035+0000 7f6d1e59c640 1 -- 172.21.15.106:0/1949759558 learned_addr learned my addr 172.21.15.106:0/1949759558 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1dd9b640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d200bac60 0x7f6d200c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61546633 0 0) 0x7f6d200c3be0 con 0x7f6d200c3fe0 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d0c003520 con 0x7f6d200c3fe0 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2806469862 0 0) 0x7f6d0c003520 con 0x7f6d200c3fe0 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d200bac60 msgr2=0x7f6d200c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d200bac60 0x7f6d200c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 >> v1:172.21.15.132:6789/0 conn(0x7f6d200c1f50 legacy=0x7f6d2014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20152840 con 0x7f6d200c3fe0 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f6d100019f0 con 0x7f6d200c3fe0 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 >> v1:172.21.15.106:6789/0 conn(0x7f6d200c3fe0 legacy=0x7f6d200701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d200bac60 0x7f6d0c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c003f70 0x7f6d0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d0c004d00 0x7f6d0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200ad190 con 0x7f6d0c003f70 2023-12-22T09:15:41.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00bb70 con 0x7f6d0c004d00 2023-12-22T09:15:41.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.036+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00bd30 con 0x7f6d200bac60 2023-12-22T09:15:41.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.037+0000 7f6d1dd9b640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c003f70 0x7f6d0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.037+0000 7f6d1e59c640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d200bac60 0x7f6d0c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.037+0000 7f6d1dd9b640 1 -- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d200bac60 msgr2=0x7f6d0c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:41.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.037+0000 7f6d1dd9b640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d200bac60 0x7f6d0c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.037+0000 7f6d1dd9b640 1 -- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d0c004d00 msgr2=0x7f6d0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:41.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.037+0000 7f6d1dd9b640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d0c004d00 0x7f6d0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.037+0000 7f6d1dd9b640 1 -- 172.21.15.106:0/1949759558 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c003520 con 0x7f6d0c003f70 2023-12-22T09:15:41.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.038+0000 7f6d1dd9b640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c003f70 0x7f6d0c0047c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009a90 tx=0x7f6d0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3befdef4926e929a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:41.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.038+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0802c680 con 0x7f6d0c003f70 2023-12-22T09:15:41.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.039+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0802c7e0 con 0x7f6d0c003f70 2023-12-22T09:15:41.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.039+0000 7f6d1d59a640 1 -- 172.21.15.106:0/1949759558 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0802cb70 con 0x7f6d0c003f70 2023-12-22T09:15:41.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.039+0000 7f6d249ab640 1 -- 172.21.15.106:0/1949759558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c003f70 msgr2=0x7f6d0c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.039+0000 7f6d249ab640 1 --2- 172.21.15.106:0/1949759558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c003f70 0x7f6d0c0047c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009a90 tx=0x7f6d0c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.039+0000 7f6d1ed9d640 1 -- 172.21.15.106:0/1949759558 reap_dead start 2023-12-22T09:15:41.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.039+0000 7f6d249ab640 1 -- 172.21.15.106:0/1949759558 shutdown_connections 2023-12-22T09:15:41.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.039+0000 7f6d249ab640 1 -- 172.21.15.106:0/1949759558 >> 172.21.15.106:0/1949759558 conn(0x7f6d200a9160 msgr2=0x7f6d200a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:41.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.039+0000 7f6d249ab640 1 -- 172.21.15.106:0/1949759558 shutdown_connections 2023-12-22T09:15:41.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.039+0000 7f6d249ab640 1 -- 172.21.15.106:0/1949759558 wait complete. 2023-12-22T09:15:41.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.041+0000 7f6d249ab640 1 Processor -- start 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.041+0000 7f6d249ab640 1 -- start start 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.042+0000 7f6d249ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d0c003f70 0x7f6d201e8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.042+0000 7f6d249ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d201ec1a0 0x7f6d200ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.042+0000 7f6d249ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d200bd320 0x7f6d200bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.042+0000 7f6d249ab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d201ed140 con 0x7f6d201ec1a0 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.042+0000 7f6d249ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20154cd0 con 0x7f6d200bd320 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.042+0000 7f6d249ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200bf8d0 con 0x7f6d0c003f70 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1dd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d201ec1a0 0x7f6d200ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1dd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d201ec1a0 0x7f6d200ab840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44918/0 (socket says 172.21.15.106:44918) 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1dd9b640 1 -- 172.21.15.106:0/1484675151 learned_addr learned my addr 172.21.15.106:0/1484675151 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1e59c640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d0c003f70 0x7f6d201e8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1dd9b640 1 -- 172.21.15.106:0/1484675151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d0c003f70 msgr2=0x7f6d201e8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1dd9b640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d0c003f70 0x7f6d201e8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1dd9b640 1 -- 172.21.15.106:0/1484675151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d200bd320 msgr2=0x7f6d200bd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1dd9b640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d200bd320 0x7f6d200bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1dd9b640 1 -- 172.21.15.106:0/1484675151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20152f70 con 0x7f6d201ec1a0 2023-12-22T09:15:41.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.043+0000 7f6d1dd9b640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d201ec1a0 0x7f6d200ab840 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6d08037040 tx=0x7f6d08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:41.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.044+0000 7f6d16ffd640 1 -- 172.21.15.106:0/1484675151 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0802dea0 con 0x7f6d201ec1a0 2023-12-22T09:15:41.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.044+0000 7f6d16ffd640 1 -- 172.21.15.106:0/1484675151 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d08003810 con 0x7f6d201ec1a0 2023-12-22T09:15:41.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.044+0000 7f6d16ffd640 1 -- 172.21.15.106:0/1484675151 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08003ba0 con 0x7f6d201ec1a0 2023-12-22T09:15:41.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.044+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d201ec620 con 0x7f6d201ec1a0 2023-12-22T09:15:41.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.044+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d201ecb80 con 0x7f6d201ec1a0 2023-12-22T09:15:41.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.045+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d20073f10 con 0x7f6d201ec1a0 2023-12-22T09:15:41.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.046+0000 7f6d16ffd640 1 -- 172.21.15.106:0/1484675151 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d08003d00 con 0x7f6d201ec1a0 2023-12-22T09:15:41.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.047+0000 7f6d16ffd640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6d0006a460 0x7f6d0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.047+0000 7f6d16ffd640 1 -- 172.21.15.106:0/1484675151 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6d080aac60 con 0x7f6d201ec1a0 2023-12-22T09:15:41.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.047+0000 7f6d1e59c640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6d0006a460 0x7f6d0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.048+0000 7f6d1e59c640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6d0006a460 0x7f6d0006c920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6d10002230 tx=0x7f6d100012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:41.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.052+0000 7f6d16ffd640 1 -- 172.21.15.106:0/1484675151 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6d08075e80 con 0x7f6d201ec1a0 2023-12-22T09:15:41.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.278+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d2006fe90 con 0x7f6d201ec1a0 2023-12-22T09:15:41.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.279+0000 7f6d16ffd640 1 -- 172.21.15.106:0/1484675151 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4653 (secure 0 0 0) 0x7f6d080794a0 con 0x7f6d201ec1a0 2023-12-22T09:15:41.279 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:41.279 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/129127310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":129127310},{"type":"v1","addr":"172.21.15.106:6835","nonce":129127310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1982908151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1982908151},{"type":"v1","addr":"172.21.15.106:6837","nonce":1982908151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1353753744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1353753744},{"type":"v1","addr":"172.21.15.132:6834","nonce":1353753744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:14:28.433865+0000","modified":"2023-12-22T09:14:55.943828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6835/4132787606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":4132787606},{"type":"v1","addr":"172.21.15.132:6835","nonce":4132787606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T09:15:41.279 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-12-22T09:15:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6d0006a460 msgr2=0x7f6d0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6d0006a460 0x7f6d0006c920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6d10002230 tx=0x7f6d100012f0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d201ec1a0 msgr2=0x7f6d200ab840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d201ec1a0 0x7f6d200ab840 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6d08037040 tx=0x7f6d08004730 comp rx=0 tx=0).stop 2023-12-22T09:15:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 shutdown_connections 2023-12-22T09:15:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6d0006a460 0x7f6d0006c920 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d200bd320 0x7f6d200bd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d201ec1a0 0x7f6d200ab840 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 --2- 172.21.15.106:0/1484675151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6d0c003f70 0x7f6d201e8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 >> 172.21.15.106:0/1484675151 conn(0x7f6d200a9160 msgr2=0x7f6d2006f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.282+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 shutdown_connections 2023-12-22T09:15:41.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.283+0000 7f6d249ab640 1 -- 172.21.15.106:0/1484675151 wait complete. 2023-12-22T09:15:41.301 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:41.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.510+0000 7fdb5d147640 1 Processor -- start 2023-12-22T09:15:41.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.510+0000 7fdb5d147640 1 -- start start 2023-12-22T09:15:41.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.511+0000 7fdb5d147640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb5813b060 0x7fdb5806a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.512+0000 7fdb5d147640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580bf770 con 0x7fdb58151b30 2023-12-22T09:15:41.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.512+0000 7fdb5d147640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb58155120 con 0x7fdb580bfce0 2023-12-22T09:15:41.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.512+0000 7fdb5d147640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58155400 con 0x7fdb5813b060 2023-12-22T09:15:41.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.512+0000 7fdb5759e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdb58151b30 0x7fdb58151fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33174/0 (socket says 172.21.15.106:33174) 2023-12-22T09:15:41.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.512+0000 7fdb5759e640 1 -- 172.21.15.106:0/602440158 learned_addr learned my addr 172.21.15.106:0/602440158 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:41.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.512+0000 7fdb56d9d640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb5813b060 0x7fdb5806a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.512+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132371216 0 0) 0x7fdb580bf770 con 0x7fdb58151b30 2023-12-22T09:15:41.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb44003520 con 0x7fdb58151b30 2023-12-22T09:15:41.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287465007 0 0) 0x7fdb44003520 con 0x7fdb58151b30 2023-12-22T09:15:41.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb5813b060 msgr2=0x7fdb5806a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb5813b060 0x7fdb5806a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 >> v1:172.21.15.132:6789/0 conn(0x7fdb580bfce0 legacy=0x7fdb58069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb581556e0 con 0x7fdb58151b30 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fdb50001670 con 0x7fdb58151b30 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 >> v1:172.21.15.106:6789/0 conn(0x7fdb58151b30 legacy=0x7fdb58151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb440039a0 0x7fdb44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb440047c0 0x7fdb44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb5813b060 0x7fdb440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58155400 con 0x7fdb440039a0 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400bab0 con 0x7fdb440047c0 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400bc70 con 0x7fdb5813b060 2023-12-22T09:15:41.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.513+0000 7fdb56d9d640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb440039a0 0x7fdb44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.514+0000 7fdb56d9d640 1 -- 172.21.15.106:0/602440158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb5813b060 msgr2=0x7fdb440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:41.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.514+0000 7fdb56d9d640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb5813b060 0x7fdb440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.514+0000 7fdb56d9d640 1 -- 172.21.15.106:0/602440158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb440047c0 msgr2=0x7fdb44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:41.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.514+0000 7fdb56d9d640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb440047c0 0x7fdb44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.514+0000 7fdb56d9d640 1 -- 172.21.15.106:0/602440158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44003520 con 0x7fdb440039a0 2023-12-22T09:15:41.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.515+0000 7fdb56d9d640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb440039a0 0x7fdb44003dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009ab0 tx=0x7fdb440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e023abf08b4f7d11 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:41.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.515+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40005990 con 0x7fdb440039a0 2023-12-22T09:15:41.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.515+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb40005af0 con 0x7fdb440039a0 2023-12-22T09:15:41.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.515+0000 7fdb55d9b640 1 -- 172.21.15.106:0/602440158 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40005ea0 con 0x7fdb440039a0 2023-12-22T09:15:41.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.515+0000 7fdb5d147640 1 -- 172.21.15.106:0/602440158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb440039a0 msgr2=0x7fdb44003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.515+0000 7fdb5d147640 1 --2- 172.21.15.106:0/602440158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb440039a0 0x7fdb44003dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009ab0 tx=0x7fdb440057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.515+0000 7fdb5759e640 1 -- 172.21.15.106:0/602440158 reap_dead start 2023-12-22T09:15:41.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.516+0000 7fdb5d147640 1 -- 172.21.15.106:0/602440158 shutdown_connections 2023-12-22T09:15:41.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.516+0000 7fdb5d147640 1 -- 172.21.15.106:0/602440158 >> 172.21.15.106:0/602440158 conn(0x7fdb580c5360 msgr2=0x7fdb580c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:41.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.516+0000 7fdb5d147640 1 -- 172.21.15.106:0/602440158 shutdown_connections 2023-12-22T09:15:41.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.516+0000 7fdb5d147640 1 -- 172.21.15.106:0/602440158 wait complete. 2023-12-22T09:15:41.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.517+0000 7fdb5d147640 1 Processor -- start 2023-12-22T09:15:41.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.517+0000 7fdb5d147640 1 -- start start 2023-12-22T09:15:41.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.518+0000 7fdb5d147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb440039a0 0x7fdb581e9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.518+0000 7fdb5d147640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb5806a6b0 0x7fdb580aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.518+0000 7fdb5d147640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb58133b50 0x7fdb58133fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.518+0000 7fdb5d147640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580c4ed0 con 0x7fdb5806a6b0 2023-12-22T09:15:41.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.518+0000 7fdb5d147640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580c3140 con 0x7fdb440039a0 2023-12-22T09:15:41.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.518+0000 7fdb5d147640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58154dd0 con 0x7fdb58133b50 2023-12-22T09:15:41.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb5659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb5806a6b0 0x7fdb580aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb5659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb5806a6b0 0x7fdb580aaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44942/0 (socket says 172.21.15.106:44942) 2023-12-22T09:15:41.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb5659c640 1 -- 172.21.15.106:0/4055241182 learned_addr learned my addr 172.21.15.106:0/4055241182 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:41.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb56d9d640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb440039a0 0x7fdb581e9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb5659c640 1 -- 172.21.15.106:0/4055241182 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb58133b50 msgr2=0x7fdb58133fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb5659c640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb58133b50 0x7fdb58133fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb5659c640 1 -- 172.21.15.106:0/4055241182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb440039a0 msgr2=0x7fdb581e9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb5659c640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb440039a0 0x7fdb581e9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb5659c640 1 -- 172.21.15.106:0/4055241182 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb58134510 con 0x7fdb5806a6b0 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb5659c640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb5806a6b0 0x7fdb580aaa50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c8a0 tx=0x7fdb4800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.519+0000 7fdb4f7fe640 1 -- 172.21.15.106:0/4055241182 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48003b70 con 0x7fdb5806a6b0 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.520+0000 7fdb4f7fe640 1 -- 172.21.15.106:0/4055241182 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48003cf0 con 0x7fdb5806a6b0 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.520+0000 7fdb4f7fe640 1 -- 172.21.15.106:0/4055241182 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800aa90 con 0x7fdb5806a6b0 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.520+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb581ea4f0 con 0x7fdb5806a6b0 2023-12-22T09:15:41.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.520+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb581eaab0 con 0x7fdb5806a6b0 2023-12-22T09:15:41.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.521+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb580c2f10 con 0x7fdb5806a6b0 2023-12-22T09:15:41.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.522+0000 7fdb4f7fe640 1 -- 172.21.15.106:0/4055241182 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb4800abf0 con 0x7fdb5806a6b0 2023-12-22T09:15:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.523+0000 7fdb4f7fe640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb3806a460 0x7fdb3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.523+0000 7fdb4f7fe640 1 -- 172.21.15.106:0/4055241182 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdb48088c70 con 0x7fdb5806a6b0 2023-12-22T09:15:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.523+0000 7fdb56d9d640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb3806a460 0x7fdb3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.524+0000 7fdb56d9d640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb3806a460 0x7fdb3806c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb40035000 tx=0x7fdb40030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:41.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.527+0000 7fdb4f7fe640 1 -- 172.21.15.106:0/4055241182 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdb580c2f10 con 0x7fdb5806a6b0 2023-12-22T09:15:41.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.705+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb58073f10 con 0x7fdb5806a6b0 2023-12-22T09:15:41.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.707+0000 7fdb4f7fe640 1 -- 172.21.15.106:0/4055241182 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18259 (secure 0 0 0) 0x7fdb48003e60 con 0x7fdb5806a6b0 2023-12-22T09:15:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:41.707 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":27,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:10.471556+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:14:26.323764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T09:14:27.442193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-22T09:14:30.508922+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:41.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb3806a460 msgr2=0x7fdb3806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb3806a460 0x7fdb3806c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb40035000 tx=0x7fdb40030000 comp rx=0 tx=0).stop 2023-12-22T09:15:41.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb5806a6b0 msgr2=0x7fdb580aaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb5806a6b0 0x7fdb580aaa50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c8a0 tx=0x7fdb4800cd60 comp rx=0 tx=0).stop 2023-12-22T09:15:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 shutdown_connections 2023-12-22T09:15:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb3806a460 0x7fdb3806c920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb58133b50 0x7fdb58133fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb5806a6b0 0x7fdb580aaa50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 --2- 172.21.15.106:0/4055241182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb440039a0 0x7fdb581e9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 >> 172.21.15.106:0/4055241182 conn(0x7fdb580c5360 msgr2=0x7fdb580c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.709+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 shutdown_connections 2023-12-22T09:15:41.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.710+0000 7fdb5d147640 1 -- 172.21.15.106:0/4055241182 wait complete. 2023-12-22T09:15:41.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T09:15:41.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.919+0000 7f0ce6167640 1 Processor -- start 2023-12-22T09:15:41.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.920+0000 7f0ce6167640 1 -- start start 2023-12-22T09:15:41.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.921+0000 7f0ce6167640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ce00c1ea0 0x7f0ce013aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.921+0000 7f0ce6167640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ce00c2760 0x7f0ce013b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.921+0000 7f0ce6167640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce006d8f0 con 0x7f0ce00bfba0 2023-12-22T09:15:41.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.921+0000 7f0ce6167640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce006d400 con 0x7f0ce00c1ea0 2023-12-22T09:15:41.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.921+0000 7f0ce6167640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce006d610 con 0x7f0ce00c2760 2023-12-22T09:15:41.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.921+0000 7f0ce5165640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ce00c1ea0 0x7f0ce013aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.921+0000 7f0ce5966640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0ce00bfba0 0x7f0ce01550e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33188/0 (socket says 172.21.15.106:33188) 2023-12-22T09:15:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.921+0000 7f0ce5966640 1 -- 172.21.15.106:0/3794160250 learned_addr learned my addr 172.21.15.106:0/3794160250 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.921+0000 7f0ce4964640 1 --2- 172.21.15.106:0/3794160250 >> v2:172.21.15.132:3300/0 conn(0x7f0ce00c2760 0x7f0ce013b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.922+0000 7f0ce5165640 1 -- 172.21.15.106:0/3794160250 >> v2:172.21.15.132:3300/0 conn(0x7f0ce00c2760 msgr2=0x7f0ce013b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.922+0000 7f0ce5165640 1 --2- 172.21.15.106:0/3794160250 >> v2:172.21.15.132:3300/0 conn(0x7f0ce00c2760 0x7f0ce013b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.922+0000 7f0ce5165640 1 -- 172.21.15.106:0/3794160250 >> v1:172.21.15.106:6789/0 conn(0x7f0ce00bfba0 legacy=0x7f0ce01550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.922+0000 7f0cd7fff640 1 -- 172.21.15.106:0/3794160250 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573244812 0 0) 0x7f0cd8001490 con 0x7f0ce00bfba0 2023-12-22T09:15:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.922+0000 7f0ce5165640 1 -- 172.21.15.106:0/3794160250 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00a8500 con 0x7f0ce00c1ea0 2023-12-22T09:15:41.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.923+0000 7f0ce5165640 1 --2- 172.21.15.106:0/3794160250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00c1ea0 0x7f0ce013aaf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00bf790 tx=0x7f0cdc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eacb648ff35d648 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.923+0000 7f0cd7fff640 1 -- 172.21.15.106:0/3794160250 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc02e070 con 0x7f0ce00c1ea0 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.923+0000 7f0cd7fff640 1 -- 172.21.15.106:0/3794160250 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc0315a0 con 0x7f0ce00c1ea0 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.923+0000 7f0cd7fff640 1 -- 172.21.15.106:0/3794160250 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc031930 con 0x7f0ce00c1ea0 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.923+0000 7f0ce6167640 1 -- 172.21.15.106:0/3794160250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00c1ea0 msgr2=0x7f0ce013aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.923+0000 7f0ce6167640 1 --2- 172.21.15.106:0/3794160250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00c1ea0 0x7f0ce013aaf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00bf790 tx=0x7f0cdc02b840 comp rx=0 tx=0).stop 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.924+0000 7f0ce6167640 1 -- 172.21.15.106:0/3794160250 shutdown_connections 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.924+0000 7f0ce6167640 1 --2- 172.21.15.106:0/3794160250 >> v2:172.21.15.132:3300/0 conn(0x7f0ce00c2760 0x7f0ce013b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.924+0000 7f0ce6167640 1 --2- 172.21.15.106:0/3794160250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00c1ea0 0x7f0ce013aaf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.924+0000 7f0ce6167640 1 -- 172.21.15.106:0/3794160250 >> 172.21.15.106:0/3794160250 conn(0x7f0ce0069bf0 msgr2=0x7f0ce0069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.924+0000 7f0ce6167640 1 -- 172.21.15.106:0/3794160250 shutdown_connections 2023-12-22T09:15:41.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.924+0000 7f0ce6167640 1 -- 172.21.15.106:0/3794160250 wait complete. 2023-12-22T09:15:41.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.925+0000 7f0ce6167640 1 Processor -- start 2023-12-22T09:15:41.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.925+0000 7f0ce6167640 1 -- start start 2023-12-22T09:15:41.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.926+0000 7f0ce6167640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00bfba0 0x7f0ce00c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.926+0000 7f0ce6167640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce00c1ea0 0x7f0ce01535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.926+0000 7f0ce6167640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ce00c2760 0x7f0ce0130b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.926+0000 7f0ce6167640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0154820 con 0x7f0ce00bfba0 2023-12-22T09:15:41.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.926+0000 7f0ce6167640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0155fa0 con 0x7f0ce00c1ea0 2023-12-22T09:15:41.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.926+0000 7f0ce6167640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0155670 con 0x7f0ce00c2760 2023-12-22T09:15:41.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.926+0000 7f0ce5165640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00bfba0 0x7f0ce00c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.927+0000 7f0ce5165640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00bfba0 0x7f0ce00c40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44964/0 (socket says 172.21.15.106:44964) 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.927+0000 7f0ce5165640 1 -- 172.21.15.106:0/1250615689 learned_addr learned my addr 172.21.15.106:0/1250615689 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.927+0000 7f0ce5165640 1 -- 172.21.15.106:0/1250615689 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ce00c2760 msgr2=0x7f0ce0130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.927+0000 7f0ce5165640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ce00c2760 0x7f0ce0130b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.927+0000 7f0ce5165640 1 -- 172.21.15.106:0/1250615689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce00c1ea0 msgr2=0x7f0ce01535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.927+0000 7f0ce5165640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce00c1ea0 0x7f0ce01535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.927+0000 7f0ce5165640 1 -- 172.21.15.106:0/1250615689 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009400 con 0x7f0ce00bfba0 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.927+0000 7f0ce5165640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00bfba0 0x7f0ce00c40b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009890 tx=0x7f0cdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.927+0000 7f0cd5ffb640 1 -- 172.21.15.106:0/1250615689 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc032840 con 0x7f0ce00bfba0 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.928+0000 7f0cd5ffb640 1 -- 172.21.15.106:0/1250615689 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc0329c0 con 0x7f0ce00bfba0 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.928+0000 7f0cd5ffb640 1 -- 172.21.15.106:0/1250615689 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc032d70 con 0x7f0ce00bfba0 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.928+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce0155950 con 0x7f0ce00bfba0 2023-12-22T09:15:41.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.928+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce00c45f0 con 0x7f0ce00bfba0 2023-12-22T09:15:41.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.929+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce004e8d0 con 0x7f0ce00bfba0 2023-12-22T09:15:41.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.930+0000 7f0cd5ffb640 1 -- 172.21.15.106:0/1250615689 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0cdc03b3f0 con 0x7f0ce00bfba0 2023-12-22T09:15:41.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.931+0000 7f0cd5ffb640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0cc406a430 0x7f0cc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:41.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.931+0000 7f0cd5ffb640 1 -- 172.21.15.106:0/1250615689 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0cdc0aac10 con 0x7f0ce00bfba0 2023-12-22T09:15:41.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.931+0000 7f0ce4964640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0cc406a430 0x7f0cc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:41.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.932+0000 7f0ce4964640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0cc406a430 0x7f0cc406c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006fd0 tx=0x7f0cd0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:41.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:41.935+0000 7f0cd5ffb640 1 -- 172.21.15.106:0/1250615689 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0cdc075f30 con 0x7f0ce00bfba0 2023-12-22T09:15:42.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.162+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0ce00c60b0 con 0x7f0ce00bfba0 2023-12-22T09:15:42.164 INFO:tasks.ceph.mon.a.smithi106.stderr:2023-12-22T09:15:42.164+0000 7fe4c35b5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T09:15:42.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.179+0000 7f0cd5ffb640 1 -- 172.21.15.106:0/1250615689 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0cdc079550 con 0x7f0ce00bfba0 2023-12-22T09:15:42.179 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T09:15:42.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0cc406a430 msgr2=0x7f0cc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:42.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0cc406a430 0x7f0cc406c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006fd0 tx=0x7f0cd0008040 comp rx=0 tx=0).stop 2023-12-22T09:15:42.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00bfba0 msgr2=0x7f0ce00c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:42.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00bfba0 0x7f0ce00c40b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009890 tx=0x7f0cdc0046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:42.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 shutdown_connections 2023-12-22T09:15:42.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0cc406a430 0x7f0cc406c8f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:42.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ce00c2760 0x7f0ce0130b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:42.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce00c1ea0 0x7f0ce01535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:42.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 --2- 172.21.15.106:0/1250615689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ce00bfba0 0x7f0ce00c40b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:42.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.182+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 >> 172.21.15.106:0/1250615689 conn(0x7f0ce0069bf0 msgr2=0x7f0ce00aac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:42.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.183+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 shutdown_connections 2023-12-22T09:15:42.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.183+0000 7f0ce6167640 1 -- 172.21.15.106:0/1250615689 wait complete. 2023-12-22T09:15:42.200 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T09:15:42.205 INFO:tasks.ceph.mds.b.smithi132.stderr: -4039> 2023-12-22T09:14:29.391+0000 7f077d07c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T09:15:42.284 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-12-22T09:15:42.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.415+0000 7fcecd94e640 1 Processor -- start 2023-12-22T09:15:42.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.416+0000 7fcecd94e640 1 -- start start 2023-12-22T09:15:42.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcecd94e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcec815b610 0x7fcec8158470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:42.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcecd94e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec80c14f0 con 0x7fcec80c07a0 2023-12-22T09:15:42.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcecd94e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec815baa0 con 0x7fcec80bff20 2023-12-22T09:15:42.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcecd94e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec815c620 con 0x7fcec815b610 2023-12-22T09:15:42.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcec67fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcec815b610 0x7fcec8158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:42.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcec77fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcec80c07a0 0x7fcec81589b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33190/0 (socket says 172.21.15.106:33190) 2023-12-22T09:15:42.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcec77fe640 1 -- 172.21.15.106:0/3535808906 learned_addr learned my addr 172.21.15.106:0/3535808906 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:42.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcec67fc640 1 -- 172.21.15.106:0/3535808906 >> v1:172.21.15.132:6789/0 conn(0x7fcec80bff20 legacy=0x7fcec8155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:42.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcec67fc640 1 -- 172.21.15.106:0/3535808906 >> v1:172.21.15.106:6789/0 conn(0x7fcec80c07a0 legacy=0x7fcec81589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:42.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.418+0000 7fcec67fc640 1 -- 172.21.15.106:0/3535808906 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec815bd80 con 0x7fcec815b610 2023-12-22T09:15:42.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.420+0000 7fcec67fc640 1 --2- 172.21.15.106:0/3535808906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec815b610 0x7fcec8158470 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0097a0 tx=0x7fcebc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10245e0e46a4ede7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:42.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.420+0000 7fcec5ffb640 1 -- 172.21.15.106:0/3535808906 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc02e070 con 0x7fcec815b610 2023-12-22T09:15:42.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.420+0000 7fcec5ffb640 1 -- 172.21.15.106:0/3535808906 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc0315a0 con 0x7fcec815b610 2023-12-22T09:15:42.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.420+0000 7fcec5ffb640 1 -- 172.21.15.106:0/3535808906 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc031930 con 0x7fcec815b610 2023-12-22T09:15:42.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.421+0000 7fcecd94e640 1 -- 172.21.15.106:0/3535808906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec815b610 msgr2=0x7fcec8158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:42.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.421+0000 7fcecd94e640 1 --2- 172.21.15.106:0/3535808906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec815b610 0x7fcec8158470 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0097a0 tx=0x7fcebc02b840 comp rx=0 tx=0).stop 2023-12-22T09:15:42.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.421+0000 7fcecd94e640 1 -- 172.21.15.106:0/3535808906 shutdown_connections 2023-12-22T09:15:42.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.421+0000 7fcecd94e640 1 --2- 172.21.15.106:0/3535808906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec815b610 0x7fcec8158470 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:42.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.421+0000 7fcecd94e640 1 -- 172.21.15.106:0/3535808906 >> 172.21.15.106:0/3535808906 conn(0x7fcec8069bf0 msgr2=0x7fcec8069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:42.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.421+0000 7fcecd94e640 1 -- 172.21.15.106:0/3535808906 shutdown_connections 2023-12-22T09:15:42.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.421+0000 7fcecd94e640 1 -- 172.21.15.106:0/3535808906 wait complete. 2023-12-22T09:15:42.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.422+0000 7fcecd94e640 1 Processor -- start 2023-12-22T09:15:42.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.423+0000 7fcecd94e640 1 -- start start 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.423+0000 7fcecd94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec80bff20 0x7fcec815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.423+0000 7fcecd94e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec80c07a0 0x7fcec80c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.423+0000 7fcecd94e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcec80c4c60 0x7fcec8141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.423+0000 7fcecd94e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80aa050 con 0x7fcec80c07a0 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcecd94e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c50e0 con 0x7fcec80bff20 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcecd94e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c3a30 con 0x7fcec80c4c60 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcec67fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec80c07a0 0x7fcec80c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcec67fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec80c07a0 0x7fcec80c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44976/0 (socket says 172.21.15.106:44976) 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcec67fc640 1 -- 172.21.15.106:0/3469853980 learned_addr learned my addr 172.21.15.106:0/3469853980 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcec67fc640 1 -- 172.21.15.106:0/3469853980 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcec80c4c60 msgr2=0x7fcec8141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcec67fc640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcec80c4c60 0x7fcec8141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:42.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcec67fc640 1 -- 172.21.15.106:0/3469853980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec80bff20 msgr2=0x7fcec815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:42.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcec67fc640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec80bff20 0x7fcec815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:42.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcec67fc640 1 -- 172.21.15.106:0/3469853980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc009400 con 0x7fcec80c07a0 2023-12-22T09:15:42.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.424+0000 7fcec67fc640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec80c07a0 0x7fcec80c4720 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcebc000c00 tx=0x7fcebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:42.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.425+0000 7fceaffff640 1 -- 172.21.15.106:0/3469853980 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc032900 con 0x7fcec80c07a0 2023-12-22T09:15:42.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.425+0000 7fceaffff640 1 -- 172.21.15.106:0/3469853980 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc032a80 con 0x7fcec80c07a0 2023-12-22T09:15:42.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.425+0000 7fceaffff640 1 -- 172.21.15.106:0/3469853980 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc032e30 con 0x7fcec80c07a0 2023-12-22T09:15:42.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.425+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec80a8500 con 0x7fcec80c07a0 2023-12-22T09:15:42.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.425+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec80c3f20 con 0x7fcec80c07a0 2023-12-22T09:15:42.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.426+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec8073f10 con 0x7fcec80c07a0 2023-12-22T09:15:42.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.427+0000 7fceaffff640 1 -- 172.21.15.106:0/3469853980 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcebc03b3f0 con 0x7fcec80c07a0 2023-12-22T09:15:42.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.428+0000 7fceaffff640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fceb406a430 0x7fceb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:42.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.429+0000 7fceaffff640 1 -- 172.21.15.106:0/3469853980 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fcebc0aaea0 con 0x7fcec80c07a0 2023-12-22T09:15:42.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.429+0000 7fcec6ffd640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fceb406a430 0x7fceb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:42.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.429+0000 7fcec6ffd640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fceb406a430 0x7fceb406c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcec8145ca0 tx=0x7fceb8007a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:42.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.433+0000 7fceaffff640 1 -- 172.21.15.106:0/3469853980 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcebc075fe0 con 0x7fcec80c07a0 2023-12-22T09:15:42.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:42.660+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcec80bf760 con 0x7fcec80c07a0 2023-12-22T09:15:43.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.191+0000 7fceaffff640 1 -- 172.21.15.106:0/3469853980 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcebc079600 con 0x7fcec80c07a0 2023-12-22T09:15:43.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fceb406a430 msgr2=0x7fceb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:43.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fceb406a430 0x7fceb406c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcec8145ca0 tx=0x7fceb8007a00 comp rx=0 tx=0).stop 2023-12-22T09:15:43.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec80c07a0 msgr2=0x7fcec80c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:43.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec80c07a0 0x7fcec80c4720 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcebc000c00 tx=0x7fcebc0046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 shutdown_connections 2023-12-22T09:15:43.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fceb406a430 0x7fceb406c8f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcec80c4c60 0x7fcec8141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec80c07a0 0x7fcec80c4720 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 --2- 172.21.15.106:0/3469853980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec80bff20 0x7fcec815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 >> 172.21.15.106:0/3469853980 conn(0x7fcec8069bf0 msgr2=0x7fcec806d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:43.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 shutdown_connections 2023-12-22T09:15:43.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.194+0000 7fcecd94e640 1 -- 172.21.15.106:0/3469853980 wait complete. 2023-12-22T09:15:43.214 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T09:15:43.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.433+0000 7f489de38640 1 Processor -- start 2023-12-22T09:15:43.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.434+0000 7f489de38640 1 -- start start 2023-12-22T09:15:43.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.435+0000 7f489de38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 0x7f48980c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:43.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.435+0000 7f489de38640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f48980c75b0 0x7f48981540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:43.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.435+0000 7f489de38640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4898157430 con 0x7f48980c6b50 2023-12-22T09:15:43.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.435+0000 7f489de38640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4898151920 con 0x7f48980c75b0 2023-12-22T09:15:43.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.435+0000 7f489de38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4898157710 con 0x7f4898151540 2023-12-22T09:15:43.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.436+0000 7f4896ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f48980c75b0 0x7f48981540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:43.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.436+0000 7f4897fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f48980c6b50 0x7f4898154630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34588/0 (socket says 172.21.15.106:34588) 2023-12-22T09:15:43.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.436+0000 7f4897fff640 1 -- 172.21.15.106:0/1964375768 learned_addr learned my addr 172.21.15.106:0/1964375768 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:43.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.436+0000 7f48977fe640 1 --2- 172.21.15.106:0/1964375768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 0x7f48980c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:43.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.436+0000 7f4896ffd640 1 -- 172.21.15.106:0/1964375768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 msgr2=0x7f48980c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:43.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.436+0000 7f4896ffd640 1 --2- 172.21.15.106:0/1964375768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 0x7f48980c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.436+0000 7f4896ffd640 1 -- 172.21.15.106:0/1964375768 >> v1:172.21.15.106:6789/0 conn(0x7f48980c6b50 legacy=0x7f4898154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:43.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.436+0000 7f4896ffd640 1 -- 172.21.15.106:0/1964375768 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48981579f0 con 0x7f48980c75b0 2023-12-22T09:15:43.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.437+0000 7f4896ffd640 1 --2- 172.21.15.106:0/1964375768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c75b0 0x7f48981540f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4888009d90 tx=0x7f488802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8699a57589d0e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:43.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f48967fc640 1 -- 172.21.15.106:0/1964375768 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488802cbd0 con 0x7f48980c75b0 2023-12-22T09:15:43.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f48967fc640 1 -- 172.21.15.106:0/1964375768 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488802cd30 con 0x7f48980c75b0 2023-12-22T09:15:43.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f48967fc640 1 -- 172.21.15.106:0/1964375768 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488802cea0 con 0x7f48980c75b0 2023-12-22T09:15:43.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f489de38640 1 -- 172.21.15.106:0/1964375768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c75b0 msgr2=0x7f48981540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:43.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f489de38640 1 --2- 172.21.15.106:0/1964375768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c75b0 0x7f48981540f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4888009d90 tx=0x7f488802be20 comp rx=0 tx=0).stop 2023-12-22T09:15:43.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f489de38640 1 -- 172.21.15.106:0/1964375768 shutdown_connections 2023-12-22T09:15:43.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f489de38640 1 --2- 172.21.15.106:0/1964375768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c75b0 0x7f48981540f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f489de38640 1 --2- 172.21.15.106:0/1964375768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 0x7f48980c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f489de38640 1 -- 172.21.15.106:0/1964375768 >> 172.21.15.106:0/1964375768 conn(0x7f4898071740 msgr2=0x7f4898071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:43.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f489de38640 1 -- 172.21.15.106:0/1964375768 shutdown_connections 2023-12-22T09:15:43.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.438+0000 7f489de38640 1 -- 172.21.15.106:0/1964375768 wait complete. 2023-12-22T09:15:43.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.440+0000 7f489de38640 1 Processor -- start 2023-12-22T09:15:43.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.440+0000 7f489de38640 1 -- start start 2023-12-22T09:15:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.441+0000 7f489de38640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c6b50 0x7f4898148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.441+0000 7f489de38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48980c75b0 0x7f4898148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.441+0000 7f489de38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 0x7f48980adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.441+0000 7f489de38640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48980ac090 con 0x7f48980c6b50 2023-12-22T09:15:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.441+0000 7f489de38640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48981edc50 con 0x7f48980c75b0 2023-12-22T09:15:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.441+0000 7f489de38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48981ed720 con 0x7f4898151540 2023-12-22T09:15:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.441+0000 7f48977fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c6b50 0x7f4898148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.441+0000 7f48977fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c6b50 0x7f4898148940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40628/0 (socket says 172.21.15.106:40628) 2023-12-22T09:15:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f48977fe640 1 -- 172.21.15.106:0/3822729839 learned_addr learned my addr 172.21.15.106:0/3822729839 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f48977fe640 1 -- 172.21.15.106:0/3822729839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 msgr2=0x7f48980adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f4897fff640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 0x7f48980adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f4896ffd640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48980c75b0 0x7f4898148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f48977fe640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 0x7f48980adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f48977fe640 1 -- 172.21.15.106:0/3822729839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48980c75b0 msgr2=0x7f4898148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f48977fe640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48980c75b0 0x7f4898148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f48977fe640 1 -- 172.21.15.106:0/3822729839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4888009a70 con 0x7f48980c6b50 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f48977fe640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c6b50 0x7f4898148940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f488000d650 tx=0x7f488000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.442+0000 7f488ffff640 1 -- 172.21.15.106:0/3822729839 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000b6c0 con 0x7f48980c6b50 2023-12-22T09:15:43.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.443+0000 7f488ffff640 1 -- 172.21.15.106:0/3822729839 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488000b820 con 0x7f48980c6b50 2023-12-22T09:15:43.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.443+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48980aef70 con 0x7f48980c6b50 2023-12-22T09:15:43.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.443+0000 7f488ffff640 1 -- 172.21.15.106:0/3822729839 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000bbd0 con 0x7f48980c6b50 2023-12-22T09:15:43.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.443+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48980af210 con 0x7f48980c6b50 2023-12-22T09:15:43.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.444+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48980aedd0 con 0x7f48980c6b50 2023-12-22T09:15:43.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.445+0000 7f488ffff640 1 -- 172.21.15.106:0/3822729839 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f488000bd30 con 0x7f48980c6b50 2023-12-22T09:15:43.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.446+0000 7f488ffff640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f487806a430 0x7f487806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:43.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.446+0000 7f488ffff640 1 -- 172.21.15.106:0/3822729839 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4880089200 con 0x7f48980c6b50 2023-12-22T09:15:43.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.446+0000 7f4896ffd640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f487806a430 0x7f487806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:43.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.447+0000 7f4896ffd640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f487806a430 0x7f487806c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4888036000 tx=0x7f4888030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:43.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.450+0000 7f488ffff640 1 -- 172.21.15.106:0/3822729839 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f48980aedd0 con 0x7f48980c6b50 2023-12-22T09:15:43.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:43.654+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48980aedd0 con 0x7f48980c6b50 2023-12-22T09:15:44.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.196+0000 7f488ffff640 1 -- 172.21.15.106:0/3822729839 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f48980aedd0 con 0x7f48980c6b50 2023-12-22T09:15:44.196 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' removed 2023-12-22T09:15:44.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.200+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f487806a430 msgr2=0x7f487806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:44.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.200+0000 7f489de38640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f487806a430 0x7f487806c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4888036000 tx=0x7f4888030000 comp rx=0 tx=0).stop 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.200+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c6b50 msgr2=0x7f4898148940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.200+0000 7f489de38640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c6b50 0x7f4898148940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f488000d650 tx=0x7f488000db10 comp rx=0 tx=0).stop 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.201+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 shutdown_connections 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.201+0000 7f489de38640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f487806a430 0x7f487806c8f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.201+0000 7f489de38640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4898151540 0x7f48980adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.201+0000 7f489de38640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48980c75b0 0x7f4898148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.201+0000 7f489de38640 1 --2- 172.21.15.106:0/3822729839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48980c6b50 0x7f4898148940 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.201+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 >> 172.21.15.106:0/3822729839 conn(0x7f4898071740 msgr2=0x7f489814a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.201+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 shutdown_connections 2023-12-22T09:15:44.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.201+0000 7f489de38640 1 -- 172.21.15.106:0/3822729839 wait complete. 2023-12-22T09:15:44.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T09:15:44.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.438+0000 7fd0bbaca640 1 Processor -- start 2023-12-22T09:15:44.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.438+0000 7fd0bbaca640 1 -- start start 2023-12-22T09:15:44.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.439+0000 7fd0bbaca640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd0b406ac00 0x7fd0b406afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:44.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.439+0000 7fd0bbaca640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b406ecf0 con 0x7fd0b4154910 2023-12-22T09:15:44.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.439+0000 7fd0bbaca640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b4154da0 con 0x7fd0b40c1da0 2023-12-22T09:15:44.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.439+0000 7fd0bbaca640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b406e730 con 0x7fd0b406ac00 2023-12-22T09:15:44.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.440+0000 7fd0b9065640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd0b4154910 0x7fd0b4157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34596/0 (socket says 172.21.15.106:34596) 2023-12-22T09:15:44.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.440+0000 7fd0b9866640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd0b406ac00 0x7fd0b406afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:44.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.440+0000 7fd0b9065640 1 -- 172.21.15.106:0/649388112 learned_addr learned my addr 172.21.15.106:0/649388112 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:44.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.440+0000 7fd0b9866640 1 -- 172.21.15.106:0/649388112 >> v1:172.21.15.132:6789/0 conn(0x7fd0b40c1da0 legacy=0x7fd0b415e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:44.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.440+0000 7fd0b9866640 1 -- 172.21.15.106:0/649388112 >> v1:172.21.15.106:6789/0 conn(0x7fd0b4154910 legacy=0x7fd0b4157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:44.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.440+0000 7fd0b9866640 1 -- 172.21.15.106:0/649388112 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b406ea10 con 0x7fd0b406ac00 2023-12-22T09:15:44.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.440+0000 7fd0b8864640 1 -- 172.21.15.106:0/649388112 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469407304 0 0) 0x7fd0b406ecf0 con 0x7fd0b4154910 2023-12-22T09:15:44.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.441+0000 7fd0b9866640 1 --2- 172.21.15.106:0/649388112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b406ac00 0x7fd0b406afe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d90 tx=0x7fd0b002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27d2447e1c0bd36 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:44.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.441+0000 7fd0b8864640 1 -- 172.21.15.106:0/649388112 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b002cb40 con 0x7fd0b406ac00 2023-12-22T09:15:44.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.441+0000 7fd0b8864640 1 -- 172.21.15.106:0/649388112 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b002cca0 con 0x7fd0b406ac00 2023-12-22T09:15:44.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.441+0000 7fd0b8864640 1 -- 172.21.15.106:0/649388112 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0034660 con 0x7fd0b406ac00 2023-12-22T09:15:44.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.442+0000 7fd0bbaca640 1 -- 172.21.15.106:0/649388112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b406ac00 msgr2=0x7fd0b406afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:44.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.442+0000 7fd0bbaca640 1 --2- 172.21.15.106:0/649388112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b406ac00 0x7fd0b406afe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d90 tx=0x7fd0b002bd90 comp rx=0 tx=0).stop 2023-12-22T09:15:44.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.442+0000 7fd0bbaca640 1 -- 172.21.15.106:0/649388112 shutdown_connections 2023-12-22T09:15:44.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.442+0000 7fd0bbaca640 1 --2- 172.21.15.106:0/649388112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b406ac00 0x7fd0b406afe0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:44.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.442+0000 7fd0bbaca640 1 -- 172.21.15.106:0/649388112 >> 172.21.15.106:0/649388112 conn(0x7fd0b40c60f0 msgr2=0x7fd0b40c2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:44.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.442+0000 7fd0bbaca640 1 -- 172.21.15.106:0/649388112 shutdown_connections 2023-12-22T09:15:44.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.442+0000 7fd0bbaca640 1 -- 172.21.15.106:0/649388112 wait complete. 2023-12-22T09:15:44.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.444+0000 7fd0bbaca640 1 Processor -- start 2023-12-22T09:15:44.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.444+0000 7fd0bbaca640 1 -- start start 2023-12-22T09:15:44.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0bbaca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b406ac00 0x7fd0b4070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:44.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0bbaca640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0b40c1da0 0x7fd0b414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:44.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0bbaca640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b4071450 0x7fd0b40b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:44.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0bbaca640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b414c880 con 0x7fd0b4071450 2023-12-22T09:15:44.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0bbaca640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b414bd00 con 0x7fd0b406ac00 2023-12-22T09:15:44.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0bbaca640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b414bfe0 con 0x7fd0b40c1da0 2023-12-22T09:15:44.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0ba067640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b4071450 0x7fd0b40b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0ba067640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b4071450 0x7fd0b40b67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40640/0 (socket says 172.21.15.106:40640) 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0ba067640 1 -- 172.21.15.106:0/1711407940 learned_addr learned my addr 172.21.15.106:0/1711407940 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0b9866640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b406ac00 0x7fd0b4070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0ba067640 1 -- 172.21.15.106:0/1711407940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0b40c1da0 msgr2=0x7fd0b414fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0ba067640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0b40c1da0 0x7fd0b414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0ba067640 1 -- 172.21.15.106:0/1711407940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b406ac00 msgr2=0x7fd0b4070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0ba067640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b406ac00 0x7fd0b4070f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.445+0000 7fd0ba067640 1 -- 172.21.15.106:0/1711407940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b0009a70 con 0x7fd0b4071450 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.446+0000 7fd0ba067640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b4071450 0x7fd0b40b67b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c410 tx=0x7fd0ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:44.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.446+0000 7fd0aa7fc640 1 -- 172.21.15.106:0/1711407940 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac011790 con 0x7fd0b4071450 2023-12-22T09:15:44.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.446+0000 7fd0aa7fc640 1 -- 172.21.15.106:0/1711407940 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac0118f0 con 0x7fd0b4071450 2023-12-22T09:15:44.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.446+0000 7fd0aa7fc640 1 -- 172.21.15.106:0/1711407940 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac011ce0 con 0x7fd0b4071450 2023-12-22T09:15:44.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.446+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b414c2c0 con 0x7fd0b4071450 2023-12-22T09:15:44.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.446+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b414b990 con 0x7fd0b4071450 2023-12-22T09:15:44.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.447+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b41ec5c0 con 0x7fd0b4071450 2023-12-22T09:15:44.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.448+0000 7fd0aa7fc640 1 -- 172.21.15.106:0/1711407940 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd0ac01c460 con 0x7fd0b4071450 2023-12-22T09:15:44.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.449+0000 7fd0aa7fc640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd09806a430 0x7fd09806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:44.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.450+0000 7fd0aa7fc640 1 -- 172.21.15.106:0/1711407940 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fd0ac088830 con 0x7fd0b4071450 2023-12-22T09:15:44.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.450+0000 7fd0b9866640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd09806a430 0x7fd09806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:44.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.450+0000 7fd0b9866640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd09806a430 0x7fd09806c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0036000 tx=0x7fd0b0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.454+0000 7fd0aa7fc640 1 -- 172.21.15.106:0/1711407940 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd0b41ec5c0 con 0x7fd0b4071450 2023-12-22T09:15:44.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:44.648+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0b41ec5c0 con 0x7fd0b4071450 2023-12-22T09:15:45.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.202+0000 7fd0aa7fc640 1 -- 172.21.15.106:0/1711407940 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd0b41ec5c0 con 0x7fd0b4071450 2023-12-22T09:15:45.203 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' removed 2023-12-22T09:15:45.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd09806a430 msgr2=0x7fd09806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:45.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd09806a430 0x7fd09806c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0036000 tx=0x7fd0b0030000 comp rx=0 tx=0).stop 2023-12-22T09:15:45.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b4071450 msgr2=0x7fd0b40b67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:45.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b4071450 0x7fd0b40b67b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c410 tx=0x7fd0ac00c8d0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 shutdown_connections 2023-12-22T09:15:45.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd09806a430 0x7fd09806c8f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b4071450 0x7fd0b40b67b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0b40c1da0 0x7fd0b414fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 --2- 172.21.15.106:0/1711407940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0b406ac00 0x7fd0b4070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.210+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 >> 172.21.15.106:0/1711407940 conn(0x7fd0b40c60f0 msgr2=0x7fd0b4152930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:45.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.211+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 shutdown_connections 2023-12-22T09:15:45.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.211+0000 7fd0bbaca640 1 -- 172.21.15.106:0/1711407940 wait complete. 2023-12-22T09:15:45.234 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-22T09:15:45.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.425+0000 7f800128f640 1 Processor -- start 2023-12-22T09:15:45.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.426+0000 7f800128f640 1 -- start start 2023-12-22T09:15:45.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.427+0000 7f800128f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc151540 0x7f7ffc0c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:45.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.427+0000 7f800128f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7ffc0c75b0 0x7f7ffc1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:45.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.427+0000 7f800128f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc157430 con 0x7f7ffc0c6b50 2023-12-22T09:15:45.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.427+0000 7f800128f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ffc151920 con 0x7f7ffc0c75b0 2023-12-22T09:15:45.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.427+0000 7f800128f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc157710 con 0x7f7ffc151540 2023-12-22T09:15:45.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.428+0000 7f7ffaffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc151540 0x7f7ffc0c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:45.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.428+0000 7f7ff27fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7ffc0c75b0 0x7f7ffc1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:45.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.428+0000 7f7ff27fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7ffc0c75b0 0x7f7ffc1540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:60000/0 (socket says 172.21.15.106:60000) 2023-12-22T09:15:45.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.428+0000 7f7ff27fc640 1 -- 172.21.15.106:0/2996330376 learned_addr learned my addr 172.21.15.106:0/2996330376 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:45.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.428+0000 7f7ffaffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc151540 0x7f7ffc0c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:54614/0 (socket says 172.21.15.106:54614) 2023-12-22T09:15:45.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.429+0000 7f7ffaffd640 1 -- 172.21.15.106:0/2996330376 >> v2:172.21.15.132:3300/0 conn(0x7f7ffc0c75b0 msgr2=0x7f7ffc1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:45.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.429+0000 7f7ffaffd640 1 --2- 172.21.15.106:0/2996330376 >> v2:172.21.15.132:3300/0 conn(0x7f7ffc0c75b0 0x7f7ffc1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.429+0000 7f7ffaffd640 1 -- 172.21.15.106:0/2996330376 >> v1:172.21.15.132:6789/0 conn(0x7f7ffc0c6b50 legacy=0x7f7ffc154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:45.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.429+0000 7f7ffaffd640 1 -- 172.21.15.106:0/2996330376 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc1579f0 con 0x7f7ffc151540 2023-12-22T09:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.430+0000 7f7ffaffd640 1 --2- 172.21.15.106:0/2996330376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc151540 0x7f7ffc0c6610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7fec0097a0 tx=0x7f7fec02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df1c3285ec290c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:45.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.430+0000 7f7ffa7fc640 1 -- 172.21.15.106:0/2996330376 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec02e070 con 0x7f7ffc151540 2023-12-22T09:15:45.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.430+0000 7f7ffa7fc640 1 -- 172.21.15.106:0/2996330376 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec0315a0 con 0x7f7ffc151540 2023-12-22T09:15:45.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.430+0000 7f7ffa7fc640 1 -- 172.21.15.106:0/2996330376 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec031930 con 0x7f7ffc151540 2023-12-22T09:15:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.431+0000 7f800128f640 1 -- 172.21.15.106:0/2996330376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc151540 msgr2=0x7f7ffc0c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.431+0000 7f800128f640 1 --2- 172.21.15.106:0/2996330376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc151540 0x7f7ffc0c6610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7fec0097a0 tx=0x7f7fec02b840 comp rx=0 tx=0).stop 2023-12-22T09:15:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.431+0000 7f800128f640 1 -- 172.21.15.106:0/2996330376 shutdown_connections 2023-12-22T09:15:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.431+0000 7f800128f640 1 --2- 172.21.15.106:0/2996330376 >> v2:172.21.15.132:3300/0 conn(0x7f7ffc0c75b0 0x7f7ffc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.431+0000 7f800128f640 1 --2- 172.21.15.106:0/2996330376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc151540 0x7f7ffc0c6610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.431+0000 7f800128f640 1 -- 172.21.15.106:0/2996330376 >> 172.21.15.106:0/2996330376 conn(0x7f7ffc071740 msgr2=0x7f7ffc071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.431+0000 7f800128f640 1 -- 172.21.15.106:0/2996330376 shutdown_connections 2023-12-22T09:15:45.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.431+0000 7f800128f640 1 -- 172.21.15.106:0/2996330376 wait complete. 2023-12-22T09:15:45.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.432+0000 7f800128f640 1 Processor -- start 2023-12-22T09:15:45.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.433+0000 7f800128f640 1 -- start start 2023-12-22T09:15:45.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.433+0000 7f800128f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ffc0c6b50 0x7f7ffc0abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.433+0000 7f800128f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc0c75b0 0x7f7ffc152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.433+0000 7f800128f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ffc151540 0x7f7ffc146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.433+0000 7f800128f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc0aa350 con 0x7f7ffc151540 2023-12-22T09:15:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.433+0000 7f800128f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc0bd8d0 con 0x7f7ffc0c6b50 2023-12-22T09:15:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.433+0000 7f800128f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc0bdbb0 con 0x7f7ffc0c75b0 2023-12-22T09:15:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ffc151540 0x7f7ffc146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ffc151540 0x7f7ffc146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40646/0 (socket says 172.21.15.106:40646) 2023-12-22T09:15:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffb7fe640 1 -- 172.21.15.106:0/1870475011 learned_addr learned my addr 172.21.15.106:0/1870475011 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ff27fc640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc0c75b0 0x7f7ffc152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffaffd640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ffc0c6b50 0x7f7ffc0abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffb7fe640 1 -- 172.21.15.106:0/1870475011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc0c75b0 msgr2=0x7f7ffc152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffb7fe640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc0c75b0 0x7f7ffc152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffb7fe640 1 -- 172.21.15.106:0/1870475011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ffc0c6b50 msgr2=0x7f7ffc0abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffb7fe640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ffc0c6b50 0x7f7ffc0abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffb7fe640 1 -- 172.21.15.106:0/1870475011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec009400 con 0x7f7ffc151540 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.434+0000 7f7ffaffd640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ffc0c6b50 0x7f7ffc0abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.435+0000 7f7ffb7fe640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ffc151540 0x7f7ffc146800 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400c7a0 tx=0x7f7ff400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.435+0000 7f7ff3fff640 1 -- 172.21.15.106:0/1870475011 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4003b70 con 0x7f7ffc151540 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.435+0000 7f7ff3fff640 1 -- 172.21.15.106:0/1870475011 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff4003cf0 con 0x7f7ffc151540 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.435+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc0bde90 con 0x7f7ffc151540 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.435+0000 7f7ff3fff640 1 -- 172.21.15.106:0/1870475011 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4003ea0 con 0x7f7ffc151540 2023-12-22T09:15:45.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.435+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc153bf0 con 0x7f7ffc151540 2023-12-22T09:15:45.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.436+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc0aa550 con 0x7f7ffc151540 2023-12-22T09:15:45.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.437+0000 7f7ff3fff640 1 -- 172.21.15.106:0/1870475011 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7ff400aa90 con 0x7f7ffc151540 2023-12-22T09:15:45.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.438+0000 7f7ff3fff640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fdc06a460 0x7f7fdc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:45.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.438+0000 7f7ff3fff640 1 -- 172.21.15.106:0/1870475011 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f7ff4088780 con 0x7f7ffc151540 2023-12-22T09:15:45.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.438+0000 7f7ffaffd640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fdc06a460 0x7f7fdc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:45.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.439+0000 7f7ffaffd640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fdc06a460 0x7f7fdc06c920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7fec036000 tx=0x7f7fec03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:45.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.442+0000 7f7ff3fff640 1 -- 172.21.15.106:0/1870475011 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7ffc0aa550 con 0x7f7ffc151540 2023-12-22T09:15:45.629 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:45.630+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7ffc0aa550 con 0x7f7ffc151540 2023-12-22T09:15:46.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.227+0000 7f7ff3fff640 1 -- 172.21.15.106:0/1870475011 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f7ffc0aa550 con 0x7f7ffc151540 2023-12-22T09:15:46.227 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data_ec' removed 2023-12-22T09:15:46.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fdc06a460 msgr2=0x7f7fdc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:46.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fdc06a460 0x7f7fdc06c920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7fec036000 tx=0x7f7fec03d040 comp rx=0 tx=0).stop 2023-12-22T09:15:46.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ffc151540 msgr2=0x7f7ffc146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:46.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ffc151540 0x7f7ffc146800 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400c7a0 tx=0x7f7ff400cc60 comp rx=0 tx=0).stop 2023-12-22T09:15:46.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 shutdown_connections 2023-12-22T09:15:46.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fdc06a460 0x7f7fdc06c920 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ffc151540 0x7f7ffc146800 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7ffc0c75b0 0x7f7ffc152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 --2- 172.21.15.106:0/1870475011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ffc0c6b50 0x7f7ffc0abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.232+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 >> 172.21.15.106:0/1870475011 conn(0x7f7ffc071740 msgr2=0x7f7ffc0c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:46.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.233+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 shutdown_connections 2023-12-22T09:15:46.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.233+0000 7f800128f640 1 -- 172.21.15.106:0/1870475011 wait complete. 2023-12-22T09:15:46.255 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T09:15:46.255 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T09:15:46.255 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T09:15:46.255 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T09:15:46.255 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T09:15:46.255 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T09:15:46.256 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T09:15:46.256 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T09:15:46.256 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T09:15:46.256 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T09:15:46.256 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T09:15:46.256 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T09:15:46.256 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T09:15:46.257 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T09:15:46.257 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T09:15:46.257 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T09:15:46.272 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T09:15:46.273 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T09:15:46.274 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T09:15:46.274 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T09:15:46.277 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T09:15:46.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T09:15:46.280 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T09:15:46.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T09:15:46.326 INFO:tasks.ceph.mds.a:Started 2023-12-22T09:15:46.327 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:46.330 INFO:tasks.ceph.mds.d:Started 2023-12-22T09:15:46.330 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:46.337 INFO:tasks.ceph.mds.c:Started 2023-12-22T09:15:46.337 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:46.337 INFO:tasks.ceph.mds.b:Started 2023-12-22T09:15:46.338 DEBUG:teuthology.parallel:result is None 2023-12-22T09:15:46.338 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T09:15:46.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-22T09:15:46.484 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2023-12-22T09:15:46.487 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2023-12-22T09:15:46.488 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-12-22T09:15:46.488 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-12-22T09:15:46.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.521+0000 7fd9ae6a1640 1 Processor -- start 2023-12-22T09:15:46.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.521+0000 7fd9ae6a1640 1 -- start start 2023-12-22T09:15:46.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9ae6a1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9a81514b0 0x7fd9a80c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:46.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9ae6a1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd9a80c4130 0x7fd9a8154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:46.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9ae6a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a8154a80 0x7fd9a80c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:46.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9ae6a1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a80c4660 con 0x7fd9a80c4130 2023-12-22T09:15:46.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9ae6a1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a8153d60 con 0x7fd9a81514b0 2023-12-22T09:15:46.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9ae6a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a806b250 con 0x7fd9a8154a80 2023-12-22T09:15:46.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9a77fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd9a80c4130 0x7fd9a8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:46.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9a7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9a81514b0 0x7fd9a80c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:46.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9a77fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd9a80c4130 0x7fd9a8154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40676/0 (socket says 172.21.15.106:40676) 2023-12-22T09:15:46.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.522+0000 7fd9a77fe640 1 -- 172.21.15.106:0/1337327065 learned_addr learned my addr 172.21.15.106:0/1337327065 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:46.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.523+0000 7fd9acc3e640 1 --2- 172.21.15.106:0/1337327065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a8154a80 0x7fd9a80c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.523+0000 7fd9a77fe640 1 -- 172.21.15.106:0/1337327065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a8154a80 msgr2=0x7fd9a80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.523+0000 7fd9a77fe640 1 --2- 172.21.15.106:0/1337327065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a8154a80 0x7fd9a80c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.523+0000 7fd9a77fe640 1 -- 172.21.15.106:0/1337327065 >> v2:172.21.15.132:3300/0 conn(0x7fd9a81514b0 msgr2=0x7fd9a80c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.523+0000 7fd9a77fe640 1 --2- 172.21.15.106:0/1337327065 >> v2:172.21.15.132:3300/0 conn(0x7fd9a81514b0 0x7fd9a80c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.523+0000 7fd9a77fe640 1 -- 172.21.15.106:0/1337327065 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a806b530 con 0x7fd9a80c4130 2023-12-22T09:15:46.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.523+0000 7fd9a7fff640 1 --2- 172.21.15.106:0/1337327065 >> v2:172.21.15.132:3300/0 conn(0x7fd9a81514b0 0x7fd9a80c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:46.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.524+0000 7fd9a77fe640 1 --2- 172.21.15.106:0/1337327065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a80c4130 0x7fd9a8154540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80668d0 tx=0x7fd99c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb7f541e3b10f9c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:46.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.525+0000 7fd9a6ffd640 1 -- 172.21.15.106:0/1337327065 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0317e0 con 0x7fd9a80c4130 2023-12-22T09:15:46.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.525+0000 7fd9a6ffd640 1 -- 172.21.15.106:0/1337327065 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c031940 con 0x7fd9a80c4130 2023-12-22T09:15:46.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.525+0000 7fd9a6ffd640 1 -- 172.21.15.106:0/1337327065 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c031cd0 con 0x7fd9a80c4130 2023-12-22T09:15:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.525+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/1337327065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a80c4130 msgr2=0x7fd9a8154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.525+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/1337327065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a80c4130 0x7fd9a8154540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80668d0 tx=0x7fd99c02b880 comp rx=0 tx=0).stop 2023-12-22T09:15:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.525+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/1337327065 shutdown_connections 2023-12-22T09:15:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.526+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/1337327065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a8154a80 0x7fd9a80c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.526+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/1337327065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a80c4130 0x7fd9a8154540 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.526+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/1337327065 >> v2:172.21.15.132:3300/0 conn(0x7fd9a81514b0 0x7fd9a80c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.526+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/1337327065 >> 172.21.15.106:0/1337327065 conn(0x7fd9a80ab1a0 msgr2=0x7fd9a80ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.526+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/1337327065 shutdown_connections 2023-12-22T09:15:46.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.526+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/1337327065 wait complete. 2023-12-22T09:15:46.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.527+0000 7fd9ae6a1640 1 Processor -- start 2023-12-22T09:15:46.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.527+0000 7fd9ae6a1640 1 -- start start 2023-12-22T09:15:46.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.528+0000 7fd9ae6a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a80c4130 0x7fd9a80c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.528+0000 7fd9ae6a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a81514b0 0x7fd9a814ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.528+0000 7fd9ae6a1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a814f1f0 0x7fd9a81482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.528+0000 7fd9ae6a1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a8147490 con 0x7fd9a814f1f0 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.528+0000 7fd9ae6a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a814f670 con 0x7fd9a81514b0 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.528+0000 7fd9ae6a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a814f860 con 0x7fd9a80c4130 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.528+0000 7fd9acc3e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a814f1f0 0x7fd9a81482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.528+0000 7fd9acc3e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a814f1f0 0x7fd9a81482a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40688/0 (socket says 172.21.15.106:40688) 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.528+0000 7fd9acc3e640 1 -- 172.21.15.106:0/538993998 learned_addr learned my addr 172.21.15.106:0/538993998 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.529+0000 7fd9a77fe640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a81514b0 0x7fd9a814ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.529+0000 7fd9a7fff640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a80c4130 0x7fd9a80c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:46.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.529+0000 7fd9acc3e640 1 -- 172.21.15.106:0/538993998 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a80c4130 msgr2=0x7fd9a80c09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:46.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.529+0000 7fd9acc3e640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a80c4130 0x7fd9a80c09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.529+0000 7fd9acc3e640 1 -- 172.21.15.106:0/538993998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a81514b0 msgr2=0x7fd9a814ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:46.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.529+0000 7fd9acc3e640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a81514b0 0x7fd9a814ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:46.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.529+0000 7fd9acc3e640 1 -- 172.21.15.106:0/538993998 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009400 con 0x7fd9a814f1f0 2023-12-22T09:15:46.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.529+0000 7fd9acc3e640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a814f1f0 0x7fd9a81482a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000efc0 tx=0x7fd9a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:46.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.532+0000 7fd9a4ff9640 1 -- 172.21.15.106:0/538993998 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0009b20 con 0x7fd9a814f1f0 2023-12-22T09:15:46.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.532+0000 7fd9a4ff9640 1 -- 172.21.15.106:0/538993998 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a000f040 con 0x7fd9a814f1f0 2023-12-22T09:15:46.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.532+0000 7fd9a4ff9640 1 -- 172.21.15.106:0/538993998 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00146c0 con 0x7fd9a814f1f0 2023-12-22T09:15:46.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.532+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99c0094d0 con 0x7fd9a814f1f0 2023-12-22T09:15:46.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.532+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a814fe20 con 0x7fd9a814f1f0 2023-12-22T09:15:46.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.534+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a8073f10 con 0x7fd9a814f1f0 2023-12-22T09:15:46.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.534+0000 7fd9a4ff9640 1 -- 172.21.15.106:0/538993998 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd9a0014820 con 0x7fd9a814f1f0 2023-12-22T09:15:46.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.535+0000 7fd9a4ff9640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd99406a480 0x7fd99406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:46.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.535+0000 7fd9a4ff9640 1 -- 172.21.15.106:0/538993998 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd9a00891f0 con 0x7fd9a814f1f0 2023-12-22T09:15:46.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.536+0000 7fd9a7fff640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd99406a480 0x7fd99406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:46.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.536+0000 7fd9a7fff640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd99406a480 0x7fd99406c940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd9980093d0 tx=0x7fd998009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:46.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.540+0000 7fd9a4ff9640 1 -- 172.21.15.106:0/538993998 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd9a0054bc0 con 0x7fd9a814f1f0 2023-12-22T09:15:46.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:46.729+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd9a81544c0 con 0x7fd9a814f1f0 2023-12-22T09:15:47.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.551+0000 7fd9a4ff9640 1 -- 172.21.15.106:0/538993998 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd9a0009e60 con 0x7fd9a814f1f0 2023-12-22T09:15:47.551 INFO:teuthology.orchestra.run.smithi106.stderr: removed all blocklist entries 2023-12-22T09:15:47.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.554+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd99406a480 msgr2=0x7fd99406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:47.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.554+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd99406a480 0x7fd99406c940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd9980093d0 tx=0x7fd998009190 comp rx=0 tx=0).stop 2023-12-22T09:15:47.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.554+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a814f1f0 msgr2=0x7fd9a81482a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:47.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.554+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a814f1f0 0x7fd9a81482a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000efc0 tx=0x7fd9a000c490 comp rx=0 tx=0).stop 2023-12-22T09:15:47.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.555+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 shutdown_connections 2023-12-22T09:15:47.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.555+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd99406a480 0x7fd99406c940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.555+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9a814f1f0 0x7fd9a81482a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.555+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a81514b0 0x7fd9a814ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.555+0000 7fd9ae6a1640 1 --2- 172.21.15.106:0/538993998 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9a80c4130 0x7fd9a80c09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.555+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 >> 172.21.15.106:0/538993998 conn(0x7fd9a80ab1a0 msgr2=0x7fd9a8152260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:47.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.555+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 shutdown_connections 2023-12-22T09:15:47.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.555+0000 7fd9ae6a1640 1 -- 172.21.15.106:0/538993998 wait complete. 2023-12-22T09:15:47.573 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T09:15:47.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.779+0000 7fb6c2019640 1 Processor -- start 2023-12-22T09:15:47.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.779+0000 7fb6c2019640 1 -- start start 2023-12-22T09:15:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.781+0000 7fb6c2019640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb6bc069e60 0x7fb6bc13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.781+0000 7fb6c2019640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc157c80 0x7fb6bc13d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.781+0000 7fb6c2019640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc153e90 con 0x7fb6bc0be700 2023-12-22T09:15:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.781+0000 7fb6c2019640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc153c80 con 0x7fb6bc069e60 2023-12-22T09:15:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.781+0000 7fb6c2019640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc158240 con 0x7fb6bc157c80 2023-12-22T09:15:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.781+0000 7fb6bb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb6bc069e60 0x7fb6bc13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.781+0000 7fb6baffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc157c80 0x7fb6bc13d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.782+0000 7fb6baffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc157c80 0x7fb6bc13d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:54668/0 (socket says 172.21.15.106:54668) 2023-12-22T09:15:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.782+0000 7fb6baffd640 1 -- 172.21.15.106:0/2039968666 learned_addr learned my addr 172.21.15.106:0/2039968666 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.782+0000 7fb6bb7fe640 1 -- 172.21.15.106:0/2039968666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc157c80 msgr2=0x7fb6bc13d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.782+0000 7fb6bb7fe640 1 --2- 172.21.15.106:0/2039968666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc157c80 0x7fb6bc13d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.782+0000 7fb6bb7fe640 1 -- 172.21.15.106:0/2039968666 >> v1:172.21.15.132:6789/0 conn(0x7fb6bc0be700 legacy=0x7fb6bc070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.782+0000 7fb6bb7fe640 1 -- 172.21.15.106:0/2039968666 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc154c10 con 0x7fb6bc069e60 2023-12-22T09:15:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.782+0000 7fb6baffd640 1 --2- 172.21.15.106:0/2039968666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc157c80 0x7fb6bc13d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:47.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.784+0000 7fb6bb7fe640 1 --2- 172.21.15.106:0/2039968666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc069e60 0x7fb6bc13cc70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009790 tx=0x7fb6ac02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61897240073372cb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.784+0000 7fb6ba7fc640 1 -- 172.21.15.106:0/2039968666 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac02d040 con 0x7fb6bc069e60 2023-12-22T09:15:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.784+0000 7fb6ba7fc640 1 -- 172.21.15.106:0/2039968666 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac031810 con 0x7fb6bc069e60 2023-12-22T09:15:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.784+0000 7fb6ba7fc640 1 -- 172.21.15.106:0/2039968666 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac031ba0 con 0x7fb6bc069e60 2023-12-22T09:15:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.785+0000 7fb6c2019640 1 -- 172.21.15.106:0/2039968666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc069e60 msgr2=0x7fb6bc13cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.785+0000 7fb6c2019640 1 --2- 172.21.15.106:0/2039968666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc069e60 0x7fb6bc13cc70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009790 tx=0x7fb6ac02b8b0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.785+0000 7fb6c2019640 1 -- 172.21.15.106:0/2039968666 shutdown_connections 2023-12-22T09:15:47.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.785+0000 7fb6c2019640 1 --2- 172.21.15.106:0/2039968666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc157c80 0x7fb6bc13d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.785+0000 7fb6c2019640 1 --2- 172.21.15.106:0/2039968666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc069e60 0x7fb6bc13cc70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.785+0000 7fb6c2019640 1 -- 172.21.15.106:0/2039968666 >> 172.21.15.106:0/2039968666 conn(0x7fb6bc0c5360 msgr2=0x7fb6bc0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:47.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.785+0000 7fb6c2019640 1 -- 172.21.15.106:0/2039968666 shutdown_connections 2023-12-22T09:15:47.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.785+0000 7fb6c2019640 1 -- 172.21.15.106:0/2039968666 wait complete. 2023-12-22T09:15:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.787+0000 7fb6c2019640 1 Processor -- start 2023-12-22T09:15:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.787+0000 7fb6c2019640 1 -- start start 2023-12-22T09:15:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.788+0000 7fb6c2019640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc069e60 0x7fb6bc135640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.788+0000 7fb6c2019640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc0be700 0x7fb6bc0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6c2019640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6bc157c80 0x7fb6bc0c0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6c2019640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc135b80 con 0x7fb6bc157c80 2023-12-22T09:15:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6c2019640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc156460 con 0x7fb6bc0be700 2023-12-22T09:15:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6c2019640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc156740 con 0x7fb6bc069e60 2023-12-22T09:15:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bbfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6bc157c80 0x7fb6bc0c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bbfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6bc157c80 0x7fb6bc0c0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40702/0 (socket says 172.21.15.106:40702) 2023-12-22T09:15:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bbfff640 1 -- 172.21.15.106:0/1207374611 learned_addr learned my addr 172.21.15.106:0/1207374611 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:47.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bb7fe640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc069e60 0x7fb6bc135640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:47.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6baffd640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc0be700 0x7fb6bc0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:47.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bbfff640 1 -- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc069e60 msgr2=0x7fb6bc135640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:47.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bbfff640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc069e60 0x7fb6bc135640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bbfff640 1 -- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc0be700 msgr2=0x7fb6bc0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:47.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bbfff640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc0be700 0x7fb6bc0c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:47.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bbfff640 1 -- 172.21.15.106:0/1207374611 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b00094d0 con 0x7fb6bc157c80 2023-12-22T09:15:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6bb7fe640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc069e60 0x7fb6bc135640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.789+0000 7fb6baffd640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc0be700 0x7fb6bc0c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.790+0000 7fb6bbfff640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6bc157c80 0x7fb6bc0c0800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400c7a0 tx=0x7fb6b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.790+0000 7fb6a3fff640 1 -- 172.21.15.106:0/1207374611 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4003b70 con 0x7fb6bc157c80 2023-12-22T09:15:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.790+0000 7fb6a3fff640 1 -- 172.21.15.106:0/1207374611 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4003cf0 con 0x7fb6bc157c80 2023-12-22T09:15:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.790+0000 7fb6a3fff640 1 -- 172.21.15.106:0/1207374611 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4003ea0 con 0x7fb6bc157c80 2023-12-22T09:15:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.790+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac0093a0 con 0x7fb6bc157c80 2023-12-22T09:15:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.790+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc135120 con 0x7fb6bc157c80 2023-12-22T09:15:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.791+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc134ca0 con 0x7fb6bc157c80 2023-12-22T09:15:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.792+0000 7fb6a3fff640 1 -- 172.21.15.106:0/1207374611 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb6b400aa90 con 0x7fb6bc157c80 2023-12-22T09:15:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.794+0000 7fb6a3fff640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6a806a430 0x7fb6a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.794+0000 7fb6a3fff640 1 -- 172.21.15.106:0/1207374611 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb6b4088550 con 0x7fb6bc157c80 2023-12-22T09:15:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.794+0000 7fb6bb7fe640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6a806a430 0x7fb6a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.795+0000 7fb6bb7fe640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6a806a430 0x7fb6a806c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac036000 tx=0x7fb6ac03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:47.798+0000 7fb6a3fff640 1 -- 172.21.15.106:0/1207374611 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb6bc134ca0 con 0x7fb6bc157c80 2023-12-22T09:15:48.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.060+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb6bc1546d0 con 0x7fb6bc157c80 2023-12-22T09:15:48.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.061+0000 7fb6a3fff640 1 -- 172.21.15.106:0/1207374611 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) v1 ==== 80+0+6065 (secure 0 0 0) 0x7fb6bc1546d0 con 0x7fb6bc157c80 2023-12-22T09:15:48.060 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:48.060 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-12-22T09:15:48.060 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_dump": [ 2023-12-22T09:15:48.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.a", 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQAzU4VlwWkqLxAApz1giF6+ha0K7ztx/4TxuA==", 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.b", 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA0U4VlZGlkFRAAlhOp8GuimPn+NUbxP7ZllQ==", 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.061 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.c", 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA0U4VlNW78AxAAtjjvQMtyKLXjO553rvgbzg==", 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.062 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.d", 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA0U4VlUtEPJhAA3bcdbWblGawtQSyE26PH9A==", 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.0", 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA5U4VlZj6+ChAAgUGYECmhf7VMz7jptVK6kg==", 2023-12-22T09:15:48.063 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.1", 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA8U4VlC5/yFRAAOCUCyRLUmz+2agqeuZvQmQ==", 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.2", 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA/U4Vln1YGLxAA8/8yn/FrMvPmQjohk/Yuag==", 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.3", 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBCU4Vl0m1gORAA4j0GIYcQmoWPOiWeDXme+w==", 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:15:48.065 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.4", 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBKU4VlC/kABxAAXafE0YIVbfH0+PwzNYZ6cA==", 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.5", 2023-12-22T09:15:48.066 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBNU4VlrO2bERAAvVCV9iET01m3JXQ71+IO+w==", 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.6", 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBQU4Vl1qE9GxAANLGc1YGoglBh6qkE6vCFCA==", 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.067 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.7", 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBTU4Vl5YYMJBAAoxMjGGh5W1Ov5y4ZkvmoGg==", 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.0", 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA0U4Vl+O39MxAAKadHlnvSTbHMtmqYe65N8w==", 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.068 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.1", 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA1U4VlrsGyAxAAMbxdEGSzUNtfZVI5FP8Llw==", 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2023-12-22T09:15:48.069 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.admin", 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQAyU4VleSnvHBAAImfeNYxKIbmkFRJYEkBBxQ==", 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mds", 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBbU4VlvaujMxAAmjBsTA7FIzxNVIlVcpkOcw==", 2023-12-22T09:15:48.070 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mds" 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mgr", 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBbU4VlV7WjMxAAidy1EleC8VP74hdOU1bkMA==", 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-osd", 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBbU4Vl272jMxAAfA3txWsd41SHCHfbMrOnLA==", 2023-12-22T09:15:48.071 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-osd" 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd", 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBbU4VlIMajMxAAydskDt6bCuRmY7/MACVTow==", 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBbU4Vl4s6jMxAAzIUDoaUrOX7kJHjpnJ9UYg==", 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.072 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rgw", 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBbU4VlbdejMxAAIlTYE0WSez4JiN7mrZxU8g==", 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.x", 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQAzU4Vl9kj8IhAA0uOah8x3KUQ+6skT+MpbwQ==", 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2023-12-22T09:15:48.073 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.y", 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQAzU4VlNjb0ExAAVGE9vTIVcmlv6k9ayU0aWA==", 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-12-22T09:15:48.074 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-12-22T09:15:48.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.063+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6a806a430 msgr2=0x7fb6a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.063+0000 7fb6c2019640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6a806a430 0x7fb6a806c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac036000 tx=0x7fb6ac03c040 comp rx=0 tx=0).stop 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.063+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6bc157c80 msgr2=0x7fb6bc0c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.063+0000 7fb6c2019640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6bc157c80 0x7fb6bc0c0800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400c7a0 tx=0x7fb6b400cc60 comp rx=0 tx=0).stop 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.063+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 shutdown_connections 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.064+0000 7fb6c2019640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6a806a430 0x7fb6a806c8f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.064+0000 7fb6c2019640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6bc157c80 0x7fb6bc0c0800 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.064+0000 7fb6c2019640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6bc0be700 0x7fb6bc0c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.064+0000 7fb6c2019640 1 --2- 172.21.15.106:0/1207374611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6bc069e60 0x7fb6bc135640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.064+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 >> 172.21.15.106:0/1207374611 conn(0x7fb6bc0c5360 msgr2=0x7fb6bc070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.064+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 shutdown_connections 2023-12-22T09:15:48.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.064+0000 7fb6c2019640 1 -- 172.21.15.106:0/1207374611 wait complete. 2023-12-22T09:15:48.081 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-22T09:15:48.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.293+0000 7ff28bffd640 1 Processor -- start 2023-12-22T09:15:48.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.293+0000 7ff28bffd640 1 -- start start 2023-12-22T09:15:48.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.295+0000 7ff28bffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2840bfce0 0x7ff28406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.295+0000 7ff28bffd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2840bf770 con 0x7ff28413b060 2023-12-22T09:15:48.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.295+0000 7ff28bffd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff284155120 con 0x7ff284151b30 2023-12-22T09:15:48.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.295+0000 7ff28bffd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff284155400 con 0x7ff2840bfce0 2023-12-22T09:15:48.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.295+0000 7ff289d99640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff28413b060 0x7ff284069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34626/0 (socket says 172.21.15.106:34626) 2023-12-22T09:15:48.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.295+0000 7ff289d99640 1 -- 172.21.15.106:0/667114590 learned_addr learned my addr 172.21.15.106:0/667114590 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:48.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.295+0000 7ff289598640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2840bfce0 0x7ff28406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.295+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47849885 0 0) 0x7ff2840bf770 con 0x7ff28413b060 2023-12-22T09:15:48.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff270003520 con 0x7ff28413b060 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2226441330 0 0) 0x7ff270003520 con 0x7ff28413b060 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2840bfce0 msgr2=0x7ff28406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2840bfce0 0x7ff28406a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 >> v1:172.21.15.132:6789/0 conn(0x7ff284151b30 legacy=0x7ff284151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2841556e0 con 0x7ff28413b060 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7ff2800017f0 con 0x7ff28413b060 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 >> v1:172.21.15.106:6789/0 conn(0x7ff28413b060 legacy=0x7ff284069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2840bfce0 0x7ff2700039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff270003f20 0x7ff2700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff270004d00 0x7ff270005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284155400 con 0x7ff270004d00 2023-12-22T09:15:48.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27000bb10 con 0x7ff270003f20 2023-12-22T09:15:48.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27000bcd0 con 0x7ff2840bfce0 2023-12-22T09:15:48.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.296+0000 7ff28a59a640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff270004d00 0x7ff270005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.297+0000 7ff289598640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff270003f20 0x7ff2700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.297+0000 7ff289d99640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2840bfce0 0x7ff2700039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.297+0000 7ff28a59a640 1 -- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2840bfce0 msgr2=0x7ff2700039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:48.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.297+0000 7ff28a59a640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2840bfce0 0x7ff2700039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.297+0000 7ff28a59a640 1 -- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff270003f20 msgr2=0x7ff2700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:48.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.297+0000 7ff28a59a640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff270003f20 0x7ff2700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.297+0000 7ff28a59a640 1 -- 172.21.15.106:0/667114590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270003520 con 0x7ff270004d00 2023-12-22T09:15:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.298+0000 7ff28a59a640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff270004d00 0x7ff270005180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff27c001e50 tx=0x7ff2700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a4808bb9583921 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.298+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c003b70 con 0x7ff270004d00 2023-12-22T09:15:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.298+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c003cd0 con 0x7ff270004d00 2023-12-22T09:15:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.298+0000 7ff288d97640 1 -- 172.21.15.106:0/667114590 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c005310 con 0x7ff270004d00 2023-12-22T09:15:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.299+0000 7ff28bffd640 1 -- 172.21.15.106:0/667114590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff270004d00 msgr2=0x7ff270005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.299+0000 7ff28bffd640 1 --2- 172.21.15.106:0/667114590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff270004d00 0x7ff270005180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff27c001e50 tx=0x7ff2700057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.299+0000 7ff28a59a640 1 -- 172.21.15.106:0/667114590 reap_dead start 2023-12-22T09:15:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.299+0000 7ff28bffd640 1 -- 172.21.15.106:0/667114590 shutdown_connections 2023-12-22T09:15:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.299+0000 7ff28bffd640 1 -- 172.21.15.106:0/667114590 >> 172.21.15.106:0/667114590 conn(0x7ff2840c5360 msgr2=0x7ff2840c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.299+0000 7ff28bffd640 1 -- 172.21.15.106:0/667114590 shutdown_connections 2023-12-22T09:15:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.299+0000 7ff28bffd640 1 -- 172.21.15.106:0/667114590 wait complete. 2023-12-22T09:15:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.301+0000 7ff28bffd640 1 Processor -- start 2023-12-22T09:15:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.301+0000 7ff28bffd640 1 -- start start 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff28bffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff270004d00 0x7ff2840712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff28bffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff284070930 0x7ff2841322b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff28bffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2841327f0 0x7ff284153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff28bffd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284135ec0 con 0x7ff284070930 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff28bffd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28413a920 con 0x7ff270004d00 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff28bffd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28414fcd0 con 0x7ff2841327f0 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff289598640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff284070930 0x7ff2841322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff289598640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff284070930 0x7ff2841322b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40718/0 (socket says 172.21.15.106:40718) 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff289598640 1 -- 172.21.15.106:0/347686780 learned_addr learned my addr 172.21.15.106:0/347686780 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:48.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff289598640 1 -- 172.21.15.106:0/347686780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2841327f0 msgr2=0x7ff284153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff289598640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2841327f0 0x7ff284153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff289598640 1 -- 172.21.15.106:0/347686780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff270004d00 msgr2=0x7ff2840712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff289598640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff270004d00 0x7ff2840712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.302+0000 7ff289598640 1 -- 172.21.15.106:0/347686780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2841363b0 con 0x7ff284070930 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.303+0000 7ff289598640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff284070930 0x7ff2841322b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff274011630 tx=0x7ff274011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.303+0000 7ff27a7fc640 1 -- 172.21.15.106:0/347686780 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274015870 con 0x7ff284070930 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.303+0000 7ff27a7fc640 1 -- 172.21.15.106:0/347686780 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2740159d0 con 0x7ff284070930 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.303+0000 7ff27a7fc640 1 -- 172.21.15.106:0/347686780 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274015d40 con 0x7ff284070930 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.303+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff284132ca0 con 0x7ff284070930 2023-12-22T09:15:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.303+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff284154c70 con 0x7ff284070930 2023-12-22T09:15:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.304+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28404e920 con 0x7ff284070930 2023-12-22T09:15:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.305+0000 7ff27a7fc640 1 -- 172.21.15.106:0/347686780 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff27400f490 con 0x7ff284070930 2023-12-22T09:15:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.306+0000 7ff27a7fc640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.306+0000 7ff27a7fc640 1 -- 172.21.15.106:0/347686780 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff274088be0 con 0x7ff284070930 2023-12-22T09:15:48.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.306+0000 7ff289d99640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.307+0000 7ff289d99640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff280000ef0 tx=0x7ff280009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:48.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.310+0000 7ff27a7fc640 1 -- 172.21.15.106:0/347686780 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff2740543d0 con 0x7ff284070930 2023-12-22T09:15:48.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.575+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff284073f10 con 0x7ff284070930 2023-12-22T09:15:48.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.583+0000 7ff27a7fc640 1 -- 172.21.15.106:0/347686780 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff2740579f0 con 0x7ff284070930 2023-12-22T09:15:48.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 msgr2=0x7ff26806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff280000ef0 tx=0x7ff280009040 comp rx=0 tx=0).stop 2023-12-22T09:15:48.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff284070930 msgr2=0x7ff2841322b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff284070930 0x7ff2841322b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff274011630 tx=0x7ff274011af0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 shutdown_connections 2023-12-22T09:15:48.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff26806a460 0x7ff26806c920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2841327f0 0x7ff284153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff284070930 0x7ff2841322b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 --2- 172.21.15.106:0/347686780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff270004d00 0x7ff2840712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 >> 172.21.15.106:0/347686780 conn(0x7ff2840c5360 msgr2=0x7ff284151f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:48.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 shutdown_connections 2023-12-22T09:15:48.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.586+0000 7ff28bffd640 1 -- 172.21.15.106:0/347686780 wait complete. 2023-12-22T09:15:48.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-22T09:15:48.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.821+0000 7fbbcf166640 1 Processor -- start 2023-12-22T09:15:48.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.821+0000 7fbbcf166640 1 -- start start 2023-12-22T09:15:48.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.823+0000 7fbbcf166640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbc8069e60 0x7fbbc814a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.823+0000 7fbbcf166640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc80bfce0 con 0x7fbbc8152680 2023-12-22T09:15:48.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.823+0000 7fbbcf166640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc80bffc0 con 0x7fbbc8150a80 2023-12-22T09:15:48.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.823+0000 7fbbcf166640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc80c0960 con 0x7fbbc8069e60 2023-12-22T09:15:48.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.824+0000 7fbbcd703640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbbc8152680 0x7fbbc815b400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34634/0 (socket says 172.21.15.106:34634) 2023-12-22T09:15:48.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.824+0000 7fbbcd703640 1 -- 172.21.15.106:0/3698599379 learned_addr learned my addr 172.21.15.106:0/3698599379 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.824+0000 7fbbccf02640 1 --2- 172.21.15.106:0/3698599379 >> v2:172.21.15.132:3300/0 conn(0x7fbbc8069e60 0x7fbbc814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.824+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749016280 0 0) 0x7fbbc80bfce0 con 0x7fbbc8152680 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.824+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb8003520 con 0x7fbbc8152680 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 775482084 0 0) 0x7fbbb8003520 con 0x7fbbc8152680 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 >> v2:172.21.15.132:3300/0 conn(0x7fbbc8069e60 msgr2=0x7fbbc814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 --2- 172.21.15.106:0/3698599379 >> v2:172.21.15.132:3300/0 conn(0x7fbbc8069e60 0x7fbbc814a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 >> v1:172.21.15.132:6789/0 conn(0x7fbbc8150a80 legacy=0x7fbbc8151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80c02a0 con 0x7fbbc8152680 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fbbc00019f0 con 0x7fbbc8152680 2023-12-22T09:15:48.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 >> v1:172.21.15.106:6789/0 conn(0x7fbbc8152680 legacy=0x7fbbc815b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80039c0 0x7fbbb8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80047c0 0x7fbbb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbb80052a0 0x7fbbb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80c0960 con 0x7fbbb80047c0 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb800c1a0 con 0x7fbbb80039c0 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb800e570 con 0x7fbbb80052a0 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.825+0000 7fbbccf02640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80039c0 0x7fbbb8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.826+0000 7fbbc7fff640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80047c0 0x7fbbb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.826+0000 7fbbcd703640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbb80052a0 0x7fbbb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.826+0000 7fbbc7fff640 1 -- 172.21.15.106:0/3698599379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbb80052a0 msgr2=0x7fbbb800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.826+0000 7fbbc7fff640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbb80052a0 0x7fbbb800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.826+0000 7fbbc7fff640 1 -- 172.21.15.106:0/3698599379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80039c0 msgr2=0x7fbbb8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.826+0000 7fbbc7fff640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80039c0 0x7fbbb8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.826+0000 7fbbc7fff640 1 -- 172.21.15.106:0/3698599379 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8003520 con 0x7fbbb80047c0 2023-12-22T09:15:48.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.826+0000 7fbbcd703640 1 -- 172.21.15.106:0/3698599379 reap_dead start 2023-12-22T09:15:48.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.827+0000 7fbbc7fff640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80047c0 0x7fbbb8004c40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4001750 tx=0x7fbbb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c214143a62c0ff server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:48.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.827+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40052d0 con 0x7fbbb80047c0 2023-12-22T09:15:48.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.827+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb402e050 con 0x7fbbb80047c0 2023-12-22T09:15:48.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.827+0000 7fbbc77fe640 1 -- 172.21.15.106:0/3698599379 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4003830 con 0x7fbbb80047c0 2023-12-22T09:15:48.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.828+0000 7fbbcf166640 1 -- 172.21.15.106:0/3698599379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80047c0 msgr2=0x7fbbb8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.828+0000 7fbbcf166640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80047c0 0x7fbbb8004c40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4001750 tx=0x7fbbb80057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.828+0000 7fbbcf166640 1 -- 172.21.15.106:0/3698599379 shutdown_connections 2023-12-22T09:15:48.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.828+0000 7fbbcf166640 1 --2- 172.21.15.106:0/3698599379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb80047c0 0x7fbbb8004c40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.828+0000 7fbbcf166640 1 -- 172.21.15.106:0/3698599379 >> 172.21.15.106:0/3698599379 conn(0x7fbbc80c5360 msgr2=0x7fbbc80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:48.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.828+0000 7fbbcf166640 1 -- 172.21.15.106:0/3698599379 shutdown_connections 2023-12-22T09:15:48.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.828+0000 7fbbcf166640 1 -- 172.21.15.106:0/3698599379 wait complete. 2023-12-22T09:15:48.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.830+0000 7fbbcf166640 1 Processor -- start 2023-12-22T09:15:48.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.830+0000 7fbbcf166640 1 -- start start 2023-12-22T09:15:48.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.831+0000 7fbbcf166640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80047c0 0x7fbbc80c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.831+0000 7fbbcf166640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8154cc0 0x7fbbc8141ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.831+0000 7fbbcf166640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbc8137dc0 0x7fbbc8138240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.831+0000 7fbbcf166640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc81478f0 con 0x7fbbc8154cc0 2023-12-22T09:15:48.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.831+0000 7fbbcf166640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc8147dd0 con 0x7fbbb80047c0 2023-12-22T09:15:48.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.831+0000 7fbbcf166640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc8147af0 con 0x7fbbc8137dc0 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.831+0000 7fbbc7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8154cc0 0x7fbbc8141ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.831+0000 7fbbc7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8154cc0 0x7fbbc8141ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40736/0 (socket says 172.21.15.106:40736) 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.831+0000 7fbbc7fff640 1 -- 172.21.15.106:0/1897498491 learned_addr learned my addr 172.21.15.106:0/1897498491 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbcd703640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbc8137dc0 0x7fbbc8138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbccf02640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80047c0 0x7fbbc80c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbc7fff640 1 -- 172.21.15.106:0/1897498491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbc8137dc0 msgr2=0x7fbbc8138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbc7fff640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbc8137dc0 0x7fbbc8138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbc7fff640 1 -- 172.21.15.106:0/1897498491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80047c0 msgr2=0x7fbbc80c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbc7fff640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80047c0 0x7fbbc80c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbc7fff640 1 -- 172.21.15.106:0/1897498491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80c3650 con 0x7fbbc8154cc0 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbccf02640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80047c0 0x7fbbc80c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbc7fff640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8154cc0 0x7fbbc8141ef0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4005040 tx=0x7fbbb4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.832+0000 7fbbc57fa640 1 -- 172.21.15.106:0/1897498491 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4007a30 con 0x7fbbc8154cc0 2023-12-22T09:15:48.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.833+0000 7fbbc57fa640 1 -- 172.21.15.106:0/1897498491 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb40069e0 con 0x7fbbc8154cc0 2023-12-22T09:15:48.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.833+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc80c3930 con 0x7fbbc8154cc0 2023-12-22T09:15:48.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.833+0000 7fbbc57fa640 1 -- 172.21.15.106:0/1897498491 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4006d70 con 0x7fbbc8154cc0 2023-12-22T09:15:48.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.833+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc8142430 con 0x7fbbc8154cc0 2023-12-22T09:15:48.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.834+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc80c34b0 con 0x7fbbc8154cc0 2023-12-22T09:15:48.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.835+0000 7fbbc57fa640 1 -- 172.21.15.106:0/1897498491 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbbb40035f0 con 0x7fbbc8154cc0 2023-12-22T09:15:48.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.836+0000 7fbbc57fa640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbac06a460 0x7fbbac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:48.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.836+0000 7fbbc57fa640 1 -- 172.21.15.106:0/1897498491 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbbb40aa810 con 0x7fbbc8154cc0 2023-12-22T09:15:48.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.836+0000 7fbbccf02640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbac06a460 0x7fbbac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:48.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.837+0000 7fbbccf02640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbac06a460 0x7fbbac06c920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009aa0 tx=0x7fbbbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:48.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:48.840+0000 7fbbc57fa640 1 -- 172.21.15.106:0/1897498491 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbbc80c34b0 con 0x7fbbc8154cc0 2023-12-22T09:15:49.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.093+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fbbc80c34b0 con 0x7fbbc8154cc0 2023-12-22T09:15:49.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.098+0000 7fbbc57fa640 1 -- 172.21.15.106:0/1897498491 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbbc80c34b0 con 0x7fbbc8154cc0 2023-12-22T09:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.100+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbac06a460 msgr2=0x7fbbac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.100+0000 7fbbcf166640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbac06a460 0x7fbbac06c920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009aa0 tx=0x7fbbbc008040 comp rx=0 tx=0).stop 2023-12-22T09:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.100+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8154cc0 msgr2=0x7fbbc8141ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.100+0000 7fbbcf166640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8154cc0 0x7fbbc8141ef0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4005040 tx=0x7fbbb4001120 comp rx=0 tx=0).stop 2023-12-22T09:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.101+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 shutdown_connections 2023-12-22T09:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.101+0000 7fbbcf166640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbac06a460 0x7fbbac06c920 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.101+0000 7fbbcf166640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbc8137dc0 0x7fbbc8138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.101+0000 7fbbcf166640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8154cc0 0x7fbbc8141ef0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.101+0000 7fbbcf166640 1 --2- 172.21.15.106:0/1897498491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb80047c0 0x7fbbc80c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.101+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 >> 172.21.15.106:0/1897498491 conn(0x7fbbc80c5360 msgr2=0x7fbbc8071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.101+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 shutdown_connections 2023-12-22T09:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.101+0000 7fbbcf166640 1 -- 172.21.15.106:0/1897498491 wait complete. 2023-12-22T09:15:49.117 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-22T09:15:49.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.327+0000 7fb599a18640 1 Processor -- start 2023-12-22T09:15:49.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.327+0000 7fb599a18640 1 -- start start 2023-12-22T09:15:49.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.328+0000 7fb599a18640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb59414a3b0 0x7fb594154560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.328+0000 7fb599a18640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb59414a790 0x7fb594157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.328+0000 7fb599a18640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb59406c740 0x7fb5940c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.328+0000 7fb599a18640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940c3f60 con 0x7fb59414a790 2023-12-22T09:15:49.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.328+0000 7fb599a18640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940c4730 con 0x7fb59414a3b0 2023-12-22T09:15:49.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.328+0000 7fb599a18640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940c4170 con 0x7fb59406c740 2023-12-22T09:15:49.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb593fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb59414a790 0x7fb594157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb593fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb59414a790 0x7fb594157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40744/0 (socket says 172.21.15.106:40744) 2023-12-22T09:15:49.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb593fff640 1 -- 172.21.15.106:0/917023900 learned_addr learned my addr 172.21.15.106:0/917023900 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:49.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb598a16640 1 --2- 172.21.15.106:0/917023900 >> v2:172.21.15.132:3300/0 conn(0x7fb59414a3b0 0x7fb594154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb593fff640 1 -- 172.21.15.106:0/917023900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb59406c740 msgr2=0x7fb5940c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:49.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb593fff640 1 --2- 172.21.15.106:0/917023900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb59406c740 0x7fb5940c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb593fff640 1 -- 172.21.15.106:0/917023900 >> v2:172.21.15.132:3300/0 conn(0x7fb59414a3b0 msgr2=0x7fb594154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:49.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb593fff640 1 --2- 172.21.15.106:0/917023900 >> v2:172.21.15.132:3300/0 conn(0x7fb59414a3b0 0x7fb594154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb593fff640 1 -- 172.21.15.106:0/917023900 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5940c4450 con 0x7fb59414a790 2023-12-22T09:15:49.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.329+0000 7fb598a16640 1 --2- 172.21.15.106:0/917023900 >> v2:172.21.15.132:3300/0 conn(0x7fb59414a3b0 0x7fb594154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:49.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.330+0000 7fb593fff640 1 --2- 172.21.15.106:0/917023900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 0x7fb594157790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb5940c5fc0 tx=0x7fb58802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fa27f844c6834a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:49.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.331+0000 7fb5937fe640 1 -- 172.21.15.106:0/917023900 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588031860 con 0x7fb59414a790 2023-12-22T09:15:49.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.331+0000 7fb5937fe640 1 -- 172.21.15.106:0/917023900 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5880319c0 con 0x7fb59414a790 2023-12-22T09:15:49.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.331+0000 7fb5937fe640 1 -- 172.21.15.106:0/917023900 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588031d50 con 0x7fb59414a790 2023-12-22T09:15:49.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.331+0000 7fb599a18640 1 -- 172.21.15.106:0/917023900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 msgr2=0x7fb594157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.331+0000 7fb599a18640 1 --2- 172.21.15.106:0/917023900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 0x7fb594157790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb5940c5fc0 tx=0x7fb58802b900 comp rx=0 tx=0).stop 2023-12-22T09:15:49.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.332+0000 7fb599a18640 1 -- 172.21.15.106:0/917023900 shutdown_connections 2023-12-22T09:15:49.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.332+0000 7fb599a18640 1 --2- 172.21.15.106:0/917023900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb59406c740 0x7fb5940c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.332+0000 7fb599a18640 1 --2- 172.21.15.106:0/917023900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 0x7fb594157790 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.332+0000 7fb599a18640 1 --2- 172.21.15.106:0/917023900 >> v2:172.21.15.132:3300/0 conn(0x7fb59414a3b0 0x7fb594154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.332+0000 7fb599a18640 1 -- 172.21.15.106:0/917023900 >> 172.21.15.106:0/917023900 conn(0x7fb594071500 msgr2=0x7fb594071910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:49.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.332+0000 7fb599a18640 1 -- 172.21.15.106:0/917023900 shutdown_connections 2023-12-22T09:15:49.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.332+0000 7fb599a18640 1 -- 172.21.15.106:0/917023900 wait complete. 2023-12-22T09:15:49.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.334+0000 7fb599a18640 1 Processor -- start 2023-12-22T09:15:49.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.334+0000 7fb599a18640 1 -- start start 2023-12-22T09:15:49.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.335+0000 7fb599a18640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb59406c740 0x7fb5941556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.335+0000 7fb599a18640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb59414a3b0 0x7fb5940aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.335+0000 7fb599a18640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 0x7fb594149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.335+0000 7fb599a18640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5941eaef0 con 0x7fb59414a790 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.335+0000 7fb599a18640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5941ea320 con 0x7fb59406c740 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.335+0000 7fb599a18640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5941ea5c0 con 0x7fb59414a3b0 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.335+0000 7fb599217640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 0x7fb594149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.335+0000 7fb599217640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 0x7fb594149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40750/0 (socket says 172.21.15.106:40750) 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb599217640 1 -- 172.21.15.106:0/1378725996 learned_addr learned my addr 172.21.15.106:0/1378725996 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb598a16640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb59406c740 0x7fb5941556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb593fff640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb59414a3b0 0x7fb5940aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb599217640 1 -- 172.21.15.106:0/1378725996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb59414a3b0 msgr2=0x7fb5940aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb599217640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb59414a3b0 0x7fb5940aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb599217640 1 -- 172.21.15.106:0/1378725996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb59406c740 msgr2=0x7fb5941556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb599217640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb59406c740 0x7fb5941556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb599217640 1 -- 172.21.15.106:0/1378725996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5880094d0 con 0x7fb59414a790 2023-12-22T09:15:49.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb599217640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 0x7fb594149860 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009fd0 tx=0x7fb58c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:49.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.336+0000 7fb5917fa640 1 -- 172.21.15.106:0/1378725996 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c011830 con 0x7fb59414a790 2023-12-22T09:15:49.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.337+0000 7fb5917fa640 1 -- 172.21.15.106:0/1378725996 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c011990 con 0x7fb59414a790 2023-12-22T09:15:49.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.337+0000 7fb5917fa640 1 -- 172.21.15.106:0/1378725996 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c011d20 con 0x7fb59414a790 2023-12-22T09:15:49.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.337+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5941ea8a0 con 0x7fb59414a790 2023-12-22T09:15:49.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.337+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb594155c20 con 0x7fb59414a790 2023-12-22T09:15:49.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.338+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5941eb060 con 0x7fb59414a790 2023-12-22T09:15:49.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.339+0000 7fb5917fa640 1 -- 172.21.15.106:0/1378725996 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb58c01b460 con 0x7fb59414a790 2023-12-22T09:15:49.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.339+0000 7fb5917fa640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb58006a430 0x7fb58006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.340+0000 7fb5917fa640 1 -- 172.21.15.106:0/1378725996 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb58c088640 con 0x7fb59414a790 2023-12-22T09:15:49.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.340+0000 7fb598a16640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb58006a430 0x7fb58006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.341+0000 7fb598a16640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb58006a430 0x7fb58006c8f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb5840075b0 tx=0x7fb584007540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:49.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.344+0000 7fb5917fa640 1 -- 172.21.15.106:0/1378725996 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb58c0577a0 con 0x7fb59414a790 2023-12-22T09:15:49.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.604+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb59404e8d0 con 0x7fb59414a790 2023-12-22T09:15:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.611+0000 7fb5917fa640 1 -- 172.21.15.106:0/1378725996 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb58c057330 con 0x7fb59414a790 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb58006a430 msgr2=0x7fb58006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb58006a430 0x7fb58006c8f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb5840075b0 tx=0x7fb584007540 comp rx=0 tx=0).stop 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 msgr2=0x7fb594149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 0x7fb594149860 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009fd0 tx=0x7fb58c00b8e0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 shutdown_connections 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb58006a430 0x7fb58006c8f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb59414a790 0x7fb594149860 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb59414a3b0 0x7fb5940aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 --2- 172.21.15.106:0/1378725996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb59406c740 0x7fb5941556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 >> 172.21.15.106:0/1378725996 conn(0x7fb594071500 msgr2=0x7fb5940a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 shutdown_connections 2023-12-22T09:15:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.614+0000 7fb599a18640 1 -- 172.21.15.106:0/1378725996 wait complete. 2023-12-22T09:15:49.631 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-22T09:15:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.843+0000 7fd7dd981640 1 Processor -- start 2023-12-22T09:15:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.844+0000 7fd7dd981640 1 -- start start 2023-12-22T09:15:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.845+0000 7fd7dd981640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd7d81514b0 0x7fd7d80c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.845+0000 7fd7dd981640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d80c4130 0x7fd7d8154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.845+0000 7fd7dd981640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d80c4660 con 0x7fd7d8154a80 2023-12-22T09:15:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.845+0000 7fd7dd981640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d8153d60 con 0x7fd7d81514b0 2023-12-22T09:15:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.845+0000 7fd7dd981640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d806b250 con 0x7fd7d80c4130 2023-12-22T09:15:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.846+0000 7fd7cffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d80c4130 0x7fd7d8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.846+0000 7fd7d6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd7d81514b0 0x7fd7d80c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.846+0000 7fd7d6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd7d81514b0 0x7fd7d80c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:60130/0 (socket says 172.21.15.106:60130) 2023-12-22T09:15:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.846+0000 7fd7cffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d80c4130 0x7fd7d8154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:54746/0 (socket says 172.21.15.106:54746) 2023-12-22T09:15:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.846+0000 7fd7d6ffd640 1 -- 172.21.15.106:0/2954587954 learned_addr learned my addr 172.21.15.106:0/2954587954 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.847+0000 7fd7cffff640 1 -- 172.21.15.106:0/2954587954 >> v2:172.21.15.132:3300/0 conn(0x7fd7d81514b0 msgr2=0x7fd7d80c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.847+0000 7fd7cffff640 1 --2- 172.21.15.106:0/2954587954 >> v2:172.21.15.132:3300/0 conn(0x7fd7d81514b0 0x7fd7d80c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.847+0000 7fd7cffff640 1 -- 172.21.15.106:0/2954587954 >> v1:172.21.15.132:6789/0 conn(0x7fd7d8154a80 legacy=0x7fd7d80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.847+0000 7fd7cffff640 1 -- 172.21.15.106:0/2954587954 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d806b530 con 0x7fd7d80c4130 2023-12-22T09:15:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.847+0000 7fd7d6ffd640 1 --2- 172.21.15.106:0/2954587954 >> v2:172.21.15.132:3300/0 conn(0x7fd7d81514b0 0x7fd7d80c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:15:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.848+0000 7fd7cffff640 1 --2- 172.21.15.106:0/2954587954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d80c4130 0x7fd7d8154540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00097a0 tx=0x7fd7c002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa68f0959575deb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.848+0000 7fd7d67fc640 1 -- 172.21.15.106:0/2954587954 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0031780 con 0x7fd7d80c4130 2023-12-22T09:15:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7d67fc640 1 -- 172.21.15.106:0/2954587954 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c00318e0 con 0x7fd7d80c4130 2023-12-22T09:15:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7d67fc640 1 -- 172.21.15.106:0/2954587954 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0031c70 con 0x7fd7d80c4130 2023-12-22T09:15:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7dd981640 1 -- 172.21.15.106:0/2954587954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d80c4130 msgr2=0x7fd7d8154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7dd981640 1 --2- 172.21.15.106:0/2954587954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d80c4130 0x7fd7d8154540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00097a0 tx=0x7fd7c002b820 comp rx=0 tx=0).stop 2023-12-22T09:15:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7dd981640 1 -- 172.21.15.106:0/2954587954 shutdown_connections 2023-12-22T09:15:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7dd981640 1 --2- 172.21.15.106:0/2954587954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d80c4130 0x7fd7d8154540 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7dd981640 1 --2- 172.21.15.106:0/2954587954 >> v2:172.21.15.132:3300/0 conn(0x7fd7d81514b0 0x7fd7d80c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7dd981640 1 -- 172.21.15.106:0/2954587954 >> 172.21.15.106:0/2954587954 conn(0x7fd7d80ab1a0 msgr2=0x7fd7d80ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7dd981640 1 -- 172.21.15.106:0/2954587954 shutdown_connections 2023-12-22T09:15:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.849+0000 7fd7dd981640 1 -- 172.21.15.106:0/2954587954 wait complete. 2023-12-22T09:15:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.851+0000 7fd7dd981640 1 Processor -- start 2023-12-22T09:15:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.851+0000 7fd7dd981640 1 -- start start 2023-12-22T09:15:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.852+0000 7fd7dd981640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d80c4130 0x7fd7d81e8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.852+0000 7fd7dd981640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d81514b0 0x7fd7d80c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.852+0000 7fd7dd981640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7d80c4b40 0x7fd7d814d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.852+0000 7fd7dd981640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80bd330 con 0x7fd7d80c4b40 2023-12-22T09:15:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.852+0000 7fd7dd981640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80bec60 con 0x7fd7d80c4130 2023-12-22T09:15:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.852+0000 7fd7dd981640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80bd580 con 0x7fd7d81514b0 2023-12-22T09:15:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.852+0000 7fd7d77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7d80c4b40 0x7fd7d814d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.852+0000 7fd7d77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7d80c4b40 0x7fd7d814d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40758/0 (socket says 172.21.15.106:40758) 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.852+0000 7fd7d77fe640 1 -- 172.21.15.106:0/1388341227 learned_addr learned my addr 172.21.15.106:0/1388341227 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d6ffd640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d80c4130 0x7fd7d81e8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7cffff640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d81514b0 0x7fd7d80c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d77fe640 1 -- 172.21.15.106:0/1388341227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d81514b0 msgr2=0x7fd7d80c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d77fe640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d81514b0 0x7fd7d80c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d77fe640 1 -- 172.21.15.106:0/1388341227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d80c4130 msgr2=0x7fd7d81e8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d77fe640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d80c4130 0x7fd7d81e8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d77fe640 1 -- 172.21.15.106:0/1388341227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c80094d0 con 0x7fd7d80c4b40 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7cffff640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d81514b0 0x7fd7d80c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d77fe640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7d80c4b40 0x7fd7d814d0b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c760 tx=0x7fd7d000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d4ff9640 1 -- 172.21.15.106:0/1388341227 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0003b70 con 0x7fd7d80c4b40 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d4ff9640 1 -- 172.21.15.106:0/1388341227 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d0003cd0 con 0x7fd7d80c4b40 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.853+0000 7fd7d4ff9640 1 -- 172.21.15.106:0/1388341227 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000aa90 con 0x7fd7d80c4b40 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.854+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c0009400 con 0x7fd7d80c4b40 2023-12-22T09:15:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.854+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d814cb90 con 0x7fd7d80c4b40 2023-12-22T09:15:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.855+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d814cd80 con 0x7fd7d80c4b40 2023-12-22T09:15:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.856+0000 7fd7d4ff9640 1 -- 172.21.15.106:0/1388341227 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd7d000abf0 con 0x7fd7d80c4b40 2023-12-22T09:15:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.857+0000 7fd7d4ff9640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd7b806a430 0x7fd7b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.857+0000 7fd7d4ff9640 1 -- 172.21.15.106:0/1388341227 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd7d0088430 con 0x7fd7d80c4b40 2023-12-22T09:15:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.857+0000 7fd7d6ffd640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd7b806a430 0x7fd7b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.858+0000 7fd7d6ffd640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd7b806a430 0x7fd7b806c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009cf0 tx=0x7fd7c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:49.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:49.861+0000 7fd7d4ff9640 1 -- 172.21.15.106:0/1388341227 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd7d0053c20 con 0x7fd7d80c4b40 2023-12-22T09:15:50.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.102+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd7d8073f10 con 0x7fd7d80c4b40 2023-12-22T09:15:50.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.110+0000 7fd7d4ff9640 1 -- 172.21.15.106:0/1388341227 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd7d0057240 con 0x7fd7d80c4b40 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd7b806a430 msgr2=0x7fd7b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd7b806a430 0x7fd7b806c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009cf0 tx=0x7fd7c8008040 comp rx=0 tx=0).stop 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7d80c4b40 msgr2=0x7fd7d814d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7d80c4b40 0x7fd7d814d0b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c760 tx=0x7fd7d000cc20 comp rx=0 tx=0).stop 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 shutdown_connections 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd7b806a430 0x7fd7b806c8f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7d80c4b40 0x7fd7d814d0b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7d81514b0 0x7fd7d80c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 --2- 172.21.15.106:0/1388341227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d80c4130 0x7fd7d81e8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 >> 172.21.15.106:0/1388341227 conn(0x7fd7d80ab1a0 msgr2=0x7fd7d80ab580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 shutdown_connections 2023-12-22T09:15:50.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.113+0000 7fd7dd981640 1 -- 172.21.15.106:0/1388341227 wait complete. 2023-12-22T09:15:50.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-22T09:15:50.249 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:15:50.258 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:15:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.330+0000 7f25bb1b9640 1 Processor -- start 2023-12-22T09:15:50.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.330+0000 7f25bb1b9640 1 -- start start 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.331+0000 7f25bb1b9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25b40aed10 0x7f25b40c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.331+0000 7f25bb1b9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 0x7f25b40c6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25bb1b9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b40c7870 con 0x7f25b406c9f0 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25bb1b9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40c47e0 con 0x7f25b40aed10 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25bb1b9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40af0f0 con 0x7f25b41547c0 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25b8f55640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25b40aed10 0x7f25b40c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25b8f55640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25b40aed10 0x7f25b40c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40766/0 (socket says 172.21.15.106:40766) 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25b8f55640 1 -- 172.21.15.106:0/2693117372 learned_addr learned my addr 172.21.15.106:0/2693117372 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25b3fff640 1 --2- 172.21.15.106:0/2693117372 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 0x7f25b40c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:50.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25b8f55640 1 -- 172.21.15.106:0/2693117372 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 msgr2=0x7f25b40c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:50.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25b8f55640 1 --2- 172.21.15.106:0/2693117372 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 0x7f25b40c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25b8f55640 1 -- 172.21.15.106:0/2693117372 >> v1:172.21.15.132:6789/0 conn(0x7f25b406c9f0 legacy=0x7f25b4157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25b8f55640 1 -- 172.21.15.106:0/2693117372 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40c4260 con 0x7f25b40aed10 2023-12-22T09:15:50.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.332+0000 7f25b3fff640 1 --2- 172.21.15.106:0/2693117372 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 0x7f25b40c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:15:50.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.335+0000 7f25b8f55640 1 --2- 172.21.15.106:0/2693117372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 0x7f25b40c5d10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009870 tx=0x7f25a802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1baadd346ebeb13 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:50.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.335+0000 7f25b37fe640 1 -- 172.21.15.106:0/2693117372 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8030840 con 0x7f25b40aed10 2023-12-22T09:15:50.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.335+0000 7f25b37fe640 1 -- 172.21.15.106:0/2693117372 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a80309a0 con 0x7f25b40aed10 2023-12-22T09:15:50.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.335+0000 7f25b37fe640 1 -- 172.21.15.106:0/2693117372 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8030d30 con 0x7f25b40aed10 2023-12-22T09:15:50.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.335+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2693117372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 msgr2=0x7f25b40c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.335+0000 7f25bb1b9640 1 --2- 172.21.15.106:0/2693117372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 0x7f25b40c5d10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009870 tx=0x7f25a802b980 comp rx=0 tx=0).stop 2023-12-22T09:15:50.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.336+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2693117372 shutdown_connections 2023-12-22T09:15:50.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.336+0000 7f25bb1b9640 1 --2- 172.21.15.106:0/2693117372 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 0x7f25b40c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.336+0000 7f25bb1b9640 1 --2- 172.21.15.106:0/2693117372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 0x7f25b40c5d10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.336+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2693117372 >> 172.21.15.106:0/2693117372 conn(0x7f25b40ab330 msgr2=0x7f25b40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:50.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.336+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2693117372 shutdown_connections 2023-12-22T09:15:50.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.336+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2693117372 wait complete. 2023-12-22T09:15:50.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.337+0000 7f25bb1b9640 1 Processor -- start 2023-12-22T09:15:50.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.337+0000 7f25bb1b9640 1 -- start start 2023-12-22T09:15:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.338+0000 7f25bb1b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b406c9f0 0x7f25b40c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.338+0000 7f25bb1b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 0x7f25b414e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.338+0000 7f25bb1b9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 0x7f25b4157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.338+0000 7f25bb1b9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40c16e0 con 0x7f25b40aed10 2023-12-22T09:15:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.338+0000 7f25bb1b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40c2cd0 con 0x7f25b406c9f0 2023-12-22T09:15:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.338+0000 7f25bb1b9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40c1f10 con 0x7f25b41547c0 2023-12-22T09:15:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 0x7f25b414e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 0x7f25b414e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40774/0 (socket says 172.21.15.106:40774) 2023-12-22T09:15:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b3fff640 1 -- 172.21.15.106:0/2673662939 learned_addr learned my addr 172.21.15.106:0/2673662939 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:50.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b3fff640 1 -- 172.21.15.106:0/2673662939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 msgr2=0x7f25b4157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b3fff640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 0x7f25b4157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b3fff640 1 -- 172.21.15.106:0/2673662939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b406c9f0 msgr2=0x7f25b40c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b3fff640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b406c9f0 0x7f25b40c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b3fff640 1 -- 172.21.15.106:0/2673662939 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a80094d0 con 0x7f25b40aed10 2023-12-22T09:15:50.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b3fff640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 0x7f25b414e240 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f25a000d800 tx=0x7f25a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:50.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.339+0000 7f25b17fa640 1 -- 172.21.15.106:0/2673662939 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0004030 con 0x7f25b40aed10 2023-12-22T09:15:50.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.340+0000 7f25b17fa640 1 -- 172.21.15.106:0/2673662939 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a0004190 con 0x7f25b40aed10 2023-12-22T09:15:50.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.340+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b414e780 con 0x7f25b40aed10 2023-12-22T09:15:50.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.340+0000 7f25b17fa640 1 -- 172.21.15.106:0/2673662939 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0004520 con 0x7f25b40aed10 2023-12-22T09:15:50.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.340+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b40c18c0 con 0x7f25b40aed10 2023-12-22T09:15:50.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.341+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b40c7ce0 con 0x7f25b40aed10 2023-12-22T09:15:50.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.342+0000 7f25b17fa640 1 -- 172.21.15.106:0/2673662939 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25a000b660 con 0x7f25b40aed10 2023-12-22T09:15:50.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.343+0000 7f25b17fa640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f259806a460 0x7f259806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.343+0000 7f25b17fa640 1 -- 172.21.15.106:0/2673662939 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f25a0088890 con 0x7f25b40aed10 2023-12-22T09:15:50.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.343+0000 7f25b8f55640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f259806a460 0x7f259806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:50.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.343+0000 7f25b8f55640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f259806a460 0x7f259806c920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25a8036000 tx=0x7f25a803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:50.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.347+0000 7f25b17fa640 1 -- 172.21.15.106:0/2673662939 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25b40c7ce0 con 0x7f25b40aed10 2023-12-22T09:15:50.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.589+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f25b40c7ce0 con 0x7f25b40aed10 2023-12-22T09:15:50.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.595+0000 7f25b17fa640 1 -- 172.21.15.106:0/2673662939 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f25b40c7ce0 con 0x7f25b40aed10 2023-12-22T09:15:50.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f259806a460 msgr2=0x7f259806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f259806a460 0x7f259806c920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25a8036000 tx=0x7f25a803b040 comp rx=0 tx=0).stop 2023-12-22T09:15:50.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 msgr2=0x7f25b414e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 0x7f25b414e240 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f25a000d800 tx=0x7f25a000dcc0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 shutdown_connections 2023-12-22T09:15:50.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f259806a460 0x7f259806c920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25b41547c0 0x7f25b4157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b40aed10 0x7f25b414e240 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 --2- 172.21.15.106:0/2673662939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b406c9f0 0x7f25b40c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 >> 172.21.15.106:0/2673662939 conn(0x7f25b40ab330 msgr2=0x7f25b40c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:50.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 shutdown_connections 2023-12-22T09:15:50.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.598+0000 7f25bb1b9640 1 -- 172.21.15.106:0/2673662939 wait complete. 2023-12-22T09:15:50.614 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-22T09:15:50.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.822+0000 7f8431fdc640 1 Processor -- start 2023-12-22T09:15:50.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.822+0000 7f8431fdc640 1 -- start start 2023-12-22T09:15:50.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.824+0000 7f8431fdc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f842c06aad0 0x7f842c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.824+0000 7f8431fdc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c0c4660 con 0x7f842c1514b0 2023-12-22T09:15:50.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.824+0000 7f8431fdc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c153d60 con 0x7f842c0c4130 2023-12-22T09:15:50.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.824+0000 7f8431fdc640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842c154c50 con 0x7f842c06aad0 2023-12-22T09:15:50.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.824+0000 7f842b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f842c1514b0 0x7f842c154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34644/0 (socket says 172.21.15.106:34644) 2023-12-22T09:15:50.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.824+0000 7f842b7fe640 1 -- 172.21.15.106:0/723208304 learned_addr learned my addr 172.21.15.106:0/723208304 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:50.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.824+0000 7f842bfff640 1 --2- 172.21.15.106:0/723208304 >> v2:172.21.15.106:3300/0 conn(0x7f842c06aad0 0x7f842c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:50.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.825+0000 7f842a7fc640 1 -- 172.21.15.106:0/723208304 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965759003 0 0) 0x7f842c0c4660 con 0x7f842c1514b0 2023-12-22T09:15:50.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.825+0000 7f842a7fc640 1 -- 172.21.15.106:0/723208304 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8418003520 con 0x7f842c1514b0 2023-12-22T09:15:50.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.825+0000 7f842bfff640 1 -- 172.21.15.106:0/723208304 >> v1:172.21.15.132:6789/0 conn(0x7f842c0c4130 legacy=0x7f842c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:50.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.825+0000 7f842bfff640 1 -- 172.21.15.106:0/723208304 >> v1:172.21.15.106:6789/0 conn(0x7f842c1514b0 legacy=0x7f842c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.825+0000 7f842bfff640 1 -- 172.21.15.106:0/723208304 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c06b250 con 0x7f842c06aad0 2023-12-22T09:15:50.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.826+0000 7f842bfff640 1 --2- 172.21.15.106:0/723208304 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c06aad0 0x7f842c0c75b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f84240097a0 tx=0x7f842402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfb4aa0add453e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.826+0000 7f842a7fc640 1 -- 172.21.15.106:0/723208304 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842402f050 con 0x7f842c06aad0 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.826+0000 7f842a7fc640 1 -- 172.21.15.106:0/723208304 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8424031700 con 0x7f842c06aad0 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.826+0000 7f842a7fc640 1 -- 172.21.15.106:0/723208304 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424031a90 con 0x7f842c06aad0 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.827+0000 7f8431fdc640 1 -- 172.21.15.106:0/723208304 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c06aad0 msgr2=0x7f842c0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.827+0000 7f8431fdc640 1 --2- 172.21.15.106:0/723208304 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c06aad0 0x7f842c0c75b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f84240097a0 tx=0x7f842402b7a0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.827+0000 7f8431fdc640 1 -- 172.21.15.106:0/723208304 shutdown_connections 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.827+0000 7f8431fdc640 1 --2- 172.21.15.106:0/723208304 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c06aad0 0x7f842c0c75b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.827+0000 7f8431fdc640 1 -- 172.21.15.106:0/723208304 >> 172.21.15.106:0/723208304 conn(0x7f842c0ab1a0 msgr2=0x7f842c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.827+0000 7f8431fdc640 1 -- 172.21.15.106:0/723208304 shutdown_connections 2023-12-22T09:15:50.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.827+0000 7f8431fdc640 1 -- 172.21.15.106:0/723208304 wait complete. 2023-12-22T09:15:50.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.828+0000 7f8431fdc640 1 Processor -- start 2023-12-22T09:15:50.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.829+0000 7f8431fdc640 1 -- start start 2023-12-22T09:15:50.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.829+0000 7f8431fdc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c06aad0 0x7f842c1e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.829+0000 7f8431fdc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c0c4130 0x7f842c0c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.829+0000 7f8431fdc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f842c1514b0 0x7f842c0c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f8431fdc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c1100 con 0x7f842c0c4130 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f8431fdc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c1910 con 0x7f842c06aad0 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f8431fdc640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0bd630 con 0x7f842c1514b0 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f842affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c0c4130 0x7f842c0c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f842affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c0c4130 0x7f842c0c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40792/0 (socket says 172.21.15.106:40792) 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f842affd640 1 -- 172.21.15.106:0/4274171 learned_addr learned my addr 172.21.15.106:0/4274171 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f842affd640 1 -- 172.21.15.106:0/4274171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f842c1514b0 msgr2=0x7f842c0c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f842affd640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f842c1514b0 0x7f842c0c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f842affd640 1 -- 172.21.15.106:0/4274171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c06aad0 msgr2=0x7f842c1e64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f842affd640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c06aad0 0x7f842c1e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.830+0000 7f842affd640 1 -- 172.21.15.106:0/4274171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424009400 con 0x7f842c0c4130 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.831+0000 7f842affd640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c0c4130 0x7f842c0c2fb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c7c0 tx=0x7f841c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:50.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.831+0000 7f8423fff640 1 -- 172.21.15.106:0/4274171 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c00aa50 con 0x7f842c0c4130 2023-12-22T09:15:50.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.831+0000 7f8423fff640 1 -- 172.21.15.106:0/4274171 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c00abb0 con 0x7f842c0c4130 2023-12-22T09:15:50.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.831+0000 7f8423fff640 1 -- 172.21.15.106:0/4274171 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c012420 con 0x7f842c0c4130 2023-12-22T09:15:50.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.831+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c0c1350 con 0x7f842c0c4130 2023-12-22T09:15:50.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.831+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c1e6a30 con 0x7f842c0c4130 2023-12-22T09:15:50.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.832+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c0c2cd0 con 0x7f842c0c4130 2023-12-22T09:15:50.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.833+0000 7f8423fff640 1 -- 172.21.15.106:0/4274171 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f841c012580 con 0x7f842c0c4130 2023-12-22T09:15:50.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.835+0000 7f8423fff640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f840c06a430 0x7f840c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:50.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.835+0000 7f8423fff640 1 -- 172.21.15.106:0/4274171 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f841c088670 con 0x7f842c0c4130 2023-12-22T09:15:50.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.835+0000 7f842b7fe640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f840c06a430 0x7f840c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:50.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.835+0000 7f842b7fe640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f840c06a430 0x7f840c06c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8414001610 tx=0x7f8414007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:50.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:50.839+0000 7f8423fff640 1 -- 172.21.15.106:0/4274171 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f842c0c2cd0 con 0x7f842c0c4130 2023-12-22T09:15:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.079+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f842c0c2cd0 con 0x7f842c0c4130 2023-12-22T09:15:51.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.083+0000 7f8423fff640 1 -- 172.21.15.106:0/4274171 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f842c0c2cd0 con 0x7f842c0c4130 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.086+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f840c06a430 msgr2=0x7f840c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.086+0000 7f8431fdc640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f840c06a430 0x7f840c06c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8414001610 tx=0x7f8414007930 comp rx=0 tx=0).stop 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.086+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c0c4130 msgr2=0x7f842c0c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.086+0000 7f8431fdc640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c0c4130 0x7f842c0c2fb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c7c0 tx=0x7f841c00cc80 comp rx=0 tx=0).stop 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.087+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 shutdown_connections 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.087+0000 7f8431fdc640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f840c06a430 0x7f840c06c8f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.087+0000 7f8431fdc640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f842c1514b0 0x7f842c0c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.087+0000 7f8431fdc640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f842c0c4130 0x7f842c0c2fb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.087+0000 7f8431fdc640 1 --2- 172.21.15.106:0/4274171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c06aad0 0x7f842c1e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.087+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 >> 172.21.15.106:0/4274171 conn(0x7f842c0ab1a0 msgr2=0x7f842c0c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.087+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 shutdown_connections 2023-12-22T09:15:51.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.087+0000 7f8431fdc640 1 -- 172.21.15.106:0/4274171 wait complete. 2023-12-22T09:15:51.102 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:51.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.294+0000 7f7cdb795640 1 Processor -- start 2023-12-22T09:15:51.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.294+0000 7f7cdb795640 1 -- start start 2023-12-22T09:15:51.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.295+0000 7f7cdb795640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7cd4150a80 0x7f7cd4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.295+0000 7f7cdb795640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd40bfce0 con 0x7f7cd4071ea0 2023-12-22T09:15:51.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7cdb795640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd40bffc0 con 0x7f7cd4069e60 2023-12-22T09:15:51.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7cdb795640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd40c0960 con 0x7f7cd4150a80 2023-12-22T09:15:51.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7cd9d32640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7cd4071ea0 0x7f7cd415b400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34660/0 (socket says 172.21.15.106:34660) 2023-12-22T09:15:51.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7cd9d32640 1 -- 172.21.15.106:0/2231880703 learned_addr learned my addr 172.21.15.106:0/2231880703 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:51.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7cd8d30640 1 --2- 172.21.15.106:0/2231880703 >> v2:172.21.15.106:3300/0 conn(0x7f7cd4150a80 0x7f7cd4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:51.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7ccbfff640 1 -- 172.21.15.106:0/2231880703 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170670579 0 0) 0x7f7cd40bfce0 con 0x7f7cd4071ea0 2023-12-22T09:15:51.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7ccbfff640 1 -- 172.21.15.106:0/2231880703 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cc0003520 con 0x7f7cd4071ea0 2023-12-22T09:15:51.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7cd8d30640 1 -- 172.21.15.106:0/2231880703 >> v1:172.21.15.132:6789/0 conn(0x7f7cd4069e60 legacy=0x7f7cd414a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:51.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7cd8d30640 1 -- 172.21.15.106:0/2231880703 >> v1:172.21.15.106:6789/0 conn(0x7f7cd4071ea0 legacy=0x7f7cd415b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.296+0000 7f7cd8d30640 1 -- 172.21.15.106:0/2231880703 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40c02a0 con 0x7f7cd4150a80 2023-12-22T09:15:51.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.298+0000 7f7cd8d30640 1 --2- 172.21.15.106:0/2231880703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4150a80 0x7f7cd4151f70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40097a0 tx=0x7f7cc402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e26a56a3e05e06 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:51.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.298+0000 7f7ccbfff640 1 -- 172.21.15.106:0/2231880703 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc402e070 con 0x7f7cd4150a80 2023-12-22T09:15:51.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.298+0000 7f7ccbfff640 1 -- 172.21.15.106:0/2231880703 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc40315a0 con 0x7f7cd4150a80 2023-12-22T09:15:51.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.298+0000 7f7ccbfff640 1 -- 172.21.15.106:0/2231880703 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4031930 con 0x7f7cd4150a80 2023-12-22T09:15:51.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.298+0000 7f7cdb795640 1 -- 172.21.15.106:0/2231880703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4150a80 msgr2=0x7f7cd4151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.298+0000 7f7cdb795640 1 --2- 172.21.15.106:0/2231880703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4150a80 0x7f7cd4151f70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40097a0 tx=0x7f7cc402b840 comp rx=0 tx=0).stop 2023-12-22T09:15:51.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.298+0000 7f7cdb795640 1 -- 172.21.15.106:0/2231880703 shutdown_connections 2023-12-22T09:15:51.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.298+0000 7f7cdb795640 1 --2- 172.21.15.106:0/2231880703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4150a80 0x7f7cd4151f70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.298+0000 7f7cdb795640 1 -- 172.21.15.106:0/2231880703 >> 172.21.15.106:0/2231880703 conn(0x7f7cd40c5360 msgr2=0x7f7cd40c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:51.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.299+0000 7f7cdb795640 1 -- 172.21.15.106:0/2231880703 shutdown_connections 2023-12-22T09:15:51.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.299+0000 7f7cdb795640 1 -- 172.21.15.106:0/2231880703 wait complete. 2023-12-22T09:15:51.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.300+0000 7f7cdb795640 1 Processor -- start 2023-12-22T09:15:51.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.300+0000 7f7cdb795640 1 -- start start 2023-12-22T09:15:51.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.301+0000 7f7cdb795640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd4069e60 0x7f7cd40c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.301+0000 7f7cdb795640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4071ea0 0x7f7cd41e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.301+0000 7f7cdb795640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cd4150a80 0x7f7cd40704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.301+0000 7f7cdb795640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41e9c00 con 0x7f7cd4071ea0 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.301+0000 7f7cdb795640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41ec170 con 0x7f7cd4069e60 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.301+0000 7f7cdb795640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41394a0 con 0x7f7cd4150a80 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.301+0000 7f7cd8d30640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4071ea0 0x7f7cd41e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.301+0000 7f7cd8d30640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4071ea0 0x7f7cd41e8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40804/0 (socket says 172.21.15.106:40804) 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.301+0000 7f7cd8d30640 1 -- 172.21.15.106:0/2962526103 learned_addr learned my addr 172.21.15.106:0/2962526103 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cd8d30640 1 -- 172.21.15.106:0/2962526103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cd4150a80 msgr2=0x7f7cd40704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cd8d30640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cd4150a80 0x7f7cd40704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cd8d30640 1 -- 172.21.15.106:0/2962526103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd4069e60 msgr2=0x7f7cd40c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cd8d30640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd4069e60 0x7f7cd40c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cd8d30640 1 -- 172.21.15.106:0/2962526103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4009400 con 0x7f7cd4071ea0 2023-12-22T09:15:51.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cd8d30640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4071ea0 0x7f7cd41e8c00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4034040 tx=0x7f7cc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:51.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cc9ffb640 1 -- 172.21.15.106:0/2962526103 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4032840 con 0x7f7cd4071ea0 2023-12-22T09:15:51.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cc9ffb640 1 -- 172.21.15.106:0/2962526103 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc40329a0 con 0x7f7cd4071ea0 2023-12-22T09:15:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cc9ffb640 1 -- 172.21.15.106:0/2962526103 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4032d50 con 0x7f7cd4071ea0 2023-12-22T09:15:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.302+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd40c45a0 con 0x7f7cd4071ea0 2023-12-22T09:15:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.303+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd40c4b60 con 0x7f7cd4071ea0 2023-12-22T09:15:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.304+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd4073f10 con 0x7f7cd4071ea0 2023-12-22T09:15:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.305+0000 7f7cc9ffb640 1 -- 172.21.15.106:0/2962526103 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7cc404e430 con 0x7f7cd4071ea0 2023-12-22T09:15:51.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.305+0000 7f7cc9ffb640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7cb806a430 0x7f7cb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.306+0000 7f7cc9ffb640 1 -- 172.21.15.106:0/2962526103 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7cc40aa710 con 0x7f7cd4071ea0 2023-12-22T09:15:51.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.306+0000 7f7cd9531640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7cb806a430 0x7f7cb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:51.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.306+0000 7f7cd9531640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7cb806a430 0x7f7cb806c8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0007fd0 tx=0x7f7cd00079a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:51.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.310+0000 7f7cc9ffb640 1 -- 172.21.15.106:0/2962526103 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7cc4075f00 con 0x7f7cd4071ea0 2023-12-22T09:15:51.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.497+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cd4135790 con 0x7f7cd4071ea0 2023-12-22T09:15:51.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.499+0000 7f7cc9ffb640 1 -- 172.21.15.106:0/2962526103 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+12642 (secure 0 0 0) 0x7f7cc4079520 con 0x7f7cd4071ea0 2023-12-22T09:15:51.499 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:51.499 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":36,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:47.540857+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:51.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7cb806a430 msgr2=0x7f7cb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7cb806a430 0x7f7cb806c8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0007fd0 tx=0x7f7cd00079a0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4071ea0 msgr2=0x7f7cd41e8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4071ea0 0x7f7cd41e8c00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4034040 tx=0x7f7cc40046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 shutdown_connections 2023-12-22T09:15:51.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7cb806a430 0x7f7cb806c8f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7cd4150a80 0x7f7cd40704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd4071ea0 0x7f7cd41e8c00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 --2- 172.21.15.106:0/2962526103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd4069e60 0x7f7cd40c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 >> 172.21.15.106:0/2962526103 conn(0x7f7cd40c5360 msgr2=0x7f7cd4070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:51.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 shutdown_connections 2023-12-22T09:15:51.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.502+0000 7f7cdb795640 1 -- 172.21.15.106:0/2962526103 wait complete. 2023-12-22T09:15:51.519 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:15:51.519 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:15:51.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.732+0000 7f7530534640 1 Processor -- start 2023-12-22T09:15:51.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.732+0000 7f7530534640 1 -- start start 2023-12-22T09:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.733+0000 7f7530534640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814f090 0x7f7528151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.733+0000 7f7530534640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75280c1910 0x7f7528155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.733+0000 7f7530534640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7528155120 con 0x7f7528155dd0 2023-12-22T09:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.733+0000 7f7530534640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752806e080 con 0x7f75280c1910 2023-12-22T09:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.733+0000 7f7530534640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75280a8720 con 0x7f752814f090 2023-12-22T09:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.734+0000 7f752ead1640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7528155dd0 0x7f75280c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34664/0 (socket says 172.21.15.106:34664) 2023-12-22T09:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.734+0000 7f752ead1640 1 -- 172.21.15.106:0/472685453 learned_addr learned my addr 172.21.15.106:0/472685453 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:51.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.734+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579370552 0 0) 0x7f7528155120 con 0x7f7528155dd0 2023-12-22T09:15:51.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.734+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7514003520 con 0x7f7528155dd0 2023-12-22T09:15:51.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.734+0000 7f752dacf640 1 --2- 172.21.15.106:0/472685453 >> v2:172.21.15.132:3300/0 conn(0x7f75280c1910 0x7f7528155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.734+0000 7f752e2d0640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814f090 0x7f7528151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1204338436 0 0) 0x7f7514003520 con 0x7f7528155dd0 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814f090 msgr2=0x7f7528151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814f090 0x7f7528151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 >> v2:172.21.15.132:3300/0 conn(0x7f75280c1910 msgr2=0x7f7528155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 --2- 172.21.15.106:0/472685453 >> v2:172.21.15.132:3300/0 conn(0x7f75280c1910 0x7f7528155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75280a8a00 con 0x7f7528155dd0 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f75200019f0 con 0x7f7528155dd0 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 >> v1:172.21.15.106:6789/0 conn(0x7f7528155dd0 legacy=0x7f75280c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814f090 0x7f7514003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7514003fa0 0x7f75140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f7514005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75280a8720 con 0x7f7514004d00 2023-12-22T09:15:51.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751400bac0 con 0x7f7514003fa0 2023-12-22T09:15:51.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751400bc80 con 0x7f752814f090 2023-12-22T09:15:51.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752ead1640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f7514005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:51.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752e2d0640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814f090 0x7f7514003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:51.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752ead1640 1 -- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814f090 msgr2=0x7f7514003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:51.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752ead1640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814f090 0x7f7514003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752ead1640 1 -- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7514003fa0 msgr2=0x7f75140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:51.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752ead1640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7514003fa0 0x7f75140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.735+0000 7f752ead1640 1 -- 172.21.15.106:0/472685453 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514003520 con 0x7f7514004d00 2023-12-22T09:15:51.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.736+0000 7f752ead1640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f7514005180 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f752000a860 tx=0x7f75140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f54e3badf13dd07 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:51.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.737+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520034630 con 0x7f7514004d00 2023-12-22T09:15:51.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.737+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752002f070 con 0x7f7514004d00 2023-12-22T09:15:51.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.737+0000 7f752d2ce640 1 -- 172.21.15.106:0/472685453 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520034a30 con 0x7f7514004d00 2023-12-22T09:15:51.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.737+0000 7f7530534640 1 -- 172.21.15.106:0/472685453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 msgr2=0x7f7514005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.737+0000 7f7530534640 1 --2- 172.21.15.106:0/472685453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f7514005180 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f752000a860 tx=0x7f75140057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.737+0000 7f752ead1640 1 -- 172.21.15.106:0/472685453 reap_dead start 2023-12-22T09:15:51.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.737+0000 7f7530534640 1 -- 172.21.15.106:0/472685453 shutdown_connections 2023-12-22T09:15:51.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.737+0000 7f7530534640 1 -- 172.21.15.106:0/472685453 >> 172.21.15.106:0/472685453 conn(0x7f7528069dd0 msgr2=0x7f752806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:51.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.738+0000 7f7530534640 1 -- 172.21.15.106:0/472685453 shutdown_connections 2023-12-22T09:15:51.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.738+0000 7f7530534640 1 -- 172.21.15.106:0/472685453 wait complete. 2023-12-22T09:15:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.739+0000 7f7530534640 1 Processor -- start 2023-12-22T09:15:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.739+0000 7f7530534640 1 -- start start 2023-12-22T09:15:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.740+0000 7f7530534640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f752814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.740+0000 7f7530534640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75281469a0 0x7f75281e4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.740+0000 7f7530534640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814c300 0x7f75281e4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.740+0000 7f7530534640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75281e4ed0 con 0x7f7514004d00 2023-12-22T09:15:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.740+0000 7f7530534640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7528151860 con 0x7f75281469a0 2023-12-22T09:15:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.740+0000 7f7530534640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7528151b40 con 0x7f752814c300 2023-12-22T09:15:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.741+0000 7f752e2d0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f752814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:51.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.741+0000 7f752e2d0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f752814bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40826/0 (socket says 172.21.15.106:40826) 2023-12-22T09:15:51.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.741+0000 7f752e2d0640 1 -- 172.21.15.106:0/3786284978 learned_addr learned my addr 172.21.15.106:0/3786284978 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.741+0000 7f752e2d0640 1 -- 172.21.15.106:0/3786284978 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814c300 msgr2=0x7f75281e4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.741+0000 7f752e2d0640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814c300 0x7f75281e4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.741+0000 7f752e2d0640 1 -- 172.21.15.106:0/3786284978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75281469a0 msgr2=0x7f75281e4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.741+0000 7f752e2d0640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75281469a0 0x7f75281e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.741+0000 7f752e2d0640 1 -- 172.21.15.106:0/3786284978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528151530 con 0x7f7514004d00 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.741+0000 7f752e2d0640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f752814bdc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f752400e840 tx=0x7f752400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.742+0000 7f751affd640 1 -- 172.21.15.106:0/3786284978 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400c850 con 0x7f7514004d00 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.742+0000 7f751affd640 1 -- 172.21.15.106:0/3786284978 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400c9b0 con 0x7f7514004d00 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.742+0000 7f751affd640 1 -- 172.21.15.106:0/3786284978 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400cd40 con 0x7f7514004d00 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.742+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75281e7e00 con 0x7f7514004d00 2023-12-22T09:15:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.742+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75280bf750 con 0x7f7514004d00 2023-12-22T09:15:51.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.743+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75280bfa30 con 0x7f7514004d00 2023-12-22T09:15:51.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.744+0000 7f751affd640 1 -- 172.21.15.106:0/3786284978 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7524013410 con 0x7f7514004d00 2023-12-22T09:15:51.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.745+0000 7f751affd640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f750c06a430 0x7f750c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:51.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.745+0000 7f751affd640 1 -- 172.21.15.106:0/3786284978 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7524088380 con 0x7f7514004d00 2023-12-22T09:15:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.745+0000 7f752dacf640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f750c06a430 0x7f750c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.746+0000 7f752dacf640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f750c06a430 0x7f750c06c8f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75280c0020 tx=0x7f751c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:51.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.749+0000 7f751affd640 1 -- 172.21.15.106:0/3786284978 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f75280bfa30 con 0x7f7514004d00 2023-12-22T09:15:51.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.936+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75280bfa30 con 0x7f7514004d00 2023-12-22T09:15:51.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.937+0000 7f751affd640 1 -- 172.21.15.106:0/3786284978 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75280bfa30 con 0x7f7514004d00 2023-12-22T09:15:51.937 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:15:51.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.939+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f750c06a430 msgr2=0x7f750c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.939+0000 7f7530534640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f750c06a430 0x7f750c06c8f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75280c0020 tx=0x7f751c008040 comp rx=0 tx=0).stop 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 msgr2=0x7f752814bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f752814bdc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f752400e840 tx=0x7f752400ed00 comp rx=0 tx=0).stop 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 shutdown_connections 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f750c06a430 0x7f750c06c8f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f752814c300 0x7f75281e4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75281469a0 0x7f75281e4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 --2- 172.21.15.106:0/3786284978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7514004d00 0x7f752814bdc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 >> 172.21.15.106:0/3786284978 conn(0x7f7528069dd0 msgr2=0x7f7528072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 shutdown_connections 2023-12-22T09:15:51.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:51.940+0000 7f7530534640 1 -- 172.21.15.106:0/3786284978 wait complete. 2023-12-22T09:15:51.958 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T09:15:52.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.161+0000 7fdd273f0640 1 Processor -- start 2023-12-22T09:15:52.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.161+0000 7fdd273f0640 1 -- start start 2023-12-22T09:15:52.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd273f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd2014f370 0x7fdd20071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd273f0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd20071570 0x7fdd20069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd273f0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2006c510 con 0x7fdd201551c0 2023-12-22T09:15:52.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd273f0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2006c1e0 con 0x7fdd2014f370 2023-12-22T09:15:52.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd273f0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd20071a30 con 0x7fdd20071570 2023-12-22T09:15:52.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd2598d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdd201551c0 0x7fdd2006c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34678/0 (socket says 172.21.15.106:34678) 2023-12-22T09:15:52.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd2598d640 1 -- 172.21.15.106:0/1084902749 learned_addr learned my addr 172.21.15.106:0/1084902749 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:52.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd2518c640 1 --2- 172.21.15.106:0/1084902749 >> v2:172.21.15.132:3300/0 conn(0x7fdd2014f370 0x7fdd20071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776638685 0 0) 0x7fdd2006c510 con 0x7fdd201551c0 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd0c003520 con 0x7fdd201551c0 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.163+0000 7fdd2498b640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd20071570 0x7fdd20069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055819501 0 0) 0x7fdd0c003520 con 0x7fdd201551c0 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd20071570 msgr2=0x7fdd20069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd20071570 0x7fdd20069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 >> v2:172.21.15.132:3300/0 conn(0x7fdd2014f370 msgr2=0x7fdd20071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 --2- 172.21.15.106:0/1084902749 >> v2:172.21.15.132:3300/0 conn(0x7fdd2014f370 0x7fdd20071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd20071d10 con 0x7fdd201551c0 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fdd180019f0 con 0x7fdd201551c0 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 >> v1:172.21.15.106:6789/0 conn(0x7fdd201551c0 legacy=0x7fdd2006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd0c003970 0x7fdd0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd20071570 0x7fdd0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0c004d00 0x7fdd0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2006c1e0 con 0x7fdd0c004d00 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd20071a30 con 0x7fdd0c003970 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c00ba00 con 0x7fdd20071570 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd2598d640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0c004d00 0x7fdd0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.164+0000 7fdd2518c640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd0c003970 0x7fdd0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.165+0000 7fdd2498b640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd20071570 0x7fdd0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.165+0000 7fdd2598d640 1 -- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd20071570 msgr2=0x7fdd0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.165+0000 7fdd2598d640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd20071570 0x7fdd0c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.165+0000 7fdd2598d640 1 -- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd0c003970 msgr2=0x7fdd0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.165+0000 7fdd2598d640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd0c003970 0x7fdd0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.165+0000 7fdd2598d640 1 -- 172.21.15.106:0/1084902749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c003520 con 0x7fdd0c004d00 2023-12-22T09:15:52.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.166+0000 7fdd2598d640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0c004d00 0x7fdd0c005180 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800a760 tx=0x7fdd0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6783f9e476789f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:52.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.166+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18034630 con 0x7fdd0c004d00 2023-12-22T09:15:52.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.166+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1802f070 con 0x7fdd0c004d00 2023-12-22T09:15:52.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.166+0000 7fdd17fff640 1 -- 172.21.15.106:0/1084902749 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd180349f0 con 0x7fdd0c004d00 2023-12-22T09:15:52.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.166+0000 7fdd273f0640 1 -- 172.21.15.106:0/1084902749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0c004d00 msgr2=0x7fdd0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:52.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.166+0000 7fdd273f0640 1 --2- 172.21.15.106:0/1084902749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0c004d00 0x7fdd0c005180 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800a760 tx=0x7fdd0c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.166+0000 7fdd2598d640 1 -- 172.21.15.106:0/1084902749 reap_dead start 2023-12-22T09:15:52.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.167+0000 7fdd273f0640 1 -- 172.21.15.106:0/1084902749 shutdown_connections 2023-12-22T09:15:52.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.167+0000 7fdd273f0640 1 -- 172.21.15.106:0/1084902749 >> 172.21.15.106:0/1084902749 conn(0x7fdd200c1db0 msgr2=0x7fdd200c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:52.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.167+0000 7fdd273f0640 1 -- 172.21.15.106:0/1084902749 shutdown_connections 2023-12-22T09:15:52.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.167+0000 7fdd273f0640 1 -- 172.21.15.106:0/1084902749 wait complete. 2023-12-22T09:15:52.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.168+0000 7fdd273f0640 1 Processor -- start 2023-12-22T09:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.169+0000 7fdd273f0640 1 -- start start 2023-12-22T09:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.169+0000 7fdd273f0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd0c004d00 0x7fdd200c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.169+0000 7fdd273f0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd20149390 0x7fdd201eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.169+0000 7fdd273f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd201549b0 0x7fdd201e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.169+0000 7fdd273f0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd201eb040 con 0x7fdd20149390 2023-12-22T09:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.169+0000 7fdd273f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd20151f60 con 0x7fdd201549b0 2023-12-22T09:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.169+0000 7fdd273f0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd201e6b80 con 0x7fdd0c004d00 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2498b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd20149390 0x7fdd201eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2498b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd20149390 0x7fdd201eab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40844/0 (socket says 172.21.15.106:40844) 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2498b640 1 -- 172.21.15.106:0/3500286145 learned_addr learned my addr 172.21.15.106:0/3500286145 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2498b640 1 -- 172.21.15.106:0/3500286145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd0c004d00 msgr2=0x7fdd200c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2598d640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd201549b0 0x7fdd201e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2518c640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd0c004d00 0x7fdd200c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2498b640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd0c004d00 0x7fdd200c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2498b640 1 -- 172.21.15.106:0/3500286145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd201549b0 msgr2=0x7fdd201e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2498b640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd201549b0 0x7fdd201e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2498b640 1 -- 172.21.15.106:0/3500286145 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd201521b0 con 0x7fdd20149390 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.170+0000 7fdd2598d640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd201549b0 0x7fdd201e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.171+0000 7fdd2498b640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd20149390 0x7fdd201eab00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000e810 tx=0x7fdd1000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.171+0000 7fdd15ffb640 1 -- 172.21.15.106:0/3500286145 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000c6d0 con 0x7fdd20149390 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.171+0000 7fdd15ffb640 1 -- 172.21.15.106:0/3500286145 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1000c830 con 0x7fdd20149390 2023-12-22T09:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.171+0000 7fdd15ffb640 1 -- 172.21.15.106:0/3500286145 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000cbe0 con 0x7fdd20149390 2023-12-22T09:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.171+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd20152490 con 0x7fdd20149390 2023-12-22T09:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.171+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd201e6e00 con 0x7fdd20149390 2023-12-22T09:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.172+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd20073f10 con 0x7fdd20149390 2023-12-22T09:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.173+0000 7fdd15ffb640 1 -- 172.21.15.106:0/3500286145 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd1000cd40 con 0x7fdd20149390 2023-12-22T09:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.174+0000 7fdd15ffb640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd0406a430 0x7fdd0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.174+0000 7fdd15ffb640 1 -- 172.21.15.106:0/3500286145 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdd10088570 con 0x7fdd20149390 2023-12-22T09:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.174+0000 7fdd2518c640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd0406a430 0x7fdd0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.175+0000 7fdd2518c640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd0406a430 0x7fdd0406c8f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009920 tx=0x7fdd1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.178+0000 7fdd15ffb640 1 -- 172.21.15.106:0/3500286145 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdd10053d60 con 0x7fdd20149390 2023-12-22T09:15:52.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.373+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdd2006bf20 con 0x7fdd20149390 2023-12-22T09:15:52.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.374+0000 7fdd15ffb640 1 -- 172.21.15.106:0/3500286145 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdd10009380 con 0x7fdd20149390 2023-12-22T09:15:52.374 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:52.374 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2023-12-22T09:15:52.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:15:52.374 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2023-12-22T09:15:52.374 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2023-12-22T09:15:52.374 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:15:52.374 INFO:teuthology.orchestra.run.smithi106.stdout:] 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd0406a430 msgr2=0x7fdd0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd0406a430 0x7fdd0406c8f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009920 tx=0x7fdd1c008040 comp rx=0 tx=0).stop 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd20149390 msgr2=0x7fdd201eab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd20149390 0x7fdd201eab00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000e810 tx=0x7fdd1000ecd0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 shutdown_connections 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdd0406a430 0x7fdd0406c8f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd201549b0 0x7fdd201e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd20149390 0x7fdd201eab00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 --2- 172.21.15.106:0/3500286145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdd0c004d00 0x7fdd200c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 >> 172.21.15.106:0/3500286145 conn(0x7fdd200c1db0 msgr2=0x7fdd200c11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:52.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 shutdown_connections 2023-12-22T09:15:52.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.377+0000 7fdd273f0640 1 -- 172.21.15.106:0/3500286145 wait complete. 2023-12-22T09:15:52.395 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T09:15:52.396 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T09:15:52.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.614+0000 7fbbe1716640 1 Processor -- start 2023-12-22T09:15:52.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.614+0000 7fbbe1716640 1 -- start start 2023-12-22T09:15:52.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbe1716640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbdc06ac00 0x7fbbdc06afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbe1716640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbdc154910 0x7fbbdc0c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbe1716640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbdc157a90 0x7fbbdc157f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbe1716640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc0c22e0 con 0x7fbbdc154910 2023-12-22T09:15:52.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbe1716640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc06ecf0 con 0x7fbbdc157a90 2023-12-22T09:15:52.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbe1716640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc154da0 con 0x7fbbdc06ac00 2023-12-22T09:15:52.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbda7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbdc154910 0x7fbbdc0c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbda7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbdc154910 0x7fbbdc0c1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40858/0 (socket says 172.21.15.106:40858) 2023-12-22T09:15:52.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbda7fc640 1 -- 172.21.15.106:0/470502111 learned_addr learned my addr 172.21.15.106:0/470502111 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:52.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbda7fc640 1 -- 172.21.15.106:0/470502111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbdc06ac00 msgr2=0x7fbbdc06afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:52.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbda7fc640 1 --2- 172.21.15.106:0/470502111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbdc06ac00 0x7fbbdc06afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbda7fc640 1 -- 172.21.15.106:0/470502111 >> v2:172.21.15.132:3300/0 conn(0x7fbbdc157a90 msgr2=0x7fbbdc157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:52.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbda7fc640 1 --2- 172.21.15.106:0/470502111 >> v2:172.21.15.132:3300/0 conn(0x7fbbdc157a90 0x7fbbdc157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.616+0000 7fbbda7fc640 1 -- 172.21.15.106:0/470502111 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc06e730 con 0x7fbbdc154910 2023-12-22T09:15:52.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.617+0000 7fbbda7fc640 1 --2- 172.21.15.106:0/470502111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc154910 0x7fbbdc0c1da0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc065ae0 tx=0x7fbbc402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3b15d73143ae7b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:52.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbd9ffb640 1 -- 172.21.15.106:0/470502111 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4031740 con 0x7fbbdc154910 2023-12-22T09:15:52.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbd9ffb640 1 -- 172.21.15.106:0/470502111 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc40318a0 con 0x7fbbdc154910 2023-12-22T09:15:52.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbd9ffb640 1 -- 172.21.15.106:0/470502111 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4031c30 con 0x7fbbdc154910 2023-12-22T09:15:52.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbe1716640 1 -- 172.21.15.106:0/470502111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc154910 msgr2=0x7fbbdc0c1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:52.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbe1716640 1 --2- 172.21.15.106:0/470502111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc154910 0x7fbbdc0c1da0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc065ae0 tx=0x7fbbc402b7e0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbe1716640 1 -- 172.21.15.106:0/470502111 shutdown_connections 2023-12-22T09:15:52.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbe1716640 1 --2- 172.21.15.106:0/470502111 >> v2:172.21.15.132:3300/0 conn(0x7fbbdc157a90 0x7fbbdc157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbe1716640 1 --2- 172.21.15.106:0/470502111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc154910 0x7fbbdc0c1da0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbe1716640 1 --2- 172.21.15.106:0/470502111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbdc06ac00 0x7fbbdc06afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.618+0000 7fbbe1716640 1 -- 172.21.15.106:0/470502111 >> 172.21.15.106:0/470502111 conn(0x7fbbdc0c60f0 msgr2=0x7fbbdc0c2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:52.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.619+0000 7fbbe1716640 1 -- 172.21.15.106:0/470502111 shutdown_connections 2023-12-22T09:15:52.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.619+0000 7fbbe1716640 1 -- 172.21.15.106:0/470502111 wait complete. 2023-12-22T09:15:52.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.620+0000 7fbbe1716640 1 Processor -- start 2023-12-22T09:15:52.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.620+0000 7fbbe1716640 1 -- start start 2023-12-22T09:15:52.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.621+0000 7fbbe1716640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc06ac00 0x7fbbdc156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.621+0000 7fbbe1716640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbdc157a90 0x7fbbdc1e9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.621+0000 7fbbe1716640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbdc14d5b0 0x7fbbdc14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.621+0000 7fbbe1716640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0b9a70 con 0x7fbbdc06ac00 2023-12-22T09:15:52.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.621+0000 7fbbe1716640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1e95e0 con 0x7fbbdc14d5b0 2023-12-22T09:15:52.622 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.621+0000 7fbbe1716640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1e92f0 con 0x7fbbdc157a90 2023-12-22T09:15:52.622 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.621+0000 7fbbdaffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc06ac00 0x7fbbdc156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.622 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbdaffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc06ac00 0x7fbbdc156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40864/0 (socket says 172.21.15.106:40864) 2023-12-22T09:15:52.622 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbdaffd640 1 -- 172.21.15.106:0/3883787148 learned_addr learned my addr 172.21.15.106:0/3883787148 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:52.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbda7fc640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbdc157a90 0x7fbbdc1e9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbdb7fe640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbdc14d5b0 0x7fbbdc14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbdaffd640 1 -- 172.21.15.106:0/3883787148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbdc157a90 msgr2=0x7fbbdc1e9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:52.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbdaffd640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbdc157a90 0x7fbbdc1e9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbdaffd640 1 -- 172.21.15.106:0/3883787148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbdc14d5b0 msgr2=0x7fbbdc14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:52.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbdaffd640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbdc14d5b0 0x7fbbdc14e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:52.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbdaffd640 1 -- 172.21.15.106:0/3883787148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40094d0 con 0x7fbbdc06ac00 2023-12-22T09:15:52.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbdaffd640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc06ac00 0x7fbbdc156500 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00ba50 tx=0x7fbbcc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:52.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.622+0000 7fbbd37fe640 1 -- 172.21.15.106:0/3883787148 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc00cbe0 con 0x7fbbdc06ac00 2023-12-22T09:15:52.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.623+0000 7fbbd37fe640 1 -- 172.21.15.106:0/3883787148 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc00cd60 con 0x7fbbdc06ac00 2023-12-22T09:15:52.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.623+0000 7fbbd37fe640 1 -- 172.21.15.106:0/3883787148 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc014680 con 0x7fbbdc06ac00 2023-12-22T09:15:52.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.623+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc0b9c50 con 0x7fbbdc06ac00 2023-12-22T09:15:52.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.623+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc153180 con 0x7fbbdc06ac00 2023-12-22T09:15:52.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.624+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc1e9850 con 0x7fbbdc06ac00 2023-12-22T09:15:52.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.625+0000 7fbbd37fe640 1 -- 172.21.15.106:0/3883787148 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbbcc01d3b0 con 0x7fbbdc06ac00 2023-12-22T09:15:52.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.626+0000 7fbbd37fe640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbbc06a430 0x7fbbbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:52.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.626+0000 7fbbd37fe640 1 -- 172.21.15.106:0/3883787148 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbbcc088670 con 0x7fbbdc06ac00 2023-12-22T09:15:52.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.626+0000 7fbbda7fc640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbbc06a430 0x7fbbbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:52.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.627+0000 7fbbda7fc640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbbc06a430 0x7fbbbc06c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4035000 tx=0x7fbbc4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.630+0000 7fbbd37fe640 1 -- 172.21.15.106:0/3883787148 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbbcc053f00 con 0x7fbbdc06ac00 2023-12-22T09:15:52.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:52.822+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbbdc153370 con 0x7fbbdc06ac00 2023-12-22T09:15:53.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-22T09:15:53.624 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.624+0000 7fbbd37fe640 1 -- 172.21.15.106:0/3883787148 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbbcc0190b0 con 0x7fbbdc06ac00 2023-12-22T09:15:53.624 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2023-12-22T09:15:53.629 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.629+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbbc06a430 msgr2=0x7fbbbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:53.629 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.629+0000 7fbbe1716640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbbc06a430 0x7fbbbc06c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4035000 tx=0x7fbbc4008030 comp rx=0 tx=0).stop 2023-12-22T09:15:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.629+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc06ac00 msgr2=0x7fbbdc156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.629+0000 7fbbe1716640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc06ac00 0x7fbbdc156500 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00ba50 tx=0x7fbbcc00bf10 comp rx=0 tx=0).stop 2023-12-22T09:15:53.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.630+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 shutdown_connections 2023-12-22T09:15:53.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.630+0000 7fbbe1716640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbbbc06a430 0x7fbbbc06c8f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.630+0000 7fbbe1716640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbdc14d5b0 0x7fbbdc14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.630+0000 7fbbe1716640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbdc157a90 0x7fbbdc1e9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.630+0000 7fbbe1716640 1 --2- 172.21.15.106:0/3883787148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbdc06ac00 0x7fbbdc156500 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.630+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 >> 172.21.15.106:0/3883787148 conn(0x7fbbdc0c60f0 msgr2=0x7fbbdc06afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:53.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.631+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 shutdown_connections 2023-12-22T09:15:53.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.632+0000 7fbbe1716640 1 -- 172.21.15.106:0/3883787148 wait complete. 2023-12-22T09:15:53.659 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T09:15:53.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.871+0000 7efe43f92640 1 Processor -- start 2023-12-22T09:15:53.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.871+0000 7efe43f92640 1 -- start start 2023-12-22T09:15:53.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.873+0000 7efe43f92640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe3c06bdc0 0x7efe3c1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:53.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.873+0000 7efe43f92640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c14f570 con 0x7efe3c06c2d0 2023-12-22T09:15:53.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.873+0000 7efe43f92640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c0c0b00 con 0x7efe3c0c5a30 2023-12-22T09:15:53.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.873+0000 7efe43f92640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0a90f0 con 0x7efe3c06bdc0 2023-12-22T09:15:53.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.873+0000 7efe4252f640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efe3c06c2d0 0x7efe3c15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47900/0 (socket says 172.21.15.106:47900) 2023-12-22T09:15:53.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.873+0000 7efe4252f640 1 -- 172.21.15.106:0/690852441 learned_addr learned my addr 172.21.15.106:0/690852441 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:53.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.873+0000 7efe4152d640 1 --2- 172.21.15.106:0/690852441 >> v2:172.21.15.132:3300/0 conn(0x7efe3c06bdc0 0x7efe3c1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:53.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.873+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424967863 0 0) 0x7efe3c14f570 con 0x7efe3c06c2d0 2023-12-22T09:15:53.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe28003520 con 0x7efe3c06c2d0 2023-12-22T09:15:53.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2857721485 0 0) 0x7efe28003520 con 0x7efe3c06c2d0 2023-12-22T09:15:53.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 >> v2:172.21.15.132:3300/0 conn(0x7efe3c06bdc0 msgr2=0x7efe3c1557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:53.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 --2- 172.21.15.106:0/690852441 >> v2:172.21.15.132:3300/0 conn(0x7efe3c06bdc0 0x7efe3c1557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 >> v1:172.21.15.132:6789/0 conn(0x7efe3c0c5a30 legacy=0x7efe3c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:53.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c0bfd40 con 0x7efe3c06c2d0 2023-12-22T09:15:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7efe340019f0 con 0x7efe3c06c2d0 2023-12-22T09:15:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 >> v1:172.21.15.106:6789/0 conn(0x7efe3c06c2d0 legacy=0x7efe3c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe28003970 0x7efe28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe280047c0 0x7efe28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe28005180 0x7efe2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0a90f0 con 0x7efe28003970 2023-12-22T09:15:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2800c120 con 0x7efe280047c0 2023-12-22T09:15:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2800c2e0 con 0x7efe28005180 2023-12-22T09:15:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.874+0000 7efe41d2e640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe28003970 0x7efe28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.875+0000 7efe4152d640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe280047c0 0x7efe28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.875+0000 7efe41d2e640 1 -- 172.21.15.106:0/690852441 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe28005180 msgr2=0x7efe2800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.875+0000 7efe41d2e640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe28005180 0x7efe2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.875+0000 7efe41d2e640 1 -- 172.21.15.106:0/690852441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe280047c0 msgr2=0x7efe28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.875+0000 7efe41d2e640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe280047c0 0x7efe28004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.875+0000 7efe41d2e640 1 -- 172.21.15.106:0/690852441 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28003520 con 0x7efe28003970 2023-12-22T09:15:53.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.875+0000 7efe4252f640 1 -- 172.21.15.106:0/690852441 reap_dead start 2023-12-22T09:15:53.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.876+0000 7efe41d2e640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe28003970 0x7efe28003d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efe38001750 tx=0x7efe280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e171815340009460 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:53.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.876+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe380052d0 con 0x7efe28003970 2023-12-22T09:15:53.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.876+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3802e050 con 0x7efe28003970 2023-12-22T09:15:53.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.876+0000 7efe40d2c640 1 -- 172.21.15.106:0/690852441 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38003830 con 0x7efe28003970 2023-12-22T09:15:53.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.877+0000 7efe43f92640 1 -- 172.21.15.106:0/690852441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe28003970 msgr2=0x7efe28003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:53.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.877+0000 7efe43f92640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe28003970 0x7efe28003d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efe38001750 tx=0x7efe280057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.877+0000 7efe43f92640 1 -- 172.21.15.106:0/690852441 shutdown_connections 2023-12-22T09:15:53.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.877+0000 7efe43f92640 1 --2- 172.21.15.106:0/690852441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe28003970 0x7efe28003d90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.877+0000 7efe43f92640 1 -- 172.21.15.106:0/690852441 >> 172.21.15.106:0/690852441 conn(0x7efe3c06a220 msgr2=0x7efe3c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:53.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.877+0000 7efe43f92640 1 -- 172.21.15.106:0/690852441 shutdown_connections 2023-12-22T09:15:53.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.877+0000 7efe43f92640 1 -- 172.21.15.106:0/690852441 wait complete. 2023-12-22T09:15:53.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.879+0000 7efe43f92640 1 Processor -- start 2023-12-22T09:15:53.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.880+0000 7efe43f92640 1 -- start start 2023-12-22T09:15:53.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe43f92640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe28003970 0x7efe3c070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:53.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe43f92640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe3c070760 0x7efe3c1dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:53.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe43f92640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe3c1dc910 0x7efe3c1ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:53.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe43f92640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1db970 con 0x7efe3c1dc910 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe43f92640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1dddf0 con 0x7efe3c070760 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe43f92640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0c52f0 con 0x7efe28003970 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe4252f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe3c1dc910 0x7efe3c1ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe4252f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe3c1dc910 0x7efe3c1ecb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37658/0 (socket says 172.21.15.106:37658) 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe4252f640 1 -- 172.21.15.106:0/2108384264 learned_addr learned my addr 172.21.15.106:0/2108384264 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe41d2e640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe28003970 0x7efe3c070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.881+0000 7efe4152d640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe3c070760 0x7efe3c1dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe4252f640 1 -- 172.21.15.106:0/2108384264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe28003970 msgr2=0x7efe3c070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe4252f640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe28003970 0x7efe3c070220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe4252f640 1 -- 172.21.15.106:0/2108384264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe3c070760 msgr2=0x7efe3c1dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe4252f640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe3c070760 0x7efe3c1dc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe4252f640 1 -- 172.21.15.106:0/2108384264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c1db320 con 0x7efe3c1dc910 2023-12-22T09:15:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe4252f640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe3c1dc910 0x7efe3c1ecb10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0a9350 tx=0x7efe3400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe327fc640 1 -- 172.21.15.106:0/2108384264 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400ce50 con 0x7efe3c1dc910 2023-12-22T09:15:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe327fc640 1 -- 172.21.15.106:0/2108384264 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400a5b0 con 0x7efe3c1dc910 2023-12-22T09:15:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c1db600 con 0x7efe3c1dc910 2023-12-22T09:15:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe327fc640 1 -- 172.21.15.106:0/2108384264 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400a9a0 con 0x7efe3c1dc910 2023-12-22T09:15:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.882+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c0c3580 con 0x7efe3c1dc910 2023-12-22T09:15:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.883+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c1dbae0 con 0x7efe3c1dc910 2023-12-22T09:15:53.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.885+0000 7efe327fc640 1 -- 172.21.15.106:0/2108384264 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe3400ab00 con 0x7efe3c1dc910 2023-12-22T09:15:53.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.886+0000 7efe327fc640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe2006a430 0x7efe2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:53.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.886+0000 7efe327fc640 1 -- 172.21.15.106:0/2108384264 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7efe34088790 con 0x7efe3c1dc910 2023-12-22T09:15:53.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.886+0000 7efe41d2e640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe2006a430 0x7efe2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:53.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.887+0000 7efe41d2e640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe2006a430 0x7efe2006c8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe38033000 tx=0x7efe38009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:53.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:53.890+0000 7efe327fc640 1 -- 172.21.15.106:0/2108384264 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe34053f90 con 0x7efe3c1dc910 2023-12-22T09:15:54.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.085+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efe3c073f10 con 0x7efe3c1dc910 2023-12-22T09:15:54.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.642+0000 7efe327fc640 1 -- 172.21.15.106:0/2108384264 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7efe340575b0 con 0x7efe3c1dc910 2023-12-22T09:15:54.643 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2023-12-22T09:15:54.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.648+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe2006a430 msgr2=0x7efe2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:54.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.648+0000 7efe43f92640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe2006a430 0x7efe2006c8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe38033000 tx=0x7efe38009030 comp rx=0 tx=0).stop 2023-12-22T09:15:54.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.648+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe3c1dc910 msgr2=0x7efe3c1ecb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:54.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.648+0000 7efe43f92640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe3c1dc910 0x7efe3c1ecb10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0a9350 tx=0x7efe3400cc00 comp rx=0 tx=0).stop 2023-12-22T09:15:54.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.652+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 shutdown_connections 2023-12-22T09:15:54.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.652+0000 7efe43f92640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efe2006a430 0x7efe2006c8f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.652+0000 7efe43f92640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe3c1dc910 0x7efe3c1ecb10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.652+0000 7efe43f92640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe3c070760 0x7efe3c1dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.652+0000 7efe43f92640 1 --2- 172.21.15.106:0/2108384264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efe28003970 0x7efe3c070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.652+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 >> 172.21.15.106:0/2108384264 conn(0x7efe3c06a220 msgr2=0x7efe3c14d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:54.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.652+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 shutdown_connections 2023-12-22T09:15:54.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.652+0000 7efe43f92640 1 -- 172.21.15.106:0/2108384264 wait complete. 2023-12-22T09:15:54.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T09:15:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.871+0000 7f94e11f1640 1 Processor -- start 2023-12-22T09:15:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.871+0000 7f94e11f1640 1 -- start start 2023-12-22T09:15:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.873+0000 7f94e11f1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94dc1514f0 0x7f94dc0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.873+0000 7f94e11f1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94dc06aca0 0x7f94dc0c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.873+0000 7f94e11f1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94dc0c5b40 con 0x7f94dc0c4380 2023-12-22T09:15:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.873+0000 7f94e11f1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc0c4e10 con 0x7f94dc06aca0 2023-12-22T09:15:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.873+0000 7f94e11f1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc06b390 con 0x7f94dc1514f0 2023-12-22T09:15:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.873+0000 7f94db59e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94dc06aca0 0x7f94dc0c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.873+0000 7f94da59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f94dc0c4380 0x7f94dc0c7610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47914/0 (socket says 172.21.15.106:47914) 2023-12-22T09:15:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.873+0000 7f94da59c640 1 -- 172.21.15.106:0/1138005076 learned_addr learned my addr 172.21.15.106:0/1138005076 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.873+0000 7f94dad9d640 1 --2- 172.21.15.106:0/1138005076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94dc1514f0 0x7f94dc0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.874+0000 7f94db59e640 1 -- 172.21.15.106:0/1138005076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94dc1514f0 msgr2=0x7f94dc0c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.874+0000 7f94db59e640 1 --2- 172.21.15.106:0/1138005076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94dc1514f0 0x7f94dc0c48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.874+0000 7f94db59e640 1 -- 172.21.15.106:0/1138005076 >> v1:172.21.15.106:6789/0 conn(0x7f94dc0c4380 legacy=0x7f94dc0c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.874+0000 7f94d9d9b640 1 -- 172.21.15.106:0/1138005076 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274749386 0 0) 0x7f94dc0c5b40 con 0x7f94dc0c4380 2023-12-22T09:15:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.874+0000 7f94db59e640 1 -- 172.21.15.106:0/1138005076 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc06b650 con 0x7f94dc06aca0 2023-12-22T09:15:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.875+0000 7f94db59e640 1 --2- 172.21.15.106:0/1138005076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 0x7f94dc0c4fd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94d40097a0 tx=0x7f94d402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5707ee1a3723c308 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.875+0000 7f94d9d9b640 1 -- 172.21.15.106:0/1138005076 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d402f050 con 0x7f94dc06aca0 2023-12-22T09:15:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.875+0000 7f94d9d9b640 1 -- 172.21.15.106:0/1138005076 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4031700 con 0x7f94dc06aca0 2023-12-22T09:15:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.875+0000 7f94d9d9b640 1 -- 172.21.15.106:0/1138005076 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4031a90 con 0x7f94dc06aca0 2023-12-22T09:15:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.876+0000 7f94e11f1640 1 -- 172.21.15.106:0/1138005076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 msgr2=0x7f94dc0c4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.876+0000 7f94e11f1640 1 --2- 172.21.15.106:0/1138005076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 0x7f94dc0c4fd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94d40097a0 tx=0x7f94d402b7a0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.876+0000 7f94e11f1640 1 -- 172.21.15.106:0/1138005076 shutdown_connections 2023-12-22T09:15:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.876+0000 7f94e11f1640 1 --2- 172.21.15.106:0/1138005076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 0x7f94dc0c4fd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.876+0000 7f94e11f1640 1 --2- 172.21.15.106:0/1138005076 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94dc1514f0 0x7f94dc0c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.876+0000 7f94e11f1640 1 -- 172.21.15.106:0/1138005076 >> 172.21.15.106:0/1138005076 conn(0x7f94dc0c9710 msgr2=0x7f94dc0c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.876+0000 7f94e11f1640 1 -- 172.21.15.106:0/1138005076 shutdown_connections 2023-12-22T09:15:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.876+0000 7f94e11f1640 1 -- 172.21.15.106:0/1138005076 wait complete. 2023-12-22T09:15:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.878+0000 7f94e11f1640 1 Processor -- start 2023-12-22T09:15:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.878+0000 7f94e11f1640 1 -- start start 2023-12-22T09:15:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.879+0000 7f94e11f1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 0x7f94dc1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.879+0000 7f94e11f1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94dc0c4380 0x7f94dc14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.879+0000 7f94e11f1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94dc1514f0 0x7f94dc14bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.879+0000 7f94e11f1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc157040 con 0x7f94dc06aca0 2023-12-22T09:15:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.879+0000 7f94e11f1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc1553b0 con 0x7f94dc0c4380 2023-12-22T09:15:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.879+0000 7f94e11f1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc1ed280 con 0x7f94dc1514f0 2023-12-22T09:15:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.879+0000 7f94dad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 0x7f94dc1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.879+0000 7f94dad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 0x7f94dc1562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37678/0 (socket says 172.21.15.106:37678) 2023-12-22T09:15:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.879+0000 7f94dad9d640 1 -- 172.21.15.106:0/1238950631 learned_addr learned my addr 172.21.15.106:0/1238950631 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94da59c640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94dc0c4380 0x7f94dc14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94dad9d640 1 -- 172.21.15.106:0/1238950631 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94dc1514f0 msgr2=0x7f94dc14bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94dad9d640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94dc1514f0 0x7f94dc14bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94dad9d640 1 -- 172.21.15.106:0/1238950631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94dc0c4380 msgr2=0x7f94dc14b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94dad9d640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94dc0c4380 0x7f94dc14b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94dad9d640 1 -- 172.21.15.106:0/1238950631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4009400 con 0x7f94dc06aca0 2023-12-22T09:15:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94dad9d640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 0x7f94dc1562f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00d620 tx=0x7f94cc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94d37fe640 1 -- 172.21.15.106:0/1238950631 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00b620 con 0x7f94dc06aca0 2023-12-22T09:15:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94d37fe640 1 -- 172.21.15.106:0/1238950631 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc00b780 con 0x7f94dc06aca0 2023-12-22T09:15:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94d37fe640 1 -- 172.21.15.106:0/1238950631 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00bb30 con 0x7f94dc06aca0 2023-12-22T09:15:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc1ed560 con 0x7f94dc06aca0 2023-12-22T09:15:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.880+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc156830 con 0x7f94dc06aca0 2023-12-22T09:15:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.881+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc153520 con 0x7f94dc06aca0 2023-12-22T09:15:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.884+0000 7f94d37fe640 1 -- 172.21.15.106:0/1238950631 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f94cc00bc90 con 0x7f94dc06aca0 2023-12-22T09:15:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.885+0000 7f94d37fe640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94bc06a430 0x7f94bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.885+0000 7f94d37fe640 1 -- 172.21.15.106:0/1238950631 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f94cc089750 con 0x7f94dc06aca0 2023-12-22T09:15:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.885+0000 7f94da59c640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94bc06a430 0x7f94bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.885+0000 7f94da59c640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94bc06a430 0x7f94bc06c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94dc14a7c0 tx=0x7f94c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:54.888+0000 7f94d37fe640 1 -- 172.21.15.106:0/1238950631 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f94cc054d40 con 0x7f94dc06aca0 2023-12-22T09:15:55.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.112+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f94dc153520 con 0x7f94dc06aca0 2023-12-22T09:15:55.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.121+0000 7f94d37fe640 1 -- 172.21.15.106:0/1238950631 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f94dc153520 con 0x7f94dc06aca0 2023-12-22T09:15:55.124 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 5 and data pool 6 2023-12-22T09:15:55.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.125+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94bc06a430 msgr2=0x7f94bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.125+0000 7f94e11f1640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94bc06a430 0x7f94bc06c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94dc14a7c0 tx=0x7f94c4009040 comp rx=0 tx=0).stop 2023-12-22T09:15:55.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.126+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 msgr2=0x7f94dc1562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.126+0000 7f94e11f1640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 0x7f94dc1562f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00d620 tx=0x7f94cc00dae0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.126+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 shutdown_connections 2023-12-22T09:15:55.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.126+0000 7f94e11f1640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94bc06a430 0x7f94bc06c8f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.126+0000 7f94e11f1640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94dc1514f0 0x7f94dc14bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.126+0000 7f94e11f1640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94dc0c4380 0x7f94dc14b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.126+0000 7f94e11f1640 1 --2- 172.21.15.106:0/1238950631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94dc06aca0 0x7f94dc1562f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.126+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 >> 172.21.15.106:0/1238950631 conn(0x7f94dc0c9710 msgr2=0x7f94dc0aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:55.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.127+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 shutdown_connections 2023-12-22T09:15:55.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.127+0000 7f94e11f1640 1 -- 172.21.15.106:0/1238950631 wait complete. 2023-12-22T09:15:55.154 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:55.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.335+0000 7f3e80138640 1 Processor -- start 2023-12-22T09:15:55.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.335+0000 7f3e80138640 1 -- start start 2023-12-22T09:15:55.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.337+0000 7f3e80138640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e780be700 0x7f3e780711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.337+0000 7f3e80138640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e78153e90 con 0x7f3e78069e60 2023-12-22T09:15:55.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.337+0000 7f3e80138640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e78154c10 con 0x7f3e78157c80 2023-12-22T09:15:55.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.337+0000 7f3e80138640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e78153c80 con 0x7f3e780be700 2023-12-22T09:15:55.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.337+0000 7f3e7ded4640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3e78069e60 0x7f3e7813cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47922/0 (socket says 172.21.15.106:47922) 2023-12-22T09:15:55.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.337+0000 7f3e7ded4640 1 -- 172.21.15.106:0/163649401 learned_addr learned my addr 172.21.15.106:0/163649401 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:55.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.337+0000 7f3e7e6d5640 1 --2- 172.21.15.106:0/163649401 >> v2:172.21.15.106:3300/0 conn(0x7f3e780be700 0x7f3e780711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:55.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.338+0000 7f3e7e6d5640 1 -- 172.21.15.106:0/163649401 >> v1:172.21.15.132:6789/0 conn(0x7f3e78157c80 legacy=0x7f3e78070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:55.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.338+0000 7f3e7e6d5640 1 -- 172.21.15.106:0/163649401 >> v1:172.21.15.106:6789/0 conn(0x7f3e78069e60 legacy=0x7f3e7813cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.338+0000 7f3e7ced2640 1 -- 172.21.15.106:0/163649401 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158253529 0 0) 0x7f3e78153e90 con 0x7f3e78069e60 2023-12-22T09:15:55.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.338+0000 7f3e7e6d5640 1 -- 172.21.15.106:0/163649401 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e78154130 con 0x7f3e780be700 2023-12-22T09:15:55.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.339+0000 7f3e7e6d5640 1 --2- 172.21.15.106:0/163649401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 0x7f3e780711d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009d90 tx=0x7f3e7002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1482c492da628 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:55.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.339+0000 7f3e7ced2640 1 -- 172.21.15.106:0/163649401 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7002cbd0 con 0x7f3e780be700 2023-12-22T09:15:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.339+0000 7f3e7ced2640 1 -- 172.21.15.106:0/163649401 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7002cd30 con 0x7f3e780be700 2023-12-22T09:15:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.339+0000 7f3e7ced2640 1 -- 172.21.15.106:0/163649401 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7002cea0 con 0x7f3e780be700 2023-12-22T09:15:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.340+0000 7f3e80138640 1 -- 172.21.15.106:0/163649401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 msgr2=0x7f3e780711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.340+0000 7f3e80138640 1 --2- 172.21.15.106:0/163649401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 0x7f3e780711d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009d90 tx=0x7f3e7002be20 comp rx=0 tx=0).stop 2023-12-22T09:15:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.340+0000 7f3e80138640 1 -- 172.21.15.106:0/163649401 shutdown_connections 2023-12-22T09:15:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.340+0000 7f3e80138640 1 --2- 172.21.15.106:0/163649401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 0x7f3e780711d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.340+0000 7f3e80138640 1 -- 172.21.15.106:0/163649401 >> 172.21.15.106:0/163649401 conn(0x7f3e780c5360 msgr2=0x7f3e780c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.340+0000 7f3e80138640 1 -- 172.21.15.106:0/163649401 shutdown_connections 2023-12-22T09:15:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.340+0000 7f3e80138640 1 -- 172.21.15.106:0/163649401 wait complete. 2023-12-22T09:15:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.341+0000 7f3e80138640 1 Processor -- start 2023-12-22T09:15:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.342+0000 7f3e80138640 1 -- start start 2023-12-22T09:15:55.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.342+0000 7f3e80138640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e78069e60 0x7f3e7813ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.342+0000 7f3e80138640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 0x7f3e78138c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.342+0000 7f3e80138640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e78157c80 0x7f3e78139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.342+0000 7f3e80138640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780aa1f0 con 0x7f3e780be700 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.342+0000 7f3e80138640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7813d020 con 0x7f3e78069e60 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.342+0000 7f3e80138640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780c2a00 con 0x7f3e78157c80 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.343+0000 7f3e7d6d3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 0x7f3e78138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.343+0000 7f3e7d6d3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 0x7f3e78138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37706/0 (socket says 172.21.15.106:37706) 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.343+0000 7f3e7d6d3640 1 -- 172.21.15.106:0/3369791173 learned_addr learned my addr 172.21.15.106:0/3369791173 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.343+0000 7f3e7d6d3640 1 -- 172.21.15.106:0/3369791173 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e78157c80 msgr2=0x7f3e78139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.343+0000 7f3e7d6d3640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e78157c80 0x7f3e78139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.343+0000 7f3e7d6d3640 1 -- 172.21.15.106:0/3369791173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e78069e60 msgr2=0x7f3e7813ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.343+0000 7f3e7d6d3640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e78069e60 0x7f3e7813ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.343+0000 7f3e7d6d3640 1 -- 172.21.15.106:0/3369791173 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70009a70 con 0x7f3e780be700 2023-12-22T09:15:55.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.343+0000 7f3e7d6d3640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 0x7f3e78138c30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800b3f0 tx=0x7f3e6800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:55.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.344+0000 7f3e6e7fc640 1 -- 172.21.15.106:0/3369791173 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68011830 con 0x7f3e780be700 2023-12-22T09:15:55.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.344+0000 7f3e6e7fc640 1 -- 172.21.15.106:0/3369791173 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68011990 con 0x7f3e780be700 2023-12-22T09:15:55.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.344+0000 7f3e6e7fc640 1 -- 172.21.15.106:0/3369791173 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68011d40 con 0x7f3e780be700 2023-12-22T09:15:55.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.344+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e780c2ce0 con 0x7f3e780be700 2023-12-22T09:15:55.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.344+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e780c1d40 con 0x7f3e780be700 2023-12-22T09:15:55.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.345+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e78153190 con 0x7f3e780be700 2023-12-22T09:15:55.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.346+0000 7f3e6e7fc640 1 -- 172.21.15.106:0/3369791173 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e6801a400 con 0x7f3e780be700 2023-12-22T09:15:55.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.347+0000 7f3e6e7fc640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3e5c06a430 0x7f3e5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.347+0000 7f3e6e7fc640 1 -- 172.21.15.106:0/3369791173 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3e68088970 con 0x7f3e780be700 2023-12-22T09:15:55.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.347+0000 7f3e7ded4640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3e5c06a430 0x7f3e5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:55.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.348+0000 7f3e7ded4640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3e5c06a430 0x7f3e5c06c8f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3e74007fd0 tx=0x7f3e740077c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:55.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.351+0000 7f3e6e7fc640 1 -- 172.21.15.106:0/3369791173 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e68053e10 con 0x7f3e780be700 2023-12-22T09:15:55.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.532+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e78073f10 con 0x7f3e780be700 2023-12-22T09:15:55.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.535+0000 7f3e6e7fc640 1 -- 172.21.15.106:0/3369791173 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16367 (secure 0 0 0) 0x7f3e68015090 con 0x7f3e780be700 2023-12-22T09:15:55.536 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:55.536 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":39,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:55.114658+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:55.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3e5c06a430 msgr2=0x7f3e5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3e5c06a430 0x7f3e5c06c8f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3e74007fd0 tx=0x7f3e740077c0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 msgr2=0x7f3e78138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 0x7f3e78138c30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800b3f0 tx=0x7f3e6800b8b0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 shutdown_connections 2023-12-22T09:15:55.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3e5c06a430 0x7f3e5c06c8f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e78157c80 0x7f3e78139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e780be700 0x7f3e78138c30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 --2- 172.21.15.106:0/3369791173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e78069e60 0x7f3e7813ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.537+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 >> 172.21.15.106:0/3369791173 conn(0x7f3e780c5360 msgr2=0x7f3e78152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:55.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.538+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 shutdown_connections 2023-12-22T09:15:55.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.538+0000 7f3e80138640 1 -- 172.21.15.106:0/3369791173 wait complete. 2023-12-22T09:15:55.556 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.753+0000 7f64eda5f640 1 Processor -- start 2023-12-22T09:15:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.753+0000 7f64eda5f640 1 -- start start 2023-12-22T09:15:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.755+0000 7f64eda5f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f64e80bfce0 0x7f64e806a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.755+0000 7f64eda5f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64e8151b30 0x7f64e8151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.755+0000 7f64eda5f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80bf770 con 0x7f64e813b060 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.755+0000 7f64eda5f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e8155120 con 0x7f64e80bfce0 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.755+0000 7f64eda5f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e8155400 con 0x7f64e8151b30 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.756+0000 7f64de7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f64e80bfce0 0x7f64e806a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.756+0000 7f64de7fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f64e80bfce0 0x7f64e806a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37718/0 (socket says 172.21.15.106:37718) 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.756+0000 7f64de7fc640 1 -- 172.21.15.106:0/1027279297 learned_addr learned my addr 172.21.15.106:0/1027279297 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.756+0000 7f64de7fc640 1 -- 172.21.15.106:0/1027279297 >> v2:172.21.15.132:3300/0 conn(0x7f64e8151b30 msgr2=0x7f64e8151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.756+0000 7f64e77fe640 1 --2- 172.21.15.106:0/1027279297 >> v2:172.21.15.132:3300/0 conn(0x7f64e8151b30 0x7f64e8151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.756+0000 7f64de7fc640 1 --2- 172.21.15.106:0/1027279297 >> v2:172.21.15.132:3300/0 conn(0x7f64e8151b30 0x7f64e8151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.756+0000 7f64de7fc640 1 -- 172.21.15.106:0/1027279297 >> v1:172.21.15.132:6789/0 conn(0x7f64e813b060 legacy=0x7f64e8069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.756+0000 7f64de7fc640 1 -- 172.21.15.106:0/1027279297 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e81556e0 con 0x7f64e80bfce0 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.757+0000 7f64de7fc640 1 --2- 172.21.15.106:0/1027279297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e80bfce0 0x7f64e806a6b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f64e80c02a0 tx=0x7f64d002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15d60da6d914651 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.757+0000 7f64e67fc640 1 -- 172.21.15.106:0/1027279297 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0031800 con 0x7f64e80bfce0 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.757+0000 7f64e67fc640 1 -- 172.21.15.106:0/1027279297 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d0031960 con 0x7f64e80bfce0 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.757+0000 7f64e67fc640 1 -- 172.21.15.106:0/1027279297 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0031cf0 con 0x7f64e80bfce0 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.758+0000 7f64eda5f640 1 -- 172.21.15.106:0/1027279297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e80bfce0 msgr2=0x7f64e806a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.758+0000 7f64eda5f640 1 --2- 172.21.15.106:0/1027279297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e80bfce0 0x7f64e806a6b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f64e80c02a0 tx=0x7f64d002b8a0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.758+0000 7f64eda5f640 1 -- 172.21.15.106:0/1027279297 shutdown_connections 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.758+0000 7f64eda5f640 1 --2- 172.21.15.106:0/1027279297 >> v2:172.21.15.132:3300/0 conn(0x7f64e8151b30 0x7f64e8151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.758+0000 7f64eda5f640 1 --2- 172.21.15.106:0/1027279297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e80bfce0 0x7f64e806a6b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.758+0000 7f64eda5f640 1 -- 172.21.15.106:0/1027279297 >> 172.21.15.106:0/1027279297 conn(0x7f64e80c5360 msgr2=0x7f64e80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.758+0000 7f64eda5f640 1 -- 172.21.15.106:0/1027279297 shutdown_connections 2023-12-22T09:15:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.758+0000 7f64eda5f640 1 -- 172.21.15.106:0/1027279297 wait complete. 2023-12-22T09:15:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.760+0000 7f64eda5f640 1 Processor -- start 2023-12-22T09:15:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.760+0000 7f64eda5f640 1 -- start start 2023-12-22T09:15:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64eda5f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64e80bfce0 0x7f64e8153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64eda5f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e813b060 0x7f64e80be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64eda5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64e8151b30 0x7f64e80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64eda5f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e81ed580 con 0x7f64e813b060 2023-12-22T09:15:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64eda5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e8153980 con 0x7f64e8151b30 2023-12-22T09:15:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64eda5f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e81545e0 con 0x7f64e80bfce0 2023-12-22T09:15:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64de7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e813b060 0x7f64e80be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64de7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e813b060 0x7f64e80be8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37734/0 (socket says 172.21.15.106:37734) 2023-12-22T09:15:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64de7fc640 1 -- 172.21.15.106:0/2944421365 learned_addr learned my addr 172.21.15.106:0/2944421365 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64de7fc640 1 -- 172.21.15.106:0/2944421365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64e80bfce0 msgr2=0x7f64e8153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64de7fc640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64e80bfce0 0x7f64e8153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64de7fc640 1 -- 172.21.15.106:0/2944421365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64e8151b30 msgr2=0x7f64e80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64de7fc640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64e8151b30 0x7f64e80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.761+0000 7f64de7fc640 1 -- 172.21.15.106:0/2944421365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00094d0 con 0x7f64e813b060 2023-12-22T09:15:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.762+0000 7f64de7fc640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e813b060 0x7f64e80be8e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f64d002b8e0 tx=0x7f64d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.762+0000 7f64e4ff9640 1 -- 172.21.15.106:0/2944421365 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d003ad30 con 0x7f64e813b060 2023-12-22T09:15:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.762+0000 7f64e4ff9640 1 -- 172.21.15.106:0/2944421365 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d003ae90 con 0x7f64e813b060 2023-12-22T09:15:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.762+0000 7f64e4ff9640 1 -- 172.21.15.106:0/2944421365 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0044630 con 0x7f64e813b060 2023-12-22T09:15:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.762+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e8154b60 con 0x7f64e813b060 2023-12-22T09:15:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.762+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e81ed2a0 con 0x7f64e813b060 2023-12-22T09:15:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.763+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e8154440 con 0x7f64e813b060 2023-12-22T09:15:55.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.764+0000 7f64e4ff9640 1 -- 172.21.15.106:0/2944421365 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f64d0044790 con 0x7f64e813b060 2023-12-22T09:15:55.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.765+0000 7f64e4ff9640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f64c806a430 0x7f64c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:55.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.765+0000 7f64e4ff9640 1 -- 172.21.15.106:0/2944421365 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f64d002e070 con 0x7f64e813b060 2023-12-22T09:15:55.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.765+0000 7f64e6ffd640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f64c806a430 0x7f64c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:55.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.766+0000 7f64e6ffd640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f64c806a430 0x7f64c806c8f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009690 tx=0x7f64d8006b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:55.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.769+0000 7f64e4ff9640 1 -- 172.21.15.106:0/2944421365 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f64e8154440 con 0x7f64e813b060 2023-12-22T09:15:55.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.957+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64e8153160 con 0x7f64e813b060 2023-12-22T09:15:55.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.958+0000 7f64e4ff9640 1 -- 172.21.15.106:0/2944421365 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16367 (secure 0 0 0) 0x7f64e8153160 con 0x7f64e813b060 2023-12-22T09:15:55.959 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:55.959 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":39,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:55.114658+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f64c806a430 msgr2=0x7f64c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f64c806a430 0x7f64c806c8f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009690 tx=0x7f64d8006b90 comp rx=0 tx=0).stop 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e813b060 msgr2=0x7f64e80be8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e813b060 0x7f64e80be8e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f64d002b8e0 tx=0x7f64d00046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 shutdown_connections 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f64c806a430 0x7f64c806c8f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64e8151b30 0x7f64e80702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64e813b060 0x7f64e80be8e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 --2- 172.21.15.106:0/2944421365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f64e80bfce0 0x7f64e8153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 >> 172.21.15.106:0/2944421365 conn(0x7f64e80c5360 msgr2=0x7f64e80c0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 shutdown_connections 2023-12-22T09:15:55.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:55.961+0000 7f64eda5f640 1 -- 172.21.15.106:0/2944421365 wait complete. 2023-12-22T09:15:55.979 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T09:15:56.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.194+0000 7f03c5d39640 1 Processor -- start 2023-12-22T09:15:56.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.194+0000 7f03c5d39640 1 -- start start 2023-12-22T09:15:56.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03c5d39640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03c0151400 0x7f03c00c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03c5d39640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f03c006ca20 0x7f03c006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03c5d39640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c00bcc70 con 0x7f03c00c7620 2023-12-22T09:15:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03c5d39640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c01517e0 con 0x7f03c006ca20 2023-12-22T09:15:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03c5d39640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00c4c90 con 0x7f03c0151400 2023-12-22T09:15:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03beffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f03c006ca20 0x7f03c006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03beffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f03c006ca20 0x7f03c006b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37742/0 (socket says 172.21.15.106:37742) 2023-12-22T09:15:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03beffd640 1 -- 172.21.15.106:0/267589326 learned_addr learned my addr 172.21.15.106:0/267589326 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:56.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03beffd640 1 -- 172.21.15.106:0/267589326 >> v2:172.21.15.132:3300/0 conn(0x7f03c0151400 msgr2=0x7f03c00c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:56.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03beffd640 1 --2- 172.21.15.106:0/267589326 >> v2:172.21.15.132:3300/0 conn(0x7f03c0151400 0x7f03c00c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:56.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.195+0000 7f03beffd640 1 -- 172.21.15.106:0/267589326 >> v1:172.21.15.132:6789/0 conn(0x7f03c00c7620 legacy=0x7f03c006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:56.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.196+0000 7f03beffd640 1 -- 172.21.15.106:0/267589326 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00c42d0 con 0x7f03c006ca20 2023-12-22T09:15:56.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.197+0000 7f03beffd640 1 --2- 172.21.15.106:0/267589326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c006ca20 0x7f03c006b1e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f03c00c71b0 tx=0x7f03a802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b4a910f8bf597d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:56.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.197+0000 7f03be7fc640 1 -- 172.21.15.106:0/267589326 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a802c960 con 0x7f03c006ca20 2023-12-22T09:15:56.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.197+0000 7f03be7fc640 1 -- 172.21.15.106:0/267589326 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a802cac0 con 0x7f03c006ca20 2023-12-22T09:15:56.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.197+0000 7f03be7fc640 1 -- 172.21.15.106:0/267589326 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a802ce50 con 0x7f03c006ca20 2023-12-22T09:15:56.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.197+0000 7f03c5d39640 1 -- 172.21.15.106:0/267589326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c006ca20 msgr2=0x7f03c006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:56.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.197+0000 7f03c5d39640 1 --2- 172.21.15.106:0/267589326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c006ca20 0x7f03c006b1e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f03c00c71b0 tx=0x7f03a802bdc0 comp rx=0 tx=0).stop 2023-12-22T09:15:56.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.198+0000 7f03c5d39640 1 -- 172.21.15.106:0/267589326 shutdown_connections 2023-12-22T09:15:56.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.198+0000 7f03c5d39640 1 --2- 172.21.15.106:0/267589326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c006ca20 0x7f03c006b1e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:56.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.198+0000 7f03c5d39640 1 --2- 172.21.15.106:0/267589326 >> v2:172.21.15.132:3300/0 conn(0x7f03c0151400 0x7f03c00c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:56.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.198+0000 7f03c5d39640 1 -- 172.21.15.106:0/267589326 >> 172.21.15.106:0/267589326 conn(0x7f03c00ab310 msgr2=0x7f03c00ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:56.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.198+0000 7f03c5d39640 1 -- 172.21.15.106:0/267589326 shutdown_connections 2023-12-22T09:15:56.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.198+0000 7f03c5d39640 1 -- 172.21.15.106:0/267589326 wait complete. 2023-12-22T09:15:56.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.199+0000 7f03c5d39640 1 Processor -- start 2023-12-22T09:15:56.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.199+0000 7f03c5d39640 1 -- start start 2023-12-22T09:15:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.200+0000 7f03c5d39640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c006ca20 0x7f03c01e9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.200+0000 7f03c5d39640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c00c7620 0x7f03c01ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.200+0000 7f03c5d39640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c0151400 0x7f03c00ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.200+0000 7f03c5d39640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0150360 con 0x7f03c0151400 2023-12-22T09:15:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.200+0000 7f03c5d39640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0150640 con 0x7f03c00c7620 2023-12-22T09:15:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.200+0000 7f03c5d39640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0150920 con 0x7f03c006ca20 2023-12-22T09:15:56.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.200+0000 7f03bffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c0151400 0x7f03c00ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03bffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c0151400 0x7f03c00ac960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37760/0 (socket says 172.21.15.106:37760) 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03bffff640 1 -- 172.21.15.106:0/188407090 learned_addr learned my addr 172.21.15.106:0/188407090 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03beffd640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c00c7620 0x7f03c01ecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03bf7fe640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c006ca20 0x7f03c01e9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03bffff640 1 -- 172.21.15.106:0/188407090 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c006ca20 msgr2=0x7f03c01e9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03bffff640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c006ca20 0x7f03c01e9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03bffff640 1 -- 172.21.15.106:0/188407090 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c00c7620 msgr2=0x7f03c01ecd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03bffff640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c00c7620 0x7f03c01ecd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03bffff640 1 -- 172.21.15.106:0/188407090 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8009b30 con 0x7f03c0151400 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03beffd640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c00c7620 0x7f03c01ecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03bffff640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c0151400 0x7f03c00ac960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f03b800c360 tx=0x7f03b800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03b7fff640 1 -- 172.21.15.106:0/188407090 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b80035f0 con 0x7f03c0151400 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03b7fff640 1 -- 172.21.15.106:0/188407090 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b8003750 con 0x7f03c0151400 2023-12-22T09:15:56.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.201+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c01e9150 con 0x7f03c0151400 2023-12-22T09:15:56.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.202+0000 7f03b7fff640 1 -- 172.21.15.106:0/188407090 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8003b40 con 0x7f03c0151400 2023-12-22T09:15:56.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.202+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c01e8e60 con 0x7f03c0151400 2023-12-22T09:15:56.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.203+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c01e9670 con 0x7f03c0151400 2023-12-22T09:15:56.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.204+0000 7f03b7fff640 1 -- 172.21.15.106:0/188407090 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f03b8003ca0 con 0x7f03c0151400 2023-12-22T09:15:56.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.204+0000 7f03b7fff640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f03a006a430 0x7f03a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:56.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.205+0000 7f03b7fff640 1 -- 172.21.15.106:0/188407090 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f03b8087fb0 con 0x7f03c0151400 2023-12-22T09:15:56.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.205+0000 7f03bf7fe640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f03a006a430 0x7f03a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:56.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.206+0000 7f03bf7fe640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f03a006a430 0x7f03a006c8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f03b000a770 tx=0x7f03b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:56.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.210+0000 7f03b7fff640 1 -- 172.21.15.106:0/188407090 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f03b80bac80 con 0x7f03c0151400 2023-12-22T09:15:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:56.418+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f03c00c4740 con 0x7f03c0151400 2023-12-22T09:15:57.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.135+0000 7f03b7fff640 1 -- 172.21.15.106:0/188407090 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f03c00c4740 con 0x7f03c0151400 2023-12-22T09:15:57.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f03a006a430 msgr2=0x7f03a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:57.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f03a006a430 0x7f03a006c8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f03b000a770 tx=0x7f03b0008040 comp rx=0 tx=0).stop 2023-12-22T09:15:57.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c0151400 msgr2=0x7f03c00ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:57.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c0151400 0x7f03c00ac960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f03b800c360 tx=0x7f03b800c820 comp rx=0 tx=0).stop 2023-12-22T09:15:57.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 shutdown_connections 2023-12-22T09:15:57.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f03a006a430 0x7f03a006c8f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:57.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03c0151400 0x7f03c00ac960 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:57.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c00c7620 0x7f03c01ecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:57.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 --2- 172.21.15.106:0/188407090 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c006ca20 0x7f03c01e9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:57.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.138+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 >> 172.21.15.106:0/188407090 conn(0x7f03c00ab310 msgr2=0x7f03c014e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:57.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.139+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 shutdown_connections 2023-12-22T09:15:57.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.139+0000 7f03c5d39640 1 -- 172.21.15.106:0/188407090 wait complete. 2023-12-22T09:15:57.160 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T09:15:57.160 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T09:15:57.242 INFO:tasks.ceph.mds.b.smithi132.stderr:2023-12-22T09:15:57.242+0000 7f8deaebf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T09:15:57.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.368+0000 7f1acd007640 1 Processor -- start 2023-12-22T09:15:57.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.368+0000 7f1acd007640 1 -- start start 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.369+0000 7f1acd007640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac80c5a30 0x7f1ac80c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.369+0000 7f1acd007640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1ac806bdc0 0x7f1ac81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.369+0000 7f1acd007640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac814f570 con 0x7f1ac806c2d0 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.369+0000 7f1acd007640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac80a90f0 con 0x7f1ac806bdc0 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.369+0000 7f1acd007640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80c0b00 con 0x7f1ac80c5a30 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.370+0000 7f1ac659c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1ac806bdc0 0x7f1ac81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.370+0000 7f1ac759e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1ac806c2d0 0x7f1ac8155620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47924/0 (socket says 172.21.15.106:47924) 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.370+0000 7f1ac759e640 1 -- 172.21.15.106:0/1499229315 learned_addr learned my addr 172.21.15.106:0/1499229315 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.370+0000 7f1ac6d9d640 1 --2- 172.21.15.106:0/1499229315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac80c5a30 0x7f1ac80c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:57.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.370+0000 7f1ac659c640 1 -- 172.21.15.106:0/1499229315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac80c5a30 msgr2=0x7f1ac80c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:57.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.370+0000 7f1ac659c640 1 --2- 172.21.15.106:0/1499229315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac80c5a30 0x7f1ac80c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:57.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.370+0000 7f1ac659c640 1 -- 172.21.15.106:0/1499229315 >> v1:172.21.15.106:6789/0 conn(0x7f1ac806c2d0 legacy=0x7f1ac8155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:57.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.370+0000 7f1ac659c640 1 -- 172.21.15.106:0/1499229315 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac80bfd40 con 0x7f1ac806bdc0 2023-12-22T09:15:57.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.371+0000 7f1ac659c640 1 --2- 172.21.15.106:0/1499229315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806bdc0 0x7f1ac81550e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0097a0 tx=0x7f1abc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a81858070dd25e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:57.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1ac5d9b640 1 -- 172.21.15.106:0/1499229315 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc031780 con 0x7f1ac806bdc0 2023-12-22T09:15:57.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1ac5d9b640 1 -- 172.21.15.106:0/1499229315 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc0318e0 con 0x7f1ac806bdc0 2023-12-22T09:15:57.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1ac5d9b640 1 -- 172.21.15.106:0/1499229315 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc031c70 con 0x7f1ac806bdc0 2023-12-22T09:15:57.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1acd007640 1 -- 172.21.15.106:0/1499229315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806bdc0 msgr2=0x7f1ac81550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:57.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1acd007640 1 --2- 172.21.15.106:0/1499229315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806bdc0 0x7f1ac81550e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0097a0 tx=0x7f1abc02b820 comp rx=0 tx=0).stop 2023-12-22T09:15:57.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1acd007640 1 -- 172.21.15.106:0/1499229315 shutdown_connections 2023-12-22T09:15:57.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1acd007640 1 --2- 172.21.15.106:0/1499229315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806bdc0 0x7f1ac81550e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:57.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1acd007640 1 --2- 172.21.15.106:0/1499229315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac80c5a30 0x7f1ac80c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:57.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1acd007640 1 -- 172.21.15.106:0/1499229315 >> 172.21.15.106:0/1499229315 conn(0x7f1ac806a220 msgr2=0x7f1ac80c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:57.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1acd007640 1 -- 172.21.15.106:0/1499229315 shutdown_connections 2023-12-22T09:15:57.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.372+0000 7f1acd007640 1 -- 172.21.15.106:0/1499229315 wait complete. 2023-12-22T09:15:57.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.374+0000 7f1acd007640 1 Processor -- start 2023-12-22T09:15:57.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.374+0000 7f1acd007640 1 -- start start 2023-12-22T09:15:57.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.375+0000 7f1acd007640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac806bdc0 0x7f1ac81541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:57.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.375+0000 7f1acd007640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806c2d0 0x7f1ac81ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:57.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.375+0000 7f1acd007640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ac80c5a30 0x7f1ac81ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:57.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.375+0000 7f1acd007640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80be310 con 0x7f1ac806c2d0 2023-12-22T09:15:57.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.375+0000 7f1acd007640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac81487a0 con 0x7f1ac80c5a30 2023-12-22T09:15:57.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.375+0000 7f1acd007640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80c43f0 con 0x7f1ac806bdc0 2023-12-22T09:15:57.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.375+0000 7f1ac659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806c2d0 0x7f1ac81ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:57.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.375+0000 7f1ac659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806c2d0 0x7f1ac81ecc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37784/0 (socket says 172.21.15.106:37784) 2023-12-22T09:15:57.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.375+0000 7f1ac659c640 1 -- 172.21.15.106:0/1439926810 learned_addr learned my addr 172.21.15.106:0/1439926810 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1ac6d9d640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac806bdc0 0x7f1ac81541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1ac659c640 1 -- 172.21.15.106:0/1439926810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac806bdc0 msgr2=0x7f1ac81541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1ac759e640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ac80c5a30 0x7f1ac81ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1ac659c640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac806bdc0 0x7f1ac81541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1ac659c640 1 -- 172.21.15.106:0/1439926810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ac80c5a30 msgr2=0x7f1ac81ed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1ac659c640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ac80c5a30 0x7f1ac81ed1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1ac659c640 1 -- 172.21.15.106:0/1439926810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc009400 con 0x7f1ac806c2d0 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1ac759e640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ac80c5a30 0x7f1ac81ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1ac659c640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806c2d0 0x7f1ac81ecc60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1abc034040 tx=0x7f1abc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1aaf7fe640 1 -- 172.21.15.106:0/1439926810 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc032820 con 0x7f1ac806c2d0 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1aaf7fe640 1 -- 172.21.15.106:0/1439926810 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc032980 con 0x7f1ac806c2d0 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1aaf7fe640 1 -- 172.21.15.106:0/1439926810 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc032d30 con 0x7f1ac806c2d0 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.376+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac80c46d0 con 0x7f1ac806c2d0 2023-12-22T09:15:57.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.377+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac81ec740 con 0x7f1ac806c2d0 2023-12-22T09:15:57.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.378+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac80c2ca0 con 0x7f1ac806c2d0 2023-12-22T09:15:57.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.379+0000 7f1aaf7fe640 1 -- 172.21.15.106:0/1439926810 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1abc04d3f0 con 0x7f1ac806c2d0 2023-12-22T09:15:57.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.380+0000 7f1aaf7fe640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1ab406a430 0x7f1ab406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:57.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.380+0000 7f1aaf7fe640 1 -- 172.21.15.106:0/1439926810 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1abc0aa830 con 0x7f1ac806c2d0 2023-12-22T09:15:57.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.380+0000 7f1ac6d9d640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1ab406a430 0x7f1ab406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:57.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.381+0000 7f1ac6d9d640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1ab406a430 0x7f1ab406c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8155020 tx=0x7f1ab800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:57.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.384+0000 7f1aaf7fe640 1 -- 172.21.15.106:0/1439926810 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1abc075c40 con 0x7f1ac806c2d0 2023-12-22T09:15:57.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:57.611+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1ac8073f10 con 0x7f1ac806c2d0 2023-12-22T09:15:58.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.137+0000 7f1aaf7fe640 1 -- 172.21.15.106:0/1439926810 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1abc079260 con 0x7f1ac806c2d0 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.140+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1ab406a430 msgr2=0x7f1ab406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1ab406a430 0x7f1ab406c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8155020 tx=0x7f1ab800b040 comp rx=0 tx=0).stop 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806c2d0 msgr2=0x7f1ac81ecc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806c2d0 0x7f1ac81ecc60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1abc034040 tx=0x7f1abc0046c0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 shutdown_connections 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1ab406a430 0x7f1ab406c8f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ac80c5a30 0x7f1ac81ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac806c2d0 0x7f1ac81ecc60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 --2- 172.21.15.106:0/1439926810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ac806bdc0 0x7f1ac81541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 >> 172.21.15.106:0/1439926810 conn(0x7f1ac806a220 msgr2=0x7f1ac814e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 shutdown_connections 2023-12-22T09:15:58.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.141+0000 7f1acd007640 1 -- 172.21.15.106:0/1439926810 wait complete. 2023-12-22T09:15:58.161 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T09:15:58.162 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:15:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.368+0000 7f0e7c5fd640 1 Processor -- start 2023-12-22T09:15:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.369+0000 7f0e7c5fd640 1 -- start start 2023-12-22T09:15:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.370+0000 7f0e7c5fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0e74069e60 0x7f0e7413cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.370+0000 7f0e7c5fd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e74153e90 con 0x7f0e740be700 2023-12-22T09:15:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.370+0000 7f0e7c5fd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e74154c10 con 0x7f0e74157c80 2023-12-22T09:15:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.370+0000 7f0e7c5fd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e74153c80 con 0x7f0e74069e60 2023-12-22T09:15:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.371+0000 7f0e7ab9a640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0e740be700 0x7f0e7415e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47926/0 (socket says 172.21.15.106:47926) 2023-12-22T09:15:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.371+0000 7f0e7ab9a640 1 -- 172.21.15.106:0/1780268363 learned_addr learned my addr 172.21.15.106:0/1780268363 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.371+0000 7f0e7a399640 1 --2- 172.21.15.106:0/1780268363 >> v2:172.21.15.132:3300/0 conn(0x7f0e74069e60 0x7f0e7413cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.371+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247329921 0 0) 0x7f0e74153e90 con 0x7f0e740be700 2023-12-22T09:15:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.371+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e60003520 con 0x7f0e740be700 2023-12-22T09:15:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.371+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 491103245 0 0) 0x7f0e60003520 con 0x7f0e740be700 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.371+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 >> v2:172.21.15.132:3300/0 conn(0x7f0e74069e60 msgr2=0x7f0e7413cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.371+0000 7f0e79397640 1 --2- 172.21.15.106:0/1780268363 >> v2:172.21.15.132:3300/0 conn(0x7f0e74069e60 0x7f0e7413cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 >> v1:172.21.15.132:6789/0 conn(0x7f0e74157c80 legacy=0x7f0e74070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74154130 con 0x7f0e740be700 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f0e6c0019f0 con 0x7f0e740be700 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 >> v1:172.21.15.106:6789/0 conn(0x7f0e740be700 legacy=0x7f0e7415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e600039c0 0x7f0e60003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e600047c0 0x7f0e60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e600051d0 0x7f0e6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e74153c80 con 0x7f0e600039c0 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6000c120 con 0x7f0e600047c0 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6000c2e0 con 0x7f0e600051d0 2023-12-22T09:15:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e7a399640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e600039c0 0x7f0e60003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e79b98640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e600047c0 0x7f0e60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e7ab9a640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e600051d0 0x7f0e6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e7a399640 1 -- 172.21.15.106:0/1780268363 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e600051d0 msgr2=0x7f0e6000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e7a399640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e600051d0 0x7f0e6000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e7a399640 1 -- 172.21.15.106:0/1780268363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e600047c0 msgr2=0x7f0e60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e7a399640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e600047c0 0x7f0e60004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.372+0000 7f0e7a399640 1 -- 172.21.15.106:0/1780268363 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60003520 con 0x7f0e600039c0 2023-12-22T09:15:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.373+0000 7f0e7ab9a640 1 -- 172.21.15.106:0/1780268363 reap_dead start 2023-12-22T09:15:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.374+0000 7f0e7a399640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e600039c0 0x7f0e60003de0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009a80 tx=0x7f0e600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808c355ee7d91837 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.374+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70005990 con 0x7f0e600039c0 2023-12-22T09:15:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.374+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e70005af0 con 0x7f0e600039c0 2023-12-22T09:15:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.374+0000 7f0e79397640 1 -- 172.21.15.106:0/1780268363 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70005ea0 con 0x7f0e600039c0 2023-12-22T09:15:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.374+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1780268363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e600039c0 msgr2=0x7f0e60003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.374+0000 7f0e7c5fd640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e600039c0 0x7f0e60003de0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009a80 tx=0x7f0e600057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.374+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1780268363 shutdown_connections 2023-12-22T09:15:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.375+0000 7f0e7c5fd640 1 --2- 172.21.15.106:0/1780268363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e600039c0 0x7f0e60003de0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.375+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1780268363 >> 172.21.15.106:0/1780268363 conn(0x7f0e740c5360 msgr2=0x7f0e740c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.375+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1780268363 shutdown_connections 2023-12-22T09:15:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.375+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1780268363 wait complete. 2023-12-22T09:15:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.376+0000 7f0e7c5fd640 1 Processor -- start 2023-12-22T09:15:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.376+0000 7f0e7c5fd640 1 -- start start 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.377+0000 7f0e7c5fd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e600039c0 0x7f0e740aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.377+0000 7f0e7c5fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e7413bef0 0x7f0e741ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.377+0000 7f0e7c5fd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74134e00 0x7f0e741352b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.377+0000 7f0e7c5fd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740aaf30 con 0x7f0e74134e00 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.377+0000 7f0e7c5fd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740ab210 con 0x7f0e7413bef0 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.377+0000 7f0e7c5fd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740a9a20 con 0x7f0e600039c0 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7ab9a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74134e00 0x7f0e741352b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7ab9a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74134e00 0x7f0e741352b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37800/0 (socket says 172.21.15.106:37800) 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7ab9a640 1 -- 172.21.15.106:0/1517370779 learned_addr learned my addr 172.21.15.106:0/1517370779 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7a399640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e600039c0 0x7f0e740aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e79b98640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e7413bef0 0x7f0e741ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7ab9a640 1 -- 172.21.15.106:0/1517370779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e600039c0 msgr2=0x7f0e740aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7ab9a640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e600039c0 0x7f0e740aa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7ab9a640 1 -- 172.21.15.106:0/1517370779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e7413bef0 msgr2=0x7f0e741ec6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7ab9a640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e7413bef0 0x7f0e741ec6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7ab9a640 1 -- 172.21.15.106:0/1517370779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e740a9d00 con 0x7f0e74134e00 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.378+0000 7f0e7ab9a640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74134e00 0x7f0e741352b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0e7406fa40 tx=0x7f0e6c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.379+0000 7f0e6affd640 1 -- 172.21.15.106:0/1517370779 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c004d60 con 0x7f0e74134e00 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.379+0000 7f0e6affd640 1 -- 172.21.15.106:0/1517370779 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c00bb80 con 0x7f0e74134e00 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.379+0000 7f0e6affd640 1 -- 172.21.15.106:0/1517370779 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c007070 con 0x7f0e74134e00 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.379+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e740a9fe0 con 0x7f0e74134e00 2023-12-22T09:15:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.379+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e74157300 con 0x7f0e74134e00 2023-12-22T09:15:58.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.380+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e740ab380 con 0x7f0e74134e00 2023-12-22T09:15:58.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.381+0000 7f0e6affd640 1 -- 172.21.15.106:0/1517370779 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0e6c0071d0 con 0x7f0e74134e00 2023-12-22T09:15:58.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.382+0000 7f0e6affd640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0e5806a430 0x7f0e5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.382+0000 7f0e6affd640 1 -- 172.21.15.106:0/1517370779 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0e6c088dd0 con 0x7f0e74134e00 2023-12-22T09:15:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.382+0000 7f0e7a399640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0e5806a430 0x7f0e5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.383+0000 7f0e7a399640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0e5806a430 0x7f0e5806c8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0e70035000 tx=0x7f0e70030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:58.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.386+0000 7f0e6affd640 1 -- 172.21.15.106:0/1517370779 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0e6c054330 con 0x7f0e74134e00 2023-12-22T09:15:58.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.596+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e740aa1d0 con 0x7f0e74134e00 2023-12-22T09:15:58.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.598+0000 7f0e6affd640 1 -- 172.21.15.106:0/1517370779 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f0e6c057950 con 0x7f0e74134e00 2023-12-22T09:15:58.598 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:58.599 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:15:55.115066+0000","modified":"2023-12-22T09:15:58.132101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6835/3435163215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3435163215},{"type":"v1","addr":"172.21.15.132:6835","nonce":3435163215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T09:15:58.599 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 16 2023-12-22T09:15:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0e5806a430 msgr2=0x7f0e5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0e5806a430 0x7f0e5806c8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0e70035000 tx=0x7f0e70030000 comp rx=0 tx=0).stop 2023-12-22T09:15:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74134e00 msgr2=0x7f0e741352b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74134e00 0x7f0e741352b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0e7406fa40 tx=0x7f0e6c00b4a0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 shutdown_connections 2023-12-22T09:15:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0e5806a430 0x7f0e5806c8f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74134e00 0x7f0e741352b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e7413bef0 0x7f0e741ec6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 --2- 172.21.15.106:0/1517370779 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0e600039c0 0x7f0e740aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.600+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 >> 172.21.15.106:0/1517370779 conn(0x7f0e740c5360 msgr2=0x7f0e741534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.601+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 shutdown_connections 2023-12-22T09:15:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.601+0000 7f0e7c5fd640 1 -- 172.21.15.106:0/1517370779 wait complete. 2023-12-22T09:15:58.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:15:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.822+0000 7f8c7639f640 1 Processor -- start 2023-12-22T09:15:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.822+0000 7f8c7639f640 1 -- start start 2023-12-22T09:15:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.824+0000 7f8c7639f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c70069e60 0x7f8c701551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.824+0000 7f8c7639f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c70070480 0x7f8c700bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.824+0000 7f8c7639f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7006fe60 con 0x7f8c7015c070 2023-12-22T09:15:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.824+0000 7f8c7639f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7015c5e0 con 0x7f8c70069e60 2023-12-22T09:15:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.824+0000 7f8c7639f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c70070140 con 0x7f8c70070480 2023-12-22T09:15:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.824+0000 7f8c6ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c70069e60 0x7f8c701551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.824+0000 7f8c6f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8c7015c070 0x7f8c70155730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47928/0 (socket says 172.21.15.106:47928) 2023-12-22T09:15:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.824+0000 7f8c6f7fe640 1 -- 172.21.15.106:0/4137260220 learned_addr learned my addr 172.21.15.106:0/4137260220 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.824+0000 7f8c7493c640 1 --2- 172.21.15.106:0/4137260220 >> v2:172.21.15.132:3300/0 conn(0x7f8c70070480 0x7f8c700bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.825+0000 7f8c6ffff640 1 -- 172.21.15.106:0/4137260220 >> v2:172.21.15.132:3300/0 conn(0x7f8c70070480 msgr2=0x7f8c700bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.825+0000 7f8c6ffff640 1 --2- 172.21.15.106:0/4137260220 >> v2:172.21.15.132:3300/0 conn(0x7f8c70070480 0x7f8c700bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.825+0000 7f8c6ffff640 1 -- 172.21.15.106:0/4137260220 >> v1:172.21.15.106:6789/0 conn(0x7f8c7015c070 legacy=0x7f8c70155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.825+0000 7f8c6ffff640 1 -- 172.21.15.106:0/4137260220 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c700c1440 con 0x7f8c70069e60 2023-12-22T09:15:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.825+0000 7f8c6effd640 1 -- 172.21.15.106:0/4137260220 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085576126 0 0) 0x7f8c7006fe60 con 0x7f8c7015c070 2023-12-22T09:15:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.825+0000 7f8c7493c640 1 --2- 172.21.15.106:0/4137260220 >> v2:172.21.15.132:3300/0 conn(0x7f8c70070480 0x7f8c700bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.826+0000 7f8c6ffff640 1 --2- 172.21.15.106:0/4137260220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c70069e60 0x7f8c701551f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009790 tx=0x7f8c6002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d17f75b0caaa9d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.826+0000 7f8c6effd640 1 -- 172.21.15.106:0/4137260220 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6002d040 con 0x7f8c70069e60 2023-12-22T09:15:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.826+0000 7f8c6effd640 1 -- 172.21.15.106:0/4137260220 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60031810 con 0x7f8c70069e60 2023-12-22T09:15:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.826+0000 7f8c6effd640 1 -- 172.21.15.106:0/4137260220 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60031ba0 con 0x7f8c70069e60 2023-12-22T09:15:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.827+0000 7f8c7639f640 1 -- 172.21.15.106:0/4137260220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c70069e60 msgr2=0x7f8c701551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.827+0000 7f8c7639f640 1 --2- 172.21.15.106:0/4137260220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c70069e60 0x7f8c701551f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009790 tx=0x7f8c6002b8b0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.827+0000 7f8c7639f640 1 -- 172.21.15.106:0/4137260220 shutdown_connections 2023-12-22T09:15:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.827+0000 7f8c7639f640 1 --2- 172.21.15.106:0/4137260220 >> v2:172.21.15.132:3300/0 conn(0x7f8c70070480 0x7f8c700bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.827+0000 7f8c7639f640 1 --2- 172.21.15.106:0/4137260220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c70069e60 0x7f8c701551f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.827+0000 7f8c7639f640 1 -- 172.21.15.106:0/4137260220 >> 172.21.15.106:0/4137260220 conn(0x7f8c700c5360 msgr2=0x7f8c700c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.827+0000 7f8c7639f640 1 -- 172.21.15.106:0/4137260220 shutdown_connections 2023-12-22T09:15:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.827+0000 7f8c7639f640 1 -- 172.21.15.106:0/4137260220 wait complete. 2023-12-22T09:15:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.829+0000 7f8c7639f640 1 Processor -- start 2023-12-22T09:15:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.829+0000 7f8c7639f640 1 -- start start 2023-12-22T09:15:58.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.830+0000 7f8c7639f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c70069e60 0x7f8c700aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.830+0000 7f8c7639f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c70070480 0x7f8c7014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.830+0000 7f8c7639f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c7015c070 0x7f8c7014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.830+0000 7f8c7639f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7014aec0 con 0x7f8c7015c070 2023-12-22T09:15:58.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.830+0000 7f8c7639f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70151980 con 0x7f8c70070480 2023-12-22T09:15:58.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.830+0000 7f8c7639f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c701ed120 con 0x7f8c70069e60 2023-12-22T09:15:58.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.830+0000 7f8c7493c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c7015c070 0x7f8c7014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.830+0000 7f8c7493c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c7015c070 0x7f8c7014a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37812/0 (socket says 172.21.15.106:37812) 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.830+0000 7f8c7493c640 1 -- 172.21.15.106:0/57087447 learned_addr learned my addr 172.21.15.106:0/57087447 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c6f7fe640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c70070480 0x7f8c7014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c6ffff640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c70069e60 0x7f8c700aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c7493c640 1 -- 172.21.15.106:0/57087447 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c70069e60 msgr2=0x7f8c700aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c7493c640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c70069e60 0x7f8c700aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c7493c640 1 -- 172.21.15.106:0/57087447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c70070480 msgr2=0x7f8c7014a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c7493c640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c70070480 0x7f8c7014a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c7493c640 1 -- 172.21.15.106:0/57087447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c600093a0 con 0x7f8c7015c070 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c6ffff640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c70069e60 0x7f8c700aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c7493c640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c7015c070 0x7f8c7014a980 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800cef0 tx=0x7f8c6800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:58.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c6cff9640 1 -- 172.21.15.106:0/57087447 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800d840 con 0x7f8c7015c070 2023-12-22T09:15:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c6cff9640 1 -- 172.21.15.106:0/57087447 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800d9c0 con 0x7f8c7015c070 2023-12-22T09:15:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c701ed400 con 0x7f8c7015c070 2023-12-22T09:15:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.831+0000 7f8c6cff9640 1 -- 172.21.15.106:0/57087447 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800dd70 con 0x7f8c7015c070 2023-12-22T09:15:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.832+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c701ed9c0 con 0x7f8c7015c070 2023-12-22T09:15:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.833+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700668b0 con 0x7f8c7015c070 2023-12-22T09:15:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.833+0000 7f8c6cff9640 1 -- 172.21.15.106:0/57087447 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8c6801e3b0 con 0x7f8c7015c070 2023-12-22T09:15:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.834+0000 7f8c6cff9640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c5c06a430 0x7f8c5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.834+0000 7f8c6cff9640 1 -- 172.21.15.106:0/57087447 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8c68089530 con 0x7f8c7015c070 2023-12-22T09:15:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.835+0000 7f8c6ffff640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c5c06a430 0x7f8c5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.835+0000 7f8c6ffff640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c5c06a430 0x7f8c5c06c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c60036000 tx=0x7f8c6003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:58.839+0000 7f8c6cff9640 1 -- 172.21.15.106:0/57087447 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8c68054a90 con 0x7f8c7015c070 2023-12-22T09:15:59.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.017+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c70073f10 con 0x7f8c7015c070 2023-12-22T09:15:59.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.018+0000 7f8c6cff9640 1 -- 172.21.15.106:0/57087447 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16354 (secure 0 0 0) 0x7f8c680580b0 con 0x7f8c7015c070 2023-12-22T09:15:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:59.019 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":40,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:56.118812+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:15:59.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c5c06a430 msgr2=0x7f8c5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c5c06a430 0x7f8c5c06c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c60036000 tx=0x7f8c6003c040 comp rx=0 tx=0).stop 2023-12-22T09:15:59.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c7015c070 msgr2=0x7f8c7014a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c7015c070 0x7f8c7014a980 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800cef0 tx=0x7f8c6800a710 comp rx=0 tx=0).stop 2023-12-22T09:15:59.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 shutdown_connections 2023-12-22T09:15:59.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c5c06a430 0x7f8c5c06c8f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c7015c070 0x7f8c7014a980 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c70070480 0x7f8c7014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 --2- 172.21.15.106:0/57087447 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c70069e60 0x7f8c700aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.021+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 >> 172.21.15.106:0/57087447 conn(0x7f8c700c5360 msgr2=0x7f8c701531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:59.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.022+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 shutdown_connections 2023-12-22T09:15:59.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.022+0000 7f8c7639f640 1 -- 172.21.15.106:0/57087447 wait complete. 2023-12-22T09:15:59.041 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T09:15:59.041 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:15:59.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.250+0000 7f1b568ad640 1 Processor -- start 2023-12-22T09:15:59.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.250+0000 7f1b568ad640 1 -- start start 2023-12-22T09:15:59.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.251+0000 7f1b568ad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b50069e60 0x7f1b5014a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.251+0000 7f1b568ad640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50152680 0x7f1b5014abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.251+0000 7f1b568ad640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b500bfce0 con 0x7f1b50150a80 2023-12-22T09:15:59.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.251+0000 7f1b568ad640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b500c0960 con 0x7f1b50069e60 2023-12-22T09:15:59.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.252+0000 7f1b568ad640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5006aba0 con 0x7f1b50152680 2023-12-22T09:15:59.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.252+0000 7f1b47fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1b50150a80 0x7f1b50151f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47936/0 (socket says 172.21.15.106:47936) 2023-12-22T09:15:59.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.252+0000 7f1b47fff640 1 -- 172.21.15.106:0/2157150791 learned_addr learned my addr 172.21.15.106:0/2157150791 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:59.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.252+0000 7f1b4ffff640 1 --2- 172.21.15.106:0/2157150791 >> v2:172.21.15.132:3300/0 conn(0x7f1b50069e60 0x7f1b5014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.252+0000 7f1b54e4a640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50152680 0x7f1b5014abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.252+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595305324 0 0) 0x7f1b500bfce0 con 0x7f1b50150a80 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.252+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b3c003520 con 0x7f1b50150a80 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 82812218 0 0) 0x7f1b3c003520 con 0x7f1b50150a80 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50152680 msgr2=0x7f1b5014abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50152680 0x7f1b5014abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 >> v2:172.21.15.132:3300/0 conn(0x7f1b50069e60 msgr2=0x7f1b5014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 --2- 172.21.15.106:0/2157150791 >> v2:172.21.15.132:3300/0 conn(0x7f1b50069e60 0x7f1b5014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500bffc0 con 0x7f1b50150a80 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f1b38001670 con 0x7f1b50150a80 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 >> v1:172.21.15.106:6789/0 conn(0x7f1b50150a80 legacy=0x7f1b50151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3c0039a0 0x7f1b3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c0047c0 0x7f1b3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50152680 0x7f1b3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500c0960 con 0x7f1b3c0047c0 2023-12-22T09:15:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5006aba0 con 0x7f1b3c0039a0 2023-12-22T09:15:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c00ba60 con 0x7f1b50152680 2023-12-22T09:15:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b47fff640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c0047c0 0x7f1b3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b47fff640 1 -- 172.21.15.106:0/2157150791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50152680 msgr2=0x7f1b3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b47fff640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50152680 0x7f1b3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b47fff640 1 -- 172.21.15.106:0/2157150791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3c0039a0 msgr2=0x7f1b3c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b47fff640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3c0039a0 0x7f1b3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.253+0000 7f1b47fff640 1 -- 172.21.15.106:0/2157150791 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c003520 con 0x7f1b3c0047c0 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.255+0000 7f1b47fff640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c0047c0 0x7f1b3c004c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800c210 tx=0x7f1b3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a2655d3cd0dcc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.255+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38005ad0 con 0x7f1b3c0047c0 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.255+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b38005c30 con 0x7f1b3c0047c0 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.255+0000 7f1b4f7fe640 1 -- 172.21.15.106:0/2157150791 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3802c870 con 0x7f1b3c0047c0 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.255+0000 7f1b568ad640 1 -- 172.21.15.106:0/2157150791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c0047c0 msgr2=0x7f1b3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.255+0000 7f1b568ad640 1 --2- 172.21.15.106:0/2157150791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c0047c0 0x7f1b3c004c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800c210 tx=0x7f1b3c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.255+0000 7f1b54e4a640 1 -- 172.21.15.106:0/2157150791 reap_dead start 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.255+0000 7f1b568ad640 1 -- 172.21.15.106:0/2157150791 shutdown_connections 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.255+0000 7f1b568ad640 1 -- 172.21.15.106:0/2157150791 >> 172.21.15.106:0/2157150791 conn(0x7f1b500c5360 msgr2=0x7f1b500c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.256+0000 7f1b568ad640 1 -- 172.21.15.106:0/2157150791 shutdown_connections 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.256+0000 7f1b568ad640 1 -- 172.21.15.106:0/2157150791 wait complete. 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.257+0000 7f1b568ad640 1 Processor -- start 2023-12-22T09:15:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.257+0000 7f1b568ad640 1 -- start start 2023-12-22T09:15:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.258+0000 7f1b568ad640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3c0047c0 0x7f1b50145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.258+0000 7f1b568ad640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50147810 0x7f1b501ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.258+0000 7f1b568ad640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b501ecc00 0x7f1b50144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.258+0000 7f1b568ad640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50142b40 con 0x7f1b501ecc00 2023-12-22T09:15:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.258+0000 7f1b568ad640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50153c60 con 0x7f1b3c0047c0 2023-12-22T09:15:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.258+0000 7f1b568ad640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50153980 con 0x7f1b50147810 2023-12-22T09:15:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.258+0000 7f1b54e4a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b501ecc00 0x7f1b50144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b54e4a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b501ecc00 0x7f1b50144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37832/0 (socket says 172.21.15.106:37832) 2023-12-22T09:15:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b54e4a640 1 -- 172.21.15.106:0/1934394350 learned_addr learned my addr 172.21.15.106:0/1934394350 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b4ffff640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3c0047c0 0x7f1b50145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b47fff640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50147810 0x7f1b501ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b54e4a640 1 -- 172.21.15.106:0/1934394350 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50147810 msgr2=0x7f1b501ec6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b54e4a640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50147810 0x7f1b501ec6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b54e4a640 1 -- 172.21.15.106:0/1934394350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3c0047c0 msgr2=0x7f1b50145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b54e4a640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3c0047c0 0x7f1b50145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b54e4a640 1 -- 172.21.15.106:0/1934394350 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b50154630 con 0x7f1b501ecc00 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b54e4a640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b501ecc00 0x7f1b50144e60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1b5006b9c0 tx=0x7f1b4800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b4d7fa640 1 -- 172.21.15.106:0/1934394350 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48010040 con 0x7f1b501ecc00 2023-12-22T09:15:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b4d7fa640 1 -- 172.21.15.106:0/1934394350 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4800bae0 con 0x7f1b501ecc00 2023-12-22T09:15:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b4d7fa640 1 -- 172.21.15.106:0/1934394350 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800be70 con 0x7f1b501ecc00 2023-12-22T09:15:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.259+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b50154910 con 0x7f1b501ecc00 2023-12-22T09:15:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.260+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b50154ed0 con 0x7f1b501ecc00 2023-12-22T09:15:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.261+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b50144b80 con 0x7f1b501ecc00 2023-12-22T09:15:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.261+0000 7f1b4d7fa640 1 -- 172.21.15.106:0/1934394350 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1b4801d400 con 0x7f1b501ecc00 2023-12-22T09:15:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.262+0000 7f1b4d7fa640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b3006a460 0x7f1b3006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.262+0000 7f1b4d7fa640 1 -- 172.21.15.106:0/1934394350 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1b48089060 con 0x7f1b501ecc00 2023-12-22T09:15:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.263+0000 7f1b4ffff640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b3006a460 0x7f1b3006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.263+0000 7f1b4ffff640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b3006a460 0x7f1b3006c920 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1b400047b0 tx=0x7f1b40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.267+0000 7f1b4d7fa640 1 -- 172.21.15.106:0/1934394350 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1b50144b80 con 0x7f1b501ecc00 2023-12-22T09:15:59.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.452+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b500c0580 con 0x7f1b3006a460 2023-12-22T09:15:59.479 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.478+0000 7f1b4d7fa640 1 -- 172.21.15.106:0/1934394350 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287377 (secure 0 0 0) 0x7f1b400095b0 con 0x7f1b3006a460 2023-12-22T09:15:59.483 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:59.485 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.484+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b3006a460 msgr2=0x7f1b3006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.484+0000 7f1b568ad640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b3006a460 0x7f1b3006c920 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1b400047b0 tx=0x7f1b40008040 comp rx=0 tx=0).stop 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.484+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b501ecc00 msgr2=0x7f1b50144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.484+0000 7f1b568ad640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b501ecc00 0x7f1b50144e60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1b5006b9c0 tx=0x7f1b4800b480 comp rx=0 tx=0).stop 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.485+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 shutdown_connections 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.485+0000 7f1b568ad640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1b3006a460 0x7f1b3006c920 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.485+0000 7f1b568ad640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b501ecc00 0x7f1b50144e60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.485+0000 7f1b568ad640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b50147810 0x7f1b501ec6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.485+0000 7f1b568ad640 1 --2- 172.21.15.106:0/1934394350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b3c0047c0 0x7f1b50145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.485+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 >> 172.21.15.106:0/1934394350 conn(0x7f1b500c5360 msgr2=0x7f1b50151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.485+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 shutdown_connections 2023-12-22T09:15:59.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.485+0000 7f1b568ad640 1 -- 172.21.15.106:0/1934394350 wait complete. 2023-12-22T09:15:59.505 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-12-22T09:15:58.727039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220340,"kb_used_data":4724,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754380,"statfs":{"total":773094113280,"available":772868485120,"internally_reserved":0,"allocated":4837376,"data_stored":2718336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.106573"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135116+0000","last_change":"2023-12-22T09:15:55.143366+0000","last_active":"2023-12-22T09:15:56.135116+0000","last_peered":"2023-12-22T09:15:56.135116+0000","last_clean":"2023-12-22T09:15:56.135116+0000","last_became_active":"2023-12-22T09:15:55.142565+0000","last_became_peered":"2023-12-22T09:15:55.142565+0000","last_unstale":"2023-12-22T09:15:56.135116+0000","last_undegraded":"2023-12-22T09:15:56.135116+0000","last_fullsized":"2023-12-22T09:15:56.135116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:59:15.395576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134761+0000","last_change":"2023-12-22T09:15:55.150939+0000","last_active":"2023-12-22T09:15:56.134761+0000","last_peered":"2023-12-22T09:15:56.134761+0000","last_clean":"2023-12-22T09:15:56.134761+0000","last_became_active":"2023-12-22T09:15:55.150675+0000","last_became_peered":"2023-12-22T09:15:55.150675+0000","last_unstale":"2023-12-22T09:15:56.134761+0000","last_undegraded":"2023-12-22T09:15:56.134761+0000","last_fullsized":"2023-12-22T09:15:56.134761+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:55.417006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.169343+0000","last_change":"2023-12-22T09:15:55.166248+0000","last_active":"2023-12-22T09:15:55.169343+0000","last_peered":"2023-12-22T09:15:55.169343+0000","last_clean":"2023-12-22T09:15:55.169343+0000","last_became_active":"2023-12-22T09:15:55.165994+0000","last_became_peered":"2023-12-22T09:15:55.165994+0000","last_unstale":"2023-12-22T09:15:55.169343+0000","last_undegraded":"2023-12-22T09:15:55.169343+0000","last_fullsized":"2023-12-22T09:15:55.169343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508954+0000","last_change":"2023-12-22T09:15:55.158634+0000","last_active":"2023-12-22T09:15:56.508954+0000","last_peered":"2023-12-22T09:15:56.508954+0000","last_clean":"2023-12-22T09:15:56.508954+0000","last_became_active":"2023-12-22T09:15:55.157672+0000","last_became_peered":"2023-12-22T09:15:55.157672+0000","last_unstale":"2023-12-22T09:15:56.508954+0000","last_undegraded":"2023-12-22T09:15:56.508954+0000","last_fullsized":"2023-12-22T09:15:56.508954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:50.284022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508436+0000","last_change":"2023-12-22T09:15:55.157645+0000","last_active":"2023-12-22T09:15:56.508436+0000","last_peered":"2023-12-22T09:15:56.508436+0000","last_clean":"2023-12-22T09:15:56.508436+0000","last_became_active":"2023-12-22T09:15:55.157416+0000","last_became_peered":"2023-12-22T09:15:55.157416+0000","last_unstale":"2023-12-22T09:15:56.508436+0000","last_undegraded":"2023-12-22T09:15:56.508436+0000","last_fullsized":"2023-12-22T09:15:56.508436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:30.809324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209233+0000","last_change":"2023-12-22T09:15:55.131493+0000","last_active":"2023-12-22T09:15:56.209233+0000","last_peered":"2023-12-22T09:15:56.209233+0000","last_clean":"2023-12-22T09:15:56.209233+0000","last_became_active":"2023-12-22T09:15:55.131210+0000","last_became_peered":"2023-12-22T09:15:55.131210+0000","last_unstale":"2023-12-22T09:15:56.209233+0000","last_undegraded":"2023-12-22T09:15:56.209233+0000","last_fullsized":"2023-12-22T09:15:56.209233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514583+0000","last_change":"2023-12-22T09:15:55.152987+0000","last_active":"2023-12-22T09:15:56.514583+0000","last_peered":"2023-12-22T09:15:56.514583+0000","last_clean":"2023-12-22T09:15:56.514583+0000","last_became_active":"2023-12-22T09:15:55.152690+0000","last_became_peered":"2023-12-22T09:15:55.152690+0000","last_unstale":"2023-12-22T09:15:56.514583+0000","last_undegraded":"2023-12-22T09:15:56.514583+0000","last_fullsized":"2023-12-22T09:15:56.514583+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:57.296942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134059+0000","last_change":"2023-12-22T09:15:55.148098+0000","last_active":"2023-12-22T09:15:56.134059+0000","last_peered":"2023-12-22T09:15:56.134059+0000","last_clean":"2023-12-22T09:15:56.134059+0000","last_became_active":"2023-12-22T09:15:55.147830+0000","last_became_peered":"2023-12-22T09:15:55.147830+0000","last_unstale":"2023-12-22T09:15:56.134059+0000","last_undegraded":"2023-12-22T09:15:56.134059+0000","last_fullsized":"2023-12-22T09:15:56.134059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:51:32.442849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.169373+0000","last_change":"2023-12-22T09:15:55.166247+0000","last_active":"2023-12-22T09:15:55.169373+0000","last_peered":"2023-12-22T09:15:55.169373+0000","last_clean":"2023-12-22T09:15:55.169373+0000","last_became_active":"2023-12-22T09:15:55.165299+0000","last_became_peered":"2023-12-22T09:15:55.165299+0000","last_unstale":"2023-12-22T09:15:55.169373+0000","last_undegraded":"2023-12-22T09:15:55.169373+0000","last_fullsized":"2023-12-22T09:15:55.169373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514383+0000","last_change":"2023-12-22T09:15:55.164570+0000","last_active":"2023-12-22T09:15:56.514383+0000","last_peered":"2023-12-22T09:15:56.514383+0000","last_clean":"2023-12-22T09:15:56.514383+0000","last_became_active":"2023-12-22T09:15:55.164287+0000","last_became_peered":"2023-12-22T09:15:55.164287+0000","last_unstale":"2023-12-22T09:15:56.514383+0000","last_undegraded":"2023-12-22T09:15:56.514383+0000","last_fullsized":"2023-12-22T09:15:56.514383+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:14.590975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514949+0000","last_change":"2023-12-22T09:15:55.160606+0000","last_active":"2023-12-22T09:15:56.514949+0000","last_peered":"2023-12-22T09:15:56.514949+0000","last_clean":"2023-12-22T09:15:56.514949+0000","last_became_active":"2023-12-22T09:15:55.160309+0000","last_became_peered":"2023-12-22T09:15:55.160309+0000","last_unstale":"2023-12-22T09:15:56.514949+0000","last_undegraded":"2023-12-22T09:15:56.514949+0000","last_fullsized":"2023-12-22T09:15:56.514949+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:36.666191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.158253+0000","last_change":"2023-12-22T09:15:55.154556+0000","last_active":"2023-12-22T09:15:55.158253+0000","last_peered":"2023-12-22T09:15:55.158253+0000","last_clean":"2023-12-22T09:15:55.158253+0000","last_became_active":"2023-12-22T09:15:55.154239+0000","last_became_peered":"2023-12-22T09:15:55.154239+0000","last_unstale":"2023-12-22T09:15:55.158253+0000","last_undegraded":"2023-12-22T09:15:55.158253+0000","last_fullsized":"2023-12-22T09:15:55.158253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.513976+0000","last_change":"2023-12-22T09:15:55.164877+0000","last_active":"2023-12-22T09:15:56.513976+0000","last_peered":"2023-12-22T09:15:56.513976+0000","last_clean":"2023-12-22T09:15:56.513976+0000","last_became_active":"2023-12-22T09:15:55.164136+0000","last_became_peered":"2023-12-22T09:15:55.164136+0000","last_unstale":"2023-12-22T09:15:56.513976+0000","last_undegraded":"2023-12-22T09:15:56.513976+0000","last_fullsized":"2023-12-22T09:15:56.513976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:51.891518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135586+0000","last_change":"2023-12-22T09:15:55.150441+0000","last_active":"2023-12-22T09:15:56.135586+0000","last_peered":"2023-12-22T09:15:56.135586+0000","last_clean":"2023-12-22T09:15:56.135586+0000","last_became_active":"2023-12-22T09:15:55.150060+0000","last_became_peered":"2023-12-22T09:15:55.150060+0000","last_unstale":"2023-12-22T09:15:56.135586+0000","last_undegraded":"2023-12-22T09:15:56.135586+0000","last_fullsized":"2023-12-22T09:15:56.135586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:51.891518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.513970+0000","last_change":"2023-12-22T09:15:55.162023+0000","last_active":"2023-12-22T09:15:56.513970+0000","last_peered":"2023-12-22T09:15:56.513970+0000","last_clean":"2023-12-22T09:15:56.513970+0000","last_became_active":"2023-12-22T09:15:55.161365+0000","last_became_peered":"2023-12-22T09:15:55.161365+0000","last_unstale":"2023-12-22T09:15:56.513970+0000","last_undegraded":"2023-12-22T09:15:56.513970+0000","last_fullsized":"2023-12-22T09:15:56.513970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:30.946693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.162899+0000","last_change":"2023-12-22T09:15:55.157211+0000","last_active":"2023-12-22T09:15:55.162899+0000","last_peered":"2023-12-22T09:15:55.162899+0000","last_clean":"2023-12-22T09:15:55.162899+0000","last_became_active":"2023-12-22T09:15:55.156865+0000","last_became_peered":"2023-12-22T09:15:55.156865+0000","last_unstale":"2023-12-22T09:15:55.162899+0000","last_undegraded":"2023-12-22T09:15:55.162899+0000","last_fullsized":"2023-12-22T09:15:55.162899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:37.962424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.156236+0000","last_change":"2023-12-22T09:15:55.148229+0000","last_active":"2023-12-22T09:15:55.156236+0000","last_peered":"2023-12-22T09:15:55.156236+0000","last_clean":"2023-12-22T09:15:55.156236+0000","last_became_active":"2023-12-22T09:15:55.147954+0000","last_became_peered":"2023-12-22T09:15:55.147954+0000","last_unstale":"2023-12-22T09:15:55.156236+0000","last_undegraded":"2023-12-22T09:15:55.156236+0000","last_fullsized":"2023-12-22T09:15:55.156236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.167247+0000","last_change":"2023-12-22T09:15:55.158945+0000","last_active":"2023-12-22T09:15:55.167247+0000","last_peered":"2023-12-22T09:15:55.167247+0000","last_clean":"2023-12-22T09:15:55.167247+0000","last_became_active":"2023-12-22T09:15:55.158673+0000","last_became_peered":"2023-12-22T09:15:55.158673+0000","last_unstale":"2023-12-22T09:15:55.167247+0000","last_undegraded":"2023-12-22T09:15:55.167247+0000","last_fullsized":"2023-12-22T09:15:55.167247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:02:09.511521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508859+0000","last_change":"2023-12-22T09:15:55.154647+0000","last_active":"2023-12-22T09:15:56.508859+0000","last_peered":"2023-12-22T09:15:56.508859+0000","last_clean":"2023-12-22T09:15:56.508859+0000","last_became_active":"2023-12-22T09:15:55.154331+0000","last_became_peered":"2023-12-22T09:15:55.154331+0000","last_unstale":"2023-12-22T09:15:56.508859+0000","last_undegraded":"2023-12-22T09:15:56.508859+0000","last_fullsized":"2023-12-22T09:15:56.508859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:08:11.667144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.167382+0000","last_change":"2023-12-22T09:15:55.160338+0000","last_active":"2023-12-22T09:15:55.167382+0000","last_peered":"2023-12-22T09:15:55.167382+0000","last_clean":"2023-12-22T09:15:55.167382+0000","last_became_active":"2023-12-22T09:15:55.159705+0000","last_became_peered":"2023-12-22T09:15:55.159705+0000","last_unstale":"2023-12-22T09:15:55.167382+0000","last_undegraded":"2023-12-22T09:15:55.167382+0000","last_fullsized":"2023-12-22T09:15:55.167382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:34:05.506636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514192+0000","last_change":"2023-12-22T09:15:55.154883+0000","last_active":"2023-12-22T09:15:56.514192+0000","last_peered":"2023-12-22T09:15:56.514192+0000","last_clean":"2023-12-22T09:15:56.514192+0000","last_became_active":"2023-12-22T09:15:55.154588+0000","last_became_peered":"2023-12-22T09:15:55.154588+0000","last_unstale":"2023-12-22T09:15:56.514192+0000","last_undegraded":"2023-12-22T09:15:56.514192+0000","last_fullsized":"2023-12-22T09:15:56.514192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:40.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.137194+0000","last_change":"2023-12-22T09:15:55.156853+0000","last_active":"2023-12-22T09:15:56.137194+0000","last_peered":"2023-12-22T09:15:56.137194+0000","last_clean":"2023-12-22T09:15:56.137194+0000","last_became_active":"2023-12-22T09:15:55.156575+0000","last_became_peered":"2023-12-22T09:15:55.156575+0000","last_unstale":"2023-12-22T09:15:56.137194+0000","last_undegraded":"2023-12-22T09:15:56.137194+0000","last_fullsized":"2023-12-22T09:15:56.137194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:59.232942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.158791+0000","last_change":"2023-12-22T09:15:55.149854+0000","last_active":"2023-12-22T09:15:55.158791+0000","last_peered":"2023-12-22T09:15:55.158791+0000","last_clean":"2023-12-22T09:15:55.158791+0000","last_became_active":"2023-12-22T09:15:55.149383+0000","last_became_peered":"2023-12-22T09:15:55.149383+0000","last_unstale":"2023-12-22T09:15:55.158791+0000","last_undegraded":"2023-12-22T09:15:55.158791+0000","last_fullsized":"2023-12-22T09:15:55.158791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:38:09.607747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508942+0000","last_change":"2023-12-22T09:15:55.159003+0000","last_active":"2023-12-22T09:15:56.508942+0000","last_peered":"2023-12-22T09:15:56.508942+0000","last_clean":"2023-12-22T09:15:56.508942+0000","last_became_active":"2023-12-22T09:15:55.158806+0000","last_became_peered":"2023-12-22T09:15:55.158806+0000","last_unstale":"2023-12-22T09:15:56.508942+0000","last_undegraded":"2023-12-22T09:15:56.508942+0000","last_fullsized":"2023-12-22T09:15:56.508942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:17.416418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.147411+0000","last_change":"2023-12-22T09:15:55.141689+0000","last_active":"2023-12-22T09:15:55.147411+0000","last_peered":"2023-12-22T09:15:55.147411+0000","last_clean":"2023-12-22T09:15:55.147411+0000","last_became_active":"2023-12-22T09:15:55.141370+0000","last_became_peered":"2023-12-22T09:15:55.141370+0000","last_unstale":"2023-12-22T09:15:55.147411+0000","last_undegraded":"2023-12-22T09:15:55.147411+0000","last_fullsized":"2023-12-22T09:15:55.147411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:46:11.778416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209562+0000","last_change":"2023-12-22T09:15:55.164805+0000","last_active":"2023-12-22T09:15:56.209562+0000","last_peered":"2023-12-22T09:15:56.209562+0000","last_clean":"2023-12-22T09:15:56.209562+0000","last_became_active":"2023-12-22T09:15:55.164583+0000","last_became_peered":"2023-12-22T09:15:55.164583+0000","last_unstale":"2023-12-22T09:15:56.209562+0000","last_undegraded":"2023-12-22T09:15:56.209562+0000","last_fullsized":"2023-12-22T09:15:56.209562+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.167104+0000","last_change":"2023-12-22T09:15:55.156206+0000","last_active":"2023-12-22T09:15:55.167104+0000","last_peered":"2023-12-22T09:15:55.167104+0000","last_clean":"2023-12-22T09:15:55.167104+0000","last_became_active":"2023-12-22T09:15:55.155875+0000","last_became_peered":"2023-12-22T09:15:55.155875+0000","last_unstale":"2023-12-22T09:15:55.167104+0000","last_undegraded":"2023-12-22T09:15:55.167104+0000","last_fullsized":"2023-12-22T09:15:55.167104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:29.348560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514795+0000","last_change":"2023-12-22T09:15:55.153391+0000","last_active":"2023-12-22T09:15:56.514795+0000","last_peered":"2023-12-22T09:15:56.514795+0000","last_clean":"2023-12-22T09:15:56.514795+0000","last_became_active":"2023-12-22T09:15:55.153161+0000","last_became_peered":"2023-12-22T09:15:55.153161+0000","last_unstale":"2023-12-22T09:15:56.514795+0000","last_undegraded":"2023-12-22T09:15:56.514795+0000","last_fullsized":"2023-12-22T09:15:56.514795+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.149381+0000","last_change":"2023-12-22T09:15:55.138160+0000","last_active":"2023-12-22T09:15:55.149381+0000","last_peered":"2023-12-22T09:15:55.149381+0000","last_clean":"2023-12-22T09:15:55.149381+0000","last_became_active":"2023-12-22T09:15:55.137859+0000","last_became_peered":"2023-12-22T09:15:55.137859+0000","last_unstale":"2023-12-22T09:15:55.149381+0000","last_undegraded":"2023-12-22T09:15:55.149381+0000","last_fullsized":"2023-12-22T09:15:55.149381+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:37:03.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.138108+0000","last_change":"2023-12-22T09:15:55.133273+0000","last_active":"2023-12-22T09:15:55.138108+0000","last_peered":"2023-12-22T09:15:55.138108+0000","last_clean":"2023-12-22T09:15:55.138108+0000","last_became_active":"2023-12-22T09:15:55.132514+0000","last_became_peered":"2023-12-22T09:15:55.132514+0000","last_unstale":"2023-12-22T09:15:55.138108+0000","last_undegraded":"2023-12-22T09:15:55.138108+0000","last_fullsized":"2023-12-22T09:15:55.138108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:07.778320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.158773+0000","last_change":"2023-12-22T09:15:55.149676+0000","last_active":"2023-12-22T09:15:55.158773+0000","last_peered":"2023-12-22T09:15:55.158773+0000","last_clean":"2023-12-22T09:15:55.158773+0000","last_became_active":"2023-12-22T09:15:55.148929+0000","last_became_peered":"2023-12-22T09:15:55.148929+0000","last_unstale":"2023-12-22T09:15:55.158773+0000","last_undegraded":"2023-12-22T09:15:55.158773+0000","last_fullsized":"2023-12-22T09:15:55.158773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209215+0000","last_change":"2023-12-22T09:15:55.150973+0000","last_active":"2023-12-22T09:15:56.209215+0000","last_peered":"2023-12-22T09:15:56.209215+0000","last_clean":"2023-12-22T09:15:56.209215+0000","last_became_active":"2023-12-22T09:15:55.150358+0000","last_became_peered":"2023-12-22T09:15:55.150358+0000","last_unstale":"2023-12-22T09:15:56.209215+0000","last_undegraded":"2023-12-22T09:15:56.209215+0000","last_fullsized":"2023-12-22T09:15:56.209215+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.171826+0000","last_change":"2023-12-22T09:15:55.166209+0000","last_active":"2023-12-22T09:15:55.171826+0000","last_peered":"2023-12-22T09:15:55.171826+0000","last_clean":"2023-12-22T09:15:55.171826+0000","last_became_active":"2023-12-22T09:15:55.165918+0000","last_became_peered":"2023-12-22T09:15:55.165918+0000","last_unstale":"2023-12-22T09:15:55.171826+0000","last_undegraded":"2023-12-22T09:15:55.171826+0000","last_fullsized":"2023-12-22T09:15:55.171826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.163969+0000","last_change":"2023-12-22T09:15:54.667477+0000","last_active":"2023-12-22T09:15:55.163969+0000","last_peered":"2023-12-22T09:15:55.163969+0000","last_clean":"2023-12-22T09:15:55.163969+0000","last_became_active":"2023-12-22T09:15:54.667221+0000","last_became_peered":"2023-12-22T09:15:54.667221+0000","last_unstale":"2023-12-22T09:15:55.163969+0000","last_undegraded":"2023-12-22T09:15:55.163969+0000","last_fullsized":"2023-12-22T09:15:55.163969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:24.188717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209514+0000","last_change":"2023-12-22T09:15:55.165566+0000","last_active":"2023-12-22T09:15:56.209514+0000","last_peered":"2023-12-22T09:15:56.209514+0000","last_clean":"2023-12-22T09:15:56.209514+0000","last_became_active":"2023-12-22T09:15:55.165257+0000","last_became_peered":"2023-12-22T09:15:55.165257+0000","last_unstale":"2023-12-22T09:15:56.209514+0000","last_undegraded":"2023-12-22T09:15:56.209514+0000","last_fullsized":"2023-12-22T09:15:56.209514+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:08.180891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.163003+0000","last_change":"2023-12-22T09:15:54.671228+0000","last_active":"2023-12-22T09:15:55.163003+0000","last_peered":"2023-12-22T09:15:55.163003+0000","last_clean":"2023-12-22T09:15:55.163003+0000","last_became_active":"2023-12-22T09:15:54.670158+0000","last_became_peered":"2023-12-22T09:15:54.670158+0000","last_unstale":"2023-12-22T09:15:55.163003+0000","last_undegraded":"2023-12-22T09:15:55.163003+0000","last_fullsized":"2023-12-22T09:15:55.163003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136911+0000","last_change":"2023-12-22T09:15:55.155575+0000","last_active":"2023-12-22T09:15:56.136911+0000","last_peered":"2023-12-22T09:15:56.136911+0000","last_clean":"2023-12-22T09:15:56.136911+0000","last_became_active":"2023-12-22T09:15:55.154127+0000","last_became_peered":"2023-12-22T09:15:55.154127+0000","last_unstale":"2023-12-22T09:15:56.136911+0000","last_undegraded":"2023-12-22T09:15:56.136911+0000","last_fullsized":"2023-12-22T09:15:56.136911+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:30.946693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209599+0000","last_change":"2023-12-22T09:15:54.671283+0000","last_active":"2023-12-22T09:15:56.209599+0000","last_peered":"2023-12-22T09:15:56.209599+0000","last_clean":"2023-12-22T09:15:56.209599+0000","last_became_active":"2023-12-22T09:15:54.671022+0000","last_became_peered":"2023-12-22T09:15:54.671022+0000","last_unstale":"2023-12-22T09:15:56.209599+0000","last_undegraded":"2023-12-22T09:15:56.209599+0000","last_fullsized":"2023-12-22T09:15:56.209599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:29:31.303313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134977+0000","last_change":"2023-12-22T09:15:55.143879+0000","last_active":"2023-12-22T09:15:56.134977+0000","last_peered":"2023-12-22T09:15:56.134977+0000","last_clean":"2023-12-22T09:15:56.134977+0000","last_became_active":"2023-12-22T09:15:55.143628+0000","last_became_peered":"2023-12-22T09:15:55.143628+0000","last_unstale":"2023-12-22T09:15:56.134977+0000","last_undegraded":"2023-12-22T09:15:56.134977+0000","last_fullsized":"2023-12-22T09:15:56.134977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:51.081158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136349+0000","last_change":"2023-12-22T09:15:54.671933+0000","last_active":"2023-12-22T09:15:56.136349+0000","last_peered":"2023-12-22T09:15:56.136349+0000","last_clean":"2023-12-22T09:15:56.136349+0000","last_became_active":"2023-12-22T09:15:54.671561+0000","last_became_peered":"2023-12-22T09:15:54.671561+0000","last_unstale":"2023-12-22T09:15:56.136349+0000","last_undegraded":"2023-12-22T09:15:56.136349+0000","last_fullsized":"2023-12-22T09:15:56.136349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:29.793501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.152951+0000","last_change":"2023-12-22T09:15:55.146289+0000","last_active":"2023-12-22T09:15:55.152951+0000","last_peered":"2023-12-22T09:15:55.152951+0000","last_clean":"2023-12-22T09:15:55.152951+0000","last_became_active":"2023-12-22T09:15:55.146028+0000","last_became_peered":"2023-12-22T09:15:55.146028+0000","last_unstale":"2023-12-22T09:15:55.152951+0000","last_undegraded":"2023-12-22T09:15:55.152951+0000","last_fullsized":"2023-12-22T09:15:55.152951+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:30.809324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514244+0000","last_change":"2023-12-22T09:15:54.676125+0000","last_active":"2023-12-22T09:15:56.514244+0000","last_peered":"2023-12-22T09:15:56.514244+0000","last_clean":"2023-12-22T09:15:56.514244+0000","last_became_active":"2023-12-22T09:15:54.675809+0000","last_became_peered":"2023-12-22T09:15:54.675809+0000","last_unstale":"2023-12-22T09:15:56.514244+0000","last_undegraded":"2023-12-22T09:15:56.514244+0000","last_fullsized":"2023-12-22T09:15:56.514244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:29:31.303313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514251+0000","last_change":"2023-12-22T09:15:55.148381+0000","last_active":"2023-12-22T09:15:56.514251+0000","last_peered":"2023-12-22T09:15:56.514251+0000","last_clean":"2023-12-22T09:15:56.514251+0000","last_became_active":"2023-12-22T09:15:55.148034+0000","last_became_peered":"2023-12-22T09:15:55.148034+0000","last_unstale":"2023-12-22T09:15:56.514251+0000","last_undegraded":"2023-12-22T09:15:56.514251+0000","last_fullsized":"2023-12-22T09:15:56.514251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:25.241349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.159611+0000","last_change":"2023-12-22T09:15:54.674806+0000","last_active":"2023-12-22T09:15:55.159611+0000","last_peered":"2023-12-22T09:15:55.159611+0000","last_clean":"2023-12-22T09:15:55.159611+0000","last_became_active":"2023-12-22T09:15:54.673649+0000","last_became_peered":"2023-12-22T09:15:54.673649+0000","last_unstale":"2023-12-22T09:15:55.159611+0000","last_undegraded":"2023-12-22T09:15:55.159611+0000","last_fullsized":"2023-12-22T09:15:55.159611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:08.829353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.137098+0000","last_change":"2023-12-22T09:15:55.167800+0000","last_active":"2023-12-22T09:15:56.137098+0000","last_peered":"2023-12-22T09:15:56.137098+0000","last_clean":"2023-12-22T09:15:56.137098+0000","last_became_active":"2023-12-22T09:15:55.167492+0000","last_became_peered":"2023-12-22T09:15:55.167492+0000","last_unstale":"2023-12-22T09:15:56.137098+0000","last_undegraded":"2023-12-22T09:15:56.137098+0000","last_fullsized":"2023-12-22T09:15:56.137098+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:14.590975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209271+0000","last_change":"2023-12-22T09:15:54.677140+0000","last_active":"2023-12-22T09:15:56.209271+0000","last_peered":"2023-12-22T09:15:56.209271+0000","last_clean":"2023-12-22T09:15:56.209271+0000","last_became_active":"2023-12-22T09:15:54.676892+0000","last_became_peered":"2023-12-22T09:15:54.676892+0000","last_unstale":"2023-12-22T09:15:56.209271+0000","last_undegraded":"2023-12-22T09:15:56.209271+0000","last_fullsized":"2023-12-22T09:15:56.209271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:29.702956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134562+0000","last_change":"2023-12-22T09:15:55.135433+0000","last_active":"2023-12-22T09:15:56.134562+0000","last_peered":"2023-12-22T09:15:56.134562+0000","last_clean":"2023-12-22T09:15:56.134562+0000","last_became_active":"2023-12-22T09:15:55.135160+0000","last_became_peered":"2023-12-22T09:15:55.135160+0000","last_unstale":"2023-12-22T09:15:56.134562+0000","last_undegraded":"2023-12-22T09:15:56.134562+0000","last_fullsized":"2023-12-22T09:15:56.134562+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:43.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135370+0000","last_change":"2023-12-22T09:15:54.665511+0000","last_active":"2023-12-22T09:15:56.135370+0000","last_peered":"2023-12-22T09:15:56.135370+0000","last_clean":"2023-12-22T09:15:56.135370+0000","last_became_active":"2023-12-22T09:15:54.665202+0000","last_became_peered":"2023-12-22T09:15:54.665202+0000","last_unstale":"2023-12-22T09:15:56.135370+0000","last_undegraded":"2023-12-22T09:15:56.135370+0000","last_fullsized":"2023-12-22T09:15:56.135370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:00.147710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.509204+0000","last_change":"2023-12-22T09:15:55.158570+0000","last_active":"2023-12-22T09:15:56.509204+0000","last_peered":"2023-12-22T09:15:56.509204+0000","last_clean":"2023-12-22T09:15:56.509204+0000","last_became_active":"2023-12-22T09:15:55.157438+0000","last_became_peered":"2023-12-22T09:15:55.157438+0000","last_unstale":"2023-12-22T09:15:56.509204+0000","last_undegraded":"2023-12-22T09:15:56.509204+0000","last_fullsized":"2023-12-22T09:15:56.509204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:37.962424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135082+0000","last_change":"2023-12-22T09:15:54.659045+0000","last_active":"2023-12-22T09:15:56.135082+0000","last_peered":"2023-12-22T09:15:56.135082+0000","last_clean":"2023-12-22T09:15:56.135082+0000","last_became_active":"2023-12-22T09:15:54.658790+0000","last_became_peered":"2023-12-22T09:15:54.658790+0000","last_unstale":"2023-12-22T09:15:56.135082+0000","last_undegraded":"2023-12-22T09:15:56.135082+0000","last_fullsized":"2023-12-22T09:15:56.135082+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:37.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.160828+0000","last_change":"2023-12-22T09:15:55.157643+0000","last_active":"2023-12-22T09:15:55.160828+0000","last_peered":"2023-12-22T09:15:55.160828+0000","last_clean":"2023-12-22T09:15:55.160828+0000","last_became_active":"2023-12-22T09:15:55.157227+0000","last_became_peered":"2023-12-22T09:15:55.157227+0000","last_unstale":"2023-12-22T09:15:55.160828+0000","last_undegraded":"2023-12-22T09:15:55.160828+0000","last_fullsized":"2023-12-22T09:15:55.160828+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:08.180891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514766+0000","last_change":"2023-12-22T09:15:54.676788+0000","last_active":"2023-12-22T09:15:56.514766+0000","last_peered":"2023-12-22T09:15:56.514766+0000","last_clean":"2023-12-22T09:15:56.514766+0000","last_became_active":"2023-12-22T09:15:54.676521+0000","last_became_peered":"2023-12-22T09:15:54.676521+0000","last_unstale":"2023-12-22T09:15:56.514766+0000","last_undegraded":"2023-12-22T09:15:56.514766+0000","last_fullsized":"2023-12-22T09:15:56.514766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:10:18.309697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.156117+0000","last_change":"2023-12-22T09:15:55.150296+0000","last_active":"2023-12-22T09:15:55.156117+0000","last_peered":"2023-12-22T09:15:55.156117+0000","last_clean":"2023-12-22T09:15:55.156117+0000","last_became_active":"2023-12-22T09:15:55.150002+0000","last_became_peered":"2023-12-22T09:15:55.150002+0000","last_unstale":"2023-12-22T09:15:55.156117+0000","last_undegraded":"2023-12-22T09:15:55.156117+0000","last_fullsized":"2023-12-22T09:15:55.156117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:38:09.607747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.515069+0000","last_change":"2023-12-22T09:15:54.734307+0000","last_active":"2023-12-22T09:15:56.515069+0000","last_peered":"2023-12-22T09:15:56.515069+0000","last_clean":"2023-12-22T09:15:56.515069+0000","last_became_active":"2023-12-22T09:15:54.733912+0000","last_became_peered":"2023-12-22T09:15:54.733912+0000","last_unstale":"2023-12-22T09:15:56.515069+0000","last_undegraded":"2023-12-22T09:15:56.515069+0000","last_fullsized":"2023-12-22T09:15:56.515069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:29.702956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136988+0000","last_change":"2023-12-22T09:15:55.161558+0000","last_active":"2023-12-22T09:15:56.136988+0000","last_peered":"2023-12-22T09:15:56.136988+0000","last_clean":"2023-12-22T09:15:56.136988+0000","last_became_active":"2023-12-22T09:15:55.161234+0000","last_became_peered":"2023-12-22T09:15:55.161234+0000","last_unstale":"2023-12-22T09:15:56.136988+0000","last_undegraded":"2023-12-22T09:15:56.136988+0000","last_fullsized":"2023-12-22T09:15:56.136988+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:40.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134786+0000","last_change":"2023-12-22T09:15:54.667080+0000","last_active":"2023-12-22T09:15:56.134786+0000","last_peered":"2023-12-22T09:15:56.134786+0000","last_clean":"2023-12-22T09:15:56.134786+0000","last_became_active":"2023-12-22T09:15:54.666810+0000","last_became_peered":"2023-12-22T09:15:54.666810+0000","last_unstale":"2023-12-22T09:15:56.134786+0000","last_undegraded":"2023-12-22T09:15:56.134786+0000","last_fullsized":"2023-12-22T09:15:56.134786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:26.702306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.153064+0000","last_change":"2023-12-22T09:15:55.148900+0000","last_active":"2023-12-22T09:15:55.153064+0000","last_peered":"2023-12-22T09:15:55.153064+0000","last_clean":"2023-12-22T09:15:55.153064+0000","last_became_active":"2023-12-22T09:15:55.148615+0000","last_became_peered":"2023-12-22T09:15:55.148615+0000","last_unstale":"2023-12-22T09:15:55.153064+0000","last_undegraded":"2023-12-22T09:15:55.153064+0000","last_fullsized":"2023-12-22T09:15:55.153064+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134660+0000","last_change":"2023-12-22T09:15:54.654891+0000","last_active":"2023-12-22T09:15:56.134660+0000","last_peered":"2023-12-22T09:15:56.134660+0000","last_clean":"2023-12-22T09:15:56.134660+0000","last_became_active":"2023-12-22T09:15:54.654648+0000","last_became_peered":"2023-12-22T09:15:54.654648+0000","last_unstale":"2023-12-22T09:15:56.134660+0000","last_undegraded":"2023-12-22T09:15:56.134660+0000","last_fullsized":"2023-12-22T09:15:56.134660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:24.225526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134458+0000","last_change":"2023-12-22T09:15:55.144394+0000","last_active":"2023-12-22T09:15:56.134458+0000","last_peered":"2023-12-22T09:15:56.134458+0000","last_clean":"2023-12-22T09:15:56.134458+0000","last_became_active":"2023-12-22T09:15:55.143235+0000","last_became_peered":"2023-12-22T09:15:55.143235+0000","last_unstale":"2023-12-22T09:15:56.134458+0000","last_undegraded":"2023-12-22T09:15:56.134458+0000","last_fullsized":"2023-12-22T09:15:56.134458+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:07.046838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209285+0000","last_change":"2023-12-22T09:15:54.674073+0000","last_active":"2023-12-22T09:15:56.209285+0000","last_peered":"2023-12-22T09:15:56.209285+0000","last_clean":"2023-12-22T09:15:56.209285+0000","last_became_active":"2023-12-22T09:15:54.673820+0000","last_became_peered":"2023-12-22T09:15:54.673820+0000","last_unstale":"2023-12-22T09:15:56.209285+0000","last_undegraded":"2023-12-22T09:15:56.209285+0000","last_fullsized":"2023-12-22T09:15:56.209285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:38.639959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.159797+0000","last_change":"2023-12-22T09:15:55.151156+0000","last_active":"2023-12-22T09:15:55.159797+0000","last_peered":"2023-12-22T09:15:55.159797+0000","last_clean":"2023-12-22T09:15:55.159797+0000","last_became_active":"2023-12-22T09:15:55.150859+0000","last_became_peered":"2023-12-22T09:15:55.150859+0000","last_unstale":"2023-12-22T09:15:55.159797+0000","last_undegraded":"2023-12-22T09:15:55.159797+0000","last_fullsized":"2023-12-22T09:15:55.159797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:50.284022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.129243+0000","last_change":"2023-12-22T09:15:54.666683+0000","last_active":"2023-12-22T09:15:55.129243+0000","last_peered":"2023-12-22T09:15:55.129243+0000","last_clean":"2023-12-22T09:15:55.129243+0000","last_became_active":"2023-12-22T09:15:54.666419+0000","last_became_peered":"2023-12-22T09:15:54.666419+0000","last_unstale":"2023-12-22T09:15:55.129243+0000","last_undegraded":"2023-12-22T09:15:55.129243+0000","last_fullsized":"2023-12-22T09:15:55.129243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:25.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134460+0000","last_change":"2023-12-22T09:15:55.141694+0000","last_active":"2023-12-22T09:15:56.134460+0000","last_peered":"2023-12-22T09:15:56.134460+0000","last_clean":"2023-12-22T09:15:56.134460+0000","last_became_active":"2023-12-22T09:15:55.141460+0000","last_became_peered":"2023-12-22T09:15:55.141460+0000","last_unstale":"2023-12-22T09:15:56.134460+0000","last_undegraded":"2023-12-22T09:15:56.134460+0000","last_fullsized":"2023-12-22T09:15:56.134460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:14:34.300486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.171772+0000","last_change":"2023-12-22T09:15:54.670469+0000","last_active":"2023-12-22T09:15:55.171772+0000","last_peered":"2023-12-22T09:15:55.171772+0000","last_clean":"2023-12-22T09:15:55.171772+0000","last_became_active":"2023-12-22T09:15:54.670183+0000","last_became_peered":"2023-12-22T09:15:54.670183+0000","last_unstale":"2023-12-22T09:15:55.171772+0000","last_undegraded":"2023-12-22T09:15:55.171772+0000","last_fullsized":"2023-12-22T09:15:55.171772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134780+0000","last_change":"2023-12-22T09:15:55.135884+0000","last_active":"2023-12-22T09:15:56.134780+0000","last_peered":"2023-12-22T09:15:56.134780+0000","last_clean":"2023-12-22T09:15:56.134780+0000","last_became_active":"2023-12-22T09:15:55.135599+0000","last_became_peered":"2023-12-22T09:15:55.135599+0000","last_unstale":"2023-12-22T09:15:56.134780+0000","last_undegraded":"2023-12-22T09:15:56.134780+0000","last_fullsized":"2023-12-22T09:15:56.134780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:23.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514856+0000","last_change":"2023-12-22T09:15:54.675247+0000","last_active":"2023-12-22T09:15:56.514856+0000","last_peered":"2023-12-22T09:15:56.514856+0000","last_clean":"2023-12-22T09:15:56.514856+0000","last_became_active":"2023-12-22T09:15:54.674964+0000","last_became_peered":"2023-12-22T09:15:54.674964+0000","last_unstale":"2023-12-22T09:15:56.514856+0000","last_undegraded":"2023-12-22T09:15:56.514856+0000","last_fullsized":"2023-12-22T09:15:56.514856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:14.720567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514853+0000","last_change":"2023-12-22T09:15:55.159520+0000","last_active":"2023-12-22T09:15:56.514853+0000","last_peered":"2023-12-22T09:15:56.514853+0000","last_clean":"2023-12-22T09:15:56.514853+0000","last_became_active":"2023-12-22T09:15:55.159183+0000","last_became_peered":"2023-12-22T09:15:55.159183+0000","last_unstale":"2023-12-22T09:15:56.514853+0000","last_undegraded":"2023-12-22T09:15:56.514853+0000","last_fullsized":"2023-12-22T09:15:56.514853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:27.387730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136979+0000","last_change":"2023-12-22T09:15:54.678077+0000","last_active":"2023-12-22T09:15:56.136979+0000","last_peered":"2023-12-22T09:15:56.136979+0000","last_clean":"2023-12-22T09:15:56.136979+0000","last_became_active":"2023-12-22T09:15:54.677750+0000","last_became_peered":"2023-12-22T09:15:54.677750+0000","last_unstale":"2023-12-22T09:15:56.136979+0000","last_undegraded":"2023-12-22T09:15:56.136979+0000","last_fullsized":"2023-12-22T09:15:56.136979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:29.498658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136701+0000","last_change":"2023-12-22T09:15:55.155587+0000","last_active":"2023-12-22T09:15:56.136701+0000","last_peered":"2023-12-22T09:15:56.136701+0000","last_clean":"2023-12-22T09:15:56.136701+0000","last_became_active":"2023-12-22T09:15:55.154482+0000","last_became_peered":"2023-12-22T09:15:55.154482+0000","last_unstale":"2023-12-22T09:15:56.136701+0000","last_undegraded":"2023-12-22T09:15:56.136701+0000","last_fullsized":"2023-12-22T09:15:56.136701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:57.296942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.509001+0000","last_change":"2023-12-22T09:15:54.670898+0000","last_active":"2023-12-22T09:15:56.509001+0000","last_peered":"2023-12-22T09:15:56.509001+0000","last_clean":"2023-12-22T09:15:56.509001+0000","last_became_active":"2023-12-22T09:15:54.670474+0000","last_became_peered":"2023-12-22T09:15:54.670474+0000","last_unstale":"2023-12-22T09:15:56.509001+0000","last_undegraded":"2023-12-22T09:15:56.509001+0000","last_fullsized":"2023-12-22T09:15:56.509001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:08.829353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508999+0000","last_change":"2023-12-22T09:15:55.153519+0000","last_active":"2023-12-22T09:15:56.508999+0000","last_peered":"2023-12-22T09:15:56.508999+0000","last_clean":"2023-12-22T09:15:56.508999+0000","last_became_active":"2023-12-22T09:15:55.153259+0000","last_became_peered":"2023-12-22T09:15:55.153259+0000","last_unstale":"2023-12-22T09:15:56.508999+0000","last_undegraded":"2023-12-22T09:15:56.508999+0000","last_fullsized":"2023-12-22T09:15:56.508999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:15.736391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209491+0000","last_change":"2023-12-22T09:15:54.668062+0000","last_active":"2023-12-22T09:15:56.209491+0000","last_peered":"2023-12-22T09:15:56.209491+0000","last_clean":"2023-12-22T09:15:56.209491+0000","last_became_active":"2023-12-22T09:15:54.667816+0000","last_became_peered":"2023-12-22T09:15:54.667816+0000","last_unstale":"2023-12-22T09:15:56.209491+0000","last_undegraded":"2023-12-22T09:15:56.209491+0000","last_fullsized":"2023-12-22T09:15:56.209491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:12.583708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.162791+0000","last_change":"2023-12-22T09:15:55.149199+0000","last_active":"2023-12-22T09:15:55.162791+0000","last_peered":"2023-12-22T09:15:55.162791+0000","last_clean":"2023-12-22T09:15:55.162791+0000","last_became_active":"2023-12-22T09:15:55.148960+0000","last_became_peered":"2023-12-22T09:15:55.148960+0000","last_unstale":"2023-12-22T09:15:55.162791+0000","last_undegraded":"2023-12-22T09:15:55.162791+0000","last_fullsized":"2023-12-22T09:15:55.162791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:01.163534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508557+0000","last_change":"2023-12-22T09:15:54.656366+0000","last_active":"2023-12-22T09:15:56.508557+0000","last_peered":"2023-12-22T09:15:56.508557+0000","last_clean":"2023-12-22T09:15:56.508557+0000","last_became_active":"2023-12-22T09:15:54.656119+0000","last_became_peered":"2023-12-22T09:15:54.656119+0000","last_unstale":"2023-12-22T09:15:56.508557+0000","last_undegraded":"2023-12-22T09:15:56.508557+0000","last_fullsized":"2023-12-22T09:15:56.508557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:23.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.156211+0000","last_change":"2023-12-22T09:15:55.150507+0000","last_active":"2023-12-22T09:15:55.156211+0000","last_peered":"2023-12-22T09:15:55.156211+0000","last_clean":"2023-12-22T09:15:55.156211+0000","last_became_active":"2023-12-22T09:15:55.149174+0000","last_became_peered":"2023-12-22T09:15:55.149174+0000","last_unstale":"2023-12-22T09:15:55.156211+0000","last_undegraded":"2023-12-22T09:15:55.156211+0000","last_fullsized":"2023-12-22T09:15:55.156211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:01.163534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508654+0000","last_change":"2023-12-22T09:15:54.666529+0000","last_active":"2023-12-22T09:15:56.508654+0000","last_peered":"2023-12-22T09:15:56.508654+0000","last_clean":"2023-12-22T09:15:56.508654+0000","last_became_active":"2023-12-22T09:15:54.666198+0000","last_became_peered":"2023-12-22T09:15:54.666198+0000","last_unstale":"2023-12-22T09:15:56.508654+0000","last_undegraded":"2023-12-22T09:15:56.508654+0000","last_fullsized":"2023-12-22T09:15:56.508654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:59.323545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514120+0000","last_change":"2023-12-22T09:15:55.154765+0000","last_active":"2023-12-22T09:15:56.514120+0000","last_peered":"2023-12-22T09:15:56.514120+0000","last_clean":"2023-12-22T09:15:56.514120+0000","last_became_active":"2023-12-22T09:15:55.154461+0000","last_became_peered":"2023-12-22T09:15:55.154461+0000","last_unstale":"2023-12-22T09:15:56.514120+0000","last_undegraded":"2023-12-22T09:15:56.514120+0000","last_fullsized":"2023-12-22T09:15:56.514120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:59.232942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.128838+0000","last_change":"2023-12-22T09:15:54.670745+0000","last_active":"2023-12-22T09:15:55.128838+0000","last_peered":"2023-12-22T09:15:55.128838+0000","last_clean":"2023-12-22T09:15:55.128838+0000","last_became_active":"2023-12-22T09:15:54.670471+0000","last_became_peered":"2023-12-22T09:15:54.670471+0000","last_unstale":"2023-12-22T09:15:55.128838+0000","last_undegraded":"2023-12-22T09:15:55.128838+0000","last_fullsized":"2023-12-22T09:15:55.128838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:18:34.722029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134560+0000","last_change":"2023-12-22T09:15:55.135327+0000","last_active":"2023-12-22T09:15:56.134560+0000","last_peered":"2023-12-22T09:15:56.134560+0000","last_clean":"2023-12-22T09:15:56.134560+0000","last_became_active":"2023-12-22T09:15:55.135121+0000","last_became_peered":"2023-12-22T09:15:55.135121+0000","last_unstale":"2023-12-22T09:15:56.134560+0000","last_undegraded":"2023-12-22T09:15:56.134560+0000","last_fullsized":"2023-12-22T09:15:56.134560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:55.239397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508638+0000","last_change":"2023-12-22T09:15:54.653992+0000","last_active":"2023-12-22T09:15:56.508638+0000","last_peered":"2023-12-22T09:15:56.508638+0000","last_clean":"2023-12-22T09:15:56.508638+0000","last_became_active":"2023-12-22T09:15:54.653705+0000","last_became_peered":"2023-12-22T09:15:54.653705+0000","last_unstale":"2023-12-22T09:15:56.508638+0000","last_undegraded":"2023-12-22T09:15:56.508638+0000","last_fullsized":"2023-12-22T09:15:56.508638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:25.659639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209427+0000","last_change":"2023-12-22T09:15:55.164900+0000","last_active":"2023-12-22T09:15:56.209427+0000","last_peered":"2023-12-22T09:15:56.209427+0000","last_clean":"2023-12-22T09:15:56.209427+0000","last_became_active":"2023-12-22T09:15:55.164618+0000","last_became_peered":"2023-12-22T09:15:55.164618+0000","last_unstale":"2023-12-22T09:15:56.209427+0000","last_undegraded":"2023-12-22T09:15:56.209427+0000","last_fullsized":"2023-12-22T09:15:56.209427+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.515067+0000","last_change":"2023-12-22T09:15:54.733914+0000","last_active":"2023-12-22T09:15:56.515067+0000","last_peered":"2023-12-22T09:15:56.515067+0000","last_clean":"2023-12-22T09:15:56.515067+0000","last_became_active":"2023-12-22T09:15:54.733504+0000","last_became_peered":"2023-12-22T09:15:54.733504+0000","last_unstale":"2023-12-22T09:15:56.515067+0000","last_undegraded":"2023-12-22T09:15:56.515067+0000","last_fullsized":"2023-12-22T09:15:56.515067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:38.639959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.160811+0000","last_change":"2023-12-22T09:15:55.157481+0000","last_active":"2023-12-22T09:15:55.160811+0000","last_peered":"2023-12-22T09:15:55.160811+0000","last_clean":"2023-12-22T09:15:55.160811+0000","last_became_active":"2023-12-22T09:15:55.156846+0000","last_became_peered":"2023-12-22T09:15:55.156846+0000","last_unstale":"2023-12-22T09:15:55.160811+0000","last_undegraded":"2023-12-22T09:15:55.160811+0000","last_fullsized":"2023-12-22T09:15:55.160811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.512269+0000","last_change":"2023-12-22T09:15:54.678864+0000","last_active":"2023-12-22T09:15:56.512269+0000","last_peered":"2023-12-22T09:15:56.512269+0000","last_clean":"2023-12-22T09:15:56.512269+0000","last_became_active":"2023-12-22T09:15:54.678585+0000","last_became_peered":"2023-12-22T09:15:54.678585+0000","last_unstale":"2023-12-22T09:15:56.512269+0000","last_undegraded":"2023-12-22T09:15:56.512269+0000","last_fullsized":"2023-12-22T09:15:56.512269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134626+0000","last_change":"2023-12-22T09:15:55.154994+0000","last_active":"2023-12-22T09:15:56.134626+0000","last_peered":"2023-12-22T09:15:56.134626+0000","last_clean":"2023-12-22T09:15:56.134626+0000","last_became_active":"2023-12-22T09:15:55.154803+0000","last_became_peered":"2023-12-22T09:15:55.154803+0000","last_unstale":"2023-12-22T09:15:56.134626+0000","last_undegraded":"2023-12-22T09:15:56.134626+0000","last_fullsized":"2023-12-22T09:15:56.134626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:57.624842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.133856+0000","last_change":"2023-12-22T09:15:54.665822+0000","last_active":"2023-12-22T09:15:55.133856+0000","last_peered":"2023-12-22T09:15:55.133856+0000","last_clean":"2023-12-22T09:15:55.133856+0000","last_became_active":"2023-12-22T09:15:54.665585+0000","last_became_peered":"2023-12-22T09:15:54.665585+0000","last_unstale":"2023-12-22T09:15:55.133856+0000","last_undegraded":"2023-12-22T09:15:55.133856+0000","last_fullsized":"2023-12-22T09:15:55.133856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:17.033333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.144688+0000","last_change":"2023-12-22T09:15:55.140870+0000","last_active":"2023-12-22T09:15:55.144688+0000","last_peered":"2023-12-22T09:15:55.144688+0000","last_clean":"2023-12-22T09:15:55.144688+0000","last_became_active":"2023-12-22T09:15:55.140487+0000","last_became_peered":"2023-12-22T09:15:55.140487+0000","last_unstale":"2023-12-22T09:15:55.144688+0000","last_undegraded":"2023-12-22T09:15:55.144688+0000","last_fullsized":"2023-12-22T09:15:55.144688+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:17.416418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.134349+0000","last_change":"2023-12-22T09:15:54.667519+0000","last_active":"2023-12-22T09:15:55.134349+0000","last_peered":"2023-12-22T09:15:55.134349+0000","last_clean":"2023-12-22T09:15:55.134349+0000","last_became_active":"2023-12-22T09:15:54.667275+0000","last_became_peered":"2023-12-22T09:15:54.667275+0000","last_unstale":"2023-12-22T09:15:55.134349+0000","last_undegraded":"2023-12-22T09:15:55.134349+0000","last_fullsized":"2023-12-22T09:15:55.134349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:22:27.185341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209224+0000","last_change":"2023-12-22T09:15:55.141979+0000","last_active":"2023-12-22T09:15:56.209224+0000","last_peered":"2023-12-22T09:15:56.209224+0000","last_clean":"2023-12-22T09:15:56.209224+0000","last_became_active":"2023-12-22T09:15:55.141734+0000","last_became_peered":"2023-12-22T09:15:55.141734+0000","last_unstale":"2023-12-22T09:15:56.209224+0000","last_undegraded":"2023-12-22T09:15:56.209224+0000","last_fullsized":"2023-12-22T09:15:56.209224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.131975+0000","last_change":"2023-12-22T09:15:54.658826+0000","last_active":"2023-12-22T09:15:55.131975+0000","last_peered":"2023-12-22T09:15:55.131975+0000","last_clean":"2023-12-22T09:15:55.131975+0000","last_became_active":"2023-12-22T09:15:54.658206+0000","last_became_peered":"2023-12-22T09:15:54.658206+0000","last_unstale":"2023-12-22T09:15:55.131975+0000","last_undegraded":"2023-12-22T09:15:55.131975+0000","last_fullsized":"2023-12-22T09:15:55.131975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:19.574375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135691+0000","last_change":"2023-12-22T09:15:55.152664+0000","last_active":"2023-12-22T09:15:56.135691+0000","last_peered":"2023-12-22T09:15:56.135691+0000","last_clean":"2023-12-22T09:15:56.135691+0000","last_became_active":"2023-12-22T09:15:55.152395+0000","last_became_peered":"2023-12-22T09:15:55.152395+0000","last_unstale":"2023-12-22T09:15:56.135691+0000","last_undegraded":"2023-12-22T09:15:56.135691+0000","last_fullsized":"2023-12-22T09:15:56.135691+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:27.387730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135433+0000","last_change":"2023-12-22T09:15:54.672839+0000","last_active":"2023-12-22T09:15:56.135433+0000","last_peered":"2023-12-22T09:15:56.135433+0000","last_clean":"2023-12-22T09:15:56.135433+0000","last_became_active":"2023-12-22T09:15:54.672501+0000","last_became_peered":"2023-12-22T09:15:54.672501+0000","last_unstale":"2023-12-22T09:15:56.135433+0000","last_undegraded":"2023-12-22T09:15:56.135433+0000","last_fullsized":"2023-12-22T09:15:56.135433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:16.400594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.158893+0000","last_change":"2023-12-22T09:15:55.142126+0000","last_active":"2023-12-22T09:15:55.158893+0000","last_peered":"2023-12-22T09:15:55.158893+0000","last_clean":"2023-12-22T09:15:55.158893+0000","last_became_active":"2023-12-22T09:15:55.138650+0000","last_became_peered":"2023-12-22T09:15:55.138650+0000","last_unstale":"2023-12-22T09:15:55.158893+0000","last_undegraded":"2023-12-22T09:15:55.158893+0000","last_fullsized":"2023-12-22T09:15:55.158893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134180+0000","last_change":"2023-12-22T09:15:54.661513+0000","last_active":"2023-12-22T09:15:56.134180+0000","last_peered":"2023-12-22T09:15:56.134180+0000","last_clean":"2023-12-22T09:15:56.134180+0000","last_became_active":"2023-12-22T09:15:54.658499+0000","last_became_peered":"2023-12-22T09:15:54.658499+0000","last_unstale":"2023-12-22T09:15:56.134180+0000","last_undegraded":"2023-12-22T09:15:56.134180+0000","last_fullsized":"2023-12-22T09:15:56.134180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:07.165067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514517+0000","last_change":"2023-12-22T09:15:55.165334+0000","last_active":"2023-12-22T09:15:56.514517+0000","last_peered":"2023-12-22T09:15:56.514517+0000","last_clean":"2023-12-22T09:15:56.514517+0000","last_became_active":"2023-12-22T09:15:55.165009+0000","last_became_peered":"2023-12-22T09:15:55.165009+0000","last_unstale":"2023-12-22T09:15:56.514517+0000","last_undegraded":"2023-12-22T09:15:56.514517+0000","last_fullsized":"2023-12-22T09:15:56.514517+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.127317+0000","last_change":"2023-12-22T09:15:54.671832+0000","last_active":"2023-12-22T09:15:55.127317+0000","last_peered":"2023-12-22T09:15:55.127317+0000","last_clean":"2023-12-22T09:15:55.127317+0000","last_became_active":"2023-12-22T09:15:54.671542+0000","last_became_peered":"2023-12-22T09:15:54.671542+0000","last_unstale":"2023-12-22T09:15:55.127317+0000","last_undegraded":"2023-12-22T09:15:55.127317+0000","last_fullsized":"2023-12-22T09:15:55.127317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:23.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-22T09:15:54.662091+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:15:54.662091+0000","last_peered":"2023-12-22T09:15:54.662091+0000","last_clean":"2023-12-22T09:15:54.662091+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:15:54.662091+0000","last_undegraded":"2023-12-22T09:15:54.662091+0000","last_fullsized":"2023-12-22T09:15:54.662091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":1056768,"data_stored":782784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.6070000000000002,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":3.2429999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.629}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":3.1960000000000002},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":3.3159999999999998}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.208},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":3.282}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.1459999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":8.1620000000000008},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.748}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":3.504},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.2490000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":191364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.024},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.3639999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.294},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.3779999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.5780000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.546}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.6240000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.671},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":3.3399999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.738}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.696},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.649}]}]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":190894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.95599999999999996}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.85499999999999998}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.3620000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.01}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.409}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.458}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":3.298,"5min":3.298,"15min":3.298},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.21}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":198006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.125},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.0369999999999999}]},{"osd":1,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.236},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.085}]},{"osd":2,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4390000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.4690000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.2969999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":462848,"data_stored":192380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.91300000000000003}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.86399999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.3380000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":24.245999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":1.6519999999999999},{"interface":"front","average":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":32.527999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":1.1559999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.722,"5min":2.722,"15min":2.722},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":33.103999999999999,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.377},{"interface":"front","average":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":27.181999999999999,"5min":27.181999999999999,"15min":27.181999999999999},"last":1.5680000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":22.715,"5min":22.715,"15min":22.715},"last":1.1220000000000001},{"interface":"front","average":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":30.108000000000001,"5min":30.108000000000001,"15min":30.108000000000001},"last":1.429}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":190852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.91700000000000004}]},{"osd":1,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.29}]},{"osd":3,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.4530000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.5780000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":1.266}]},{"osd":6,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":1.498}]},{"osd":7,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.3929999999999998,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":1.625}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":190872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.5640000000000001,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.127},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.524,"5min":4.524,"15min":4.524},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.97999999999999998}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.71499999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":781184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.495}]},{"osd":3,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.77700000000000002}]},{"osd":5,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.016}]},{"osd":7,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:15:59.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:15:59.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.768+0000 7f46421c4640 1 Processor -- start 2023-12-22T09:15:59.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.768+0000 7f46421c4640 1 -- start start 2023-12-22T09:15:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.769+0000 7f46421c4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 0x7f463c153250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.769+0000 7f46421c4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f463c0c3a30 0x7f463c0c2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.769+0000 7f46421c4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463c14d710 con 0x7f463c0c25a0 2023-12-22T09:15:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.769+0000 7f46421c4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c06c710 con 0x7f463c0c3a30 2023-12-22T09:15:59.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.769+0000 7f46421c4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c153830 con 0x7f463c066c40 2023-12-22T09:15:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.770+0000 7f46409c1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f463c0c3a30 0x7f463c0c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.770+0000 7f46419c3640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f463c0c25a0 0x7f463c06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47938/0 (socket says 172.21.15.106:47938) 2023-12-22T09:15:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.770+0000 7f46419c3640 1 -- 172.21.15.106:0/360507649 learned_addr learned my addr 172.21.15.106:0/360507649 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:15:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.770+0000 7f46411c2640 1 --2- 172.21.15.106:0/360507649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 0x7f463c153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.770+0000 7f46409c1640 1 -- 172.21.15.106:0/360507649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 msgr2=0x7f463c153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:15:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.770+0000 7f46409c1640 1 --2- 172.21.15.106:0/360507649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 0x7f463c153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.770+0000 7f46409c1640 1 -- 172.21.15.106:0/360507649 >> v1:172.21.15.106:6789/0 conn(0x7f463c0c25a0 legacy=0x7f463c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.770+0000 7f46409c1640 1 -- 172.21.15.106:0/360507649 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c153b10 con 0x7f463c0c3a30 2023-12-22T09:15:59.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.770+0000 7f4633fff640 1 -- 172.21.15.106:0/360507649 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709302912 0 0) 0x7f463c14d710 con 0x7f463c0c25a0 2023-12-22T09:15:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.771+0000 7f46409c1640 1 --2- 172.21.15.106:0/360507649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 0x7f463c0c2060 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f462c0097a0 tx=0x7f462c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c2c0d45cf8e456 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f4633fff640 1 -- 172.21.15.106:0/360507649 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c031780 con 0x7f463c0c3a30 2023-12-22T09:15:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f4633fff640 1 -- 172.21.15.106:0/360507649 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c0318e0 con 0x7f463c0c3a30 2023-12-22T09:15:59.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f4633fff640 1 -- 172.21.15.106:0/360507649 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c031c70 con 0x7f463c0c3a30 2023-12-22T09:15:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f46421c4640 1 -- 172.21.15.106:0/360507649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 msgr2=0x7f463c0c2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f46421c4640 1 --2- 172.21.15.106:0/360507649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 0x7f463c0c2060 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f462c0097a0 tx=0x7f462c02b820 comp rx=0 tx=0).stop 2023-12-22T09:15:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f46421c4640 1 -- 172.21.15.106:0/360507649 shutdown_connections 2023-12-22T09:15:59.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f46421c4640 1 --2- 172.21.15.106:0/360507649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 0x7f463c0c2060 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f46421c4640 1 --2- 172.21.15.106:0/360507649 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 0x7f463c153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f46421c4640 1 -- 172.21.15.106:0/360507649 >> 172.21.15.106:0/360507649 conn(0x7f463c06a7b0 msgr2=0x7f463c0a72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:15:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f46421c4640 1 -- 172.21.15.106:0/360507649 shutdown_connections 2023-12-22T09:15:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.772+0000 7f46421c4640 1 -- 172.21.15.106:0/360507649 wait complete. 2023-12-22T09:15:59.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.774+0000 7f46421c4640 1 Processor -- start 2023-12-22T09:15:59.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.774+0000 7f46421c4640 1 -- start start 2023-12-22T09:15:59.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.775+0000 7f46421c4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 0x7f463c0a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.775+0000 7f46421c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0c25a0 0x7f463c0a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.775+0000 7f46421c4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 0x7f463c0a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.775+0000 7f46421c4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c070700 con 0x7f463c0c3a30 2023-12-22T09:15:59.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.775+0000 7f46421c4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c070ed0 con 0x7f463c0c25a0 2023-12-22T09:15:59.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.775+0000 7f46421c4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c14a560 con 0x7f463c066c40 2023-12-22T09:15:59.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.775+0000 7f46419c3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 0x7f463c0a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46419c3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 0x7f463c0a9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37850/0 (socket says 172.21.15.106:37850) 2023-12-22T09:15:59.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46419c3640 1 -- 172.21.15.106:0/2023657854 learned_addr learned my addr 172.21.15.106:0/2023657854 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46409c1640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0c25a0 0x7f463c0a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46411c2640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 0x7f463c0a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46419c3640 1 -- 172.21.15.106:0/2023657854 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 msgr2=0x7f463c0a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46419c3640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 0x7f463c0a64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46419c3640 1 -- 172.21.15.106:0/2023657854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0c25a0 msgr2=0x7f463c0a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46419c3640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0c25a0 0x7f463c0a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46419c3640 1 -- 172.21.15.106:0/2023657854 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c009400 con 0x7f463c0c3a30 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46409c1640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0c25a0 0x7f463c0a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f46419c3640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 0x7f463c0a9810 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4634002230 tx=0x7f463400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.776+0000 7f4631ffb640 1 -- 172.21.15.106:0/2023657854 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400ce30 con 0x7f463c0c3a30 2023-12-22T09:15:59.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.777+0000 7f4631ffb640 1 -- 172.21.15.106:0/2023657854 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463400a640 con 0x7f463c0c3a30 2023-12-22T09:15:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.777+0000 7f4631ffb640 1 -- 172.21.15.106:0/2023657854 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400a9f0 con 0x7f463c0c3a30 2023-12-22T09:15:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.777+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c070910 con 0x7f463c0c3a30 2023-12-22T09:15:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.777+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c071ac0 con 0x7f463c0c3a30 2023-12-22T09:15:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.778+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c0a83c0 con 0x7f463c0c3a30 2023-12-22T09:15:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.779+0000 7f4631ffb640 1 -- 172.21.15.106:0/2023657854 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f463400ab50 con 0x7f463c0c3a30 2023-12-22T09:15:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.780+0000 7f4631ffb640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f462006a430 0x7f462006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:15:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.780+0000 7f4631ffb640 1 -- 172.21.15.106:0/2023657854 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4634088060 con 0x7f463c0c3a30 2023-12-22T09:15:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.780+0000 7f46411c2640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f462006a430 0x7f462006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:15:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.781+0000 7f46411c2640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f462006a430 0x7f462006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f463800b7c0 tx=0x7f4638008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:15:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.784+0000 7f4631ffb640 1 -- 172.21.15.106:0/2023657854 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f46340bac80 con 0x7f463c0c3a30 2023-12-22T09:15:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.970+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f463c153df0 con 0x7f462006a430 2023-12-22T09:15:59.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:15:59.992+0000 7f4631ffb640 1 -- 172.21.15.106:0/2023657854 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287377 (secure 0 0 0) 0x7f463800c040 con 0x7f462006a430 2023-12-22T09:15:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:15:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:16:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f462006a430 msgr2=0x7f462006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f462006a430 0x7f462006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f463800b7c0 tx=0x7f4638008040 comp rx=0 tx=0).stop 2023-12-22T09:16:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 msgr2=0x7f463c0a9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 0x7f463c0a9810 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4634002230 tx=0x7f463400cbe0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 shutdown_connections 2023-12-22T09:16:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f462006a430 0x7f462006c8f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c0c3a30 0x7f463c0a9810 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f463c0c25a0 0x7f463c0a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 --2- 172.21.15.106:0/2023657854 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f463c066c40 0x7f463c0a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 >> 172.21.15.106:0/2023657854 conn(0x7f463c06a7b0 msgr2=0x7f463c1545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.000+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 shutdown_connections 2023-12-22T09:16:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.001+0000 7f46421c4640 1 -- 172.21.15.106:0/2023657854 wait complete. 2023-12-22T09:16:00.023 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-12-22T09:15:58.727039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220340,"kb_used_data":4724,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754380,"statfs":{"total":773094113280,"available":772868485120,"internally_reserved":0,"allocated":4837376,"data_stored":2718336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.106573"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135116+0000","last_change":"2023-12-22T09:15:55.143366+0000","last_active":"2023-12-22T09:15:56.135116+0000","last_peered":"2023-12-22T09:15:56.135116+0000","last_clean":"2023-12-22T09:15:56.135116+0000","last_became_active":"2023-12-22T09:15:55.142565+0000","last_became_peered":"2023-12-22T09:15:55.142565+0000","last_unstale":"2023-12-22T09:15:56.135116+0000","last_undegraded":"2023-12-22T09:15:56.135116+0000","last_fullsized":"2023-12-22T09:15:56.135116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:59:15.395576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134761+0000","last_change":"2023-12-22T09:15:55.150939+0000","last_active":"2023-12-22T09:15:56.134761+0000","last_peered":"2023-12-22T09:15:56.134761+0000","last_clean":"2023-12-22T09:15:56.134761+0000","last_became_active":"2023-12-22T09:15:55.150675+0000","last_became_peered":"2023-12-22T09:15:55.150675+0000","last_unstale":"2023-12-22T09:15:56.134761+0000","last_undegraded":"2023-12-22T09:15:56.134761+0000","last_fullsized":"2023-12-22T09:15:56.134761+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:55.417006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.169343+0000","last_change":"2023-12-22T09:15:55.166248+0000","last_active":"2023-12-22T09:15:55.169343+0000","last_peered":"2023-12-22T09:15:55.169343+0000","last_clean":"2023-12-22T09:15:55.169343+0000","last_became_active":"2023-12-22T09:15:55.165994+0000","last_became_peered":"2023-12-22T09:15:55.165994+0000","last_unstale":"2023-12-22T09:15:55.169343+0000","last_undegraded":"2023-12-22T09:15:55.169343+0000","last_fullsized":"2023-12-22T09:15:55.169343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508954+0000","last_change":"2023-12-22T09:15:55.158634+0000","last_active":"2023-12-22T09:15:56.508954+0000","last_peered":"2023-12-22T09:15:56.508954+0000","last_clean":"2023-12-22T09:15:56.508954+0000","last_became_active":"2023-12-22T09:15:55.157672+0000","last_became_peered":"2023-12-22T09:15:55.157672+0000","last_unstale":"2023-12-22T09:15:56.508954+0000","last_undegraded":"2023-12-22T09:15:56.508954+0000","last_fullsized":"2023-12-22T09:15:56.508954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:50.284022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508436+0000","last_change":"2023-12-22T09:15:55.157645+0000","last_active":"2023-12-22T09:15:56.508436+0000","last_peered":"2023-12-22T09:15:56.508436+0000","last_clean":"2023-12-22T09:15:56.508436+0000","last_became_active":"2023-12-22T09:15:55.157416+0000","last_became_peered":"2023-12-22T09:15:55.157416+0000","last_unstale":"2023-12-22T09:15:56.508436+0000","last_undegraded":"2023-12-22T09:15:56.508436+0000","last_fullsized":"2023-12-22T09:15:56.508436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:30.809324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209233+0000","last_change":"2023-12-22T09:15:55.131493+0000","last_active":"2023-12-22T09:15:56.209233+0000","last_peered":"2023-12-22T09:15:56.209233+0000","last_clean":"2023-12-22T09:15:56.209233+0000","last_became_active":"2023-12-22T09:15:55.131210+0000","last_became_peered":"2023-12-22T09:15:55.131210+0000","last_unstale":"2023-12-22T09:15:56.209233+0000","last_undegraded":"2023-12-22T09:15:56.209233+0000","last_fullsized":"2023-12-22T09:15:56.209233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514583+0000","last_change":"2023-12-22T09:15:55.152987+0000","last_active":"2023-12-22T09:15:56.514583+0000","last_peered":"2023-12-22T09:15:56.514583+0000","last_clean":"2023-12-22T09:15:56.514583+0000","last_became_active":"2023-12-22T09:15:55.152690+0000","last_became_peered":"2023-12-22T09:15:55.152690+0000","last_unstale":"2023-12-22T09:15:56.514583+0000","last_undegraded":"2023-12-22T09:15:56.514583+0000","last_fullsized":"2023-12-22T09:15:56.514583+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:57.296942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134059+0000","last_change":"2023-12-22T09:15:55.148098+0000","last_active":"2023-12-22T09:15:56.134059+0000","last_peered":"2023-12-22T09:15:56.134059+0000","last_clean":"2023-12-22T09:15:56.134059+0000","last_became_active":"2023-12-22T09:15:55.147830+0000","last_became_peered":"2023-12-22T09:15:55.147830+0000","last_unstale":"2023-12-22T09:15:56.134059+0000","last_undegraded":"2023-12-22T09:15:56.134059+0000","last_fullsized":"2023-12-22T09:15:56.134059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:51:32.442849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.169373+0000","last_change":"2023-12-22T09:15:55.166247+0000","last_active":"2023-12-22T09:15:55.169373+0000","last_peered":"2023-12-22T09:15:55.169373+0000","last_clean":"2023-12-22T09:15:55.169373+0000","last_became_active":"2023-12-22T09:15:55.165299+0000","last_became_peered":"2023-12-22T09:15:55.165299+0000","last_unstale":"2023-12-22T09:15:55.169373+0000","last_undegraded":"2023-12-22T09:15:55.169373+0000","last_fullsized":"2023-12-22T09:15:55.169373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514383+0000","last_change":"2023-12-22T09:15:55.164570+0000","last_active":"2023-12-22T09:15:56.514383+0000","last_peered":"2023-12-22T09:15:56.514383+0000","last_clean":"2023-12-22T09:15:56.514383+0000","last_became_active":"2023-12-22T09:15:55.164287+0000","last_became_peered":"2023-12-22T09:15:55.164287+0000","last_unstale":"2023-12-22T09:15:56.514383+0000","last_undegraded":"2023-12-22T09:15:56.514383+0000","last_fullsized":"2023-12-22T09:15:56.514383+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:14.590975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514949+0000","last_change":"2023-12-22T09:15:55.160606+0000","last_active":"2023-12-22T09:15:56.514949+0000","last_peered":"2023-12-22T09:15:56.514949+0000","last_clean":"2023-12-22T09:15:56.514949+0000","last_became_active":"2023-12-22T09:15:55.160309+0000","last_became_peered":"2023-12-22T09:15:55.160309+0000","last_unstale":"2023-12-22T09:15:56.514949+0000","last_undegraded":"2023-12-22T09:15:56.514949+0000","last_fullsized":"2023-12-22T09:15:56.514949+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:36.666191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.158253+0000","last_change":"2023-12-22T09:15:55.154556+0000","last_active":"2023-12-22T09:15:55.158253+0000","last_peered":"2023-12-22T09:15:55.158253+0000","last_clean":"2023-12-22T09:15:55.158253+0000","last_became_active":"2023-12-22T09:15:55.154239+0000","last_became_peered":"2023-12-22T09:15:55.154239+0000","last_unstale":"2023-12-22T09:15:55.158253+0000","last_undegraded":"2023-12-22T09:15:55.158253+0000","last_fullsized":"2023-12-22T09:15:55.158253+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.513976+0000","last_change":"2023-12-22T09:15:55.164877+0000","last_active":"2023-12-22T09:15:56.513976+0000","last_peered":"2023-12-22T09:15:56.513976+0000","last_clean":"2023-12-22T09:15:56.513976+0000","last_became_active":"2023-12-22T09:15:55.164136+0000","last_became_peered":"2023-12-22T09:15:55.164136+0000","last_unstale":"2023-12-22T09:15:56.513976+0000","last_undegraded":"2023-12-22T09:15:56.513976+0000","last_fullsized":"2023-12-22T09:15:56.513976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:51.891518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135586+0000","last_change":"2023-12-22T09:15:55.150441+0000","last_active":"2023-12-22T09:15:56.135586+0000","last_peered":"2023-12-22T09:15:56.135586+0000","last_clean":"2023-12-22T09:15:56.135586+0000","last_became_active":"2023-12-22T09:15:55.150060+0000","last_became_peered":"2023-12-22T09:15:55.150060+0000","last_unstale":"2023-12-22T09:15:56.135586+0000","last_undegraded":"2023-12-22T09:15:56.135586+0000","last_fullsized":"2023-12-22T09:15:56.135586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:51.891518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.513970+0000","last_change":"2023-12-22T09:15:55.162023+0000","last_active":"2023-12-22T09:15:56.513970+0000","last_peered":"2023-12-22T09:15:56.513970+0000","last_clean":"2023-12-22T09:15:56.513970+0000","last_became_active":"2023-12-22T09:15:55.161365+0000","last_became_peered":"2023-12-22T09:15:55.161365+0000","last_unstale":"2023-12-22T09:15:56.513970+0000","last_undegraded":"2023-12-22T09:15:56.513970+0000","last_fullsized":"2023-12-22T09:15:56.513970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:30.946693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.162899+0000","last_change":"2023-12-22T09:15:55.157211+0000","last_active":"2023-12-22T09:15:55.162899+0000","last_peered":"2023-12-22T09:15:55.162899+0000","last_clean":"2023-12-22T09:15:55.162899+0000","last_became_active":"2023-12-22T09:15:55.156865+0000","last_became_peered":"2023-12-22T09:15:55.156865+0000","last_unstale":"2023-12-22T09:15:55.162899+0000","last_undegraded":"2023-12-22T09:15:55.162899+0000","last_fullsized":"2023-12-22T09:15:55.162899+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:37.962424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.156236+0000","last_change":"2023-12-22T09:15:55.148229+0000","last_active":"2023-12-22T09:15:55.156236+0000","last_peered":"2023-12-22T09:15:55.156236+0000","last_clean":"2023-12-22T09:15:55.156236+0000","last_became_active":"2023-12-22T09:15:55.147954+0000","last_became_peered":"2023-12-22T09:15:55.147954+0000","last_unstale":"2023-12-22T09:15:55.156236+0000","last_undegraded":"2023-12-22T09:15:55.156236+0000","last_fullsized":"2023-12-22T09:15:55.156236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.167247+0000","last_change":"2023-12-22T09:15:55.158945+0000","last_active":"2023-12-22T09:15:55.167247+0000","last_peered":"2023-12-22T09:15:55.167247+0000","last_clean":"2023-12-22T09:15:55.167247+0000","last_became_active":"2023-12-22T09:15:55.158673+0000","last_became_peered":"2023-12-22T09:15:55.158673+0000","last_unstale":"2023-12-22T09:15:55.167247+0000","last_undegraded":"2023-12-22T09:15:55.167247+0000","last_fullsized":"2023-12-22T09:15:55.167247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:02:09.511521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508859+0000","last_change":"2023-12-22T09:15:55.154647+0000","last_active":"2023-12-22T09:15:56.508859+0000","last_peered":"2023-12-22T09:15:56.508859+0000","last_clean":"2023-12-22T09:15:56.508859+0000","last_became_active":"2023-12-22T09:15:55.154331+0000","last_became_peered":"2023-12-22T09:15:55.154331+0000","last_unstale":"2023-12-22T09:15:56.508859+0000","last_undegraded":"2023-12-22T09:15:56.508859+0000","last_fullsized":"2023-12-22T09:15:56.508859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:08:11.667144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.167382+0000","last_change":"2023-12-22T09:15:55.160338+0000","last_active":"2023-12-22T09:15:55.167382+0000","last_peered":"2023-12-22T09:15:55.167382+0000","last_clean":"2023-12-22T09:15:55.167382+0000","last_became_active":"2023-12-22T09:15:55.159705+0000","last_became_peered":"2023-12-22T09:15:55.159705+0000","last_unstale":"2023-12-22T09:15:55.167382+0000","last_undegraded":"2023-12-22T09:15:55.167382+0000","last_fullsized":"2023-12-22T09:15:55.167382+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:34:05.506636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514192+0000","last_change":"2023-12-22T09:15:55.154883+0000","last_active":"2023-12-22T09:15:56.514192+0000","last_peered":"2023-12-22T09:15:56.514192+0000","last_clean":"2023-12-22T09:15:56.514192+0000","last_became_active":"2023-12-22T09:15:55.154588+0000","last_became_peered":"2023-12-22T09:15:55.154588+0000","last_unstale":"2023-12-22T09:15:56.514192+0000","last_undegraded":"2023-12-22T09:15:56.514192+0000","last_fullsized":"2023-12-22T09:15:56.514192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:40.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.137194+0000","last_change":"2023-12-22T09:15:55.156853+0000","last_active":"2023-12-22T09:15:56.137194+0000","last_peered":"2023-12-22T09:15:56.137194+0000","last_clean":"2023-12-22T09:15:56.137194+0000","last_became_active":"2023-12-22T09:15:55.156575+0000","last_became_peered":"2023-12-22T09:15:55.156575+0000","last_unstale":"2023-12-22T09:15:56.137194+0000","last_undegraded":"2023-12-22T09:15:56.137194+0000","last_fullsized":"2023-12-22T09:15:56.137194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:59.232942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.158791+0000","last_change":"2023-12-22T09:15:55.149854+0000","last_active":"2023-12-22T09:15:55.158791+0000","last_peered":"2023-12-22T09:15:55.158791+0000","last_clean":"2023-12-22T09:15:55.158791+0000","last_became_active":"2023-12-22T09:15:55.149383+0000","last_became_peered":"2023-12-22T09:15:55.149383+0000","last_unstale":"2023-12-22T09:15:55.158791+0000","last_undegraded":"2023-12-22T09:15:55.158791+0000","last_fullsized":"2023-12-22T09:15:55.158791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:38:09.607747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508942+0000","last_change":"2023-12-22T09:15:55.159003+0000","last_active":"2023-12-22T09:15:56.508942+0000","last_peered":"2023-12-22T09:15:56.508942+0000","last_clean":"2023-12-22T09:15:56.508942+0000","last_became_active":"2023-12-22T09:15:55.158806+0000","last_became_peered":"2023-12-22T09:15:55.158806+0000","last_unstale":"2023-12-22T09:15:56.508942+0000","last_undegraded":"2023-12-22T09:15:56.508942+0000","last_fullsized":"2023-12-22T09:15:56.508942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:17.416418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.147411+0000","last_change":"2023-12-22T09:15:55.141689+0000","last_active":"2023-12-22T09:15:55.147411+0000","last_peered":"2023-12-22T09:15:55.147411+0000","last_clean":"2023-12-22T09:15:55.147411+0000","last_became_active":"2023-12-22T09:15:55.141370+0000","last_became_peered":"2023-12-22T09:15:55.141370+0000","last_unstale":"2023-12-22T09:15:55.147411+0000","last_undegraded":"2023-12-22T09:15:55.147411+0000","last_fullsized":"2023-12-22T09:15:55.147411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:46:11.778416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209562+0000","last_change":"2023-12-22T09:15:55.164805+0000","last_active":"2023-12-22T09:15:56.209562+0000","last_peered":"2023-12-22T09:15:56.209562+0000","last_clean":"2023-12-22T09:15:56.209562+0000","last_became_active":"2023-12-22T09:15:55.164583+0000","last_became_peered":"2023-12-22T09:15:55.164583+0000","last_unstale":"2023-12-22T09:15:56.209562+0000","last_undegraded":"2023-12-22T09:15:56.209562+0000","last_fullsized":"2023-12-22T09:15:56.209562+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.167104+0000","last_change":"2023-12-22T09:15:55.156206+0000","last_active":"2023-12-22T09:15:55.167104+0000","last_peered":"2023-12-22T09:15:55.167104+0000","last_clean":"2023-12-22T09:15:55.167104+0000","last_became_active":"2023-12-22T09:15:55.155875+0000","last_became_peered":"2023-12-22T09:15:55.155875+0000","last_unstale":"2023-12-22T09:15:55.167104+0000","last_undegraded":"2023-12-22T09:15:55.167104+0000","last_fullsized":"2023-12-22T09:15:55.167104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:29.348560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514795+0000","last_change":"2023-12-22T09:15:55.153391+0000","last_active":"2023-12-22T09:15:56.514795+0000","last_peered":"2023-12-22T09:15:56.514795+0000","last_clean":"2023-12-22T09:15:56.514795+0000","last_became_active":"2023-12-22T09:15:55.153161+0000","last_became_peered":"2023-12-22T09:15:55.153161+0000","last_unstale":"2023-12-22T09:15:56.514795+0000","last_undegraded":"2023-12-22T09:15:56.514795+0000","last_fullsized":"2023-12-22T09:15:56.514795+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.149381+0000","last_change":"2023-12-22T09:15:55.138160+0000","last_active":"2023-12-22T09:15:55.149381+0000","last_peered":"2023-12-22T09:15:55.149381+0000","last_clean":"2023-12-22T09:15:55.149381+0000","last_became_active":"2023-12-22T09:15:55.137859+0000","last_became_peered":"2023-12-22T09:15:55.137859+0000","last_unstale":"2023-12-22T09:15:55.149381+0000","last_undegraded":"2023-12-22T09:15:55.149381+0000","last_fullsized":"2023-12-22T09:15:55.149381+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:37:03.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.138108+0000","last_change":"2023-12-22T09:15:55.133273+0000","last_active":"2023-12-22T09:15:55.138108+0000","last_peered":"2023-12-22T09:15:55.138108+0000","last_clean":"2023-12-22T09:15:55.138108+0000","last_became_active":"2023-12-22T09:15:55.132514+0000","last_became_peered":"2023-12-22T09:15:55.132514+0000","last_unstale":"2023-12-22T09:15:55.138108+0000","last_undegraded":"2023-12-22T09:15:55.138108+0000","last_fullsized":"2023-12-22T09:15:55.138108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:07.778320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.158773+0000","last_change":"2023-12-22T09:15:55.149676+0000","last_active":"2023-12-22T09:15:55.158773+0000","last_peered":"2023-12-22T09:15:55.158773+0000","last_clean":"2023-12-22T09:15:55.158773+0000","last_became_active":"2023-12-22T09:15:55.148929+0000","last_became_peered":"2023-12-22T09:15:55.148929+0000","last_unstale":"2023-12-22T09:15:55.158773+0000","last_undegraded":"2023-12-22T09:15:55.158773+0000","last_fullsized":"2023-12-22T09:15:55.158773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209215+0000","last_change":"2023-12-22T09:15:55.150973+0000","last_active":"2023-12-22T09:15:56.209215+0000","last_peered":"2023-12-22T09:15:56.209215+0000","last_clean":"2023-12-22T09:15:56.209215+0000","last_became_active":"2023-12-22T09:15:55.150358+0000","last_became_peered":"2023-12-22T09:15:55.150358+0000","last_unstale":"2023-12-22T09:15:56.209215+0000","last_undegraded":"2023-12-22T09:15:56.209215+0000","last_fullsized":"2023-12-22T09:15:56.209215+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.171826+0000","last_change":"2023-12-22T09:15:55.166209+0000","last_active":"2023-12-22T09:15:55.171826+0000","last_peered":"2023-12-22T09:15:55.171826+0000","last_clean":"2023-12-22T09:15:55.171826+0000","last_became_active":"2023-12-22T09:15:55.165918+0000","last_became_peered":"2023-12-22T09:15:55.165918+0000","last_unstale":"2023-12-22T09:15:55.171826+0000","last_undegraded":"2023-12-22T09:15:55.171826+0000","last_fullsized":"2023-12-22T09:15:55.171826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.163969+0000","last_change":"2023-12-22T09:15:54.667477+0000","last_active":"2023-12-22T09:15:55.163969+0000","last_peered":"2023-12-22T09:15:55.163969+0000","last_clean":"2023-12-22T09:15:55.163969+0000","last_became_active":"2023-12-22T09:15:54.667221+0000","last_became_peered":"2023-12-22T09:15:54.667221+0000","last_unstale":"2023-12-22T09:15:55.163969+0000","last_undegraded":"2023-12-22T09:15:55.163969+0000","last_fullsized":"2023-12-22T09:15:55.163969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:24.188717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209514+0000","last_change":"2023-12-22T09:15:55.165566+0000","last_active":"2023-12-22T09:15:56.209514+0000","last_peered":"2023-12-22T09:15:56.209514+0000","last_clean":"2023-12-22T09:15:56.209514+0000","last_became_active":"2023-12-22T09:15:55.165257+0000","last_became_peered":"2023-12-22T09:15:55.165257+0000","last_unstale":"2023-12-22T09:15:56.209514+0000","last_undegraded":"2023-12-22T09:15:56.209514+0000","last_fullsized":"2023-12-22T09:15:56.209514+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:08.180891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.163003+0000","last_change":"2023-12-22T09:15:54.671228+0000","last_active":"2023-12-22T09:15:55.163003+0000","last_peered":"2023-12-22T09:15:55.163003+0000","last_clean":"2023-12-22T09:15:55.163003+0000","last_became_active":"2023-12-22T09:15:54.670158+0000","last_became_peered":"2023-12-22T09:15:54.670158+0000","last_unstale":"2023-12-22T09:15:55.163003+0000","last_undegraded":"2023-12-22T09:15:55.163003+0000","last_fullsized":"2023-12-22T09:15:55.163003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136911+0000","last_change":"2023-12-22T09:15:55.155575+0000","last_active":"2023-12-22T09:15:56.136911+0000","last_peered":"2023-12-22T09:15:56.136911+0000","last_clean":"2023-12-22T09:15:56.136911+0000","last_became_active":"2023-12-22T09:15:55.154127+0000","last_became_peered":"2023-12-22T09:15:55.154127+0000","last_unstale":"2023-12-22T09:15:56.136911+0000","last_undegraded":"2023-12-22T09:15:56.136911+0000","last_fullsized":"2023-12-22T09:15:56.136911+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:30.946693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209599+0000","last_change":"2023-12-22T09:15:54.671283+0000","last_active":"2023-12-22T09:15:56.209599+0000","last_peered":"2023-12-22T09:15:56.209599+0000","last_clean":"2023-12-22T09:15:56.209599+0000","last_became_active":"2023-12-22T09:15:54.671022+0000","last_became_peered":"2023-12-22T09:15:54.671022+0000","last_unstale":"2023-12-22T09:15:56.209599+0000","last_undegraded":"2023-12-22T09:15:56.209599+0000","last_fullsized":"2023-12-22T09:15:56.209599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:29:31.303313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134977+0000","last_change":"2023-12-22T09:15:55.143879+0000","last_active":"2023-12-22T09:15:56.134977+0000","last_peered":"2023-12-22T09:15:56.134977+0000","last_clean":"2023-12-22T09:15:56.134977+0000","last_became_active":"2023-12-22T09:15:55.143628+0000","last_became_peered":"2023-12-22T09:15:55.143628+0000","last_unstale":"2023-12-22T09:15:56.134977+0000","last_undegraded":"2023-12-22T09:15:56.134977+0000","last_fullsized":"2023-12-22T09:15:56.134977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:51.081158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136349+0000","last_change":"2023-12-22T09:15:54.671933+0000","last_active":"2023-12-22T09:15:56.136349+0000","last_peered":"2023-12-22T09:15:56.136349+0000","last_clean":"2023-12-22T09:15:56.136349+0000","last_became_active":"2023-12-22T09:15:54.671561+0000","last_became_peered":"2023-12-22T09:15:54.671561+0000","last_unstale":"2023-12-22T09:15:56.136349+0000","last_undegraded":"2023-12-22T09:15:56.136349+0000","last_fullsized":"2023-12-22T09:15:56.136349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:29.793501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.152951+0000","last_change":"2023-12-22T09:15:55.146289+0000","last_active":"2023-12-22T09:15:55.152951+0000","last_peered":"2023-12-22T09:15:55.152951+0000","last_clean":"2023-12-22T09:15:55.152951+0000","last_became_active":"2023-12-22T09:15:55.146028+0000","last_became_peered":"2023-12-22T09:15:55.146028+0000","last_unstale":"2023-12-22T09:15:55.152951+0000","last_undegraded":"2023-12-22T09:15:55.152951+0000","last_fullsized":"2023-12-22T09:15:55.152951+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:30.809324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514244+0000","last_change":"2023-12-22T09:15:54.676125+0000","last_active":"2023-12-22T09:15:56.514244+0000","last_peered":"2023-12-22T09:15:56.514244+0000","last_clean":"2023-12-22T09:15:56.514244+0000","last_became_active":"2023-12-22T09:15:54.675809+0000","last_became_peered":"2023-12-22T09:15:54.675809+0000","last_unstale":"2023-12-22T09:15:56.514244+0000","last_undegraded":"2023-12-22T09:15:56.514244+0000","last_fullsized":"2023-12-22T09:15:56.514244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:29:31.303313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514251+0000","last_change":"2023-12-22T09:15:55.148381+0000","last_active":"2023-12-22T09:15:56.514251+0000","last_peered":"2023-12-22T09:15:56.514251+0000","last_clean":"2023-12-22T09:15:56.514251+0000","last_became_active":"2023-12-22T09:15:55.148034+0000","last_became_peered":"2023-12-22T09:15:55.148034+0000","last_unstale":"2023-12-22T09:15:56.514251+0000","last_undegraded":"2023-12-22T09:15:56.514251+0000","last_fullsized":"2023-12-22T09:15:56.514251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:25.241349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.159611+0000","last_change":"2023-12-22T09:15:54.674806+0000","last_active":"2023-12-22T09:15:55.159611+0000","last_peered":"2023-12-22T09:15:55.159611+0000","last_clean":"2023-12-22T09:15:55.159611+0000","last_became_active":"2023-12-22T09:15:54.673649+0000","last_became_peered":"2023-12-22T09:15:54.673649+0000","last_unstale":"2023-12-22T09:15:55.159611+0000","last_undegraded":"2023-12-22T09:15:55.159611+0000","last_fullsized":"2023-12-22T09:15:55.159611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:08.829353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.137098+0000","last_change":"2023-12-22T09:15:55.167800+0000","last_active":"2023-12-22T09:15:56.137098+0000","last_peered":"2023-12-22T09:15:56.137098+0000","last_clean":"2023-12-22T09:15:56.137098+0000","last_became_active":"2023-12-22T09:15:55.167492+0000","last_became_peered":"2023-12-22T09:15:55.167492+0000","last_unstale":"2023-12-22T09:15:56.137098+0000","last_undegraded":"2023-12-22T09:15:56.137098+0000","last_fullsized":"2023-12-22T09:15:56.137098+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:14.590975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209271+0000","last_change":"2023-12-22T09:15:54.677140+0000","last_active":"2023-12-22T09:15:56.209271+0000","last_peered":"2023-12-22T09:15:56.209271+0000","last_clean":"2023-12-22T09:15:56.209271+0000","last_became_active":"2023-12-22T09:15:54.676892+0000","last_became_peered":"2023-12-22T09:15:54.676892+0000","last_unstale":"2023-12-22T09:15:56.209271+0000","last_undegraded":"2023-12-22T09:15:56.209271+0000","last_fullsized":"2023-12-22T09:15:56.209271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:29.702956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134562+0000","last_change":"2023-12-22T09:15:55.135433+0000","last_active":"2023-12-22T09:15:56.134562+0000","last_peered":"2023-12-22T09:15:56.134562+0000","last_clean":"2023-12-22T09:15:56.134562+0000","last_became_active":"2023-12-22T09:15:55.135160+0000","last_became_peered":"2023-12-22T09:15:55.135160+0000","last_unstale":"2023-12-22T09:15:56.134562+0000","last_undegraded":"2023-12-22T09:15:56.134562+0000","last_fullsized":"2023-12-22T09:15:56.134562+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:43.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135370+0000","last_change":"2023-12-22T09:15:54.665511+0000","last_active":"2023-12-22T09:15:56.135370+0000","last_peered":"2023-12-22T09:15:56.135370+0000","last_clean":"2023-12-22T09:15:56.135370+0000","last_became_active":"2023-12-22T09:15:54.665202+0000","last_became_peered":"2023-12-22T09:15:54.665202+0000","last_unstale":"2023-12-22T09:15:56.135370+0000","last_undegraded":"2023-12-22T09:15:56.135370+0000","last_fullsized":"2023-12-22T09:15:56.135370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:00.147710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.509204+0000","last_change":"2023-12-22T09:15:55.158570+0000","last_active":"2023-12-22T09:15:56.509204+0000","last_peered":"2023-12-22T09:15:56.509204+0000","last_clean":"2023-12-22T09:15:56.509204+0000","last_became_active":"2023-12-22T09:15:55.157438+0000","last_became_peered":"2023-12-22T09:15:55.157438+0000","last_unstale":"2023-12-22T09:15:56.509204+0000","last_undegraded":"2023-12-22T09:15:56.509204+0000","last_fullsized":"2023-12-22T09:15:56.509204+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:37.962424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135082+0000","last_change":"2023-12-22T09:15:54.659045+0000","last_active":"2023-12-22T09:15:56.135082+0000","last_peered":"2023-12-22T09:15:56.135082+0000","last_clean":"2023-12-22T09:15:56.135082+0000","last_became_active":"2023-12-22T09:15:54.658790+0000","last_became_peered":"2023-12-22T09:15:54.658790+0000","last_unstale":"2023-12-22T09:15:56.135082+0000","last_undegraded":"2023-12-22T09:15:56.135082+0000","last_fullsized":"2023-12-22T09:15:56.135082+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:37.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.160828+0000","last_change":"2023-12-22T09:15:55.157643+0000","last_active":"2023-12-22T09:15:55.160828+0000","last_peered":"2023-12-22T09:15:55.160828+0000","last_clean":"2023-12-22T09:15:55.160828+0000","last_became_active":"2023-12-22T09:15:55.157227+0000","last_became_peered":"2023-12-22T09:15:55.157227+0000","last_unstale":"2023-12-22T09:15:55.160828+0000","last_undegraded":"2023-12-22T09:15:55.160828+0000","last_fullsized":"2023-12-22T09:15:55.160828+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:08.180891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514766+0000","last_change":"2023-12-22T09:15:54.676788+0000","last_active":"2023-12-22T09:15:56.514766+0000","last_peered":"2023-12-22T09:15:56.514766+0000","last_clean":"2023-12-22T09:15:56.514766+0000","last_became_active":"2023-12-22T09:15:54.676521+0000","last_became_peered":"2023-12-22T09:15:54.676521+0000","last_unstale":"2023-12-22T09:15:56.514766+0000","last_undegraded":"2023-12-22T09:15:56.514766+0000","last_fullsized":"2023-12-22T09:15:56.514766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:10:18.309697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.156117+0000","last_change":"2023-12-22T09:15:55.150296+0000","last_active":"2023-12-22T09:15:55.156117+0000","last_peered":"2023-12-22T09:15:55.156117+0000","last_clean":"2023-12-22T09:15:55.156117+0000","last_became_active":"2023-12-22T09:15:55.150002+0000","last_became_peered":"2023-12-22T09:15:55.150002+0000","last_unstale":"2023-12-22T09:15:55.156117+0000","last_undegraded":"2023-12-22T09:15:55.156117+0000","last_fullsized":"2023-12-22T09:15:55.156117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:38:09.607747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.515069+0000","last_change":"2023-12-22T09:15:54.734307+0000","last_active":"2023-12-22T09:15:56.515069+0000","last_peered":"2023-12-22T09:15:56.515069+0000","last_clean":"2023-12-22T09:15:56.515069+0000","last_became_active":"2023-12-22T09:15:54.733912+0000","last_became_peered":"2023-12-22T09:15:54.733912+0000","last_unstale":"2023-12-22T09:15:56.515069+0000","last_undegraded":"2023-12-22T09:15:56.515069+0000","last_fullsized":"2023-12-22T09:15:56.515069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:29.702956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136988+0000","last_change":"2023-12-22T09:15:55.161558+0000","last_active":"2023-12-22T09:15:56.136988+0000","last_peered":"2023-12-22T09:15:56.136988+0000","last_clean":"2023-12-22T09:15:56.136988+0000","last_became_active":"2023-12-22T09:15:55.161234+0000","last_became_peered":"2023-12-22T09:15:55.161234+0000","last_unstale":"2023-12-22T09:15:56.136988+0000","last_undegraded":"2023-12-22T09:15:56.136988+0000","last_fullsized":"2023-12-22T09:15:56.136988+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:40.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134786+0000","last_change":"2023-12-22T09:15:54.667080+0000","last_active":"2023-12-22T09:15:56.134786+0000","last_peered":"2023-12-22T09:15:56.134786+0000","last_clean":"2023-12-22T09:15:56.134786+0000","last_became_active":"2023-12-22T09:15:54.666810+0000","last_became_peered":"2023-12-22T09:15:54.666810+0000","last_unstale":"2023-12-22T09:15:56.134786+0000","last_undegraded":"2023-12-22T09:15:56.134786+0000","last_fullsized":"2023-12-22T09:15:56.134786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:26.702306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.153064+0000","last_change":"2023-12-22T09:15:55.148900+0000","last_active":"2023-12-22T09:15:55.153064+0000","last_peered":"2023-12-22T09:15:55.153064+0000","last_clean":"2023-12-22T09:15:55.153064+0000","last_became_active":"2023-12-22T09:15:55.148615+0000","last_became_peered":"2023-12-22T09:15:55.148615+0000","last_unstale":"2023-12-22T09:15:55.153064+0000","last_undegraded":"2023-12-22T09:15:55.153064+0000","last_fullsized":"2023-12-22T09:15:55.153064+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134660+0000","last_change":"2023-12-22T09:15:54.654891+0000","last_active":"2023-12-22T09:15:56.134660+0000","last_peered":"2023-12-22T09:15:56.134660+0000","last_clean":"2023-12-22T09:15:56.134660+0000","last_became_active":"2023-12-22T09:15:54.654648+0000","last_became_peered":"2023-12-22T09:15:54.654648+0000","last_unstale":"2023-12-22T09:15:56.134660+0000","last_undegraded":"2023-12-22T09:15:56.134660+0000","last_fullsized":"2023-12-22T09:15:56.134660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:24.225526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134458+0000","last_change":"2023-12-22T09:15:55.144394+0000","last_active":"2023-12-22T09:15:56.134458+0000","last_peered":"2023-12-22T09:15:56.134458+0000","last_clean":"2023-12-22T09:15:56.134458+0000","last_became_active":"2023-12-22T09:15:55.143235+0000","last_became_peered":"2023-12-22T09:15:55.143235+0000","last_unstale":"2023-12-22T09:15:56.134458+0000","last_undegraded":"2023-12-22T09:15:56.134458+0000","last_fullsized":"2023-12-22T09:15:56.134458+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:07.046838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209285+0000","last_change":"2023-12-22T09:15:54.674073+0000","last_active":"2023-12-22T09:15:56.209285+0000","last_peered":"2023-12-22T09:15:56.209285+0000","last_clean":"2023-12-22T09:15:56.209285+0000","last_became_active":"2023-12-22T09:15:54.673820+0000","last_became_peered":"2023-12-22T09:15:54.673820+0000","last_unstale":"2023-12-22T09:15:56.209285+0000","last_undegraded":"2023-12-22T09:15:56.209285+0000","last_fullsized":"2023-12-22T09:15:56.209285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:38.639959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.159797+0000","last_change":"2023-12-22T09:15:55.151156+0000","last_active":"2023-12-22T09:15:55.159797+0000","last_peered":"2023-12-22T09:15:55.159797+0000","last_clean":"2023-12-22T09:15:55.159797+0000","last_became_active":"2023-12-22T09:15:55.150859+0000","last_became_peered":"2023-12-22T09:15:55.150859+0000","last_unstale":"2023-12-22T09:15:55.159797+0000","last_undegraded":"2023-12-22T09:15:55.159797+0000","last_fullsized":"2023-12-22T09:15:55.159797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:50.284022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.129243+0000","last_change":"2023-12-22T09:15:54.666683+0000","last_active":"2023-12-22T09:15:55.129243+0000","last_peered":"2023-12-22T09:15:55.129243+0000","last_clean":"2023-12-22T09:15:55.129243+0000","last_became_active":"2023-12-22T09:15:54.666419+0000","last_became_peered":"2023-12-22T09:15:54.666419+0000","last_unstale":"2023-12-22T09:15:55.129243+0000","last_undegraded":"2023-12-22T09:15:55.129243+0000","last_fullsized":"2023-12-22T09:15:55.129243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:25.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134460+0000","last_change":"2023-12-22T09:15:55.141694+0000","last_active":"2023-12-22T09:15:56.134460+0000","last_peered":"2023-12-22T09:15:56.134460+0000","last_clean":"2023-12-22T09:15:56.134460+0000","last_became_active":"2023-12-22T09:15:55.141460+0000","last_became_peered":"2023-12-22T09:15:55.141460+0000","last_unstale":"2023-12-22T09:15:56.134460+0000","last_undegraded":"2023-12-22T09:15:56.134460+0000","last_fullsized":"2023-12-22T09:15:56.134460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:14:34.300486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.171772+0000","last_change":"2023-12-22T09:15:54.670469+0000","last_active":"2023-12-22T09:15:55.171772+0000","last_peered":"2023-12-22T09:15:55.171772+0000","last_clean":"2023-12-22T09:15:55.171772+0000","last_became_active":"2023-12-22T09:15:54.670183+0000","last_became_peered":"2023-12-22T09:15:54.670183+0000","last_unstale":"2023-12-22T09:15:55.171772+0000","last_undegraded":"2023-12-22T09:15:55.171772+0000","last_fullsized":"2023-12-22T09:15:55.171772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134780+0000","last_change":"2023-12-22T09:15:55.135884+0000","last_active":"2023-12-22T09:15:56.134780+0000","last_peered":"2023-12-22T09:15:56.134780+0000","last_clean":"2023-12-22T09:15:56.134780+0000","last_became_active":"2023-12-22T09:15:55.135599+0000","last_became_peered":"2023-12-22T09:15:55.135599+0000","last_unstale":"2023-12-22T09:15:56.134780+0000","last_undegraded":"2023-12-22T09:15:56.134780+0000","last_fullsized":"2023-12-22T09:15:56.134780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:23.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514856+0000","last_change":"2023-12-22T09:15:54.675247+0000","last_active":"2023-12-22T09:15:56.514856+0000","last_peered":"2023-12-22T09:15:56.514856+0000","last_clean":"2023-12-22T09:15:56.514856+0000","last_became_active":"2023-12-22T09:15:54.674964+0000","last_became_peered":"2023-12-22T09:15:54.674964+0000","last_unstale":"2023-12-22T09:15:56.514856+0000","last_undegraded":"2023-12-22T09:15:56.514856+0000","last_fullsized":"2023-12-22T09:15:56.514856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:14.720567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514853+0000","last_change":"2023-12-22T09:15:55.159520+0000","last_active":"2023-12-22T09:15:56.514853+0000","last_peered":"2023-12-22T09:15:56.514853+0000","last_clean":"2023-12-22T09:15:56.514853+0000","last_became_active":"2023-12-22T09:15:55.159183+0000","last_became_peered":"2023-12-22T09:15:55.159183+0000","last_unstale":"2023-12-22T09:15:56.514853+0000","last_undegraded":"2023-12-22T09:15:56.514853+0000","last_fullsized":"2023-12-22T09:15:56.514853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:27.387730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136979+0000","last_change":"2023-12-22T09:15:54.678077+0000","last_active":"2023-12-22T09:15:56.136979+0000","last_peered":"2023-12-22T09:15:56.136979+0000","last_clean":"2023-12-22T09:15:56.136979+0000","last_became_active":"2023-12-22T09:15:54.677750+0000","last_became_peered":"2023-12-22T09:15:54.677750+0000","last_unstale":"2023-12-22T09:15:56.136979+0000","last_undegraded":"2023-12-22T09:15:56.136979+0000","last_fullsized":"2023-12-22T09:15:56.136979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:29.498658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.136701+0000","last_change":"2023-12-22T09:15:55.155587+0000","last_active":"2023-12-22T09:15:56.136701+0000","last_peered":"2023-12-22T09:15:56.136701+0000","last_clean":"2023-12-22T09:15:56.136701+0000","last_became_active":"2023-12-22T09:15:55.154482+0000","last_became_peered":"2023-12-22T09:15:55.154482+0000","last_unstale":"2023-12-22T09:15:56.136701+0000","last_undegraded":"2023-12-22T09:15:56.136701+0000","last_fullsized":"2023-12-22T09:15:56.136701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:57.296942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.509001+0000","last_change":"2023-12-22T09:15:54.670898+0000","last_active":"2023-12-22T09:15:56.509001+0000","last_peered":"2023-12-22T09:15:56.509001+0000","last_clean":"2023-12-22T09:15:56.509001+0000","last_became_active":"2023-12-22T09:15:54.670474+0000","last_became_peered":"2023-12-22T09:15:54.670474+0000","last_unstale":"2023-12-22T09:15:56.509001+0000","last_undegraded":"2023-12-22T09:15:56.509001+0000","last_fullsized":"2023-12-22T09:15:56.509001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:08.829353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508999+0000","last_change":"2023-12-22T09:15:55.153519+0000","last_active":"2023-12-22T09:15:56.508999+0000","last_peered":"2023-12-22T09:15:56.508999+0000","last_clean":"2023-12-22T09:15:56.508999+0000","last_became_active":"2023-12-22T09:15:55.153259+0000","last_became_peered":"2023-12-22T09:15:55.153259+0000","last_unstale":"2023-12-22T09:15:56.508999+0000","last_undegraded":"2023-12-22T09:15:56.508999+0000","last_fullsized":"2023-12-22T09:15:56.508999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:15.736391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209491+0000","last_change":"2023-12-22T09:15:54.668062+0000","last_active":"2023-12-22T09:15:56.209491+0000","last_peered":"2023-12-22T09:15:56.209491+0000","last_clean":"2023-12-22T09:15:56.209491+0000","last_became_active":"2023-12-22T09:15:54.667816+0000","last_became_peered":"2023-12-22T09:15:54.667816+0000","last_unstale":"2023-12-22T09:15:56.209491+0000","last_undegraded":"2023-12-22T09:15:56.209491+0000","last_fullsized":"2023-12-22T09:15:56.209491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:12.583708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.162791+0000","last_change":"2023-12-22T09:15:55.149199+0000","last_active":"2023-12-22T09:15:55.162791+0000","last_peered":"2023-12-22T09:15:55.162791+0000","last_clean":"2023-12-22T09:15:55.162791+0000","last_became_active":"2023-12-22T09:15:55.148960+0000","last_became_peered":"2023-12-22T09:15:55.148960+0000","last_unstale":"2023-12-22T09:15:55.162791+0000","last_undegraded":"2023-12-22T09:15:55.162791+0000","last_fullsized":"2023-12-22T09:15:55.162791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:01.163534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508557+0000","last_change":"2023-12-22T09:15:54.656366+0000","last_active":"2023-12-22T09:15:56.508557+0000","last_peered":"2023-12-22T09:15:56.508557+0000","last_clean":"2023-12-22T09:15:56.508557+0000","last_became_active":"2023-12-22T09:15:54.656119+0000","last_became_peered":"2023-12-22T09:15:54.656119+0000","last_unstale":"2023-12-22T09:15:56.508557+0000","last_undegraded":"2023-12-22T09:15:56.508557+0000","last_fullsized":"2023-12-22T09:15:56.508557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:23.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.156211+0000","last_change":"2023-12-22T09:15:55.150507+0000","last_active":"2023-12-22T09:15:55.156211+0000","last_peered":"2023-12-22T09:15:55.156211+0000","last_clean":"2023-12-22T09:15:55.156211+0000","last_became_active":"2023-12-22T09:15:55.149174+0000","last_became_peered":"2023-12-22T09:15:55.149174+0000","last_unstale":"2023-12-22T09:15:55.156211+0000","last_undegraded":"2023-12-22T09:15:55.156211+0000","last_fullsized":"2023-12-22T09:15:55.156211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:01.163534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508654+0000","last_change":"2023-12-22T09:15:54.666529+0000","last_active":"2023-12-22T09:15:56.508654+0000","last_peered":"2023-12-22T09:15:56.508654+0000","last_clean":"2023-12-22T09:15:56.508654+0000","last_became_active":"2023-12-22T09:15:54.666198+0000","last_became_peered":"2023-12-22T09:15:54.666198+0000","last_unstale":"2023-12-22T09:15:56.508654+0000","last_undegraded":"2023-12-22T09:15:56.508654+0000","last_fullsized":"2023-12-22T09:15:56.508654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:59.323545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514120+0000","last_change":"2023-12-22T09:15:55.154765+0000","last_active":"2023-12-22T09:15:56.514120+0000","last_peered":"2023-12-22T09:15:56.514120+0000","last_clean":"2023-12-22T09:15:56.514120+0000","last_became_active":"2023-12-22T09:15:55.154461+0000","last_became_peered":"2023-12-22T09:15:55.154461+0000","last_unstale":"2023-12-22T09:15:56.514120+0000","last_undegraded":"2023-12-22T09:15:56.514120+0000","last_fullsized":"2023-12-22T09:15:56.514120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:59.232942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.128838+0000","last_change":"2023-12-22T09:15:54.670745+0000","last_active":"2023-12-22T09:15:55.128838+0000","last_peered":"2023-12-22T09:15:55.128838+0000","last_clean":"2023-12-22T09:15:55.128838+0000","last_became_active":"2023-12-22T09:15:54.670471+0000","last_became_peered":"2023-12-22T09:15:54.670471+0000","last_unstale":"2023-12-22T09:15:55.128838+0000","last_undegraded":"2023-12-22T09:15:55.128838+0000","last_fullsized":"2023-12-22T09:15:55.128838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:18:34.722029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134560+0000","last_change":"2023-12-22T09:15:55.135327+0000","last_active":"2023-12-22T09:15:56.134560+0000","last_peered":"2023-12-22T09:15:56.134560+0000","last_clean":"2023-12-22T09:15:56.134560+0000","last_became_active":"2023-12-22T09:15:55.135121+0000","last_became_peered":"2023-12-22T09:15:55.135121+0000","last_unstale":"2023-12-22T09:15:56.134560+0000","last_undegraded":"2023-12-22T09:15:56.134560+0000","last_fullsized":"2023-12-22T09:15:56.134560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:55.239397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.508638+0000","last_change":"2023-12-22T09:15:54.653992+0000","last_active":"2023-12-22T09:15:56.508638+0000","last_peered":"2023-12-22T09:15:56.508638+0000","last_clean":"2023-12-22T09:15:56.508638+0000","last_became_active":"2023-12-22T09:15:54.653705+0000","last_became_peered":"2023-12-22T09:15:54.653705+0000","last_unstale":"2023-12-22T09:15:56.508638+0000","last_undegraded":"2023-12-22T09:15:56.508638+0000","last_fullsized":"2023-12-22T09:15:56.508638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:25.659639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209427+0000","last_change":"2023-12-22T09:15:55.164900+0000","last_active":"2023-12-22T09:15:56.209427+0000","last_peered":"2023-12-22T09:15:56.209427+0000","last_clean":"2023-12-22T09:15:56.209427+0000","last_became_active":"2023-12-22T09:15:55.164618+0000","last_became_peered":"2023-12-22T09:15:55.164618+0000","last_unstale":"2023-12-22T09:15:56.209427+0000","last_undegraded":"2023-12-22T09:15:56.209427+0000","last_fullsized":"2023-12-22T09:15:56.209427+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.515067+0000","last_change":"2023-12-22T09:15:54.733914+0000","last_active":"2023-12-22T09:15:56.515067+0000","last_peered":"2023-12-22T09:15:56.515067+0000","last_clean":"2023-12-22T09:15:56.515067+0000","last_became_active":"2023-12-22T09:15:54.733504+0000","last_became_peered":"2023-12-22T09:15:54.733504+0000","last_unstale":"2023-12-22T09:15:56.515067+0000","last_undegraded":"2023-12-22T09:15:56.515067+0000","last_fullsized":"2023-12-22T09:15:56.515067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:38.639959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.160811+0000","last_change":"2023-12-22T09:15:55.157481+0000","last_active":"2023-12-22T09:15:55.160811+0000","last_peered":"2023-12-22T09:15:55.160811+0000","last_clean":"2023-12-22T09:15:55.160811+0000","last_became_active":"2023-12-22T09:15:55.156846+0000","last_became_peered":"2023-12-22T09:15:55.156846+0000","last_unstale":"2023-12-22T09:15:55.160811+0000","last_undegraded":"2023-12-22T09:15:55.160811+0000","last_fullsized":"2023-12-22T09:15:55.160811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.512269+0000","last_change":"2023-12-22T09:15:54.678864+0000","last_active":"2023-12-22T09:15:56.512269+0000","last_peered":"2023-12-22T09:15:56.512269+0000","last_clean":"2023-12-22T09:15:56.512269+0000","last_became_active":"2023-12-22T09:15:54.678585+0000","last_became_peered":"2023-12-22T09:15:54.678585+0000","last_unstale":"2023-12-22T09:15:56.512269+0000","last_undegraded":"2023-12-22T09:15:56.512269+0000","last_fullsized":"2023-12-22T09:15:56.512269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134626+0000","last_change":"2023-12-22T09:15:55.154994+0000","last_active":"2023-12-22T09:15:56.134626+0000","last_peered":"2023-12-22T09:15:56.134626+0000","last_clean":"2023-12-22T09:15:56.134626+0000","last_became_active":"2023-12-22T09:15:55.154803+0000","last_became_peered":"2023-12-22T09:15:55.154803+0000","last_unstale":"2023-12-22T09:15:56.134626+0000","last_undegraded":"2023-12-22T09:15:56.134626+0000","last_fullsized":"2023-12-22T09:15:56.134626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:57.624842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.133856+0000","last_change":"2023-12-22T09:15:54.665822+0000","last_active":"2023-12-22T09:15:55.133856+0000","last_peered":"2023-12-22T09:15:55.133856+0000","last_clean":"2023-12-22T09:15:55.133856+0000","last_became_active":"2023-12-22T09:15:54.665585+0000","last_became_peered":"2023-12-22T09:15:54.665585+0000","last_unstale":"2023-12-22T09:15:55.133856+0000","last_undegraded":"2023-12-22T09:15:55.133856+0000","last_fullsized":"2023-12-22T09:15:55.133856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:17.033333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.144688+0000","last_change":"2023-12-22T09:15:55.140870+0000","last_active":"2023-12-22T09:15:55.144688+0000","last_peered":"2023-12-22T09:15:55.144688+0000","last_clean":"2023-12-22T09:15:55.144688+0000","last_became_active":"2023-12-22T09:15:55.140487+0000","last_became_peered":"2023-12-22T09:15:55.140487+0000","last_unstale":"2023-12-22T09:15:55.144688+0000","last_undegraded":"2023-12-22T09:15:55.144688+0000","last_fullsized":"2023-12-22T09:15:55.144688+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:17.416418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.134349+0000","last_change":"2023-12-22T09:15:54.667519+0000","last_active":"2023-12-22T09:15:55.134349+0000","last_peered":"2023-12-22T09:15:55.134349+0000","last_clean":"2023-12-22T09:15:55.134349+0000","last_became_active":"2023-12-22T09:15:54.667275+0000","last_became_peered":"2023-12-22T09:15:54.667275+0000","last_unstale":"2023-12-22T09:15:55.134349+0000","last_undegraded":"2023-12-22T09:15:55.134349+0000","last_fullsized":"2023-12-22T09:15:55.134349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:22:27.185341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.209224+0000","last_change":"2023-12-22T09:15:55.141979+0000","last_active":"2023-12-22T09:15:56.209224+0000","last_peered":"2023-12-22T09:15:56.209224+0000","last_clean":"2023-12-22T09:15:56.209224+0000","last_became_active":"2023-12-22T09:15:55.141734+0000","last_became_peered":"2023-12-22T09:15:55.141734+0000","last_unstale":"2023-12-22T09:15:56.209224+0000","last_undegraded":"2023-12-22T09:15:56.209224+0000","last_fullsized":"2023-12-22T09:15:56.209224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.131975+0000","last_change":"2023-12-22T09:15:54.658826+0000","last_active":"2023-12-22T09:15:55.131975+0000","last_peered":"2023-12-22T09:15:55.131975+0000","last_clean":"2023-12-22T09:15:55.131975+0000","last_became_active":"2023-12-22T09:15:54.658206+0000","last_became_peered":"2023-12-22T09:15:54.658206+0000","last_unstale":"2023-12-22T09:15:55.131975+0000","last_undegraded":"2023-12-22T09:15:55.131975+0000","last_fullsized":"2023-12-22T09:15:55.131975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:19.574375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135691+0000","last_change":"2023-12-22T09:15:55.152664+0000","last_active":"2023-12-22T09:15:56.135691+0000","last_peered":"2023-12-22T09:15:56.135691+0000","last_clean":"2023-12-22T09:15:56.135691+0000","last_became_active":"2023-12-22T09:15:55.152395+0000","last_became_peered":"2023-12-22T09:15:55.152395+0000","last_unstale":"2023-12-22T09:15:56.135691+0000","last_undegraded":"2023-12-22T09:15:56.135691+0000","last_fullsized":"2023-12-22T09:15:56.135691+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:27.387730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.135433+0000","last_change":"2023-12-22T09:15:54.672839+0000","last_active":"2023-12-22T09:15:56.135433+0000","last_peered":"2023-12-22T09:15:56.135433+0000","last_clean":"2023-12-22T09:15:56.135433+0000","last_became_active":"2023-12-22T09:15:54.672501+0000","last_became_peered":"2023-12-22T09:15:54.672501+0000","last_unstale":"2023-12-22T09:15:56.135433+0000","last_undegraded":"2023-12-22T09:15:56.135433+0000","last_fullsized":"2023-12-22T09:15:56.135433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:16.400594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.158893+0000","last_change":"2023-12-22T09:15:55.142126+0000","last_active":"2023-12-22T09:15:55.158893+0000","last_peered":"2023-12-22T09:15:55.158893+0000","last_clean":"2023-12-22T09:15:55.158893+0000","last_became_active":"2023-12-22T09:15:55.138650+0000","last_became_peered":"2023-12-22T09:15:55.138650+0000","last_unstale":"2023-12-22T09:15:55.158893+0000","last_undegraded":"2023-12-22T09:15:55.158893+0000","last_fullsized":"2023-12-22T09:15:55.158893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.134180+0000","last_change":"2023-12-22T09:15:54.661513+0000","last_active":"2023-12-22T09:15:56.134180+0000","last_peered":"2023-12-22T09:15:56.134180+0000","last_clean":"2023-12-22T09:15:56.134180+0000","last_became_active":"2023-12-22T09:15:54.658499+0000","last_became_peered":"2023-12-22T09:15:54.658499+0000","last_unstale":"2023-12-22T09:15:56.134180+0000","last_undegraded":"2023-12-22T09:15:56.134180+0000","last_fullsized":"2023-12-22T09:15:56.134180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:07.165067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-22T09:15:56.514517+0000","last_change":"2023-12-22T09:15:55.165334+0000","last_active":"2023-12-22T09:15:56.514517+0000","last_peered":"2023-12-22T09:15:56.514517+0000","last_clean":"2023-12-22T09:15:56.514517+0000","last_became_active":"2023-12-22T09:15:55.165009+0000","last_became_peered":"2023-12-22T09:15:55.165009+0000","last_unstale":"2023-12-22T09:15:56.514517+0000","last_undegraded":"2023-12-22T09:15:56.514517+0000","last_fullsized":"2023-12-22T09:15:56.514517+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-22T09:15:55.127317+0000","last_change":"2023-12-22T09:15:54.671832+0000","last_active":"2023-12-22T09:15:55.127317+0000","last_peered":"2023-12-22T09:15:55.127317+0000","last_clean":"2023-12-22T09:15:55.127317+0000","last_became_active":"2023-12-22T09:15:54.671542+0000","last_became_peered":"2023-12-22T09:15:54.671542+0000","last_unstale":"2023-12-22T09:15:55.127317+0000","last_undegraded":"2023-12-22T09:15:55.127317+0000","last_fullsized":"2023-12-22T09:15:55.127317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:23.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-22T09:15:54.662091+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:15:54.662091+0000","last_peered":"2023-12-22T09:15:54.662091+0000","last_clean":"2023-12-22T09:15:54.662091+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:15:54.662091+0000","last_undegraded":"2023-12-22T09:15:54.662091+0000","last_fullsized":"2023-12-22T09:15:54.662091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":1056768,"data_stored":782784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.6070000000000002,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":3.2429999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.629}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":3.1960000000000002},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":3.3159999999999998}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.208},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":3.282}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.1459999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":8.1620000000000008},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.748}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":3.504},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.2490000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":191364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.024},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.3639999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.294},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.3779999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.5780000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.546}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.6240000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.671},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":3.3399999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.738}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.696},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.649}]}]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":190894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.95599999999999996}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.85499999999999998}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.3620000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.01}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.409}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.458}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":3.298,"5min":3.298,"15min":3.298},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.21}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":198006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.125},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.0369999999999999}]},{"osd":1,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.236},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.085}]},{"osd":2,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4390000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.4690000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.2969999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":462848,"data_stored":192380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.91300000000000003}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.86399999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.3380000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":24.245999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":1.6519999999999999},{"interface":"front","average":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":32.527999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":1.1559999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.722,"5min":2.722,"15min":2.722},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":33.103999999999999,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.377},{"interface":"front","average":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":27.181999999999999,"5min":27.181999999999999,"15min":27.181999999999999},"last":1.5680000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":22.715,"5min":22.715,"15min":22.715},"last":1.1220000000000001},{"interface":"front","average":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":30.108000000000001,"5min":30.108000000000001,"15min":30.108000000000001},"last":1.429}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":190852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.91700000000000004}]},{"osd":1,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.29}]},{"osd":3,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.4530000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.5780000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":1.266}]},{"osd":6,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":1.498}]},{"osd":7,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.3929999999999998,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":1.625}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":190872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.5640000000000001,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.127},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.524,"5min":4.524,"15min":4.524},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.97999999999999998}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.71499999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":781184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.495}]},{"osd":3,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.77700000000000002}]},{"osd":5,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.016}]},{"osd":7,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:16:00.028 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T09:16:00.029 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T09:16:00.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.294+0000 7f4c031b9640 1 Processor -- start 2023-12-22T09:16:00.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.294+0000 7f4c031b9640 1 -- start start 2023-12-22T09:16:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.295+0000 7f4c031b9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4bfc151630 0x7f4bfc0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.295+0000 7f4c031b9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bfc154960 con 0x7f4bfc06fc30 2023-12-22T09:16:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.295+0000 7f4c031b9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bfc0c3810 con 0x7f4bfc0c1f50 2023-12-22T09:16:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.295+0000 7f4c031b9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bfc0c3dd0 con 0x7f4bfc151630 2023-12-22T09:16:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.296+0000 7f4bfbfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4bfc06fc30 0x7f4bfc157360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47944/0 (socket says 172.21.15.106:47944) 2023-12-22T09:16:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.296+0000 7f4bfbfff640 1 -- 172.21.15.106:0/3228101099 learned_addr learned my addr 172.21.15.106:0/3228101099 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.296+0000 7f4c00f55640 1 --2- 172.21.15.106:0/3228101099 >> v2:172.21.15.106:3300/0 conn(0x7f4bfc151630 0x7f4bfc0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.296+0000 7f4c00f55640 1 -- 172.21.15.106:0/3228101099 >> v1:172.21.15.132:6789/0 conn(0x7f4bfc0c1f50 legacy=0x7f4bfc15e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.296+0000 7f4c00f55640 1 -- 172.21.15.106:0/3228101099 >> v1:172.21.15.106:6789/0 conn(0x7f4bfc06fc30 legacy=0x7f4bfc157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.296+0000 7f4c00f55640 1 -- 172.21.15.106:0/3228101099 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0c3af0 con 0x7f4bfc151630 2023-12-22T09:16:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.296+0000 7f4bfb7fe640 1 -- 172.21.15.106:0/3228101099 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834799151 0 0) 0x7f4bfc154960 con 0x7f4bfc06fc30 2023-12-22T09:16:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.297+0000 7f4c00f55640 1 --2- 172.21.15.106:0/3228101099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc151630 0x7f4bfc0c3fe0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0097a0 tx=0x7f4bec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238f77d4b1cc510 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:00.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.297+0000 7f4bfb7fe640 1 -- 172.21.15.106:0/3228101099 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec031830 con 0x7f4bfc151630 2023-12-22T09:16:00.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.298+0000 7f4bfb7fe640 1 -- 172.21.15.106:0/3228101099 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec031990 con 0x7f4bfc151630 2023-12-22T09:16:00.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.298+0000 7f4bfb7fe640 1 -- 172.21.15.106:0/3228101099 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec031d20 con 0x7f4bfc151630 2023-12-22T09:16:00.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.298+0000 7f4c031b9640 1 -- 172.21.15.106:0/3228101099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc151630 msgr2=0x7f4bfc0c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.298+0000 7f4c031b9640 1 --2- 172.21.15.106:0/3228101099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc151630 0x7f4bfc0c3fe0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0097a0 tx=0x7f4bec02b8d0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.298+0000 7f4c031b9640 1 -- 172.21.15.106:0/3228101099 shutdown_connections 2023-12-22T09:16:00.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.298+0000 7f4c031b9640 1 --2- 172.21.15.106:0/3228101099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc151630 0x7f4bfc0c3fe0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.298+0000 7f4c031b9640 1 -- 172.21.15.106:0/3228101099 >> 172.21.15.106:0/3228101099 conn(0x7f4bfc0a9160 msgr2=0x7f4bfc0a9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:00.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.298+0000 7f4c031b9640 1 -- 172.21.15.106:0/3228101099 shutdown_connections 2023-12-22T09:16:00.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.298+0000 7f4c031b9640 1 -- 172.21.15.106:0/3228101099 wait complete. 2023-12-22T09:16:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.300+0000 7f4c031b9640 1 Processor -- start 2023-12-22T09:16:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.300+0000 7f4c031b9640 1 -- start start 2023-12-22T09:16:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.301+0000 7f4c031b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc06fc30 0x7f4bfc0abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.301+0000 7f4c031b9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4bfc0c1f50 0x7f4bfc0ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.301+0000 7f4c031b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bfc151630 0x7f4bfc1ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.301+0000 7f4c031b9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc0bc700 con 0x7f4bfc06fc30 2023-12-22T09:16:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.301+0000 7f4c031b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc157000 con 0x7f4bfc151630 2023-12-22T09:16:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.301+0000 7f4c031b9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1ec930 con 0x7f4bfc0c1f50 2023-12-22T09:16:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.301+0000 7f4c00f55640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc06fc30 0x7f4bfc0abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.301+0000 7f4c00f55640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc06fc30 0x7f4bfc0abd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37872/0 (socket says 172.21.15.106:37872) 2023-12-22T09:16:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.301+0000 7f4c00f55640 1 -- 172.21.15.106:0/2073641496 learned_addr learned my addr 172.21.15.106:0/2073641496 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4c00f55640 1 -- 172.21.15.106:0/2073641496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4bfc0c1f50 msgr2=0x7f4bfc0ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4c00f55640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4bfc0c1f50 0x7f4bfc0ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4c00f55640 1 -- 172.21.15.106:0/2073641496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bfc151630 msgr2=0x7f4bfc1ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4c00f55640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bfc151630 0x7f4bfc1ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4c00f55640 1 -- 172.21.15.106:0/2073641496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009400 con 0x7f4bfc06fc30 2023-12-22T09:16:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4c00f55640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc06fc30 0x7f4bfc0abd10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4bf97fa640 1 -- 172.21.15.106:0/2073641496 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec03aa60 con 0x7f4bfc06fc30 2023-12-22T09:16:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4bf97fa640 1 -- 172.21.15.106:0/2073641496 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec03abc0 con 0x7f4bfc06fc30 2023-12-22T09:16:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4bf97fa640 1 -- 172.21.15.106:0/2073641496 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0443f0 con 0x7f4bfc06fc30 2023-12-22T09:16:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc0bc140 con 0x7f4bfc06fc30 2023-12-22T09:16:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.302+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc157250 con 0x7f4bfc06fc30 2023-12-22T09:16:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.303+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bfc073f10 con 0x7f4bfc06fc30 2023-12-22T09:16:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.304+0000 7f4bf97fa640 1 -- 172.21.15.106:0/2073641496 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4bec04d450 con 0x7f4bfc06fc30 2023-12-22T09:16:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.305+0000 7f4bf97fa640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4bdc06a430 0x7f4bdc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.305+0000 7f4bf97fa640 1 -- 172.21.15.106:0/2073641496 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4bec0aad50 con 0x7f4bfc06fc30 2023-12-22T09:16:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.306+0000 7f4bfbfff640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4bdc06a430 0x7f4bdc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.306+0000 7f4bfbfff640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4bdc06a430 0x7f4bdc06c8f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4be40011e0 tx=0x7f4be4007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.309+0000 7f4bf97fa640 1 -- 172.21.15.106:0/2073641496 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4bec076280 con 0x7f4bfc06fc30 2023-12-22T09:16:00.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.567+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4bfc06ad00 con 0x7f4bfc06fc30 2023-12-22T09:16:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.574+0000 7f4bf97fa640 1 -- 172.21.15.106:0/2073641496 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4bec0798a0 con 0x7f4bfc06fc30 2023-12-22T09:16:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:updated caps for client.0 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4bdc06a430 msgr2=0x7f4bdc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4bdc06a430 0x7f4bdc06c8f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4be40011e0 tx=0x7f4be4007920 comp rx=0 tx=0).stop 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc06fc30 msgr2=0x7f4bfc0abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc06fc30 0x7f4bfc0abd10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec0046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 shutdown_connections 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4bdc06a430 0x7f4bdc06c8f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bfc151630 0x7f4bfc1ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4bfc0c1f50 0x7f4bfc0ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 --2- 172.21.15.106:0/2073641496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bfc06fc30 0x7f4bfc0abd10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 >> 172.21.15.106:0/2073641496 conn(0x7f4bfc0a9160 msgr2=0x7f4bfc1508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 shutdown_connections 2023-12-22T09:16:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.577+0000 7f4c031b9640 1 -- 172.21.15.106:0/2073641496 wait complete. 2023-12-22T09:16:00.597 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.806+0000 7f9b0a1a9640 1 Processor -- start 2023-12-22T09:16:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.806+0000 7f9b0a1a9640 1 -- start start 2023-12-22T09:16:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.808+0000 7f9b0a1a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b040bfce0 0x7f9b0406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.808+0000 7f9b0a1a9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b04151b30 0x7f9b04151f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.808+0000 7f9b0a1a9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b040bf770 con 0x7f9b0413b060 2023-12-22T09:16:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.808+0000 7f9b0a1a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b04155120 con 0x7f9b040bfce0 2023-12-22T09:16:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.808+0000 7f9b0a1a9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b04155400 con 0x7f9b04151b30 2023-12-22T09:16:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.808+0000 7f9b037fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9b0413b060 0x7f9b04069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47958/0 (socket says 172.21.15.106:47958) 2023-12-22T09:16:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.808+0000 7f9b037fe640 1 -- 172.21.15.106:0/1921993151 learned_addr learned my addr 172.21.15.106:0/1921993151 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.809+0000 7f9b02ffd640 1 --2- 172.21.15.106:0/1921993151 >> v2:172.21.15.132:3300/0 conn(0x7f9b040bfce0 0x7f9b0406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.809+0000 7f9b03fff640 1 --2- 172.21.15.106:0/1921993151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b04151b30 0x7f9b04151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.809+0000 7f9b027fc640 1 -- 172.21.15.106:0/1921993151 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798735247 0 0) 0x7f9b040bf770 con 0x7f9b0413b060 2023-12-22T09:16:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.809+0000 7f9b027fc640 1 -- 172.21.15.106:0/1921993151 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af0003520 con 0x7f9b0413b060 2023-12-22T09:16:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.809+0000 7f9b027fc640 1 -- 172.21.15.106:0/1921993151 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1520442922 0 0) 0x7f9af0003520 con 0x7f9b0413b060 2023-12-22T09:16:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.809+0000 7f9b02ffd640 1 -- 172.21.15.106:0/1921993151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b04151b30 msgr2=0x7f9b04151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.809+0000 7f9b02ffd640 1 --2- 172.21.15.106:0/1921993151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b04151b30 0x7f9b04151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.809+0000 7f9b02ffd640 1 -- 172.21.15.106:0/1921993151 >> v1:172.21.15.106:6789/0 conn(0x7f9b0413b060 legacy=0x7f9b04069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.809+0000 7f9b02ffd640 1 -- 172.21.15.106:0/1921993151 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b041556e0 con 0x7f9b040bfce0 2023-12-22T09:16:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.810+0000 7f9b02ffd640 1 --2- 172.21.15.106:0/1921993151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b040bfce0 0x7f9b0406a6b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9af40097a0 tx=0x7f9af402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da0c7c576b4027f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.811+0000 7f9b027fc640 1 -- 172.21.15.106:0/1921993151 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0017f0 con 0x7f9b040bfce0 2023-12-22T09:16:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.811+0000 7f9b027fc640 1 -- 172.21.15.106:0/1921993151 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af402e050 con 0x7f9b040bfce0 2023-12-22T09:16:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.811+0000 7f9b027fc640 1 -- 172.21.15.106:0/1921993151 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4030730 con 0x7f9b040bfce0 2023-12-22T09:16:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.811+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1921993151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b040bfce0 msgr2=0x7f9b0406a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.811+0000 7f9b0a1a9640 1 --2- 172.21.15.106:0/1921993151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b040bfce0 0x7f9b0406a6b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9af40097a0 tx=0x7f9af402b710 comp rx=0 tx=0).stop 2023-12-22T09:16:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.812+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1921993151 shutdown_connections 2023-12-22T09:16:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.812+0000 7f9b0a1a9640 1 --2- 172.21.15.106:0/1921993151 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b04151b30 0x7f9b04151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.812+0000 7f9b0a1a9640 1 --2- 172.21.15.106:0/1921993151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b040bfce0 0x7f9b0406a6b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.812+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1921993151 >> 172.21.15.106:0/1921993151 conn(0x7f9b040c5360 msgr2=0x7f9b040c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.812+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1921993151 shutdown_connections 2023-12-22T09:16:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.812+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1921993151 wait complete. 2023-12-22T09:16:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.813+0000 7f9b0a1a9640 1 Processor -- start 2023-12-22T09:16:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.813+0000 7f9b0a1a9640 1 -- start start 2023-12-22T09:16:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.814+0000 7f9b0a1a9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b040bfce0 0x7f9b040aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.814+0000 7f9b0a1a9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b0413b060 0x7f9b0414f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.814+0000 7f9b0a1a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b04151b30 0x7f9b0414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.814+0000 7f9b0a1a9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c3310 con 0x7f9b0413b060 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.814+0000 7f9b0a1a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c49f0 con 0x7f9b04151b30 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.814+0000 7f9b0a1a9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b041eb3f0 con 0x7f9b040bfce0 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b02ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b0413b060 0x7f9b0414f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b02ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b0413b060 0x7f9b0414f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37884/0 (socket says 172.21.15.106:37884) 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b02ffd640 1 -- 172.21.15.106:0/1303074838 learned_addr learned my addr 172.21.15.106:0/1303074838 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b03fff640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b04151b30 0x7f9b0414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b037fe640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b040bfce0 0x7f9b040aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b02ffd640 1 -- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b040bfce0 msgr2=0x7f9b040aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b02ffd640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b040bfce0 0x7f9b040aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b02ffd640 1 -- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b04151b30 msgr2=0x7f9b0414fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b02ffd640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b04151b30 0x7f9b0414fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b02ffd640 1 -- 172.21.15.106:0/1303074838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4009400 con 0x7f9b0413b060 2023-12-22T09:16:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b03fff640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b04151b30 0x7f9b0414fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b037fe640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b040bfce0 0x7f9b040aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.815+0000 7f9b02ffd640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b0413b060 0x7f9b0414f9a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000c00 tx=0x7f9af40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.816+0000 7f9afbfff640 1 -- 172.21.15.106:0/1303074838 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af403b810 con 0x7f9b0413b060 2023-12-22T09:16:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.816+0000 7f9afbfff640 1 -- 172.21.15.106:0/1303074838 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af403b970 con 0x7f9b0413b060 2023-12-22T09:16:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.816+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040c4c40 con 0x7f9b0413b060 2023-12-22T09:16:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.816+0000 7f9afbfff640 1 -- 172.21.15.106:0/1303074838 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af403bd20 con 0x7f9b0413b060 2023-12-22T09:16:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.816+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b040c4f20 con 0x7f9b0413b060 2023-12-22T09:16:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.817+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b040c40f0 con 0x7f9b0413b060 2023-12-22T09:16:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.818+0000 7f9afbfff640 1 -- 172.21.15.106:0/1303074838 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9af4039040 con 0x7f9b0413b060 2023-12-22T09:16:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.819+0000 7f9afbfff640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9ae406a460 0x7f9ae406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.819+0000 7f9afbfff640 1 -- 172.21.15.106:0/1303074838 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9af40aa180 con 0x7f9b0413b060 2023-12-22T09:16:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.819+0000 7f9b037fe640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9ae406a460 0x7f9ae406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.820+0000 7f9b037fe640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9ae406a460 0x7f9ae406c920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0010e0 tx=0x7f9aec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:00.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:00.823+0000 7f9afbfff640 1 -- 172.21.15.106:0/1303074838 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9b040c40f0 con 0x7f9b0413b060 2023-12-22T09:16:01.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.051+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b040c40f0 con 0x7f9b0413b060 2023-12-22T09:16:01.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.052+0000 7f9afbfff640 1 -- 172.21.15.106:0/1303074838 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4657 (secure 0 0 0) 0x7f9b040c40f0 con 0x7f9b0413b060 2023-12-22T09:16:01.053 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:01.053 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:15:55.115066+0000","modified":"2023-12-22T09:15:58.132101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6835/3435163215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3435163215},{"type":"v1","addr":"172.21.15.132:6835","nonce":3435163215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T09:16:01.053 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 16 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9ae406a460 msgr2=0x7f9ae406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9ae406a460 0x7f9ae406c920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0010e0 tx=0x7f9aec009040 comp rx=0 tx=0).stop 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b0413b060 msgr2=0x7f9b0414f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b0413b060 0x7f9b0414f9a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000c00 tx=0x7f9af40046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 shutdown_connections 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9ae406a460 0x7f9ae406c920 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b04151b30 0x7f9b0414fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b0413b060 0x7f9b0414f9a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 --2- 172.21.15.106:0/1303074838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b040bfce0 0x7f9b040aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 >> 172.21.15.106:0/1303074838 conn(0x7f9b040c5360 msgr2=0x7f9b04072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 shutdown_connections 2023-12-22T09:16:01.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.055+0000 7f9b0a1a9640 1 -- 172.21.15.106:0/1303074838 wait complete. 2023-12-22T09:16:01.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T09:15:55.115066+0000', 'modified': '2023-12-22T09:15:58.132101+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.132:6835/3435163215', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6833', 'nonce': 3435163215}, {'type': 'v1', 'addr': '172.21.15.132:6835', 'nonce': 3435163215}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T09:16:01.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T09:16:01.476 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-22T09:16:01.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.698+0000 7f274700e640 1 Processor -- start 2023-12-22T09:16:01.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.698+0000 7f274700e640 1 -- start start 2023-12-22T09:16:01.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.699+0000 7f274700e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f27401514b0 0x7f27400c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.699+0000 7f274700e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27400c4130 0x7f2740154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.699+0000 7f274700e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27400c4660 con 0x7f2740154a80 2023-12-22T09:16:01.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.699+0000 7f274700e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2740153d60 con 0x7f27401514b0 2023-12-22T09:16:01.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.699+0000 7f274700e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274006b250 con 0x7f27400c4130 2023-12-22T09:16:01.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f27455ab640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2740154a80 0x7f27400c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47972/0 (socket says 172.21.15.106:47972) 2023-12-22T09:16:01.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f27455ab640 1 -- 172.21.15.106:0/1317245993 learned_addr learned my addr 172.21.15.106:0/1317245993 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f2744daa640 1 --2- 172.21.15.106:0/1317245993 >> v2:172.21.15.132:3300/0 conn(0x7f27401514b0 0x7f27400c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433767416 0 0) 0x7f27400c4660 con 0x7f2740154a80 2023-12-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f272c003520 con 0x7f2740154a80 2023-12-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f273ffff640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27400c4130 0x7f2740154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3399927362 0 0) 0x7f272c003520 con 0x7f2740154a80 2023-12-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27400c4130 msgr2=0x7f2740154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f273f7fe640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27400c4130 0x7f2740154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 >> v2:172.21.15.132:3300/0 conn(0x7f27401514b0 msgr2=0x7f27400c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f273f7fe640 1 --2- 172.21.15.106:0/1317245993 >> v2:172.21.15.132:3300/0 conn(0x7f27401514b0 0x7f27400c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.700+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274006b530 con 0x7f2740154a80 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f2738001670 con 0x7f2740154a80 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 >> v1:172.21.15.106:6789/0 conn(0x7f2740154a80 legacy=0x7f27400c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273f7fe640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27400c4130 0x7f272c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273f7fe640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f272c003fa0 0x7f272c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273f7fe640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c004d00 0x7f272c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740153d60 con 0x7f272c003fa0 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274006b250 con 0x7f272c004d00 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c00bb40 con 0x7f27400c4130 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f2744daa640 1 --2- 172.21.15.106:0/1317245993 >> v2:172.21.15.132:3300/0 conn(0x7f27401514b0 0x7f27400c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:16:01.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273ffff640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f272c003fa0 0x7f272c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273ffff640 1 -- 172.21.15.106:0/1317245993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27400c4130 msgr2=0x7f272c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273ffff640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27400c4130 0x7f272c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273ffff640 1 -- 172.21.15.106:0/1317245993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c004d00 msgr2=0x7f272c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273ffff640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272c004d00 0x7f272c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.701+0000 7f273ffff640 1 -- 172.21.15.106:0/1317245993 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c003520 con 0x7f272c003fa0 2023-12-22T09:16:01.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.702+0000 7f273ffff640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f272c003fa0 0x7f272c0047c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f272800ba00 tx=0x7f272c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5d07d8b7e9c681 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728032640 con 0x7f272c003fa0 2023-12-22T09:16:01.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27280327a0 con 0x7f272c003fa0 2023-12-22T09:16:01.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f273f7fe640 1 -- 172.21.15.106:0/1317245993 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728032b30 con 0x7f272c003fa0 2023-12-22T09:16:01.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f274700e640 1 -- 172.21.15.106:0/1317245993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f272c003fa0 msgr2=0x7f272c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f274700e640 1 --2- 172.21.15.106:0/1317245993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f272c003fa0 0x7f272c0047c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f272800ba00 tx=0x7f272c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f27455ab640 1 -- 172.21.15.106:0/1317245993 reap_dead start 2023-12-22T09:16:01.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f274700e640 1 -- 172.21.15.106:0/1317245993 shutdown_connections 2023-12-22T09:16:01.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f274700e640 1 -- 172.21.15.106:0/1317245993 >> 172.21.15.106:0/1317245993 conn(0x7f27400ab1a0 msgr2=0x7f27400ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:01.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f274700e640 1 -- 172.21.15.106:0/1317245993 shutdown_connections 2023-12-22T09:16:01.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.703+0000 7f274700e640 1 -- 172.21.15.106:0/1317245993 wait complete. 2023-12-22T09:16:01.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.705+0000 7f274700e640 1 Processor -- start 2023-12-22T09:16:01.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.705+0000 7f274700e640 1 -- start start 2023-12-22T09:16:01.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.706+0000 7f274700e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f272c003fa0 0x7f274014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.706+0000 7f274700e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2740149cc0 0x7f27400bf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.706+0000 7f274700e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27400bfd80 0x7f27400c0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.706+0000 7f274700e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27400bf060 con 0x7f27400bfd80 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.706+0000 7f274700e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27400bc960 con 0x7f2740149cc0 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.706+0000 7f274700e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27400c3510 con 0x7f272c003fa0 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.706+0000 7f27455ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27400bfd80 0x7f27400c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.706+0000 7f27455ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27400bfd80 0x7f27400c0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37896/0 (socket says 172.21.15.106:37896) 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f27455ab640 1 -- 172.21.15.106:0/1420870165 learned_addr learned my addr 172.21.15.106:0/1420870165 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f273ffff640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2740149cc0 0x7f27400bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f2744daa640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f272c003fa0 0x7f274014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f27455ab640 1 -- 172.21.15.106:0/1420870165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f272c003fa0 msgr2=0x7f274014ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f27455ab640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f272c003fa0 0x7f274014ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f27455ab640 1 -- 172.21.15.106:0/1420870165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2740149cc0 msgr2=0x7f27400bf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f27455ab640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2740149cc0 0x7f27400bf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f27455ab640 1 -- 172.21.15.106:0/1420870165 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400c37f0 con 0x7f27400bfd80 2023-12-22T09:16:01.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f27455ab640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27400bfd80 0x7f27400c0780 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2738000c00 tx=0x7f273800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f273d7fa640 1 -- 172.21.15.106:0/1420870165 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738007440 con 0x7f27400bfd80 2023-12-22T09:16:01.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.707+0000 7f273d7fa640 1 -- 172.21.15.106:0/1420870165 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27380075e0 con 0x7f27400bfd80 2023-12-22T09:16:01.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.708+0000 7f274700e640 1 -- 172.21.15.106:0/1420870165 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27401504d0 con 0x7f27400bfd80 2023-12-22T09:16:01.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.708+0000 7f273d7fa640 1 -- 172.21.15.106:0/1420870165 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738004a20 con 0x7f27400bfd80 2023-12-22T09:16:01.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.708+0000 7f274700e640 1 -- 172.21.15.106:0/1420870165 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27400bde00 con 0x7f27400bfd80 2023-12-22T09:16:01.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.710+0000 7f273d7fa640 1 -- 172.21.15.106:0/1420870165 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2738004b80 con 0x7f27400bfd80 2023-12-22T09:16:01.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.711+0000 7f273d7fa640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f272006a430 0x7f272006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.711+0000 7f273d7fa640 1 -- 172.21.15.106:0/1420870165 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2738088360 con 0x7f27400bfd80 2023-12-22T09:16:01.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.711+0000 7f2744daa640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f272006a430 0x7f272006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.711+0000 7f2744daa640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f272006a430 0x7f272006c8f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2730004af0 tx=0x7f273000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.712+0000 7f2749b77740 1 Processor -- start 2023-12-22T09:16:01.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.712+0000 7f2749b77740 1 -- start start 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f2749b77740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c77d0 0x558ca09020c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f2749b77740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 0x558ca0902600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f2749b77740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0903630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f2749b77740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ca0831f80 con 0x558ca08c8860 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f2749b77740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ca082f710 con 0x558ca08c77d0 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f2749b77740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ca082b000 con 0x558ca08c7bb0 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f27455ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0903630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f27455ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0903630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37910/0 (socket says 172.21.15.106:37910) 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f27455ab640 1 -- 172.21.15.106:0/728414749 learned_addr learned my addr 172.21.15.106:0/728414749 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f2744daa640 1 --2- 172.21.15.106:0/728414749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c77d0 0x558ca09020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f27455ab640 1 -- 172.21.15.106:0/728414749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 msgr2=0x558ca0902600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f27455ab640 1 --2- 172.21.15.106:0/728414749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 0x558ca0902600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f27455ab640 1 -- 172.21.15.106:0/728414749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c77d0 msgr2=0x558ca09020c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f27455ab640 1 --2- 172.21.15.106:0/728414749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c77d0 0x558ca09020c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f27455ab640 1 -- 172.21.15.106:0/728414749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ca07f2690 con 0x558ca08c8860 2023-12-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.713+0000 7f2744daa640 1 --2- 172.21.15.106:0/728414749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c77d0 0x558ca09020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:01.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.714+0000 7f27455ab640 1 --2- 172.21.15.106:0/728414749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0903630 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f27380077e0 tx=0x7f2738057c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c491214f18262a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.714+0000 7f27367fc640 1 -- 172.21.15.106:0/728414749 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273805f410 con 0x558ca08c8860 2023-12-22T09:16:01.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.714+0000 7f27367fc640 1 -- 172.21.15.106:0/728414749 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27380880c0 con 0x558ca08c8860 2023-12-22T09:16:01.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.714+0000 7f27367fc640 1 -- 172.21.15.106:0/728414749 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800ed60 con 0x558ca08c8860 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.714+0000 7f2749b77740 1 -- 172.21.15.106:0/728414749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 msgr2=0x558ca0903630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.714+0000 7f2749b77740 1 --2- 172.21.15.106:0/728414749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0903630 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f27380077e0 tx=0x7f2738057c70 comp rx=0 tx=0).stop 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.715+0000 7f2749b77740 1 -- 172.21.15.106:0/728414749 shutdown_connections 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.715+0000 7f2749b77740 1 --2- 172.21.15.106:0/728414749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0903630 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.715+0000 7f2749b77740 1 --2- 172.21.15.106:0/728414749 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 0x558ca0902600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.715+0000 7f2749b77740 1 --2- 172.21.15.106:0/728414749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c77d0 0x558ca09020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.715+0000 7f2749b77740 1 -- 172.21.15.106:0/728414749 >> 172.21.15.106:0/728414749 conn(0x558ca08c3ea0 msgr2=0x558ca08e88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.715+0000 7f2749b77740 1 -- 172.21.15.106:0/728414749 shutdown_connections 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.715+0000 7f2749b77740 1 -- 172.21.15.106:0/728414749 wait complete. 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.715+0000 7f2749b77740 1 -- start start 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.715+0000 7f2749b77740 1 Processor -- start 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.716+0000 7f2749b77740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 0x558ca09132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.716+0000 7f2749b77740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca08e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.716+0000 7f2749b77740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca0900520 0x558ca09009a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.716+0000 7f2749b77740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ca07cc7d0 con 0x558ca08c8860 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.716+0000 7f2749b77740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ca07cc470 con 0x558ca0900520 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.716+0000 7f2749b77740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ca0592f20 con 0x558ca08c7bb0 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f2749b77740 10 client.0 _ll_register_callbacks cb 0x558ca081b1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f273ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca08e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f273ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca08e8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37926/0 (socket says 172.21.15.106:37926) 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f273ffff640 1 -- 172.21.15.106:0/1665758890 learned_addr learned my addr 172.21.15.106:0/1665758890 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f273ffff640 1 -- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 msgr2=0x558ca09132c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f273ffff640 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 0x558ca09132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f273ffff640 1 -- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca0900520 msgr2=0x558ca09009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f273ffff640 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca0900520 0x558ca09009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f273ffff640 1 -- 172.21.15.106:0/1665758890 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27400bde00 con 0x558ca08c8860 2023-12-22T09:16:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f273ffff640 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca08e8580 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f272802bec0 tx=0x7f27280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e472d612ccc11550 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.717+0000 7f271f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-12-22T09:16:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f271f7fe640 1 -- 172.21.15.106:0/1665758890 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728004220 con 0x558ca08c8860 2023-12-22T09:16:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f271f7fe640 1 -- 172.21.15.106:0/1665758890 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2728004380 con 0x558ca08c8860 2023-12-22T09:16:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f2749b77740 1 -- 172.21.15.106:0/1665758890 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ca0855550 con 0x558ca08c8860 2023-12-22T09:16:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f271f7fe640 1 -- 172.21.15.106:0/1665758890 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f272803b630 con 0x558ca08c8860 2023-12-22T09:16:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f2749b77740 10 client.5385 fetch_fsmap learned FSMap version 16 2023-12-22T09:16:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f2749b77740 1 -- 172.21.15.106:0/1665758890 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x558ca0829680 con 0x558ca08c8860 2023-12-22T09:16:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f271f7fe640 1 -- 172.21.15.106:0/1665758890 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ca0855550 con 0x558ca08c8860 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f271f7fe640 1 -- 172.21.15.106:0/1665758890 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f272803b790 con 0x558ca08c8860 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f2749b77740 10 client.5385 fetch_fsmap finished waiting for FSMap version 16 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f2749b77740 10 client.5385 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f2749b77740 20 client.5385 populate_metadata read hostname 'smithi106' 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f2749b77740 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] conn(0x558ca091ff40 0x558ca0922330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f2749b77740 4 client.5385 mds_command: new command op to 5211 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.718+0000 7f2749b77740 1 -- 172.21.15.106:0/1665758890 --> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ca081db50 con 0x558ca091ff40 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.719+0000 7f2744daa640 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] conn(0x558ca091ff40 0x558ca0922330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.720+0000 7f2744daa640 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] conn(0x558ca091ff40 0x558ca0922330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7bf55e6064756bf server_cookie=724152a3f42d8cd9 in_seq=0 out_seq=0 2023-12-22T09:16:01.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.720+0000 7f271f7fe640 10 client.5385 ms_handle_connect on v2:172.21.15.132:6833/3435163215 2023-12-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.722+0000 7f271f7fe640 1 -- 172.21.15.106:0/1665758890 <== mds.0 v2:172.21.15.132:6833/3435163215 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x558ca081db50 con 0x558ca091ff40 2023-12-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.722+0000 7f271f7fe640 10 client.5385 handle_command_reply: tid=0 2023-12-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.722+0000 7f2749b77740 1 client.5385 shutdown 2023-12-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 -- 172.21.15.106:0/1665758890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 msgr2=0x558ca08e8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca08e8580 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f272802bec0 tx=0x7f27280046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 -- 172.21.15.106:0/1665758890 shutdown_connections 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] conn(0x558ca091ff40 0x558ca0922330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca0900520 0x558ca09009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca08e8580 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 --2- 172.21.15.106:0/1665758890 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 0x558ca09132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f271f7fe640 0 client.5385 ms_handle_reset on v2:172.21.15.132:6833/3435163215 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 -- 172.21.15.106:0/1665758890 >> 172.21.15.106:0/1665758890 conn(0x558ca08c77d0 msgr2=0x558ca0902bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 -- 172.21.15.106:0/1665758890 shutdown_connections 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 1 -- 172.21.15.106:0/1665758890 wait complete. 2023-12-22T09:16:01.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.723+0000 7f2749b77740 20 client.5385 trim_cache size 0 max 16384 2023-12-22T09:16:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.739+0000 7f2749b77740 1 Processor -- start 2023-12-22T09:16:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.739+0000 7f2749b77740 1 -- start start 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.740+0000 7f2749b77740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c7bb0 0x558ca08e8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.740+0000 7f2749b77740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.740+0000 7f2749b77740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca0900520 0x558ca0903340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.740+0000 7f2749b77740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ca08e6670 con 0x558ca08c8860 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.740+0000 7f2749b77740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ca0903880 con 0x558ca08c7bb0 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.740+0000 7f2749b77740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ca0904600 con 0x558ca0900520 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.740+0000 7f273ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.740+0000 7f273ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37934/0 (socket says 172.21.15.106:37934) 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.740+0000 7f273ffff640 1 -- 172.21.15.106:0/3148280552 learned_addr learned my addr 172.21.15.106:0/3148280552 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f273ffff640 1 -- 172.21.15.106:0/3148280552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca0900520 msgr2=0x558ca0903340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f2744daa640 1 --2- 172.21.15.106:0/3148280552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c7bb0 0x558ca08e8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f273ffff640 1 --2- 172.21.15.106:0/3148280552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca0900520 0x558ca0903340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f273ffff640 1 -- 172.21.15.106:0/3148280552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c7bb0 msgr2=0x558ca08e8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f273ffff640 1 --2- 172.21.15.106:0/3148280552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c7bb0 0x558ca08e8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f273ffff640 1 -- 172.21.15.106:0/3148280552 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ca07cb9e0 con 0x558ca08c8860 2023-12-22T09:16:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f273ffff640 1 --2- 172.21.15.106:0/3148280552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f272800b850 tx=0x7f272803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9d0d698f464dba server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f2736ffd640 1 -- 172.21.15.106:0/3148280552 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272803b830 con 0x558ca08c8860 2023-12-22T09:16:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f2736ffd640 1 -- 172.21.15.106:0/3148280552 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728044460 con 0x558ca08c8860 2023-12-22T09:16:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.741+0000 7f2736ffd640 1 -- 172.21.15.106:0/3148280552 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728044810 con 0x558ca08c8860 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 -- 172.21.15.106:0/3148280552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 msgr2=0x558ca0902e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 --2- 172.21.15.106:0/3148280552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f272800b850 tx=0x7f272803f000 comp rx=0 tx=0).stop 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 -- 172.21.15.106:0/3148280552 shutdown_connections 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 --2- 172.21.15.106:0/3148280552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca0900520 0x558ca0903340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 --2- 172.21.15.106:0/3148280552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902e00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 --2- 172.21.15.106:0/3148280552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca08c7bb0 0x558ca08e8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 -- 172.21.15.106:0/3148280552 >> 172.21.15.106:0/3148280552 conn(0x558ca08c77d0 msgr2=0x558ca08bd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 -- 172.21.15.106:0/3148280552 shutdown_connections 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 -- 172.21.15.106:0/3148280552 wait complete. 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.742+0000 7f2749b77740 1 -- start start 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.743+0000 7f2749b77740 1 Processor -- start 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f2749b77740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 0x558ca08f9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f2749b77740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f2749b77740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca0900520 0x558ca0968fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f2749b77740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ca0913450 con 0x558ca08c8860 2023-12-22T09:16:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f2749b77740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ca096cf00 con 0x558ca0900520 2023-12-22T09:16:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f2749b77740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ca0969d20 con 0x558ca08c7bb0 2023-12-22T09:16:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f2749b77740 10 client.0 _ll_register_callbacks cb 0x7f2738053770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T09:16:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f273ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f273ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37936/0 (socket says 172.21.15.106:37936) 2023-12-22T09:16:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f273ffff640 1 -- 172.21.15.106:0/3332157339 learned_addr learned my addr 172.21.15.106:0/3332157339 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f273ffff640 1 -- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 msgr2=0x558ca08f9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f273ffff640 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 0x558ca08f9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f273ffff640 1 -- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca0900520 msgr2=0x558ca0968fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f273ffff640 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca0900520 0x558ca0968fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f273ffff640 1 -- 172.21.15.106:0/3332157339 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ca0829680 con 0x558ca08c8860 2023-12-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f273ffff640 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902fd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2728032750 tx=0x7f2728008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de97a743727158d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.744+0000 7f271f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-12-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f271f7fe640 1 -- 172.21.15.106:0/3332157339 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280449e0 con 0x558ca08c8860 2023-12-22T09:16:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f271f7fe640 1 -- 172.21.15.106:0/3332157339 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2728044b40 con 0x558ca08c8860 2023-12-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f2749b77740 1 -- 172.21.15.106:0/3332157339 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27380880c0 con 0x558ca08c8860 2023-12-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f271f7fe640 1 -- 172.21.15.106:0/3332157339 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f272800b7a0 con 0x558ca08c8860 2023-12-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f2749b77740 10 client.5391 fetch_fsmap learned FSMap version 16 2023-12-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f2749b77740 1 -- 172.21.15.106:0/3332157339 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x558ca07f0ef0 con 0x558ca08c8860 2023-12-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f271f7fe640 1 -- 172.21.15.106:0/3332157339 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27380880c0 con 0x558ca08c8860 2023-12-22T09:16:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f271f7fe640 1 -- 172.21.15.106:0/3332157339 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2728055040 con 0x558ca08c8860 2023-12-22T09:16:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f2749b77740 10 client.5391 fetch_fsmap finished waiting for FSMap version 16 2023-12-22T09:16:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f2749b77740 10 client.5391 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-22T09:16:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f2749b77740 20 client.5391 populate_metadata read hostname 'smithi106' 2023-12-22T09:16:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f2749b77740 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] conn(0x558ca0966300 0x558ca09666e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f2749b77740 4 client.5391 mds_command: new command op to 5211 tid=0[{"prefix": "status"}] 2023-12-22T09:16:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.745+0000 7f2749b77740 1 -- 172.21.15.106:0/3332157339 --> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558ca0824080 con 0x558ca0966300 2023-12-22T09:16:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.746+0000 7f2744daa640 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] conn(0x558ca0966300 0x558ca09666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.747+0000 7f2744daa640 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] conn(0x558ca0966300 0x558ca09666e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=575912b3d453eae server_cookie=d8415ec6f668a8d6 in_seq=0 out_seq=0 2023-12-22T09:16:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.747+0000 7f271f7fe640 10 client.5391 ms_handle_connect on v2:172.21.15.132:6833/3435163215 2023-12-22T09:16:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f271f7fe640 1 -- 172.21.15.106:0/3332157339 <== mds.0 v2:172.21.15.132:6833/3435163215 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558ca0824080 con 0x558ca0966300 2023-12-22T09:16:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f271f7fe640 10 client.5391 handle_command_reply: tid=0 2023-12-22T09:16:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 client.5391 shutdown 2023-12-22T09:16:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 -- 172.21.15.106:0/3332157339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 msgr2=0x558ca0902fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902fd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2728032750 tx=0x7f2728008040 comp rx=0 tx=0).stop 2023-12-22T09:16:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 -- 172.21.15.106:0/3332157339 shutdown_connections 2023-12-22T09:16:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:6833/3435163215,v1:172.21.15.132:6835/3435163215] conn(0x558ca0966300 0x558ca09666e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558ca0900520 0x558ca0968fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ca08c8860 0x558ca0902fd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 --2- 172.21.15.106:0/3332157339 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x558ca08c7bb0 0x558ca08f9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f271f7fe640 0 client.5391 ms_handle_reset on v2:172.21.15.132:6833/3435163215 2023-12-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 -- 172.21.15.106:0/3332157339 >> 172.21.15.106:0/3332157339 conn(0x558ca08c77d0 msgr2=0x558ca08e8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 -- 172.21.15.106:0/3332157339 shutdown_connections 2023-12-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 1 -- 172.21.15.106:0/3332157339 wait complete. 2023-12-22T09:16:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.748+0000 7f2749b77740 20 client.5391 trim_cache size 0 max 16384 2023-12-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-12-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "c9422aac-a1e3-428b-87d0-2dbf321c6b46", 2023-12-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2023-12-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 5211, 2023-12-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2023-12-22T09:16:01.756 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2023-12-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2023-12-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 6.6290049130000002, 2023-12-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 16, 2023-12-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 40, 2023-12-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 40, 2023-12-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 15.254989995000001 2023-12-22T09:16:01.757 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-12-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 -- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f272006a430 msgr2=0x7f272006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f272006a430 0x7f272006c8f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2730004af0 tx=0x7f273000b040 comp rx=0 tx=0).stop 2023-12-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 -- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27400bfd80 msgr2=0x7f27400c0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27400bfd80 0x7f27400c0780 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2738000c00 tx=0x7f273800c960 comp rx=0 tx=0).stop 2023-12-22T09:16:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 -- 172.21.15.106:0/1420870165 shutdown_connections 2023-12-22T09:16:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f272006a430 0x7f272006c8f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27400bfd80 0x7f27400c0780 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2740149cc0 0x7f27400bf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 --2- 172.21.15.106:0/1420870165 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f272c003fa0 0x7f274014ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 -- 172.21.15.106:0/1420870165 >> 172.21.15.106:0/1420870165 conn(0x7f27400ab1a0 msgr2=0x7f27400c6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 -- 172.21.15.106:0/1420870165 shutdown_connections 2023-12-22T09:16:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.749+0000 7f274700e640 1 -- 172.21.15.106:0/1420870165 wait complete. 2023-12-22T09:16:01.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:16:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.973+0000 7f18c9fcf640 1 Processor -- start 2023-12-22T09:16:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.973+0000 7f18c9fcf640 1 -- start start 2023-12-22T09:16:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.975+0000 7f18c9fcf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18c414f050 0x7f18c40c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.975+0000 7f18c9fcf640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c4152300 con 0x7f18c40c2360 2023-12-22T09:16:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.975+0000 7f18c9fcf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c414f430 con 0x7f18c4071510 2023-12-22T09:16:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.975+0000 7f18c9fcf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c41519f0 con 0x7f18c414f050 2023-12-22T09:16:01.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.975+0000 7f18c3fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f18c40c2360 0x7f18c4070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47976/0 (socket says 172.21.15.106:47976) 2023-12-22T09:16:01.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.975+0000 7f18c3fff640 1 -- 172.21.15.106:0/2159605398 learned_addr learned my addr 172.21.15.106:0/2159605398 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.975+0000 7f18c8fcd640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18c414f050 0x7f18c40c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.975+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338812755 0 0) 0x7f18c4152300 con 0x7f18c40c2360 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.975+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18b4003520 con 0x7f18c40c2360 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1658508432 0 0) 0x7f18b4003520 con 0x7f18c40c2360 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18c414f050 msgr2=0x7f18c40c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18c414f050 0x7f18c40c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 >> v1:172.21.15.132:6789/0 conn(0x7f18c4071510 legacy=0x7f18c415c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c40c0860 con 0x7f18c40c2360 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f18b0001670 con 0x7f18c40c2360 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 >> v1:172.21.15.106:6789/0 conn(0x7f18c40c2360 legacy=0x7f18c4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18b40039a0 0x7f18b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18c414f050 0x7f18b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b4004d00 0x7f18b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c41519f0 con 0x7f18b4004d00 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b400bab0 con 0x7f18b40039a0 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b400bc70 con 0x7f18c414f050 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.976+0000 7f18c97ce640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b4004d00 0x7f18b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.977+0000 7f18c8fcd640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18b40039a0 0x7f18b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.977+0000 7f18c97ce640 1 -- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18c414f050 msgr2=0x7f18b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.977+0000 7f18c97ce640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18c414f050 0x7f18b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.977+0000 7f18c97ce640 1 -- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18b40039a0 msgr2=0x7f18b4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.977+0000 7f18c97ce640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18b40039a0 0x7f18b4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.977+0000 7f18c97ce640 1 -- 172.21.15.106:0/2159605398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4003520 con 0x7f18b4004d00 2023-12-22T09:16:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.978+0000 7f18c97ce640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b4004d00 0x7f18b4005180 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f18bc001e20 tx=0x7f18b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56f6f08b80b1f06 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.978+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc003b70 con 0x7f18b4004d00 2023-12-22T09:16:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.978+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc003cd0 con 0x7f18b4004d00 2023-12-22T09:16:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.978+0000 7f18c37fe640 1 -- 172.21.15.106:0/2159605398 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc005310 con 0x7f18b4004d00 2023-12-22T09:16:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.979+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2159605398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b4004d00 msgr2=0x7f18b4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.979+0000 7f18c9fcf640 1 --2- 172.21.15.106:0/2159605398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b4004d00 0x7f18b4005180 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f18bc001e20 tx=0x7f18b40057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.979+0000 7f18c97ce640 1 -- 172.21.15.106:0/2159605398 reap_dead start 2023-12-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.979+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2159605398 shutdown_connections 2023-12-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.979+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2159605398 >> 172.21.15.106:0/2159605398 conn(0x7f18c4069dd0 msgr2=0x7f18c406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.979+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2159605398 shutdown_connections 2023-12-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.979+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2159605398 wait complete. 2023-12-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.981+0000 7f18c9fcf640 1 Processor -- start 2023-12-22T09:16:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.981+0000 7f18c9fcf640 1 -- start start 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c9fcf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18b4004d00 0x7f18c41e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c9fcf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18c4146e10 0x7f18c414b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c9fcf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c40c16f0 0x7f18c40c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c9fcf640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c4143740 con 0x7f18c4146e10 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c9fcf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c41e6f50 con 0x7f18c40c16f0 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c9fcf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c41475a0 con 0x7f18b4004d00 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18c4146e10 0x7f18c414b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18c4146e10 0x7f18c414b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37954/0 (socket says 172.21.15.106:37954) 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c3fff640 1 -- 172.21.15.106:0/2002375155 learned_addr learned my addr 172.21.15.106:0/2002375155 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c8fcd640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18b4004d00 0x7f18c41e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c3fff640 1 -- 172.21.15.106:0/2002375155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18b4004d00 msgr2=0x7f18c41e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c3fff640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18b4004d00 0x7f18c41e6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c3fff640 1 -- 172.21.15.106:0/2002375155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c40c16f0 msgr2=0x7f18c40c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c3fff640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c40c16f0 0x7f18c40c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.982+0000 7f18c3fff640 1 -- 172.21.15.106:0/2002375155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c40c4050 con 0x7f18c4146e10 2023-12-22T09:16:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.983+0000 7f18c3fff640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18c4146e10 0x7f18c414b0b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c770 tx=0x7f18b000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.983+0000 7f18c17fa640 1 -- 172.21.15.106:0/2002375155 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00074e0 con 0x7f18c4146e10 2023-12-22T09:16:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.983+0000 7f18c17fa640 1 -- 172.21.15.106:0/2002375155 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b0007640 con 0x7f18c4146e10 2023-12-22T09:16:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.983+0000 7f18c17fa640 1 -- 172.21.15.106:0/2002375155 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00049e0 con 0x7f18c4146e10 2023-12-22T09:16:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.983+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c40beda0 con 0x7f18c4146e10 2023-12-22T09:16:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.983+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c40c42f0 con 0x7f18c4146e10 2023-12-22T09:16:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.984+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c40c4510 con 0x7f18c4146e10 2023-12-22T09:16:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.985+0000 7f18c17fa640 1 -- 172.21.15.106:0/2002375155 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f18b0004b40 con 0x7f18c4146e10 2023-12-22T09:16:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.986+0000 7f18c17fa640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f18a806a430 0x7f18a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.986+0000 7f18c17fa640 1 -- 172.21.15.106:0/2002375155 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f18b0087f10 con 0x7f18c4146e10 2023-12-22T09:16:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.986+0000 7f18c8fcd640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f18a806a430 0x7f18a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.987+0000 7f18c8fcd640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f18a806a430 0x7f18a806c8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f18c41560a0 tx=0x7f18b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:01.990+0000 7f18c17fa640 1 -- 172.21.15.106:0/2002375155 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f18b00533b0 con 0x7f18c4146e10 2023-12-22T09:16:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.221+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f18c404e8d0 con 0x7f18c4146e10 2023-12-22T09:16:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.222+0000 7f18c17fa640 1 -- 172.21.15.106:0/2002375155 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f18b0018020 con 0x7f18c4146e10 2023-12-22T09:16:02.223 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T09:16:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.224+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f18a806a430 msgr2=0x7f18a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.224+0000 7f18c9fcf640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f18a806a430 0x7f18a806c8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f18c41560a0 tx=0x7f18b8008040 comp rx=0 tx=0).stop 2023-12-22T09:16:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.224+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18c4146e10 msgr2=0x7f18c414b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.224+0000 7f18c9fcf640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18c4146e10 0x7f18c414b0b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c770 tx=0x7f18b000cc30 comp rx=0 tx=0).stop 2023-12-22T09:16:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.224+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 shutdown_connections 2023-12-22T09:16:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.224+0000 7f18c9fcf640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f18a806a430 0x7f18a806c8f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.224+0000 7f18c9fcf640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18c40c16f0 0x7f18c40c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.224+0000 7f18c9fcf640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18c4146e10 0x7f18c414b0b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.224+0000 7f18c9fcf640 1 --2- 172.21.15.106:0/2002375155 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f18b4004d00 0x7f18c41e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.225+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 >> 172.21.15.106:0/2002375155 conn(0x7f18c4069dd0 msgr2=0x7f18c406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.225+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 shutdown_connections 2023-12-22T09:16:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:02.225+0000 7f18c9fcf640 1 -- 172.21.15.106:0/2002375155 wait complete. 2023-12-22T09:16:02.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T09:16:02.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:16:02.244 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2023-12-22T09:16:02.244 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T09:16:02.244 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T09:16:02.244 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T09:16:02.244 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T09:16:02.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T09:16:02.245 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:16:02.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:02.245 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2023-12-22T09:16:02.295 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:02.296 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42273sec preferred_lft 42273sec 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 1a:08:33:e3:a0:21 brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::b017:8aff:febf:6d1d/64 scope link 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 1a:08:33:e3:a0:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T09:16:02.297 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::1808:33ff:fee3:a021/64 scope link 2023-12-22T09:16:02.298 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:02.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:02.298 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:16:02.386 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-12-22T09:16:02.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:02.391 DEBUG:teuthology.orchestra.run.smithi106:> route 2023-12-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2023-12-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:16:02.443 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:16:02.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:02.443 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:16:02.444 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:16:02.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:16:02.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:16:02.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:16:02.444 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:16:02.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:02.629 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-12-22T09:16:02.683 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T09:16:02.683 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:16:02.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:02.684 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2023-12-22T09:16:02.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:16:02.775 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T09:16:02.828 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:16:02.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:16:02.828 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T09:16:02.878 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T09:16:02.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:02.879 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:16:03.017 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:16:03.017 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T09:16:03.017 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:16:03.038 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:16:03.038 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:16:03.039 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790" 2023-12-22T09:16:03.068 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2023-12-22T09:16:03.069 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c9422aac-a1e3-428b-87d0-2dbf321c6b46" will pass to kernel 2023-12-22T09:16:03.071 INFO:teuthology.orchestra.run.smithi106.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T09:16:03.071 INFO:teuthology.orchestra.run.smithi106.stdout: You just mounted a file system that supports labels which does not 2023-12-22T09:16:03.071 INFO:teuthology.orchestra.run.smithi106.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T09:16:03.072 INFO:teuthology.orchestra.run.smithi106.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T09:16:03.072 INFO:teuthology.orchestra.run.smithi106.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T09:16:03.076 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T09:16:03.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:03.076 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T09:16:03.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:03.171 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:16:03.246 INFO:teuthology.orchestra.run.smithi106.stdout:client4700 2023-12-22T09:16:03.247 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:16:03.247 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:03.306 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.519+0000 7fce38fc4640 1 Processor -- start 2023-12-22T09:16:03.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.519+0000 7fce38fc4640 1 -- start start 2023-12-22T09:16:03.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.521+0000 7fce38fc4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce340bfce0 0x7fce3406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:03.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.521+0000 7fce38fc4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fce34151b30 0x7fce34151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:03.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.521+0000 7fce38fc4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce340bf770 con 0x7fce3413b060 2023-12-22T09:16:03.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.521+0000 7fce38fc4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce34155120 con 0x7fce34151b30 2023-12-22T09:16:03.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.521+0000 7fce38fc4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce34155400 con 0x7fce340bfce0 2023-12-22T09:16:03.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.521+0000 7fce32d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fce34151b30 0x7fce34151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:03.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.521+0000 7fce31d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce340bfce0 0x7fce3406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:03.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.521+0000 7fce32d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fce34151b30 0x7fce34151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:58410/0 (socket says 172.21.15.106:58410) 2023-12-22T09:16:03.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.522+0000 7fce32d9d640 1 -- 172.21.15.106:0/688599135 learned_addr learned my addr 172.21.15.106:0/688599135 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:03.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.521+0000 7fce31d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce340bfce0 0x7fce3406a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:41438/0 (socket says 172.21.15.106:41438) 2023-12-22T09:16:03.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.522+0000 7fce32d9d640 1 -- 172.21.15.106:0/688599135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce340bfce0 msgr2=0x7fce3406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:03.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.522+0000 7fce32d9d640 1 --2- 172.21.15.106:0/688599135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce340bfce0 0x7fce3406a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.522+0000 7fce32d9d640 1 -- 172.21.15.106:0/688599135 >> v1:172.21.15.132:6789/0 conn(0x7fce3413b060 legacy=0x7fce34069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:03.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.522+0000 7fce32d9d640 1 -- 172.21.15.106:0/688599135 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce341556e0 con 0x7fce34151b30 2023-12-22T09:16:03.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.524+0000 7fce32d9d640 1 --2- 172.21.15.106:0/688599135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce34151b30 0x7fce34151fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009870 tx=0x7fce2c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=901dcd57e8b3c2cf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:03.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.524+0000 7fce3159a640 1 -- 172.21.15.106:0/688599135 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c031640 con 0x7fce34151b30 2023-12-22T09:16:03.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.524+0000 7fce3159a640 1 -- 172.21.15.106:0/688599135 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c0317a0 con 0x7fce34151b30 2023-12-22T09:16:03.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.524+0000 7fce3159a640 1 -- 172.21.15.106:0/688599135 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c031b30 con 0x7fce34151b30 2023-12-22T09:16:03.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.525+0000 7fce38fc4640 1 -- 172.21.15.106:0/688599135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce34151b30 msgr2=0x7fce34151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.525+0000 7fce38fc4640 1 --2- 172.21.15.106:0/688599135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce34151b30 0x7fce34151fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009870 tx=0x7fce2c02b8f0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.525+0000 7fce38fc4640 1 -- 172.21.15.106:0/688599135 shutdown_connections 2023-12-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.525+0000 7fce38fc4640 1 --2- 172.21.15.106:0/688599135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce34151b30 0x7fce34151fa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.525+0000 7fce38fc4640 1 --2- 172.21.15.106:0/688599135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce340bfce0 0x7fce3406a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.525+0000 7fce38fc4640 1 -- 172.21.15.106:0/688599135 >> 172.21.15.106:0/688599135 conn(0x7fce340c5360 msgr2=0x7fce340c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.525+0000 7fce38fc4640 1 -- 172.21.15.106:0/688599135 shutdown_connections 2023-12-22T09:16:03.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.525+0000 7fce38fc4640 1 -- 172.21.15.106:0/688599135 wait complete. 2023-12-22T09:16:03.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.527+0000 7fce38fc4640 1 Processor -- start 2023-12-22T09:16:03.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.527+0000 7fce38fc4640 1 -- start start 2023-12-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce38fc4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce340bfce0 0x7fce341eab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce38fc4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce3413b060 0x7fce340c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce38fc4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce34151b30 0x7fce34133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce38fc4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340c2f30 con 0x7fce3413b060 2023-12-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce38fc4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34151530 con 0x7fce340bfce0 2023-12-22T09:16:03.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce38fc4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce341eb0a0 con 0x7fce34151b30 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce31d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce3413b060 0x7fce340c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce31d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce3413b060 0x7fce340c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40406/0 (socket says 172.21.15.106:40406) 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce31d9b640 1 -- 172.21.15.106:0/3096729389 learned_addr learned my addr 172.21.15.106:0/3096729389 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce3259c640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce340bfce0 0x7fce341eab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce32d9d640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce34151b30 0x7fce34133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce31d9b640 1 -- 172.21.15.106:0/3096729389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce34151b30 msgr2=0x7fce34133cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce31d9b640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce34151b30 0x7fce34133cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce31d9b640 1 -- 172.21.15.106:0/3096729389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce340bfce0 msgr2=0x7fce341eab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce31d9b640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce340bfce0 0x7fce341eab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.529+0000 7fce31d9b640 1 -- 172.21.15.106:0/3096729389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c0094d0 con 0x7fce3413b060 2023-12-22T09:16:03.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.530+0000 7fce31d9b640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce3413b060 0x7fce340c4ac0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00e870 tx=0x7fce1c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.530+0000 7fce2affd640 1 -- 172.21.15.106:0/3096729389 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0094f0 con 0x7fce3413b060 2023-12-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.530+0000 7fce2affd640 1 -- 172.21.15.106:0/3096729389 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c00c8e0 con 0x7fce3413b060 2023-12-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.530+0000 7fce2affd640 1 -- 172.21.15.106:0/3096729389 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00cc90 con 0x7fce3413b060 2023-12-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.530+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce341509f0 con 0x7fce3413b060 2023-12-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.530+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce34150f70 con 0x7fce3413b060 2023-12-22T09:16:03.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.531+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce34073f10 con 0x7fce3413b060 2023-12-22T09:16:03.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.533+0000 7fce2affd640 1 -- 172.21.15.106:0/3096729389 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fce1c013470 con 0x7fce3413b060 2023-12-22T09:16:03.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.533+0000 7fce2affd640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fce1406a430 0x7fce1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:03.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.534+0000 7fce2affd640 1 -- 172.21.15.106:0/3096729389 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fce1c088db0 con 0x7fce3413b060 2023-12-22T09:16:03.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.534+0000 7fce3259c640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fce1406a430 0x7fce1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:03.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.535+0000 7fce3259c640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fce1406a430 0x7fce1406c8f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fce24001330 tx=0x7fce24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:03.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.539+0000 7fce2affd640 1 -- 172.21.15.106:0/3096729389 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fce1c0542f0 con 0x7fce3413b060 2023-12-22T09:16:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.769+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce34072ef0 con 0x7fce3413b060 2023-12-22T09:16:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.770+0000 7fce2affd640 1 -- 172.21.15.106:0/3096729389 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fce1c057910 con 0x7fce3413b060 2023-12-22T09:16:03.771 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T09:16:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.772+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fce1406a430 msgr2=0x7fce1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.772+0000 7fce38fc4640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fce1406a430 0x7fce1406c8f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fce24001330 tx=0x7fce24009040 comp rx=0 tx=0).stop 2023-12-22T09:16:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.772+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce3413b060 msgr2=0x7fce340c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.772+0000 7fce38fc4640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce3413b060 0x7fce340c4ac0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00e870 tx=0x7fce1c00ed30 comp rx=0 tx=0).stop 2023-12-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.773+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 shutdown_connections 2023-12-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.773+0000 7fce38fc4640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fce1406a430 0x7fce1406c8f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.773+0000 7fce38fc4640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fce34151b30 0x7fce34133cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.773+0000 7fce38fc4640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce3413b060 0x7fce340c4ac0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.773+0000 7fce38fc4640 1 --2- 172.21.15.106:0/3096729389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce340bfce0 0x7fce341eab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.773+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 >> 172.21.15.106:0/3096729389 conn(0x7fce340c5360 msgr2=0x7fce34151f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.773+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 shutdown_connections 2023-12-22T09:16:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:03.773+0000 7fce38fc4640 1 -- 172.21.15.106:0/3096729389 wait complete. 2023-12-22T09:16:03.792 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T09:16:03.793 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:16:03.793 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-22T09:16:03.793 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T09:16:03.793 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:03.793 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T09:16:03.793 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T09:16:03.793 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T09:16:03.793 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:16:03.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:03.793 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:16:03.855 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-22T09:16:03.856 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:03.857 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:16:03.858 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42271sec preferred_lft 42271sec 2023-12-22T09:16:03.858 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-22T09:16:03.858 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:03.858 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T09:16:03.858 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 9e:b3:3a:4a:07:97 brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:03.858 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T09:16:03.858 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::fc76:1aff:fe8a:2e61/64 scope link 2023-12-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 9e:b3:3a:4a:07:97 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::9cb3:3aff:fe4a:797/64 scope link 2023-12-22T09:16:03.859 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:03.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:03.860 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:16:03.955 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-22T09:16:03.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:03.960 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-22T09:16:04.012 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-22T09:16:04.012 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:16:04.012 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:16:04.012 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:16:04.012 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:16:04.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:04.013 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-22T09:16:04.013 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-22T09:16:04.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:16:04.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:16:04.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:16:04.013 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-22T09:16:04.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:04.189 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-22T09:16:04.241 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T09:16:04.241 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:16:04.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:04.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-22T09:16:04.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:16:04.337 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:04.392 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:16:04.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:16:04.392 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:04.443 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T09:16:04.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:04.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:16:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:16:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-22T09:16:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:16:04.611 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:16:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-22T09:16:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:16:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:16:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:16:04.637 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:16:04.637 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-22T09:16:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:16:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:16:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:16:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790" 2023-12-22T09:16:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2023-12-22T09:16:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c9422aac-a1e3-428b-87d0-2dbf321c6b46" will pass to kernel 2023-12-22T09:16:04.639 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T09:16:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-12-22T09:16:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T09:16:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T09:16:04.639 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T09:16:04.642 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T09:16:04.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:04.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:04.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:04.718 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:16:04.766 INFO:teuthology.orchestra.run.smithi132.stdout:client4709 2023-12-22T09:16:04.837 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:16:04.837 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:04.891 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-22T09:16:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.115+0000 7fb107fff640 1 Processor -- start 2023-12-22T09:16:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.115+0000 7fb107fff640 1 -- start start 2023-12-22T09:16:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.117+0000 7fb107fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb10806fd30 0x7fb108071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.117+0000 7fb107fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb1080c0900 0x7fb10815b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.117+0000 7fb107fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080c0e00 con 0x7fb1080c1ea0 2023-12-22T09:16:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.117+0000 7fb107fff640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1080714d0 con 0x7fb10806fd30 2023-12-22T09:16:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.117+0000 7fb107fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1080c1630 con 0x7fb1080c0900 2023-12-22T09:16:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.117+0000 7fb1067fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb10806fd30 0x7fb108071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.117+0000 7fb1067fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb10806fd30 0x7fb108071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40420/0 (socket says 172.21.15.106:40420) 2023-12-22T09:16:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.117+0000 7fb1067fc640 1 -- 172.21.15.106:0/1464959401 learned_addr learned my addr 172.21.15.106:0/1464959401 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.117+0000 7fb1077fe640 1 --2- 172.21.15.106:0/1464959401 >> v2:172.21.15.132:3300/0 conn(0x7fb1080c0900 0x7fb10815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.118+0000 7fb1067fc640 1 -- 172.21.15.106:0/1464959401 >> v2:172.21.15.132:3300/0 conn(0x7fb1080c0900 msgr2=0x7fb10815b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.118+0000 7fb1067fc640 1 --2- 172.21.15.106:0/1464959401 >> v2:172.21.15.132:3300/0 conn(0x7fb1080c0900 0x7fb10815b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.118+0000 7fb1067fc640 1 -- 172.21.15.106:0/1464959401 >> v1:172.21.15.132:6789/0 conn(0x7fb1080c1ea0 legacy=0x7fb108155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.118+0000 7fb1067fc640 1 -- 172.21.15.106:0/1464959401 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080c1910 con 0x7fb10806fd30 2023-12-22T09:16:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.119+0000 7fb1067fc640 1 --2- 172.21.15.106:0/1464959401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb10806fd30 0x7fb108071ce0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb10806fa40 tx=0x7fb0fc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d052eff0a8c4d332 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.119+0000 7fb105ffb640 1 -- 172.21.15.106:0/1464959401 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0317e0 con 0x7fb10806fd30 2023-12-22T09:16:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.119+0000 7fb105ffb640 1 -- 172.21.15.106:0/1464959401 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc031940 con 0x7fb10806fd30 2023-12-22T09:16:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.119+0000 7fb105ffb640 1 -- 172.21.15.106:0/1464959401 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc031cd0 con 0x7fb10806fd30 2023-12-22T09:16:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.120+0000 7fb107fff640 1 -- 172.21.15.106:0/1464959401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb10806fd30 msgr2=0x7fb108071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.120+0000 7fb107fff640 1 --2- 172.21.15.106:0/1464959401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb10806fd30 0x7fb108071ce0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb10806fa40 tx=0x7fb0fc02b880 comp rx=0 tx=0).stop 2023-12-22T09:16:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.120+0000 7fb107fff640 1 -- 172.21.15.106:0/1464959401 shutdown_connections 2023-12-22T09:16:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.120+0000 7fb107fff640 1 --2- 172.21.15.106:0/1464959401 >> v2:172.21.15.132:3300/0 conn(0x7fb1080c0900 0x7fb10815b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.120+0000 7fb107fff640 1 --2- 172.21.15.106:0/1464959401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb10806fd30 0x7fb108071ce0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.120+0000 7fb107fff640 1 -- 172.21.15.106:0/1464959401 >> 172.21.15.106:0/1464959401 conn(0x7fb108069bf0 msgr2=0x7fb108069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.120+0000 7fb107fff640 1 -- 172.21.15.106:0/1464959401 shutdown_connections 2023-12-22T09:16:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.120+0000 7fb107fff640 1 -- 172.21.15.106:0/1464959401 wait complete. 2023-12-22T09:16:05.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.122+0000 7fb107fff640 1 Processor -- start 2023-12-22T09:16:05.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.122+0000 7fb107fff640 1 -- start start 2023-12-22T09:16:05.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb107fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10806fd30 0x7fb1080c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb107fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1080c0900 0x7fb10814b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb107fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1080c1ea0 0x7fb10814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb107fff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb108157a00 con 0x7fb1080c0900 2023-12-22T09:16:05.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb107fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb108148ff0 con 0x7fb10806fd30 2023-12-22T09:16:05.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb107fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb108144f80 con 0x7fb1080c1ea0 2023-12-22T09:16:05.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb1067fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1080c0900 0x7fb10814b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb1067fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1080c0900 0x7fb10814b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40426/0 (socket says 172.21.15.106:40426) 2023-12-22T09:16:05.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb1067fc640 1 -- 172.21.15.106:0/3855061266 learned_addr learned my addr 172.21.15.106:0/3855061266 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:05.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.123+0000 7fb106ffd640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10806fd30 0x7fb1080c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.124+0000 7fb1077fe640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1080c1ea0 0x7fb10814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.124+0000 7fb1067fc640 1 -- 172.21.15.106:0/3855061266 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1080c1ea0 msgr2=0x7fb10814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.124+0000 7fb1067fc640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1080c1ea0 0x7fb10814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.124+0000 7fb1067fc640 1 -- 172.21.15.106:0/3855061266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10806fd30 msgr2=0x7fb1080c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.124+0000 7fb1067fc640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10806fd30 0x7fb1080c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.124+0000 7fb1067fc640 1 -- 172.21.15.106:0/3855061266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0094d0 con 0x7fb1080c0900 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.124+0000 7fb1067fc640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1080c0900 0x7fb10814b160 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc02b8c0 tx=0x7fb0fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.125+0000 7fb0ef7fe640 1 -- 172.21.15.106:0/3855061266 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc032880 con 0x7fb1080c0900 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.125+0000 7fb0ef7fe640 1 -- 172.21.15.106:0/3855061266 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc032a00 con 0x7fb1080c0900 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.125+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb108155de0 con 0x7fb1080c0900 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.125+0000 7fb0ef7fe640 1 -- 172.21.15.106:0/3855061266 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc032db0 con 0x7fb1080c0900 2023-12-22T09:16:05.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.125+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1081f0640 con 0x7fb1080c0900 2023-12-22T09:16:05.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.126+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10804e8d0 con 0x7fb1080c0900 2023-12-22T09:16:05.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.127+0000 7fb0ef7fe640 1 -- 172.21.15.106:0/3855061266 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb0fc04e450 con 0x7fb1080c0900 2023-12-22T09:16:05.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.127+0000 7fb0ef7fe640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb0f406a430 0x7fb0f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.128+0000 7fb0ef7fe640 1 -- 172.21.15.106:0/3855061266 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb0fc0aab60 con 0x7fb1080c0900 2023-12-22T09:16:05.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.128+0000 7fb106ffd640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb0f406a430 0x7fb0f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.128+0000 7fb106ffd640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb0f406a430 0x7fb0f406c8f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8000f60 tx=0x7fb0f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:05.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.132+0000 7fb0ef7fe640 1 -- 172.21.15.106:0/3855061266 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb0fc0760b0 con 0x7fb1080c0900 2023-12-22T09:16:05.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.388+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fb10814f840 con 0x7fb1080c0900 2023-12-22T09:16:05.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.389+0000 7fb0ef7fe640 1 -- 172.21.15.106:0/3855061266 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v12) v1 ==== 84+0+0 (secure 0 0 0) 0x7fb0fc0796d0 con 0x7fb1080c0900 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb0f406a430 msgr2=0x7fb0f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb0f406a430 0x7fb0f406c8f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8000f60 tx=0x7fb0f8009040 comp rx=0 tx=0).stop 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1080c0900 msgr2=0x7fb10814b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1080c0900 0x7fb10814b160 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc02b8c0 tx=0x7fb0fc0046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 shutdown_connections 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb0f406a430 0x7fb0f406c8f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb1080c1ea0 0x7fb10814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1080c0900 0x7fb10814b160 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 --2- 172.21.15.106:0/3855061266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb10806fd30 0x7fb1080c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 >> 172.21.15.106:0/3855061266 conn(0x7fb108069bf0 msgr2=0x7fb10815bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 shutdown_connections 2023-12-22T09:16:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.391+0000 7fb107fff640 1 -- 172.21.15.106:0/3855061266 wait complete. 2023-12-22T09:16:05.411 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:05.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.602+0000 7f614e55c640 1 Processor -- start 2023-12-22T09:16:05.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.602+0000 7f614e55c640 1 -- start start 2023-12-22T09:16:05.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.603+0000 7f614e55c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6148069e60 0x7f614814a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.603+0000 7f614e55c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148152680 0x7f614814abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.603+0000 7f614e55c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61480bfce0 con 0x7f6148150a80 2023-12-22T09:16:05.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.603+0000 7f614e55c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480c0960 con 0x7f6148069e60 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.603+0000 7f614e55c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614806aba0 con 0x7f6148152680 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.604+0000 7f6147fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6148069e60 0x7f614814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.604+0000 7f61477fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6148150a80 0x7f6148151f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39412/0 (socket says 172.21.15.106:39412) 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.604+0000 7f61477fe640 1 -- 172.21.15.106:0/752895043 learned_addr learned my addr 172.21.15.106:0/752895043 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.604+0000 7f6147fff640 1 -- 172.21.15.106:0/752895043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148152680 msgr2=0x7f614814abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.604+0000 7f614caf9640 1 --2- 172.21.15.106:0/752895043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148152680 0x7f614814abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.604+0000 7f6146ffd640 1 -- 172.21.15.106:0/752895043 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876881336 0 0) 0x7f61480bfce0 con 0x7f6148150a80 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.604+0000 7f6147fff640 1 --2- 172.21.15.106:0/752895043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148152680 0x7f614814abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.604+0000 7f6147fff640 1 -- 172.21.15.106:0/752895043 >> v1:172.21.15.106:6789/0 conn(0x7f6148150a80 legacy=0x7f6148151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.604+0000 7f6147fff640 1 -- 172.21.15.106:0/752895043 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61480bffc0 con 0x7f6148069e60 2023-12-22T09:16:05.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.605+0000 7f6147fff640 1 --2- 172.21.15.106:0/752895043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148069e60 0x7f614814a670 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f61380097c0 tx=0x7f613802b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccaaf3e4a477901 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:05.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f6146ffd640 1 -- 172.21.15.106:0/752895043 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380316d0 con 0x7f6148069e60 2023-12-22T09:16:05.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f6146ffd640 1 -- 172.21.15.106:0/752895043 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6138031830 con 0x7f6148069e60 2023-12-22T09:16:05.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f6146ffd640 1 -- 172.21.15.106:0/752895043 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138031bc0 con 0x7f6148069e60 2023-12-22T09:16:05.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f614e55c640 1 -- 172.21.15.106:0/752895043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148069e60 msgr2=0x7f614814a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f614e55c640 1 --2- 172.21.15.106:0/752895043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148069e60 0x7f614814a670 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f61380097c0 tx=0x7f613802b770 comp rx=0 tx=0).stop 2023-12-22T09:16:05.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f614e55c640 1 -- 172.21.15.106:0/752895043 shutdown_connections 2023-12-22T09:16:05.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f614e55c640 1 --2- 172.21.15.106:0/752895043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148152680 0x7f614814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f614e55c640 1 --2- 172.21.15.106:0/752895043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148069e60 0x7f614814a670 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f614e55c640 1 -- 172.21.15.106:0/752895043 >> 172.21.15.106:0/752895043 conn(0x7f61480c5360 msgr2=0x7f61480c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:05.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f614e55c640 1 -- 172.21.15.106:0/752895043 shutdown_connections 2023-12-22T09:16:05.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.606+0000 7f614e55c640 1 -- 172.21.15.106:0/752895043 wait complete. 2023-12-22T09:16:05.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.608+0000 7f614e55c640 1 Processor -- start 2023-12-22T09:16:05.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.608+0000 7f614e55c640 1 -- start start 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614e55c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148069e60 0x7f61481e76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614e55c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6148150a80 0x7f614813f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614e55c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148152680 0x7f6148148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614e55c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614813ff00 con 0x7f6148152680 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614e55c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6148152bb0 con 0x7f6148150a80 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614e55c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61481e8100 con 0x7f6148069e60 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614caf9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148152680 0x7f6148148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614caf9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148152680 0x7f6148148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40450/0 (socket says 172.21.15.106:40450) 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614caf9640 1 -- 172.21.15.106:0/2172021803 learned_addr learned my addr 172.21.15.106:0/2172021803 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f6147fff640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148069e60 0x7f61481e76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f61477fe640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6148150a80 0x7f614813f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614caf9640 1 -- 172.21.15.106:0/2172021803 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148069e60 msgr2=0x7f61481e76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614caf9640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148069e60 0x7f61481e76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614caf9640 1 -- 172.21.15.106:0/2172021803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6148150a80 msgr2=0x7f614813f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614caf9640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6148150a80 0x7f614813f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.609+0000 7f614caf9640 1 -- 172.21.15.106:0/2172021803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61380093a0 con 0x7f6148152680 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.610+0000 7f6147fff640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148069e60 0x7f61481e76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.610+0000 7f614caf9640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148152680 0x7f6148148970 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f614000c550 tx=0x7f614000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.610+0000 7f6144ff9640 1 -- 172.21.15.106:0/2172021803 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140004220 con 0x7f6148152680 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.610+0000 7f6144ff9640 1 -- 172.21.15.106:0/2172021803 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6140004380 con 0x7f6148152680 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.610+0000 7f6144ff9640 1 -- 172.21.15.106:0/2172021803 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140003830 con 0x7f6148152680 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.610+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6148154100 con 0x7f6148152680 2023-12-22T09:16:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.610+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61481546c0 con 0x7f6148152680 2023-12-22T09:16:05.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.611+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6148073f10 con 0x7f6148152680 2023-12-22T09:16:05.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.612+0000 7f6144ff9640 1 -- 172.21.15.106:0/2172021803 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6140003990 con 0x7f6148152680 2023-12-22T09:16:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.613+0000 7f6144ff9640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f613406a430 0x7f613406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.614+0000 7f6144ff9640 1 -- 172.21.15.106:0/2172021803 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6140088630 con 0x7f6148152680 2023-12-22T09:16:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.614+0000 7f6147fff640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f613406a430 0x7f613406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:05.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.614+0000 7f6147fff640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f613406a430 0x7f613406c8f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6138036000 tx=0x7f6138008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:05.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.618+0000 7f6144ff9640 1 -- 172.21.15.106:0/2172021803 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6140053b70 con 0x7f6148152680 2023-12-22T09:16:05.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.810+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f614814fac0 con 0x7f6148152680 2023-12-22T09:16:05.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.813+0000 7f6144ff9640 1 -- 172.21.15.106:0/2172021803 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16354 (secure 0 0 0) 0x7f6140057190 con 0x7f6148152680 2023-12-22T09:16:05.814 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:05.814 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":40,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:15:56.118812+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f613406a430 msgr2=0x7f613406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f613406a430 0x7f613406c8f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6138036000 tx=0x7f6138008030 comp rx=0 tx=0).stop 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148152680 msgr2=0x7f6148148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148152680 0x7f6148148970 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f614000c550 tx=0x7f614000ca10 comp rx=0 tx=0).stop 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 shutdown_connections 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f613406a430 0x7f613406c8f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6148152680 0x7f6148148970 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6148150a80 0x7f614813f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 --2- 172.21.15.106:0/2172021803 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148069e60 0x7f61481e76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 >> 172.21.15.106:0/2172021803 conn(0x7f61480c5360 msgr2=0x7f61480aa650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 shutdown_connections 2023-12-22T09:16:05.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:05.816+0000 7f614e55c640 1 -- 172.21.15.106:0/2172021803 wait complete. 2023-12-22T09:16:05.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:15:52.874302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:15:54.136774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:16:05.835 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:16:06.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.050+0000 7f082e604640 1 Processor -- start 2023-12-22T09:16:06.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.050+0000 7f082e604640 1 -- start start 2023-12-22T09:16:06.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.051+0000 7f082e604640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0828070470 0x7f08280c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.052+0000 7f082e604640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0828071db0 con 0x7f0828153e50 2023-12-22T09:16:06.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.052+0000 7f082e604640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0828072090 con 0x7f082806dec0 2023-12-22T09:16:06.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.052+0000 7f082e604640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0828071180 con 0x7f0828070470 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.052+0000 7f082cba1640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0828153e50 0x7f0828154300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39422/0 (socket says 172.21.15.106:39422) 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.052+0000 7f082cba1640 1 -- 172.21.15.106:0/2142658492 learned_addr learned my addr 172.21.15.106:0/2142658492 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.052+0000 7f081f7fe640 1 --2- 172.21.15.106:0/2142658492 >> v2:172.21.15.132:3300/0 conn(0x7f0828070470 0x7f08280c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.052+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986965722 0 0) 0x7f0828071db0 con 0x7f0828153e50 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.052+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0814003520 con 0x7f0828153e50 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2219561373 0 0) 0x7f0814003520 con 0x7f0828153e50 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 >> v2:172.21.15.132:3300/0 conn(0x7f0828070470 msgr2=0x7f08280c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 --2- 172.21.15.106:0/2142658492 >> v2:172.21.15.132:3300/0 conn(0x7f0828070470 0x7f08280c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 >> v1:172.21.15.132:6789/0 conn(0x7f082806dec0 legacy=0x7f082806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280c53b0 con 0x7f0828153e50 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f0820001670 con 0x7f0828153e50 2023-12-22T09:16:06.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 >> v1:172.21.15.106:6789/0 conn(0x7f0828153e50 legacy=0x7f0828154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0814003970 0x7f0814003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08140047c0 0x7f0814004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0814005180 0x7f081400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0828071180 con 0x7f0814003970 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081400c120 con 0x7f0814005180 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081400c2e0 con 0x7f08140047c0 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.053+0000 7f0827fff640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0814003970 0x7f0814003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.054+0000 7f081f7fe640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08140047c0 0x7f0814004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.054+0000 7f082cba1640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0814005180 0x7f081400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.054+0000 7f0827fff640 1 -- 172.21.15.106:0/2142658492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08140047c0 msgr2=0x7f0814004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.054+0000 7f0827fff640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08140047c0 0x7f0814004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.054+0000 7f0827fff640 1 -- 172.21.15.106:0/2142658492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0814005180 msgr2=0x7f081400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.054+0000 7f0827fff640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0814005180 0x7f081400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.054+0000 7f0827fff640 1 -- 172.21.15.106:0/2142658492 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814003520 con 0x7f0814003970 2023-12-22T09:16:06.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.054+0000 7f082cba1640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0814005180 0x7f081400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:06.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.054+0000 7f082cba1640 1 -- 172.21.15.106:0/2142658492 reap_dead start 2023-12-22T09:16:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.055+0000 7f0827fff640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0814003970 0x7f0814003d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0818001750 tx=0x7f08140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ddb76d94f7d75b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.055+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08180052d0 con 0x7f0814003970 2023-12-22T09:16:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.055+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081802e050 con 0x7f0814003970 2023-12-22T09:16:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.055+0000 7f08277fe640 1 -- 172.21.15.106:0/2142658492 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818003830 con 0x7f0814003970 2023-12-22T09:16:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.056+0000 7f082e604640 1 -- 172.21.15.106:0/2142658492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0814003970 msgr2=0x7f0814003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.056+0000 7f082e604640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0814003970 0x7f0814003d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0818001750 tx=0x7f08140057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.056+0000 7f082e604640 1 -- 172.21.15.106:0/2142658492 shutdown_connections 2023-12-22T09:16:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.056+0000 7f082e604640 1 --2- 172.21.15.106:0/2142658492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0814003970 0x7f0814003d90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.056+0000 7f082e604640 1 -- 172.21.15.106:0/2142658492 >> 172.21.15.106:0/2142658492 conn(0x7f08280c2680 msgr2=0x7f08280c2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.056+0000 7f082e604640 1 -- 172.21.15.106:0/2142658492 shutdown_connections 2023-12-22T09:16:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.056+0000 7f082e604640 1 -- 172.21.15.106:0/2142658492 wait complete. 2023-12-22T09:16:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.057+0000 7f082e604640 1 Processor -- start 2023-12-22T09:16:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.058+0000 7f082e604640 1 -- start start 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.058+0000 7f082e604640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0814003970 0x7f0828150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.058+0000 7f082e604640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f082814a490 0x7f08281497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.058+0000 7f082e604640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08280b6130 0x7f0828149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.058+0000 7f082e604640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280c5790 con 0x7f082814a490 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.058+0000 7f082e604640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0828072370 con 0x7f08280b6130 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.058+0000 7f082e604640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082814ae50 con 0x7f0814003970 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f081f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f082814a490 0x7f08281497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f081f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f082814a490 0x7f08281497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40458/0 (socket says 172.21.15.106:40458) 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f081f7fe640 1 -- 172.21.15.106:0/3581899855 learned_addr learned my addr 172.21.15.106:0/3581899855 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f0827fff640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0814003970 0x7f0828150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f082cba1640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08280b6130 0x7f0828149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f081f7fe640 1 -- 172.21.15.106:0/3581899855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0814003970 msgr2=0x7f0828150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f081f7fe640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0814003970 0x7f0828150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f081f7fe640 1 -- 172.21.15.106:0/3581899855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08280b6130 msgr2=0x7f0828149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f081f7fe640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08280b6130 0x7f0828149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.059+0000 7f081f7fe640 1 -- 172.21.15.106:0/3581899855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082814f4a0 con 0x7f082814a490 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.060+0000 7f081f7fe640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f082814a490 0x7f08281497d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0810009f30 tx=0x7f08100115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.060+0000 7f08257fa640 1 -- 172.21.15.106:0/3581899855 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081000e030 con 0x7f082814a490 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.060+0000 7f08257fa640 1 -- 172.21.15.106:0/3581899855 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810011ea0 con 0x7f082814a490 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.060+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082814eee0 con 0x7f082814a490 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.060+0000 7f08257fa640 1 -- 172.21.15.106:0/3581899855 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08100166b0 con 0x7f082814a490 2023-12-22T09:16:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.060+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082814e330 con 0x7f082814a490 2023-12-22T09:16:06.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.061+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0828073f10 con 0x7f082814a490 2023-12-22T09:16:06.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.062+0000 7f08257fa640 1 -- 172.21.15.106:0/3581899855 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0810016810 con 0x7f082814a490 2023-12-22T09:16:06.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.063+0000 7f08257fa640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f080806a430 0x7f080806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.063+0000 7f08257fa640 1 -- 172.21.15.106:0/3581899855 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f081000f070 con 0x7f082814a490 2023-12-22T09:16:06.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.063+0000 7f0827fff640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f080806a430 0x7f080806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.064+0000 7f0827fff640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f080806a430 0x7f080806c8f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0818033000 tx=0x7f0818009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.067+0000 7f08257fa640 1 -- 172.21.15.106:0/3581899855 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0810054a90 con 0x7f082814a490 2023-12-22T09:16:06.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.255+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0828065b60 con 0x7f082814a490 2023-12-22T09:16:06.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.256+0000 7f08257fa640 1 -- 172.21.15.106:0/3581899855 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08100580b0 con 0x7f082814a490 2023-12-22T09:16:06.257 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:16:06.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f080806a430 msgr2=0x7f080806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f080806a430 0x7f080806c8f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0818033000 tx=0x7f0818009030 comp rx=0 tx=0).stop 2023-12-22T09:16:06.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f082814a490 msgr2=0x7f08281497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f082814a490 0x7f08281497d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0810009f30 tx=0x7f08100115a0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 shutdown_connections 2023-12-22T09:16:06.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f080806a430 0x7f080806c8f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08280b6130 0x7f0828149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f082814a490 0x7f08281497d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 --2- 172.21.15.106:0/3581899855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0814003970 0x7f0828150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 >> 172.21.15.106:0/3581899855 conn(0x7f08280c2680 msgr2=0x7f08280c0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:06.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 shutdown_connections 2023-12-22T09:16:06.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.259+0000 7f082e604640 1 -- 172.21.15.106:0/3581899855 wait complete. 2023-12-22T09:16:06.278 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:16:06.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.493+0000 7f8135a4c640 1 Processor -- start 2023-12-22T09:16:06.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.493+0000 7f8135a4c640 1 -- start start 2023-12-22T09:16:06.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.494+0000 7f8135a4c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8130151400 0x7f81300c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.494+0000 7f8135a4c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81300bcc70 con 0x7f813006ca20 2023-12-22T09:16:06.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.494+0000 7f8135a4c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81300c42d0 con 0x7f81300c7620 2023-12-22T09:16:06.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.494+0000 7f8135a4c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81301517e0 con 0x7f8130151400 2023-12-22T09:16:06.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.495+0000 7f812e7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f813006ca20 0x7f813006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39434/0 (socket says 172.21.15.106:39434) 2023-12-22T09:16:06.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.495+0000 7f812e7fc640 1 -- 172.21.15.106:0/26745107 learned_addr learned my addr 172.21.15.106:0/26745107 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:06.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.495+0000 7f812effd640 1 --2- 172.21.15.106:0/26745107 >> v2:172.21.15.132:3300/0 conn(0x7f8130151400 0x7f81300c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.495+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087553920 0 0) 0x7f81300bcc70 con 0x7f813006ca20 2023-12-22T09:16:06.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.495+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8118003520 con 0x7f813006ca20 2023-12-22T09:16:06.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 258753771 0 0) 0x7f8118003520 con 0x7f813006ca20 2023-12-22T09:16:06.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 >> v2:172.21.15.132:3300/0 conn(0x7f8130151400 msgr2=0x7f81300c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:06.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 --2- 172.21.15.106:0/26745107 >> v2:172.21.15.132:3300/0 conn(0x7f8130151400 0x7f81300c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 >> v1:172.21.15.132:6789/0 conn(0x7f81300c7620 legacy=0x7f813015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81300c4760 con 0x7f813006ca20 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f8124001670 con 0x7f813006ca20 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 >> v1:172.21.15.106:6789/0 conn(0x7f813006ca20 legacy=0x7f813006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180039c0 0x7f8118003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81180047c0 0x7f8118004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81180052a0 0x7f811800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301517e0 con 0x7f81180052a0 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811800c1a0 con 0x7f81180039c0 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811800c360 con 0x7f81180047c0 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812f7fe640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81180052a0 0x7f811800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812effd640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180039c0 0x7f8118003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812e7fc640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81180047c0 0x7f8118004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812f7fe640 1 -- 172.21.15.106:0/26745107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81180047c0 msgr2=0x7f8118004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:06.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812f7fe640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81180047c0 0x7f8118004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812f7fe640 1 -- 172.21.15.106:0/26745107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180039c0 msgr2=0x7f8118003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:06.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812f7fe640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180039c0 0x7f8118003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812f7fe640 1 -- 172.21.15.106:0/26745107 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118003520 con 0x7f81180052a0 2023-12-22T09:16:06.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.496+0000 7f812effd640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180039c0 0x7f8118003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:06.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.497+0000 7f812f7fe640 1 -- 172.21.15.106:0/26745107 reap_dead start 2023-12-22T09:16:06.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.497+0000 7f812f7fe640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81180052a0 0x7f811800b980 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8128001e50 tx=0x7f81180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c609cbeb42318e8e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128003b70 con 0x7f81180052a0 2023-12-22T09:16:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128003d10 con 0x7f81180052a0 2023-12-22T09:16:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f812dffb640 1 -- 172.21.15.106:0/26745107 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128005310 con 0x7f81180052a0 2023-12-22T09:16:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f8135a4c640 1 -- 172.21.15.106:0/26745107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81180052a0 msgr2=0x7f811800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f8135a4c640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81180052a0 0x7f811800b980 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8128001e50 tx=0x7f81180057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f8135a4c640 1 -- 172.21.15.106:0/26745107 shutdown_connections 2023-12-22T09:16:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f8135a4c640 1 --2- 172.21.15.106:0/26745107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81180052a0 0x7f811800b980 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f8135a4c640 1 -- 172.21.15.106:0/26745107 >> 172.21.15.106:0/26745107 conn(0x7f81300ab310 msgr2=0x7f81300ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f8135a4c640 1 -- 172.21.15.106:0/26745107 shutdown_connections 2023-12-22T09:16:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.498+0000 7f8135a4c640 1 -- 172.21.15.106:0/26745107 wait complete. 2023-12-22T09:16:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.500+0000 7f8135a4c640 1 Processor -- start 2023-12-22T09:16:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.500+0000 7f8135a4c640 1 -- start start 2023-12-22T09:16:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.501+0000 7f8135a4c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180052a0 0x7f81300aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.501+0000 7f8135a4c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813014ece0 0x7f8130150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.501+0000 7f8135a4c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f813014b730 0x7f81300c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.501+0000 7f8135a4c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301ed1c0 con 0x7f813014b730 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.501+0000 7f8135a4c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81300c9780 con 0x7f81180052a0 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.501+0000 7f8135a4c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81300ac940 con 0x7f813014ece0 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.501+0000 7f812f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f813014b730 0x7f81300c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.501+0000 7f812f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f813014b730 0x7f81300c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40480/0 (socket says 172.21.15.106:40480) 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.501+0000 7f812f7fe640 1 -- 172.21.15.106:0/2376935163 learned_addr learned my addr 172.21.15.106:0/2376935163 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f812effd640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180052a0 0x7f81300aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f812f7fe640 1 -- 172.21.15.106:0/2376935163 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813014ece0 msgr2=0x7f8130150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f812f7fe640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813014ece0 0x7f8130150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f812f7fe640 1 -- 172.21.15.106:0/2376935163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180052a0 msgr2=0x7f81300aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f812f7fe640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180052a0 0x7f81300aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f812f7fe640 1 -- 172.21.15.106:0/2376935163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81301ecc00 con 0x7f813014b730 2023-12-22T09:16:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f812f7fe640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f813014b730 0x7f81300c7f10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f812802c060 tx=0x7f81280014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:06.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f8117fff640 1 -- 172.21.15.106:0/2376935163 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128006d50 con 0x7f813014b730 2023-12-22T09:16:06.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f8117fff640 1 -- 172.21.15.106:0/2376935163 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128003b80 con 0x7f813014b730 2023-12-22T09:16:06.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f8117fff640 1 -- 172.21.15.106:0/2376935163 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128039680 con 0x7f813014b730 2023-12-22T09:16:06.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.502+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81301ecee0 con 0x7f813014b730 2023-12-22T09:16:06.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.503+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81300acec0 con 0x7f813014b730 2023-12-22T09:16:06.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.504+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81300ac7a0 con 0x7f813014b730 2023-12-22T09:16:06.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.505+0000 7f8117fff640 1 -- 172.21.15.106:0/2376935163 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81280397e0 con 0x7f813014b730 2023-12-22T09:16:06.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.505+0000 7f8117fff640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f811c06a430 0x7f811c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.505+0000 7f8117fff640 1 -- 172.21.15.106:0/2376935163 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f81280aa860 con 0x7f813014b730 2023-12-22T09:16:06.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.506+0000 7f812effd640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f811c06a430 0x7f811c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.506+0000 7f812effd640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f811c06a430 0x7f811c06c8f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81200099c0 tx=0x7f8120008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:06.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.509+0000 7f8117fff640 1 -- 172.21.15.106:0/2376935163 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81300ac7a0 con 0x7f813014b730 2023-12-22T09:16:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.688+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81300ac7a0 con 0x7f813014b730 2023-12-22T09:16:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.689+0000 7f8117fff640 1 -- 172.21.15.106:0/2376935163 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81300ac7a0 con 0x7f813014b730 2023-12-22T09:16:06.690 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.691+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f811c06a430 msgr2=0x7f811c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.691+0000 7f8135a4c640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f811c06a430 0x7f811c06c8f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81200099c0 tx=0x7f8120008040 comp rx=0 tx=0).stop 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.691+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f813014b730 msgr2=0x7f81300c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.692+0000 7f8135a4c640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f813014b730 0x7f81300c7f10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f812802c060 tx=0x7f81280014a0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.692+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 shutdown_connections 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.692+0000 7f8135a4c640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f811c06a430 0x7f811c06c8f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.692+0000 7f8135a4c640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f813014b730 0x7f81300c7f10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.692+0000 7f8135a4c640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f813014ece0 0x7f8130150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.692+0000 7f8135a4c640 1 --2- 172.21.15.106:0/2376935163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81180052a0 0x7f81300aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.692+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 >> 172.21.15.106:0/2376935163 conn(0x7f81300ab310 msgr2=0x7f81300ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.692+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 shutdown_connections 2023-12-22T09:16:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.692+0000 7f8135a4c640 1 -- 172.21.15.106:0/2376935163 wait complete. 2023-12-22T09:16:06.710 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:16:06.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.916+0000 7f078ebae640 1 Processor -- start 2023-12-22T09:16:06.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.917+0000 7f078ebae640 1 -- start start 2023-12-22T09:16:06.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.918+0000 7f078ebae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07880c1910 0x7f0788151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.918+0000 7f078ebae640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0788155120 con 0x7f078806b960 2023-12-22T09:16:06.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.918+0000 7f078ebae640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0788155fa0 con 0x7f078814f090 2023-12-22T09:16:06.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.918+0000 7f078ebae640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078806e080 con 0x7f07880c1910 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.918+0000 7f078d14b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f078806b960 0x7f07880c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39440/0 (socket says 172.21.15.106:39440) 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.918+0000 7f078d14b640 1 -- 172.21.15.106:0/3068255637 learned_addr learned my addr 172.21.15.106:0/3068255637 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077ffff640 1 --2- 172.21.15.106:0/3068255637 >> v2:172.21.15.132:3300/0 conn(0x7f07880c1910 0x7f0788151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913880842 0 0) 0x7f0788155120 con 0x7f078806b960 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0770003520 con 0x7f078806b960 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 560994184 0 0) 0x7f0770003520 con 0x7f078806b960 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 >> v2:172.21.15.132:3300/0 conn(0x7f07880c1910 msgr2=0x7f0788151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 --2- 172.21.15.106:0/3068255637 >> v2:172.21.15.132:3300/0 conn(0x7f07880c1910 0x7f0788151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 >> v1:172.21.15.132:6789/0 conn(0x7f078814f090 legacy=0x7f0788155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880a8720 con 0x7f078806b960 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f0780001670 con 0x7f078806b960 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 >> v1:172.21.15.106:6789/0 conn(0x7f078806b960 legacy=0x7f07880c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0770003970 0x7f0770003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07700047c0 0x7f0770004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0770005180 0x7f077000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077000c0f0 con 0x7f0770005180 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077000c260 con 0x7f07700047c0 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.919+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077000c420 con 0x7f0770003970 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.920+0000 7f078d14b640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0770005180 0x7f077000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.920+0000 7f077ffff640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07700047c0 0x7f0770004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.920+0000 7f078c94a640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0770003970 0x7f0770003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.920+0000 7f078d14b640 1 -- 172.21.15.106:0/3068255637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0770003970 msgr2=0x7f0770003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:06.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.920+0000 7f078d14b640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0770003970 0x7f0770003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.920+0000 7f078d14b640 1 -- 172.21.15.106:0/3068255637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07700047c0 msgr2=0x7f0770004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:06.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.920+0000 7f078d14b640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07700047c0 0x7f0770004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.920+0000 7f078d14b640 1 -- 172.21.15.106:0/3068255637 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770003520 con 0x7f0770005180 2023-12-22T09:16:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.921+0000 7f078d14b640 1 -- 172.21.15.106:0/3068255637 reap_dead start 2023-12-22T09:16:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.921+0000 7f078d14b640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0770005180 0x7f077000b980 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f078000c240 tx=0x7f07700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c709bd4784afa9d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780005ad0 con 0x7f0770005180 2023-12-22T09:16:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0780005c70 con 0x7f0770005180 2023-12-22T09:16:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f077f7fe640 1 -- 172.21.15.106:0/3068255637 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078002c8b0 con 0x7f0770005180 2023-12-22T09:16:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f078ebae640 1 -- 172.21.15.106:0/3068255637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0770005180 msgr2=0x7f077000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f078ebae640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0770005180 0x7f077000b980 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f078000c240 tx=0x7f07700057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f078ebae640 1 -- 172.21.15.106:0/3068255637 shutdown_connections 2023-12-22T09:16:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f078ebae640 1 --2- 172.21.15.106:0/3068255637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0770005180 0x7f077000b980 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f078ebae640 1 -- 172.21.15.106:0/3068255637 >> 172.21.15.106:0/3068255637 conn(0x7f0788069dd0 msgr2=0x7f078806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f078ebae640 1 -- 172.21.15.106:0/3068255637 shutdown_connections 2023-12-22T09:16:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.922+0000 7f078ebae640 1 -- 172.21.15.106:0/3068255637 wait complete. 2023-12-22T09:16:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.924+0000 7f078ebae640 1 Processor -- start 2023-12-22T09:16:06.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.924+0000 7f078ebae640 1 -- start start 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.925+0000 7f078ebae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0770005180 0x7f0788148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.925+0000 7f078ebae640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07881543b0 0x7f0788154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.925+0000 7f078ebae640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0788139e60 0x7f078813a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.925+0000 7f078ebae640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0788147660 con 0x7f0788139e60 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.925+0000 7f078ebae640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07881eb900 con 0x7f0770005180 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.925+0000 7f078ebae640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078813a850 con 0x7f07881543b0 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.925+0000 7f078d14b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0788139e60 0x7f078813a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.925+0000 7f078d14b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0788139e60 0x7f078813a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40496/0 (socket says 172.21.15.106:40496) 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.925+0000 7f078d14b640 1 -- 172.21.15.106:0/1895958900 learned_addr learned my addr 172.21.15.106:0/1895958900 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.926+0000 7f078c94a640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0770005180 0x7f0788148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.926+0000 7f078d14b640 1 -- 172.21.15.106:0/1895958900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07881543b0 msgr2=0x7f0788154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.926+0000 7f078d14b640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07881543b0 0x7f0788154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.926+0000 7f078d14b640 1 -- 172.21.15.106:0/1895958900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0770005180 msgr2=0x7f0788148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.926+0000 7f078d14b640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0770005180 0x7f0788148d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.926+0000 7f078d14b640 1 -- 172.21.15.106:0/1895958900 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07881ead80 con 0x7f0788139e60 2023-12-22T09:16:06.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.926+0000 7f078d14b640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0788139e60 0x7f078813a310 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f078000c360 tx=0x7f0780001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:06.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.926+0000 7f077d7fa640 1 -- 172.21.15.106:0/1895958900 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800049e0 con 0x7f0788139e60 2023-12-22T09:16:06.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.926+0000 7f077d7fa640 1 -- 172.21.15.106:0/1895958900 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0780004b40 con 0x7f0788139e60 2023-12-22T09:16:06.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.927+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07881eb060 con 0x7f0788139e60 2023-12-22T09:16:06.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.927+0000 7f077d7fa640 1 -- 172.21.15.106:0/1895958900 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780001640 con 0x7f0788139e60 2023-12-22T09:16:06.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.927+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07881eb620 con 0x7f0788139e60 2023-12-22T09:16:06.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.928+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0788073f10 con 0x7f0788139e60 2023-12-22T09:16:06.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.929+0000 7f077d7fa640 1 -- 172.21.15.106:0/1895958900 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0780032070 con 0x7f0788139e60 2023-12-22T09:16:06.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.930+0000 7f077d7fa640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f077406a460 0x7f077406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:06.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.930+0000 7f077d7fa640 1 -- 172.21.15.106:0/1895958900 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f078003c070 con 0x7f0788139e60 2023-12-22T09:16:06.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.930+0000 7f078c94a640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f077406a460 0x7f077406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:06.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.931+0000 7f078c94a640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f077406a460 0x7f077406c920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0784001c20 tx=0x7f0784009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:06.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:06.934+0000 7f077d7fa640 1 -- 172.21.15.106:0/1895958900 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0780075430 con 0x7f0788139e60 2023-12-22T09:16:07.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.126+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07880c16f0 con 0x7f0788139e60 2023-12-22T09:16:07.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.127+0000 7f077d7fa640 1 -- 172.21.15.106:0/1895958900 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0780045020 con 0x7f0788139e60 2023-12-22T09:16:07.128 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:07.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f077406a460 msgr2=0x7f077406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f077406a460 0x7f077406c920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0784001c20 tx=0x7f0784009040 comp rx=0 tx=0).stop 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0788139e60 msgr2=0x7f078813a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0788139e60 0x7f078813a310 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f078000c360 tx=0x7f0780001a00 comp rx=0 tx=0).stop 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 shutdown_connections 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f077406a460 0x7f077406c920 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0788139e60 0x7f078813a310 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07881543b0 0x7f0788154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 --2- 172.21.15.106:0/1895958900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0770005180 0x7f0788148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 >> 172.21.15.106:0/1895958900 conn(0x7f0788069dd0 msgr2=0x7f07880c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 shutdown_connections 2023-12-22T09:16:07.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.130+0000 7f078ebae640 1 -- 172.21.15.106:0/1895958900 wait complete. 2023-12-22T09:16:07.150 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T09:16:07.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.357+0000 7f17a59ce640 1 Processor -- start 2023-12-22T09:16:07.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.357+0000 7f17a59ce640 1 -- start start 2023-12-22T09:16:07.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.359+0000 7f17a59ce640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17a00c2760 0x7f17a0069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.359+0000 7f17a59ce640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a00c22d0 con 0x7f17a01516a0 2023-12-22T09:16:07.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.359+0000 7f17a59ce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a00c1cc0 con 0x7f17a0154b40 2023-12-22T09:16:07.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.359+0000 7f17a59ce640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a0071680 con 0x7f17a00c2760 2023-12-22T09:16:07.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.359+0000 7f179effd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f17a01516a0 0x7f17a0070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39450/0 (socket says 172.21.15.106:39450) 2023-12-22T09:16:07.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.359+0000 7f179effd640 1 -- 172.21.15.106:0/2017436673 learned_addr learned my addr 172.21.15.106:0/2017436673 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:07.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.359+0000 7f179f7fe640 1 --2- 172.21.15.106:0/2017436673 >> v2:172.21.15.106:3300/0 conn(0x7f17a00c2760 0x7f17a0069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.360+0000 7f179f7fe640 1 -- 172.21.15.106:0/2017436673 >> v1:172.21.15.132:6789/0 conn(0x7f17a0154b40 legacy=0x7f17a00a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:07.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.360+0000 7f179f7fe640 1 -- 172.21.15.106:0/2017436673 >> v1:172.21.15.106:6789/0 conn(0x7f17a01516a0 legacy=0x7f17a0070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.360+0000 7f179f7fe640 1 -- 172.21.15.106:0/2017436673 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a00c1f60 con 0x7f17a00c2760 2023-12-22T09:16:07.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.361+0000 7f179f7fe640 1 --2- 172.21.15.106:0/2017436673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00c2760 0x7f17a0069bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f17980097a0 tx=0x7f179802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18657780f9a73f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:07.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.361+0000 7f179dffb640 1 -- 172.21.15.106:0/2017436673 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798031830 con 0x7f17a00c2760 2023-12-22T09:16:07.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.361+0000 7f179dffb640 1 -- 172.21.15.106:0/2017436673 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798031990 con 0x7f17a00c2760 2023-12-22T09:16:07.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.361+0000 7f179dffb640 1 -- 172.21.15.106:0/2017436673 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798031d20 con 0x7f17a00c2760 2023-12-22T09:16:07.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.362+0000 7f17a59ce640 1 -- 172.21.15.106:0/2017436673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00c2760 msgr2=0x7f17a0069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.362+0000 7f17a59ce640 1 --2- 172.21.15.106:0/2017436673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00c2760 0x7f17a0069bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f17980097a0 tx=0x7f179802b8d0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.362+0000 7f17a59ce640 1 -- 172.21.15.106:0/2017436673 shutdown_connections 2023-12-22T09:16:07.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.362+0000 7f17a59ce640 1 --2- 172.21.15.106:0/2017436673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00c2760 0x7f17a0069bf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.362+0000 7f17a59ce640 1 -- 172.21.15.106:0/2017436673 >> 172.21.15.106:0/2017436673 conn(0x7f17a00c6460 msgr2=0x7f17a00c6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:07.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.362+0000 7f17a59ce640 1 -- 172.21.15.106:0/2017436673 shutdown_connections 2023-12-22T09:16:07.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.362+0000 7f17a59ce640 1 -- 172.21.15.106:0/2017436673 wait complete. 2023-12-22T09:16:07.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.364+0000 7f17a59ce640 1 Processor -- start 2023-12-22T09:16:07.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.364+0000 7f17a59ce640 1 -- start start 2023-12-22T09:16:07.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f17a59ce640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17a00c2760 0x7f17a0153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f17a59ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a01516a0 0x7f17a00be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f17a59ce640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a0154b40 0x7f17a014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f17a59ce640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00abc20 con 0x7f17a0154b40 2023-12-22T09:16:07.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f17a59ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0152e50 con 0x7f17a01516a0 2023-12-22T09:16:07.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f17a59ce640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0153ec0 con 0x7f17a00c2760 2023-12-22T09:16:07.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f179f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a0154b40 0x7f17a014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f179f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a0154b40 0x7f17a014acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40506/0 (socket says 172.21.15.106:40506) 2023-12-22T09:16:07.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f179f7fe640 1 -- 172.21.15.106:0/1667755043 learned_addr learned my addr 172.21.15.106:0/1667755043 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f179e7fc640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a01516a0 0x7f17a00be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f179effd640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17a00c2760 0x7f17a0153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.365+0000 7f179f7fe640 1 -- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17a00c2760 msgr2=0x7f17a0153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f179f7fe640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17a00c2760 0x7f17a0153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f179f7fe640 1 -- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a01516a0 msgr2=0x7f17a00be1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f179f7fe640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a01516a0 0x7f17a00be1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f179f7fe640 1 -- 172.21.15.106:0/1667755043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798009400 con 0x7f17a0154b40 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f179e7fc640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a01516a0 0x7f17a00be1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f179effd640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17a00c2760 0x7f17a0153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f179f7fe640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a0154b40 0x7f17a014acc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f17980098c0 tx=0x7f17980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f1797fff640 1 -- 172.21.15.106:0/1667755043 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179803b9f0 con 0x7f17a0154b40 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f1797fff640 1 -- 172.21.15.106:0/1667755043 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179803bb50 con 0x7f17a0154b40 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a01541a0 con 0x7f17a0154b40 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f1797fff640 1 -- 172.21.15.106:0/1667755043 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980453f0 con 0x7f17a0154b40 2023-12-22T09:16:07.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.366+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a0152a70 con 0x7f17a0154b40 2023-12-22T09:16:07.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.367+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a0073f10 con 0x7f17a0154b40 2023-12-22T09:16:07.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.368+0000 7f1797fff640 1 -- 172.21.15.106:0/1667755043 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1798045550 con 0x7f17a0154b40 2023-12-22T09:16:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.370+0000 7f1797fff640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f178006a400 0x7f178006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.370+0000 7f1797fff640 1 -- 172.21.15.106:0/1667755043 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f17980aaeb0 con 0x7f17a0154b40 2023-12-22T09:16:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.370+0000 7f179effd640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f178006a400 0x7f178006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.371+0000 7f179effd640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f178006a400 0x7f178006c8c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1790005c00 tx=0x7f1790009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:07.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.374+0000 7f1797fff640 1 -- 172.21.15.106:0/1667755043 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f17980763e0 con 0x7f17a0154b40 2023-12-22T09:16:07.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.565+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f17a006aa50 con 0x7f17a0154b40 2023-12-22T09:16:07.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.566+0000 7f1797fff640 1 -- 172.21.15.106:0/1667755043 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+207 (secure 0 0 0) 0x7f17980350e0 con 0x7f17a0154b40 2023-12-22T09:16:07.567 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:07.567 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2023-12-22T09:16:07.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:07.567 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2023-12-22T09:16:07.567 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 5, 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": "cephfs_metadata" 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 6, 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": "cephfs_data" 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:07.568 INFO:teuthology.orchestra.run.smithi106.stdout:] 2023-12-22T09:16:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f178006a400 msgr2=0x7f178006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f178006a400 0x7f178006c8c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1790005c00 tx=0x7f1790009040 comp rx=0 tx=0).stop 2023-12-22T09:16:07.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a0154b40 msgr2=0x7f17a014acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a0154b40 0x7f17a014acc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f17980098c0 tx=0x7f17980046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 shutdown_connections 2023-12-22T09:16:07.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f178006a400 0x7f178006c8c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a0154b40 0x7f17a014acc0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a01516a0 0x7f17a00be1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 --2- 172.21.15.106:0/1667755043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17a00c2760 0x7f17a0153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 >> 172.21.15.106:0/1667755043 conn(0x7f17a00c6460 msgr2=0x7f17a00bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 shutdown_connections 2023-12-22T09:16:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.569+0000 7f17a59ce640 1 -- 172.21.15.106:0/1667755043 wait complete. 2023-12-22T09:16:07.588 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-22T09:16:07.588 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-22T09:16:07.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.801+0000 7f43f7a30640 1 Processor -- start 2023-12-22T09:16:07.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.802+0000 7f43f7a30640 1 -- start start 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.803+0000 7f43f7a30640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f0151540 0x7f43f00c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.803+0000 7f43f7a30640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f43f00c6b50 0x7f43f0154800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.803+0000 7f43f7a30640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f0157430 con 0x7f43f00c75b0 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.803+0000 7f43f7a30640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f0151920 con 0x7f43f00c6b50 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.803+0000 7f43f7a30640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f0157710 con 0x7f43f0151540 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.804+0000 7f43f5fcd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f43f00c6b50 0x7f43f0154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.804+0000 7f43f57cc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f0151540 0x7f43f00c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.804+0000 7f43f5fcd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f43f00c6b50 0x7f43f0154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:58542/0 (socket says 172.21.15.106:58542) 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.804+0000 7f43f5fcd640 1 -- 172.21.15.106:0/34541023 learned_addr learned my addr 172.21.15.106:0/34541023 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.804+0000 7f43f57cc640 1 -- 172.21.15.106:0/34541023 >> v2:172.21.15.132:3300/0 conn(0x7f43f00c6b50 msgr2=0x7f43f0154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.805+0000 7f43f57cc640 1 --2- 172.21.15.106:0/34541023 >> v2:172.21.15.132:3300/0 conn(0x7f43f00c6b50 0x7f43f0154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.805+0000 7f43f57cc640 1 -- 172.21.15.106:0/34541023 >> v1:172.21.15.132:6789/0 conn(0x7f43f00c75b0 legacy=0x7f43f01540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.805+0000 7f43f57cc640 1 -- 172.21.15.106:0/34541023 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f01579f0 con 0x7f43f0151540 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.806+0000 7f43f57cc640 1 --2- 172.21.15.106:0/34541023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f0151540 0x7f43f00c6610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0097a0 tx=0x7f43ec02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94dd95b36baa84a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.806+0000 7f43e7fff640 1 -- 172.21.15.106:0/34541023 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec031780 con 0x7f43f0151540 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43e7fff640 1 -- 172.21.15.106:0/34541023 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec0318e0 con 0x7f43f0151540 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43e7fff640 1 -- 172.21.15.106:0/34541023 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec031c70 con 0x7f43f0151540 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43f7a30640 1 -- 172.21.15.106:0/34541023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f0151540 msgr2=0x7f43f00c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43f7a30640 1 --2- 172.21.15.106:0/34541023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f0151540 0x7f43f00c6610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0097a0 tx=0x7f43ec02b820 comp rx=0 tx=0).stop 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43f7a30640 1 -- 172.21.15.106:0/34541023 shutdown_connections 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43f7a30640 1 --2- 172.21.15.106:0/34541023 >> v2:172.21.15.132:3300/0 conn(0x7f43f00c6b50 0x7f43f0154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43f7a30640 1 --2- 172.21.15.106:0/34541023 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f0151540 0x7f43f00c6610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43f7a30640 1 -- 172.21.15.106:0/34541023 >> 172.21.15.106:0/34541023 conn(0x7f43f0071740 msgr2=0x7f43f0071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43f7a30640 1 -- 172.21.15.106:0/34541023 shutdown_connections 2023-12-22T09:16:07.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.807+0000 7f43f7a30640 1 -- 172.21.15.106:0/34541023 wait complete. 2023-12-22T09:16:07.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.810+0000 7f43f7a30640 1 Processor -- start 2023-12-22T09:16:07.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.810+0000 7f43f7a30640 1 -- start start 2023-12-22T09:16:07.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.811+0000 7f43f7a30640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f00c6b50 0x7f43f00acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.811+0000 7f43f7a30640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f00c75b0 0x7f43f0152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.811+0000 7f43f7a30640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f0151540 0x7f43f0146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.811+0000 7f43f7a30640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00ad300 con 0x7f43f00c75b0 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.811+0000 7f43f7a30640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00a9090 con 0x7f43f0151540 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.811+0000 7f43f7a30640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00aa5a0 con 0x7f43f00c6b50 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.811+0000 7f43f4fcb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f00c75b0 0x7f43f0152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.811+0000 7f43f4fcb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f00c75b0 0x7f43f0152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40512/0 (socket says 172.21.15.106:40512) 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.811+0000 7f43f4fcb640 1 -- 172.21.15.106:0/551490628 learned_addr learned my addr 172.21.15.106:0/551490628 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f57cc640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f00c6b50 0x7f43f00acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f5fcd640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f0151540 0x7f43f0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f4fcb640 1 -- 172.21.15.106:0/551490628 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f00c6b50 msgr2=0x7f43f00acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f4fcb640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f00c6b50 0x7f43f00acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f4fcb640 1 -- 172.21.15.106:0/551490628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f0151540 msgr2=0x7f43f0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f4fcb640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f0151540 0x7f43f0146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f4fcb640 1 -- 172.21.15.106:0/551490628 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec009400 con 0x7f43f00c75b0 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f5fcd640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f0151540 0x7f43f0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:07.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f4fcb640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f00c75b0 0x7f43f0152f70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f43e000c450 tx=0x7f43e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:07.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43e5ffb640 1 -- 172.21.15.106:0/551490628 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00052d0 con 0x7f43f00c75b0 2023-12-22T09:16:07.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43e5ffb640 1 -- 172.21.15.106:0/551490628 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e0005430 con 0x7f43f00c75b0 2023-12-22T09:16:07.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43e5ffb640 1 -- 172.21.15.106:0/551490628 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0012870 con 0x7f43f00c75b0 2023-12-22T09:16:07.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.812+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f00ab980 con 0x7f43f00c75b0 2023-12-22T09:16:07.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.813+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f00ad780 con 0x7f43f00c75b0 2023-12-22T09:16:07.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.814+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f0073f10 con 0x7f43f00c75b0 2023-12-22T09:16:07.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.815+0000 7f43e5ffb640 1 -- 172.21.15.106:0/551490628 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43e00129d0 con 0x7f43f00c75b0 2023-12-22T09:16:07.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.816+0000 7f43e5ffb640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f43d406a460 0x7f43d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:07.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.816+0000 7f43e5ffb640 1 -- 172.21.15.106:0/551490628 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f43e0088460 con 0x7f43f00c75b0 2023-12-22T09:16:07.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.816+0000 7f43f57cc640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f43d406a460 0x7f43d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:07.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.817+0000 7f43f57cc640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f43d406a460 0x7f43d406c920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f43ec036000 tx=0x7f43ec03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:07.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:07.820+0000 7f43e5ffb640 1 -- 172.21.15.106:0/551490628 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f43e00539a0 con 0x7f43f00c75b0 2023-12-22T09:16:08.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.011+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f43f006c7d0 con 0x7f43f00c75b0 2023-12-22T09:16:08.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.743+0000 7f43e5ffb640 1 -- 172.21.15.106:0/551490628 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v41) v1 ==== 140+0+0 (secure 0 0 0) 0x7f43e0056fc0 con 0x7f43f00c75b0 2023-12-22T09:16:08.744 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs2_metadata' created 2023-12-22T09:16:08.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.748+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f43d406a460 msgr2=0x7f43d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:08.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.748+0000 7f43f7a30640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f43d406a460 0x7f43d406c920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f43ec036000 tx=0x7f43ec03d040 comp rx=0 tx=0).stop 2023-12-22T09:16:08.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.748+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f00c75b0 msgr2=0x7f43f0152f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:08.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.748+0000 7f43f7a30640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f00c75b0 0x7f43f0152f70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f43e000c450 tx=0x7f43e000c910 comp rx=0 tx=0).stop 2023-12-22T09:16:08.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.749+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 shutdown_connections 2023-12-22T09:16:08.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.749+0000 7f43f7a30640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f43d406a460 0x7f43d406c920 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.749+0000 7f43f7a30640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43f0151540 0x7f43f0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.749+0000 7f43f7a30640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43f00c75b0 0x7f43f0152f70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.749+0000 7f43f7a30640 1 --2- 172.21.15.106:0/551490628 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f43f00c6b50 0x7f43f00acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.749+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 >> 172.21.15.106:0/551490628 conn(0x7f43f0071740 msgr2=0x7f43f00c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:08.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.750+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 shutdown_connections 2023-12-22T09:16:08.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.750+0000 7f43f7a30640 1 -- 172.21.15.106:0/551490628 wait complete. 2023-12-22T09:16:08.777 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T09:16:08.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.978+0000 7f2aff59e640 1 Processor -- start 2023-12-22T09:16:08.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.978+0000 7f2aff59e640 1 -- start start 2023-12-22T09:16:08.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.980+0000 7f2aff59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b000c4600 0x7f2b0015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:08.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.980+0000 7f2aff59e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0006a3e0 con 0x7f2b001513e0 2023-12-22T09:16:08.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.980+0000 7f2aff59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0006a100 con 0x7f2b00069bf0 2023-12-22T09:16:08.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.980+0000 7f2aff59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b000c4ff0 con 0x7f2b000c4600 2023-12-22T09:16:08.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.980+0000 7f2afe59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2b001513e0 0x7f2b0006d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39460/0 (socket says 172.21.15.106:39460) 2023-12-22T09:16:08.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.980+0000 7f2afe59c640 1 -- 172.21.15.106:0/3222949467 learned_addr learned my addr 172.21.15.106:0/3222949467 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:08.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afed9d640 1 --2- 172.21.15.106:0/3222949467 >> v2:172.21.15.132:3300/0 conn(0x7f2b000c4600 0x7f2b0015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:08.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483777815 0 0) 0x7f2b0006a3e0 con 0x7f2b001513e0 2023-12-22T09:16:08.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aec003520 con 0x7f2b001513e0 2023-12-22T09:16:08.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3089628674 0 0) 0x7f2aec003520 con 0x7f2b001513e0 2023-12-22T09:16:08.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 >> v2:172.21.15.132:3300/0 conn(0x7f2b000c4600 msgr2=0x7f2b0015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:08.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 --2- 172.21.15.106:0/3222949467 >> v2:172.21.15.132:3300/0 conn(0x7f2b000c4600 0x7f2b0015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 >> v1:172.21.15.132:6789/0 conn(0x7f2b00069bf0 legacy=0x7f2b00157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:08.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000a4d50 con 0x7f2b001513e0 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f2af00019f0 con 0x7f2b001513e0 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afed9d640 1 --2- 172.21.15.106:0/3222949467 >> v2:172.21.15.132:3300/0 conn(0x7f2b000c4600 0x7f2b0015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 >> v1:172.21.15.106:6789/0 conn(0x7f2b001513e0 legacy=0x7f2b0006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2aec003970 0x7f2aec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.981+0000 7f2afd59a640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aec0047c0 0x7f2aec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.982+0000 7f2afd59a640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2aec005180 0x7f2aec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.982+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000c4ff0 con 0x7f2aec003970 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.982+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec00c0d0 con 0x7f2aec0047c0 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.982+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec00c290 con 0x7f2aec005180 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.982+0000 7f2afe59c640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2aec003970 0x7f2aec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.982+0000 7f2afdd9b640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aec0047c0 0x7f2aec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.982+0000 7f2afed9d640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2aec005180 0x7f2aec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:08.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.983+0000 7f2afe59c640 1 -- 172.21.15.106:0/3222949467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2aec005180 msgr2=0x7f2aec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:08.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.983+0000 7f2afe59c640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2aec005180 0x7f2aec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.983+0000 7f2afe59c640 1 -- 172.21.15.106:0/3222949467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aec0047c0 msgr2=0x7f2aec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:08.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.983+0000 7f2afe59c640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aec0047c0 0x7f2aec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.983+0000 7f2afe59c640 1 -- 172.21.15.106:0/3222949467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec003520 con 0x7f2aec003970 2023-12-22T09:16:08.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.983+0000 7f2afed9d640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2aec005180 0x7f2aec00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:08.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.983+0000 7f2afed9d640 1 -- 172.21.15.106:0/3222949467 reap_dead start 2023-12-22T09:16:08.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.984+0000 7f2afe59c640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2aec003970 0x7f2aec003d90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2af000a830 tx=0x7f2aec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de903ae623fc976 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:08.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.984+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00072d0 con 0x7f2aec003970 2023-12-22T09:16:08.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.985+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af002f070 con 0x7f2aec003970 2023-12-22T09:16:08.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.985+0000 7f2afd59a640 1 -- 172.21.15.106:0/3222949467 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00076f0 con 0x7f2aec003970 2023-12-22T09:16:08.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.985+0000 7f2aff59e640 1 -- 172.21.15.106:0/3222949467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2aec003970 msgr2=0x7f2aec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:08.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.985+0000 7f2aff59e640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2aec003970 0x7f2aec003d90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2af000a830 tx=0x7f2aec0057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.985+0000 7f2aff59e640 1 -- 172.21.15.106:0/3222949467 shutdown_connections 2023-12-22T09:16:08.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.985+0000 7f2aff59e640 1 --2- 172.21.15.106:0/3222949467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2aec003970 0x7f2aec003d90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.985+0000 7f2aff59e640 1 -- 172.21.15.106:0/3222949467 >> 172.21.15.106:0/3222949467 conn(0x7f2b000c5a60 msgr2=0x7f2b000c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:08.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.985+0000 7f2aff59e640 1 -- 172.21.15.106:0/3222949467 shutdown_connections 2023-12-22T09:16:08.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.985+0000 7f2aff59e640 1 -- 172.21.15.106:0/3222949467 wait complete. 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.987+0000 7f2aff59e640 1 Processor -- start 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.987+0000 7f2aff59e640 1 -- start start 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.988+0000 7f2aff59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aec003970 0x7f2b001e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.988+0000 7f2aff59e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b00142820 0x7f2b000a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.988+0000 7f2aff59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b001497a0 0x7f2b00149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.988+0000 7f2aff59e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00140980 con 0x7f2b00142820 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.988+0000 7f2aff59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000a5550 con 0x7f2aec003970 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.988+0000 7f2aff59e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b001410b0 con 0x7f2b001497a0 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.988+0000 7f2afdd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b00142820 0x7f2b000a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.988+0000 7f2afdd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b00142820 0x7f2b000a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40532/0 (socket says 172.21.15.106:40532) 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.988+0000 7f2afdd9b640 1 -- 172.21.15.106:0/2499734625 learned_addr learned my addr 172.21.15.106:0/2499734625 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2afe59c640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aec003970 0x7f2b001e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2afed9d640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b001497a0 0x7f2b00149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2afdd9b640 1 -- 172.21.15.106:0/2499734625 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b001497a0 msgr2=0x7f2b00149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2afdd9b640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b001497a0 0x7f2b00149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2afdd9b640 1 -- 172.21.15.106:0/2499734625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aec003970 msgr2=0x7f2b001e9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2afdd9b640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aec003970 0x7f2b001e9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2afdd9b640 1 -- 172.21.15.106:0/2499734625 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b00141c90 con 0x7f2b00142820 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2afed9d640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b001497a0 0x7f2b00149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2afdd9b640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b00142820 0x7f2b000a6bb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800f620 tx=0x7f2ae800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.989+0000 7f2af6ffd640 1 -- 172.21.15.106:0/2499734625 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80052e0 con 0x7f2b00142820 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.990+0000 7f2af6ffd640 1 -- 172.21.15.106:0/2499734625 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae8005440 con 0x7f2b00142820 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.990+0000 7f2af6ffd640 1 -- 172.21.15.106:0/2499734625 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8003810 con 0x7f2b00142820 2023-12-22T09:16:08.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.990+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b00141f70 con 0x7f2b00142820 2023-12-22T09:16:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.990+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b000a57a0 con 0x7f2b00142820 2023-12-22T09:16:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.991+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b000a5960 con 0x7f2b00142820 2023-12-22T09:16:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.992+0000 7f2af6ffd640 1 -- 172.21.15.106:0/2499734625 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ae8003970 con 0x7f2b00142820 2023-12-22T09:16:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.994+0000 7f2af6ffd640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ae006a430 0x7f2ae006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.994+0000 7f2af6ffd640 1 -- 172.21.15.106:0/2499734625 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f2ae80889a0 con 0x7f2b00142820 2023-12-22T09:16:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.994+0000 7f2afe59c640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ae006a430 0x7f2ae006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.994+0000 7f2afe59c640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ae006a430 0x7f2ae006c8f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2af0034000 tx=0x7f2af0007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:08.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:08.999+0000 7f2af6ffd640 1 -- 172.21.15.106:0/2499734625 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ae8053d70 con 0x7f2b00142820 2023-12-22T09:16:09.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.192+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2b0004e8d0 con 0x7f2b00142820 2023-12-22T09:16:09.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.754+0000 7f2af6ffd640 1 -- 172.21.15.106:0/2499734625 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v42) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2ae8057390 con 0x7f2b00142820 2023-12-22T09:16:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs2_data' created 2023-12-22T09:16:09.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.761+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ae006a430 msgr2=0x7f2ae006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:09.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.761+0000 7f2aff59e640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ae006a430 0x7f2ae006c8f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2af0034000 tx=0x7f2af0007000 comp rx=0 tx=0).stop 2023-12-22T09:16:09.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.761+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b00142820 msgr2=0x7f2b000a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:09.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.761+0000 7f2aff59e640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b00142820 0x7f2b000a6bb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800f620 tx=0x7f2ae800fae0 comp rx=0 tx=0).stop 2023-12-22T09:16:09.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.762+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 shutdown_connections 2023-12-22T09:16:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.763+0000 7f2aff59e640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2ae006a430 0x7f2ae006c8f0 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2af0034000 tx=0x7f2af0007000 comp rx=0 tx=0).stop 2023-12-22T09:16:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.763+0000 7f2aff59e640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b001497a0 0x7f2b00149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.763+0000 7f2aff59e640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b00142820 0x7f2b000a6bb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.763+0000 7f2aff59e640 1 --2- 172.21.15.106:0/2499734625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aec003970 0x7f2b001e9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.763+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 >> 172.21.15.106:0/2499734625 conn(0x7f2b000c5a60 msgr2=0x7f2b000c2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:09.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.767+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 shutdown_connections 2023-12-22T09:16:09.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.767+0000 7f2aff59e640 1 -- 172.21.15.106:0/2499734625 wait complete. 2023-12-22T09:16:09.800 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-22T09:16:09.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.986+0000 7f2be77ab640 1 Processor -- start 2023-12-22T09:16:09.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.986+0000 7f2be77ab640 1 -- start start 2023-12-22T09:16:09.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.988+0000 7f2be77ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be00c0790 0x7f2be00c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:09.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.988+0000 7f2be77ab640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2be01543f0 0x7f2be01548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:09.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.988+0000 7f2be77ab640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be00c1c40 con 0x7f2be00aa290 2023-12-22T09:16:09.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.988+0000 7f2be77ab640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be00706c0 con 0x7f2be01543f0 2023-12-22T09:16:09.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.988+0000 7f2be77ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be0154de0 con 0x7f2be00c0790 2023-12-22T09:16:09.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.988+0000 7f2be5547640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2be00aa290 0x7f2be00c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39468/0 (socket says 172.21.15.106:39468) 2023-12-22T09:16:09.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.988+0000 7f2be5547640 1 -- 172.21.15.106:0/2456426528 learned_addr learned my addr 172.21.15.106:0/2456426528 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:09.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.988+0000 7f2be5d48640 1 --2- 172.21.15.106:0/2456426528 >> v2:172.21.15.106:3300/0 conn(0x7f2be01543f0 0x7f2be01548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.989+0000 7f2bd7fff640 1 -- 172.21.15.106:0/2456426528 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960186675 0 0) 0x7f2be00c1c40 con 0x7f2be00aa290 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.989+0000 7f2be4d46640 1 --2- 172.21.15.106:0/2456426528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be00c0790 0x7f2be00c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.989+0000 7f2be5d48640 1 -- 172.21.15.106:0/2456426528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be00c0790 msgr2=0x7f2be00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.989+0000 7f2be5d48640 1 --2- 172.21.15.106:0/2456426528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be00c0790 0x7f2be00c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.989+0000 7f2be5d48640 1 -- 172.21.15.106:0/2456426528 >> v1:172.21.15.106:6789/0 conn(0x7f2be00aa290 legacy=0x7f2be00c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.989+0000 7f2be5d48640 1 -- 172.21.15.106:0/2456426528 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be00708b0 con 0x7f2be01543f0 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.989+0000 7f2be4d46640 1 --2- 172.21.15.106:0/2456426528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be00c0790 0x7f2be00c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.990+0000 7f2be5d48640 1 --2- 172.21.15.106:0/2456426528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be01543f0 0x7f2be01548a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009d90 tx=0x7f2bd802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7aeee633c90eeee server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.990+0000 7f2bd7fff640 1 -- 172.21.15.106:0/2456426528 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd802cbd0 con 0x7f2be01543f0 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.990+0000 7f2bd7fff640 1 -- 172.21.15.106:0/2456426528 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd802cd30 con 0x7f2be01543f0 2023-12-22T09:16:09.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.990+0000 7f2bd7fff640 1 -- 172.21.15.106:0/2456426528 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd802cea0 con 0x7f2be01543f0 2023-12-22T09:16:09.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.991+0000 7f2be77ab640 1 -- 172.21.15.106:0/2456426528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be01543f0 msgr2=0x7f2be01548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:09.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.991+0000 7f2be77ab640 1 --2- 172.21.15.106:0/2456426528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be01543f0 0x7f2be01548a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009d90 tx=0x7f2bd802be20 comp rx=0 tx=0).stop 2023-12-22T09:16:09.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.991+0000 7f2be77ab640 1 -- 172.21.15.106:0/2456426528 shutdown_connections 2023-12-22T09:16:09.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.991+0000 7f2be77ab640 1 --2- 172.21.15.106:0/2456426528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be01543f0 0x7f2be01548a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:09.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.991+0000 7f2be77ab640 1 --2- 172.21.15.106:0/2456426528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be00c0790 0x7f2be00c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:09.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.991+0000 7f2be77ab640 1 -- 172.21.15.106:0/2456426528 >> 172.21.15.106:0/2456426528 conn(0x7f2be0069dd0 msgr2=0x7f2be006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:09.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.991+0000 7f2be77ab640 1 -- 172.21.15.106:0/2456426528 shutdown_connections 2023-12-22T09:16:09.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.991+0000 7f2be77ab640 1 -- 172.21.15.106:0/2456426528 wait complete. 2023-12-22T09:16:09.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.993+0000 7f2be77ab640 1 Processor -- start 2023-12-22T09:16:09.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.993+0000 7f2be77ab640 1 -- start start 2023-12-22T09:16:09.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.993+0000 7f2be77ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2be00aa290 0x7f2be00c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:09.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be77ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be00c0790 0x7f2be00c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:09.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be77ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be01543f0 0x7f2be011e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:09.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be77ab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00c5130 con 0x7f2be00c0790 2023-12-22T09:16:09.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be77ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be01537b0 con 0x7f2be00aa290 2023-12-22T09:16:09.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be77ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be0152b00 con 0x7f2be01543f0 2023-12-22T09:16:09.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be4d46640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be00c0790 0x7f2be00c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:09.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be4d46640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be00c0790 0x7f2be00c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40556/0 (socket says 172.21.15.106:40556) 2023-12-22T09:16:09.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be4d46640 1 -- 172.21.15.106:0/1726119394 learned_addr learned my addr 172.21.15.106:0/1726119394 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:09.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be5547640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2be00aa290 0x7f2be00c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:09.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be5d48640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be01543f0 0x7f2be011e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:09.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be4d46640 1 -- 172.21.15.106:0/1726119394 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be01543f0 msgr2=0x7f2be011e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:09.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be4d46640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be01543f0 0x7f2be011e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:09.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be4d46640 1 -- 172.21.15.106:0/1726119394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2be00aa290 msgr2=0x7f2be00c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:09.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be4d46640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2be00aa290 0x7f2be00c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:09.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.994+0000 7f2be4d46640 1 -- 172.21.15.106:0/1726119394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8009a70 con 0x7f2be00c0790 2023-12-22T09:16:09.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.995+0000 7f2be4d46640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be00c0790 0x7f2be00c2250 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000c820 tx=0x7f2bd000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:09.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.995+0000 7f2bd5ffb640 1 -- 172.21.15.106:0/1726119394 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0007a30 con 0x7f2be00c0790 2023-12-22T09:16:09.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.995+0000 7f2bd5ffb640 1 -- 172.21.15.106:0/1726119394 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd0007b90 con 0x7f2be00c0790 2023-12-22T09:16:09.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.995+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be00c60e0 con 0x7f2be00c0790 2023-12-22T09:16:09.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.995+0000 7f2bd5ffb640 1 -- 172.21.15.106:0/1726119394 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd000ce70 con 0x7f2be00c0790 2023-12-22T09:16:09.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.995+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be01534d0 con 0x7f2be00c0790 2023-12-22T09:16:09.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.996+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be00c5270 con 0x7f2be00c0790 2023-12-22T09:16:09.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.998+0000 7f2bd5ffb640 1 -- 172.21.15.106:0/1726119394 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2bd0024480 con 0x7f2be00c0790 2023-12-22T09:16:09.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.999+0000 7f2bd5ffb640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2bc406a430 0x7f2bc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.999+0000 7f2bd5ffb640 1 -- 172.21.15.106:0/1726119394 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6783+0+0 (secure 0 0 0) 0x7f2bd0089180 con 0x7f2be00c0790 2023-12-22T09:16:10.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:09.999+0000 7f2be5547640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2bc406a430 0x7f2bc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.000+0000 7f2be5547640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2bc406a430 0x7f2bc406c8f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc000f60 tx=0x7f2bdc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:10.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.003+0000 7f2bd5ffb640 1 -- 172.21.15.106:0/1726119394 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2bd00543b0 con 0x7f2be00c0790 2023-12-22T09:16:10.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.235+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f2be00c5270 con 0x7f2be00c0790 2023-12-22T09:16:10.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.256+0000 7f2bd5ffb640 1 -- 172.21.15.106:0/1726119394 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 7 and data pool 8 v17) v1 ==== 175+0+0 (secure 0 0 0) 0x7f2be00c5270 con 0x7f2be00c0790 2023-12-22T09:16:10.259 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 7 and data pool 8 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2bc406a430 msgr2=0x7f2bc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2bc406a430 0x7f2bc406c8f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc000f60 tx=0x7f2bdc009040 comp rx=0 tx=0).stop 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be00c0790 msgr2=0x7f2be00c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be00c0790 0x7f2be00c2250 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000c820 tx=0x7f2bd000cc20 comp rx=0 tx=0).stop 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 shutdown_connections 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2bc406a430 0x7f2bc406c8f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2be01543f0 0x7f2be011e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be00c0790 0x7f2be00c2250 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 --2- 172.21.15.106:0/1726119394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2be00aa290 0x7f2be00c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 >> 172.21.15.106:0/1726119394 conn(0x7f2be0069dd0 msgr2=0x7f2be01500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:10.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 shutdown_connections 2023-12-22T09:16:10.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.263+0000 7f2be77ab640 1 -- 172.21.15.106:0/1726119394 wait complete. 2023-12-22T09:16:10.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:10.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.465+0000 7f1cba3c1640 1 Processor -- start 2023-12-22T09:16:10.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.465+0000 7f1cba3c1640 1 -- start start 2023-12-22T09:16:10.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.467+0000 7f1cba3c1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1cb40a8150 0x7f1cb4070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.467+0000 7f1cba3c1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1cb40c16f0 0x7f1cb4071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.467+0000 7f1cba3c1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb4152300 con 0x7f1cb414f050 2023-12-22T09:16:10.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.467+0000 7f1cba3c1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb414f430 con 0x7f1cb40c16f0 2023-12-22T09:16:10.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.467+0000 7f1cba3c1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb41519f0 con 0x7f1cb40a8150 2023-12-22T09:16:10.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.467+0000 7f1cb93bf640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1cb414f050 0x7f1cb40c1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39482/0 (socket says 172.21.15.106:39482) 2023-12-22T09:16:10.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.467+0000 7f1cb93bf640 1 -- 172.21.15.106:0/836451050 learned_addr learned my addr 172.21.15.106:0/836451050 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:10.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.467+0000 7f1cb9bc0640 1 --2- 172.21.15.106:0/836451050 >> v2:172.21.15.106:3300/0 conn(0x7f1cb40c16f0 0x7f1cb4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.468+0000 7f1cb8bbe640 1 --2- 172.21.15.106:0/836451050 >> v2:172.21.15.132:3300/0 conn(0x7f1cb40a8150 0x7f1cb4070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.468+0000 7f1cb9bc0640 1 -- 172.21.15.106:0/836451050 >> v2:172.21.15.132:3300/0 conn(0x7f1cb40a8150 msgr2=0x7f1cb4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:10.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.468+0000 7f1cb9bc0640 1 --2- 172.21.15.106:0/836451050 >> v2:172.21.15.132:3300/0 conn(0x7f1cb40a8150 0x7f1cb4070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.468+0000 7f1cb9bc0640 1 -- 172.21.15.106:0/836451050 >> v1:172.21.15.106:6789/0 conn(0x7f1cb414f050 legacy=0x7f1cb40c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.468+0000 7f1cb9bc0640 1 -- 172.21.15.106:0/836451050 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40c0860 con 0x7f1cb40c16f0 2023-12-22T09:16:10.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.468+0000 7f1cabfff640 1 -- 172.21.15.106:0/836451050 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113919918 0 0) 0x7f1cb4152300 con 0x7f1cb414f050 2023-12-22T09:16:10.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.469+0000 7f1cb9bc0640 1 --2- 172.21.15.106:0/836451050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb40c16f0 0x7f1cb4071340 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40a8930 tx=0x7f1cac02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4936a79c219298ca server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:10.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.469+0000 7f1cabfff640 1 -- 172.21.15.106:0/836451050 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac02cbf0 con 0x7f1cb40c16f0 2023-12-22T09:16:10.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.469+0000 7f1cabfff640 1 -- 172.21.15.106:0/836451050 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac02cd50 con 0x7f1cb40c16f0 2023-12-22T09:16:10.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.469+0000 7f1cabfff640 1 -- 172.21.15.106:0/836451050 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac034660 con 0x7f1cb40c16f0 2023-12-22T09:16:10.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.470+0000 7f1cba3c1640 1 -- 172.21.15.106:0/836451050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb40c16f0 msgr2=0x7f1cb4071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.470+0000 7f1cba3c1640 1 --2- 172.21.15.106:0/836451050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb40c16f0 0x7f1cb4071340 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40a8930 tx=0x7f1cac02be40 comp rx=0 tx=0).stop 2023-12-22T09:16:10.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.470+0000 7f1cba3c1640 1 -- 172.21.15.106:0/836451050 shutdown_connections 2023-12-22T09:16:10.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.470+0000 7f1cba3c1640 1 --2- 172.21.15.106:0/836451050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb40c16f0 0x7f1cb4071340 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.470+0000 7f1cba3c1640 1 --2- 172.21.15.106:0/836451050 >> v2:172.21.15.132:3300/0 conn(0x7f1cb40a8150 0x7f1cb4070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.470+0000 7f1cba3c1640 1 -- 172.21.15.106:0/836451050 >> 172.21.15.106:0/836451050 conn(0x7f1cb4069dd0 msgr2=0x7f1cb406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:10.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.470+0000 7f1cba3c1640 1 -- 172.21.15.106:0/836451050 shutdown_connections 2023-12-22T09:16:10.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.470+0000 7f1cba3c1640 1 -- 172.21.15.106:0/836451050 wait complete. 2023-12-22T09:16:10.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.471+0000 7f1cba3c1640 1 Processor -- start 2023-12-22T09:16:10.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.471+0000 7f1cba3c1640 1 -- start start 2023-12-22T09:16:10.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.472+0000 7f1cba3c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cb40a8150 0x7f1cb40c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.472+0000 7f1cba3c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cb40c16f0 0x7f1cb41409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.472+0000 7f1cba3c1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb414f050 0x7f1cb4140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.472+0000 7f1cba3c1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb41531d0 con 0x7f1cb414f050 2023-12-22T09:16:10.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.472+0000 7f1cba3c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb4141430 con 0x7f1cb40c16f0 2023-12-22T09:16:10.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.472+0000 7f1cba3c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb41e9040 con 0x7f1cb40a8150 2023-12-22T09:16:10.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1cb9bc0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb414f050 0x7f1cb4140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1cb9bc0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb414f050 0x7f1cb4140ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40572/0 (socket says 172.21.15.106:40572) 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1cb9bc0640 1 -- 172.21.15.106:0/2963567218 learned_addr learned my addr 172.21.15.106:0/2963567218 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1cb9bc0640 1 -- 172.21.15.106:0/2963567218 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cb40a8150 msgr2=0x7f1cb40c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1cb9bc0640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cb40a8150 0x7f1cb40c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1cb9bc0640 1 -- 172.21.15.106:0/2963567218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cb40c16f0 msgr2=0x7f1cb41409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1cb9bc0640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cb40c16f0 0x7f1cb41409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1cb9bc0640 1 -- 172.21.15.106:0/2963567218 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac009a70 con 0x7f1cb414f050 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1cb9bc0640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb414f050 0x7f1cb4140ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009e80 tx=0x7f1cac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.473+0000 7f1ca9ffb640 1 -- 172.21.15.106:0/2963567218 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac040650 con 0x7f1cb414f050 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.474+0000 7f1ca9ffb640 1 -- 172.21.15.106:0/2963567218 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac0407b0 con 0x7f1cb414f050 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.474+0000 7f1ca9ffb640 1 -- 172.21.15.106:0/2963567218 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac040b60 con 0x7f1cb414f050 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.474+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb41e9320 con 0x7f1cb414f050 2023-12-22T09:16:10.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.474+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb41e98e0 con 0x7f1cb414f050 2023-12-22T09:16:10.476 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.475+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb404e8d0 con 0x7f1cb414f050 2023-12-22T09:16:10.476 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.476+0000 7f1ca9ffb640 1 -- 172.21.15.106:0/2963567218 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cac040cc0 con 0x7f1cb414f050 2023-12-22T09:16:10.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.476+0000 7f1ca9ffb640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9806a430 0x7f1c9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.477+0000 7f1ca9ffb640 1 -- 172.21.15.106:0/2963567218 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1cac0abd00 con 0x7f1cb414f050 2023-12-22T09:16:10.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.477+0000 7f1cb93bf640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9806a430 0x7f1c9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.477+0000 7f1cb93bf640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9806a430 0x7f1c9806c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0007fd0 tx=0x7f1cb0007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:10.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.481+0000 7f1ca9ffb640 1 -- 172.21.15.106:0/2963567218 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1cac076db0 con 0x7f1cb414f050 2023-12-22T09:16:10.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.659+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cb40c1290 con 0x7f1cb414f050 2023-12-22T09:16:10.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.663+0000 7f1ca9ffb640 1 -- 172.21.15.106:0/2963567218 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+20083 (secure 0 0 0) 0x7f1cac07a3d0 con 0x7f1cb414f050 2023-12-22T09:16:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:10.665 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":43,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:10.237432+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:10.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9806a430 msgr2=0x7f1c9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9806a430 0x7f1c9806c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0007fd0 tx=0x7f1cb0007960 comp rx=0 tx=0).stop 2023-12-22T09:16:10.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb414f050 msgr2=0x7f1cb4140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb414f050 0x7f1cb4140ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009e80 tx=0x7f1cac004a40 comp rx=0 tx=0).stop 2023-12-22T09:16:10.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 shutdown_connections 2023-12-22T09:16:10.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1c9806a430 0x7f1c9806c8f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cb414f050 0x7f1cb4140ef0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cb40c16f0 0x7f1cb41409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 --2- 172.21.15.106:0/2963567218 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cb40a8150 0x7f1cb40c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 >> 172.21.15.106:0/2963567218 conn(0x7f1cb4069dd0 msgr2=0x7f1cb4070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:10.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.666+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 shutdown_connections 2023-12-22T09:16:10.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.667+0000 7f1cba3c1640 1 -- 172.21.15.106:0/2963567218 wait complete. 2023-12-22T09:16:10.685 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.885+0000 7f94d27ab640 1 Processor -- start 2023-12-22T09:16:10.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.885+0000 7f94d27ab640 1 -- start start 2023-12-22T09:16:10.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.886+0000 7f94d27ab640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94cc1514b0 0x7f94cc0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.886+0000 7f94d27ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc0c4130 0x7f94cc154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.886+0000 7f94d27ab640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94cc0c4660 con 0x7f94cc154a80 2023-12-22T09:16:10.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.886+0000 7f94d27ab640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94cc153d60 con 0x7f94cc1514b0 2023-12-22T09:16:10.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.886+0000 7f94d27ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc06b250 con 0x7f94cc0c4130 2023-12-22T09:16:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.887+0000 7f94d0d48640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f94cc154a80 0x7f94cc0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39492/0 (socket says 172.21.15.106:39492) 2023-12-22T09:16:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.887+0000 7f94cbfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94cc1514b0 0x7f94cc0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.887+0000 7f94d0d48640 1 -- 172.21.15.106:0/1243562260 learned_addr learned my addr 172.21.15.106:0/1243562260 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.887+0000 7f94cb7fe640 1 --2- 172.21.15.106:0/1243562260 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc0c4130 0x7f94cc154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.887+0000 7f94cbfff640 1 -- 172.21.15.106:0/1243562260 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc0c4130 msgr2=0x7f94cc154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.887+0000 7f94cbfff640 1 --2- 172.21.15.106:0/1243562260 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc0c4130 0x7f94cc154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.887+0000 7f94cbfff640 1 -- 172.21.15.106:0/1243562260 >> v1:172.21.15.106:6789/0 conn(0x7f94cc154a80 legacy=0x7f94cc0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.887+0000 7f94cbfff640 1 -- 172.21.15.106:0/1243562260 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc06b530 con 0x7f94cc1514b0 2023-12-22T09:16:10.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.887+0000 7f94caffd640 1 -- 172.21.15.106:0/1243562260 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889666668 0 0) 0x7f94cc0c4660 con 0x7f94cc154a80 2023-12-22T09:16:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.888+0000 7f94cbfff640 1 --2- 172.21.15.106:0/1243562260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 0x7f94cc0c75b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009d90 tx=0x7f94bc02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af81acf396ff5a1a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94caffd640 1 -- 172.21.15.106:0/1243562260 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc02cbc0 con 0x7f94cc1514b0 2023-12-22T09:16:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94caffd640 1 -- 172.21.15.106:0/1243562260 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc02cd20 con 0x7f94cc1514b0 2023-12-22T09:16:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94caffd640 1 -- 172.21.15.106:0/1243562260 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc034660 con 0x7f94cc1514b0 2023-12-22T09:16:10.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94d27ab640 1 -- 172.21.15.106:0/1243562260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 msgr2=0x7f94cc0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94d27ab640 1 --2- 172.21.15.106:0/1243562260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 0x7f94cc0c75b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009d90 tx=0x7f94bc02be10 comp rx=0 tx=0).stop 2023-12-22T09:16:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94d27ab640 1 -- 172.21.15.106:0/1243562260 shutdown_connections 2023-12-22T09:16:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94d27ab640 1 --2- 172.21.15.106:0/1243562260 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc0c4130 0x7f94cc154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94d27ab640 1 --2- 172.21.15.106:0/1243562260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 0x7f94cc0c75b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94d27ab640 1 -- 172.21.15.106:0/1243562260 >> 172.21.15.106:0/1243562260 conn(0x7f94cc0ab1a0 msgr2=0x7f94cc0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94d27ab640 1 -- 172.21.15.106:0/1243562260 shutdown_connections 2023-12-22T09:16:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.889+0000 7f94d27ab640 1 -- 172.21.15.106:0/1243562260 wait complete. 2023-12-22T09:16:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.891+0000 7f94d27ab640 1 Processor -- start 2023-12-22T09:16:10.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.891+0000 7f94d27ab640 1 -- start start 2023-12-22T09:16:10.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.892+0000 7f94d27ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94cc0c4130 0x7f94cc1db3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.892+0000 7f94d27ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 0x7f94cc149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.892+0000 7f94d27ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc150350 0x7f94cc1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.892+0000 7f94d27ab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc1ed4f0 con 0x7f94cc1514b0 2023-12-22T09:16:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.892+0000 7f94d27ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc1ec730 con 0x7f94cc0c4130 2023-12-22T09:16:10.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.892+0000 7f94d27ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc1eca10 con 0x7f94cc150350 2023-12-22T09:16:10.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 0x7f94cc149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 0x7f94cc149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40582/0 (socket says 172.21.15.106:40582) 2023-12-22T09:16:10.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cb7fe640 1 -- 172.21.15.106:0/1772157501 learned_addr learned my addr 172.21.15.106:0/1772157501 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:10.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cbfff640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94cc0c4130 0x7f94cc1db3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94d0d48640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc150350 0x7f94cc1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cb7fe640 1 -- 172.21.15.106:0/1772157501 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc150350 msgr2=0x7f94cc1499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cb7fe640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc150350 0x7f94cc1499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cb7fe640 1 -- 172.21.15.106:0/1772157501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94cc0c4130 msgr2=0x7f94cc1db3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cb7fe640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94cc0c4130 0x7f94cc1db3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cb7fe640 1 -- 172.21.15.106:0/1772157501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc009a70 con 0x7f94cc1514b0 2023-12-22T09:16:10.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.893+0000 7f94cb7fe640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 0x7f94cc149470 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f94b400c7f0 tx=0x7f94b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.894+0000 7f94c8ff9640 1 -- 172.21.15.106:0/1772157501 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4004220 con 0x7f94cc1514b0 2023-12-22T09:16:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.894+0000 7f94c8ff9640 1 -- 172.21.15.106:0/1772157501 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4004380 con 0x7f94cc1514b0 2023-12-22T09:16:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.894+0000 7f94c8ff9640 1 -- 172.21.15.106:0/1772157501 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4007840 con 0x7f94cc1514b0 2023-12-22T09:16:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.894+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc1eccf0 con 0x7f94cc1514b0 2023-12-22T09:16:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.894+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94cc1db910 con 0x7f94cc1514b0 2023-12-22T09:16:10.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.895+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94cc1ed210 con 0x7f94cc1514b0 2023-12-22T09:16:10.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.896+0000 7f94c8ff9640 1 -- 172.21.15.106:0/1772157501 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f94b4007bb0 con 0x7f94cc1514b0 2023-12-22T09:16:10.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.897+0000 7f94c8ff9640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94ac06a430 0x7f94ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:10.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.897+0000 7f94c8ff9640 1 -- 172.21.15.106:0/1772157501 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f94b4088cb0 con 0x7f94cc1514b0 2023-12-22T09:16:10.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.897+0000 7f94cbfff640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94ac06a430 0x7f94ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:10.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.898+0000 7f94cbfff640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94ac06a430 0x7f94ac06c8f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94bc036000 tx=0x7f94bc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:10.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:10.901+0000 7f94c8ff9640 1 -- 172.21.15.106:0/1772157501 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f94cc1ed210 con 0x7f94cc1514b0 2023-12-22T09:16:11.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.092+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94cc1ed210 con 0x7f94cc1514b0 2023-12-22T09:16:11.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.094+0000 7f94c8ff9640 1 -- 172.21.15.106:0/1772157501 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+20083 (secure 0 0 0) 0x7f94cc1ed210 con 0x7f94cc1514b0 2023-12-22T09:16:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:11.095 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":43,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:10.237432+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:11.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94ac06a430 msgr2=0x7f94ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94ac06a430 0x7f94ac06c8f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f94bc036000 tx=0x7f94bc030000 comp rx=0 tx=0).stop 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 msgr2=0x7f94cc149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 0x7f94cc149470 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f94b400c7f0 tx=0x7f94b400ccb0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 shutdown_connections 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f94ac06a430 0x7f94ac06c8f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc150350 0x7f94cc1499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc1514b0 0x7f94cc149470 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 --2- 172.21.15.106:0/1772157501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94cc0c4130 0x7f94cc1db3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 >> 172.21.15.106:0/1772157501 conn(0x7f94cc0ab1a0 msgr2=0x7f94cc152080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 shutdown_connections 2023-12-22T09:16:11.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.097+0000 7f94d27ab640 1 -- 172.21.15.106:0/1772157501 wait complete. 2023-12-22T09:16:11.116 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-22T09:16:11.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.331+0000 7efc666d4640 1 Processor -- start 2023-12-22T09:16:11.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.331+0000 7efc666d4640 1 -- start start 2023-12-22T09:16:11.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc666d4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efc600c5ca0 0x7efc60150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:11.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc666d4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efc6006bdc0 0x7efc6014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:11.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc666d4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc60070000 con 0x7efc60071e30 2023-12-22T09:16:11.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc666d4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc600702e0 con 0x7efc6006bdc0 2023-12-22T09:16:11.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc666d4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc600705c0 con 0x7efc600c5ca0 2023-12-22T09:16:11.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc64c71640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efc6006bdc0 0x7efc6014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:11.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc64c71640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efc6006bdc0 0x7efc6014a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40596/0 (socket says 172.21.15.106:40596) 2023-12-22T09:16:11.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc64c71640 1 -- 172.21.15.106:0/2776563160 learned_addr learned my addr 172.21.15.106:0/2776563160 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:11.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc64c71640 1 -- 172.21.15.106:0/2776563160 >> v2:172.21.15.132:3300/0 conn(0x7efc600c5ca0 msgr2=0x7efc60150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:11.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.333+0000 7efc5ffff640 1 --2- 172.21.15.106:0/2776563160 >> v2:172.21.15.132:3300/0 conn(0x7efc600c5ca0 0x7efc60150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:11.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.334+0000 7efc64c71640 1 --2- 172.21.15.106:0/2776563160 >> v2:172.21.15.132:3300/0 conn(0x7efc600c5ca0 0x7efc60150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.334+0000 7efc64c71640 1 -- 172.21.15.106:0/2776563160 >> v1:172.21.15.132:6789/0 conn(0x7efc60071e30 legacy=0x7efc600710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:11.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.334+0000 7efc64c71640 1 -- 172.21.15.106:0/2776563160 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc600708a0 con 0x7efc6006bdc0 2023-12-22T09:16:11.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.335+0000 7efc64c71640 1 --2- 172.21.15.106:0/2776563160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 0x7efc6014a5f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efc6014e930 tx=0x7efc5802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e042514cc2cd783 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:11.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.335+0000 7efc5f7fe640 1 -- 172.21.15.106:0/2776563160 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5802c9f0 con 0x7efc6006bdc0 2023-12-22T09:16:11.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.335+0000 7efc5f7fe640 1 -- 172.21.15.106:0/2776563160 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5802cb50 con 0x7efc6006bdc0 2023-12-22T09:16:11.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.335+0000 7efc5f7fe640 1 -- 172.21.15.106:0/2776563160 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc580343f0 con 0x7efc6006bdc0 2023-12-22T09:16:11.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.335+0000 7efc666d4640 1 -- 172.21.15.106:0/2776563160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 msgr2=0x7efc6014a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:11.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.335+0000 7efc666d4640 1 --2- 172.21.15.106:0/2776563160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 0x7efc6014a5f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efc6014e930 tx=0x7efc5802be50 comp rx=0 tx=0).stop 2023-12-22T09:16:11.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.336+0000 7efc666d4640 1 -- 172.21.15.106:0/2776563160 shutdown_connections 2023-12-22T09:16:11.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.336+0000 7efc666d4640 1 --2- 172.21.15.106:0/2776563160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 0x7efc6014a5f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.336+0000 7efc666d4640 1 --2- 172.21.15.106:0/2776563160 >> v2:172.21.15.132:3300/0 conn(0x7efc600c5ca0 0x7efc60150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.336+0000 7efc666d4640 1 -- 172.21.15.106:0/2776563160 >> 172.21.15.106:0/2776563160 conn(0x7efc6006a220 msgr2=0x7efc600c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:11.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.336+0000 7efc666d4640 1 -- 172.21.15.106:0/2776563160 shutdown_connections 2023-12-22T09:16:11.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.336+0000 7efc666d4640 1 -- 172.21.15.106:0/2776563160 wait complete. 2023-12-22T09:16:11.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.337+0000 7efc666d4640 1 Processor -- start 2023-12-22T09:16:11.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.337+0000 7efc666d4640 1 -- start start 2023-12-22T09:16:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.338+0000 7efc666d4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 0x7efc60152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.338+0000 7efc666d4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc60071e30 0x7efc600b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.338+0000 7efc666d4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc600c5ca0 0x7efc600b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.338+0000 7efc666d4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc60154900 con 0x7efc6006bdc0 2023-12-22T09:16:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.338+0000 7efc666d4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600b9240 con 0x7efc60071e30 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.338+0000 7efc666d4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc601535a0 con 0x7efc600c5ca0 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.338+0000 7efc5ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 0x7efc60152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 0x7efc60152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40608/0 (socket says 172.21.15.106:40608) 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5ffff640 1 -- 172.21.15.106:0/1407248365 learned_addr learned my addr 172.21.15.106:0/1407248365 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc64c71640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc600c5ca0 0x7efc600b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5ffff640 1 -- 172.21.15.106:0/1407248365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc600c5ca0 msgr2=0x7efc600b9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5ffff640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc600c5ca0 0x7efc600b9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5ffff640 1 -- 172.21.15.106:0/1407248365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc60071e30 msgr2=0x7efc600b96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5ffff640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc60071e30 0x7efc600b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5ffff640 1 -- 172.21.15.106:0/1407248365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009b30 con 0x7efc6006bdc0 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5ffff640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 0x7efc60152150 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7efc5000c820 tx=0x7efc5000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5d7fa640 1 -- 172.21.15.106:0/1407248365 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50004020 con 0x7efc6006bdc0 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5d7fa640 1 -- 172.21.15.106:0/1407248365 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc50004180 con 0x7efc6006bdc0 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6013e350 con 0x7efc6006bdc0 2023-12-22T09:16:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.339+0000 7efc5d7fa640 1 -- 172.21.15.106:0/1407248365 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50007830 con 0x7efc6006bdc0 2023-12-22T09:16:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.340+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc60152690 con 0x7efc6006bdc0 2023-12-22T09:16:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.341+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc60073f10 con 0x7efc6006bdc0 2023-12-22T09:16:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.342+0000 7efc5d7fa640 1 -- 172.21.15.106:0/1407248365 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efc50007990 con 0x7efc6006bdc0 2023-12-22T09:16:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.342+0000 7efc5d7fa640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efc4006a460 0x7efc4006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.342+0000 7efc5d7fa640 1 -- 172.21.15.106:0/1407248365 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7efc50088af0 con 0x7efc6006bdc0 2023-12-22T09:16:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.343+0000 7efc57fff640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efc4006a460 0x7efc4006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.343+0000 7efc57fff640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efc4006a460 0x7efc4006c920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc60071550 tx=0x7efc48007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:11.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.347+0000 7efc5d7fa640 1 -- 172.21.15.106:0/1407248365 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efc50053ba0 con 0x7efc6006bdc0 2023-12-22T09:16:11.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:11.571+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efc600bf750 con 0x7efc6006bdc0 2023-12-22T09:16:12.240 INFO:tasks.ceph.mds.d.smithi132.stderr:2023-12-22T09:16:12.239+0000 7fc23d083640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T09:16:12.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.273+0000 7efc5d7fa640 1 -- 172.21.15.106:0/1407248365 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 119+0+0 (secure 0 0 0) 0x7efc5001e0b0 con 0x7efc6006bdc0 2023-12-22T09:16:12.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efc4006a460 msgr2=0x7efc4006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:12.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efc4006a460 0x7efc4006c920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc60071550 tx=0x7efc48007990 comp rx=0 tx=0).stop 2023-12-22T09:16:12.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 msgr2=0x7efc60152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:12.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 0x7efc60152150 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7efc5000c820 tx=0x7efc5000cce0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 shutdown_connections 2023-12-22T09:16:12.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efc4006a460 0x7efc4006c920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efc600c5ca0 0x7efc600b9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc60071e30 0x7efc600b96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 --2- 172.21.15.106:0/1407248365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc6006bdc0 0x7efc60152150 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.276+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 >> 172.21.15.106:0/1407248365 conn(0x7efc6006a220 msgr2=0x7efc600c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:12.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.277+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 shutdown_connections 2023-12-22T09:16:12.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.277+0000 7efc666d4640 1 -- 172.21.15.106:0/1407248365 wait complete. 2023-12-22T09:16:12.297 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T09:16:12.297 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-22T09:16:12.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.510+0000 7f2606cec640 1 Processor -- start 2023-12-22T09:16:12.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.511+0000 7f2606cec640 1 -- start start 2023-12-22T09:16:12.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.512+0000 7f2606cec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26000c5a30 0x7f26000c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:12.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.512+0000 7f2606cec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f260006bdc0 0x7f26001550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:12.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.512+0000 7f2606cec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260014f570 con 0x7f260006c2d0 2023-12-22T09:16:12.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.512+0000 7f2606cec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26000a90f0 con 0x7f260006bdc0 2023-12-22T09:16:12.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.512+0000 7f2606cec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26000c0b00 con 0x7f26000c5a30 2023-12-22T09:16:12.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.513+0000 7f25fffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f260006bdc0 0x7f26001550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:12.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.513+0000 7f25fffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f260006bdc0 0x7f26001550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:58636/0 (socket says 172.21.15.106:58636) 2023-12-22T09:16:12.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.513+0000 7f25fffff640 1 -- 172.21.15.106:0/3063725607 learned_addr learned my addr 172.21.15.106:0/3063725607 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:12.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.513+0000 7f2604a88640 1 --2- 172.21.15.106:0/3063725607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26000c5a30 0x7f26000c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:12.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.514+0000 7f25fffff640 1 -- 172.21.15.106:0/3063725607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26000c5a30 msgr2=0x7f26000c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:12.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.514+0000 7f25fffff640 1 --2- 172.21.15.106:0/3063725607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26000c5a30 0x7f26000c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.514+0000 7f25fffff640 1 -- 172.21.15.106:0/3063725607 >> v1:172.21.15.132:6789/0 conn(0x7f260006c2d0 legacy=0x7f2600155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:12.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.514+0000 7f25fffff640 1 -- 172.21.15.106:0/3063725607 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000bfd40 con 0x7f260006bdc0 2023-12-22T09:16:12.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.515+0000 7f25fffff640 1 --2- 172.21.15.106:0/3063725607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f260006bdc0 0x7f26001550e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009870 tx=0x7f25ec02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f93a3834559aee75 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:12.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.515+0000 7f25ff7fe640 1 -- 172.21.15.106:0/3063725607 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec031640 con 0x7f260006bdc0 2023-12-22T09:16:12.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.515+0000 7f25ff7fe640 1 -- 172.21.15.106:0/3063725607 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec0317a0 con 0x7f260006bdc0 2023-12-22T09:16:12.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.515+0000 7f25ff7fe640 1 -- 172.21.15.106:0/3063725607 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec031b30 con 0x7f260006bdc0 2023-12-22T09:16:12.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.516+0000 7f2606cec640 1 -- 172.21.15.106:0/3063725607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f260006bdc0 msgr2=0x7f26001550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:12.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.516+0000 7f2606cec640 1 --2- 172.21.15.106:0/3063725607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f260006bdc0 0x7f26001550e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009870 tx=0x7f25ec02b8f0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.516+0000 7f2606cec640 1 -- 172.21.15.106:0/3063725607 shutdown_connections 2023-12-22T09:16:12.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.516+0000 7f2606cec640 1 --2- 172.21.15.106:0/3063725607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f260006bdc0 0x7f26001550e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.516+0000 7f2606cec640 1 --2- 172.21.15.106:0/3063725607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26000c5a30 0x7f26000c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.516+0000 7f2606cec640 1 -- 172.21.15.106:0/3063725607 >> 172.21.15.106:0/3063725607 conn(0x7f260006a220 msgr2=0x7f26000c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:12.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.516+0000 7f2606cec640 1 -- 172.21.15.106:0/3063725607 shutdown_connections 2023-12-22T09:16:12.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.516+0000 7f2606cec640 1 -- 172.21.15.106:0/3063725607 wait complete. 2023-12-22T09:16:12.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.518+0000 7f2606cec640 1 Processor -- start 2023-12-22T09:16:12.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.518+0000 7f2606cec640 1 -- start start 2023-12-22T09:16:12.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2606cec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f260006bdc0 0x7f26001541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:12.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2606cec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f260006c2d0 0x7f26001ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:12.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2606cec640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26000c5a30 0x7f26001ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:12.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2606cec640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000be310 con 0x7f26000c5a30 2023-12-22T09:16:12.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2606cec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26001487a0 con 0x7f260006c2d0 2023-12-22T09:16:12.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2606cec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26000c43f0 con 0x7f260006bdc0 2023-12-22T09:16:12.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2605289640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26000c5a30 0x7f26001ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2605289640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26000c5a30 0x7f26001ed1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40618/0 (socket says 172.21.15.106:40618) 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2605289640 1 -- 172.21.15.106:0/1800354785 learned_addr learned my addr 172.21.15.106:0/1800354785 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f25fffff640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f260006c2d0 0x7f26001ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2604a88640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f260006bdc0 0x7f26001541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2605289640 1 -- 172.21.15.106:0/1800354785 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f260006bdc0 msgr2=0x7f26001541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2605289640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f260006bdc0 0x7f26001541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2605289640 1 -- 172.21.15.106:0/1800354785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f260006c2d0 msgr2=0x7f26001ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.519+0000 7f2605289640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f260006c2d0 0x7f26001ecc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.520+0000 7f2605289640 1 -- 172.21.15.106:0/1800354785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec0094d0 con 0x7f26000c5a30 2023-12-22T09:16:12.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.520+0000 7f2605289640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26000c5a30 0x7f26001ed1a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c730 tx=0x7f25f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:12.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.520+0000 7f25fd7fa640 1 -- 172.21.15.106:0/1800354785 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8003b70 con 0x7f26000c5a30 2023-12-22T09:16:12.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.520+0000 7f25fd7fa640 1 -- 172.21.15.106:0/1800354785 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8003cf0 con 0x7f26000c5a30 2023-12-22T09:16:12.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.520+0000 7f25fd7fa640 1 -- 172.21.15.106:0/1800354785 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8005310 con 0x7f26000c5a30 2023-12-22T09:16:12.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.520+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26000c46d0 con 0x7f26000c5a30 2023-12-22T09:16:12.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.520+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26001ec740 con 0x7f26000c5a30 2023-12-22T09:16:12.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.521+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26000c2ca0 con 0x7f26000c5a30 2023-12-22T09:16:12.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.522+0000 7f25fd7fa640 1 -- 172.21.15.106:0/1800354785 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25f8005680 con 0x7f26000c5a30 2023-12-22T09:16:12.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.523+0000 7f25fd7fa640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f25e406a430 0x7f25e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:12.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.523+0000 7f25fd7fa640 1 -- 172.21.15.106:0/1800354785 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f25f8088e40 con 0x7f26000c5a30 2023-12-22T09:16:12.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.523+0000 7f2604a88640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f25e406a430 0x7f25e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:12.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.524+0000 7f2604a88640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f25e406a430 0x7f25e406c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2600155020 tx=0x7f25f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:12.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.527+0000 7f25fd7fa640 1 -- 172.21.15.106:0/1800354785 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25f8053ef0 con 0x7f26000c5a30 2023-12-22T09:16:12.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:12.752+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2600073f10 con 0x7f26000c5a30 2023-12-22T09:16:13.277 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.277+0000 7f25fd7fa640 1 -- 172.21.15.106:0/1800354785 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 123+0+0 (secure 0 0 0) 0x7f25f8003e60 con 0x7f26000c5a30 2023-12-22T09:16:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f25e406a430 msgr2=0x7f25e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f25e406a430 0x7f25e406c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2600155020 tx=0x7f25f4008040 comp rx=0 tx=0).stop 2023-12-22T09:16:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26000c5a30 msgr2=0x7f26001ed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26000c5a30 0x7f26001ed1a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c730 tx=0x7f25f800cbf0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 shutdown_connections 2023-12-22T09:16:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f25e406a430 0x7f25e406c8f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26000c5a30 0x7f26001ed1a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f260006c2d0 0x7f26001ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 --2- 172.21.15.106:0/1800354785 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f260006bdc0 0x7f26001541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 >> 172.21.15.106:0/1800354785 conn(0x7f260006a220 msgr2=0x7f260014e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:13.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 shutdown_connections 2023-12-22T09:16:13.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.280+0000 7f2606cec640 1 -- 172.21.15.106:0/1800354785 wait complete. 2023-12-22T09:16:13.302 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-22T09:16:13.303 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:13.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.512+0000 7fc2729d9640 1 Processor -- start 2023-12-22T09:16:13.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.513+0000 7fc2729d9640 1 -- start start 2023-12-22T09:16:13.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.514+0000 7fc2729d9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc26c13b060 0x7fc26c06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.514+0000 7fc2729d9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26c0bf770 con 0x7fc26c151b30 2023-12-22T09:16:13.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.514+0000 7fc2729d9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26c155120 con 0x7fc26c0bfce0 2023-12-22T09:16:13.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.514+0000 7fc2729d9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c155400 con 0x7fc26c13b060 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.514+0000 7fc270f76640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc26c151b30 0x7fc26c151f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39214/0 (socket says 172.21.15.106:39214) 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc270f76640 1 -- 172.21.15.106:0/3678681141 learned_addr learned my addr 172.21.15.106:0/3678681141 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26bfff640 1 --2- 172.21.15.106:0/3678681141 >> v2:172.21.15.132:3300/0 conn(0x7fc26c13b060 0x7fc26c06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91448650 0 0) 0x7fc26c0bf770 con 0x7fc26c151b30 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc258003520 con 0x7fc26c151b30 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 369237527 0 0) 0x7fc258003520 con 0x7fc26c151b30 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 >> v2:172.21.15.132:3300/0 conn(0x7fc26c13b060 msgr2=0x7fc26c06a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 --2- 172.21.15.106:0/3678681141 >> v2:172.21.15.132:3300/0 conn(0x7fc26c13b060 0x7fc26c06a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 >> v1:172.21.15.132:6789/0 conn(0x7fc26c0bfce0 legacy=0x7fc26c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c1556e0 con 0x7fc26c151b30 2023-12-22T09:16:13.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fc2640019f0 con 0x7fc26c151b30 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 >> v1:172.21.15.106:6789/0 conn(0x7fc26c151b30 legacy=0x7fc26c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 --2- 172.21.15.106:0/3678681141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc258003970 0x7fc258003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 --2- 172.21.15.106:0/3678681141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2580047c0 0x7fc258004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 --2- 172.21.15.106:0/3678681141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc258005180 0x7fc25800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c155400 con 0x7fc2580047c0 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25800c120 con 0x7fc258005180 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.515+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25800c2e0 con 0x7fc258003970 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.516+0000 7fc263fff640 1 --2- 172.21.15.106:0/3678681141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2580047c0 0x7fc258004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.516+0000 7fc263fff640 1 -- 172.21.15.106:0/3678681141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc258003970 msgr2=0x7fc258003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.516+0000 7fc263fff640 1 --2- 172.21.15.106:0/3678681141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc258003970 0x7fc258003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.516+0000 7fc263fff640 1 -- 172.21.15.106:0/3678681141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc258005180 msgr2=0x7fc25800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:13.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.516+0000 7fc263fff640 1 --2- 172.21.15.106:0/3678681141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc258005180 0x7fc25800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.516+0000 7fc263fff640 1 -- 172.21.15.106:0/3678681141 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc258003520 con 0x7fc2580047c0 2023-12-22T09:16:13.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.516+0000 7fc270f76640 1 -- 172.21.15.106:0/3678681141 reap_dead start 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.517+0000 7fc263fff640 1 --2- 172.21.15.106:0/3678681141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2580047c0 0x7fc258004c40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc254001750 tx=0x7fc2580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0e551fb1b5c2bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.517+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2540052d0 con 0x7fc2580047c0 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.517+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25402e050 con 0x7fc2580047c0 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.517+0000 7fc26b7fe640 1 -- 172.21.15.106:0/3678681141 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254003830 con 0x7fc2580047c0 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.518+0000 7fc2729d9640 1 -- 172.21.15.106:0/3678681141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2580047c0 msgr2=0x7fc258004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.518+0000 7fc2729d9640 1 --2- 172.21.15.106:0/3678681141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2580047c0 0x7fc258004c40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc254001750 tx=0x7fc2580057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.518+0000 7fc2729d9640 1 -- 172.21.15.106:0/3678681141 shutdown_connections 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.518+0000 7fc2729d9640 1 --2- 172.21.15.106:0/3678681141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2580047c0 0x7fc258004c40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.518+0000 7fc2729d9640 1 -- 172.21.15.106:0/3678681141 >> 172.21.15.106:0/3678681141 conn(0x7fc26c0c5360 msgr2=0x7fc26c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.518+0000 7fc2729d9640 1 -- 172.21.15.106:0/3678681141 shutdown_connections 2023-12-22T09:16:13.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.518+0000 7fc2729d9640 1 -- 172.21.15.106:0/3678681141 wait complete. 2023-12-22T09:16:13.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.520+0000 7fc2729d9640 1 Processor -- start 2023-12-22T09:16:13.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.520+0000 7fc2729d9640 1 -- start start 2023-12-22T09:16:13.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.521+0000 7fc2729d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2580047c0 0x7fc26c0c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.521+0000 7fc2729d9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc26c151740 0x7fc26c0c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.521+0000 7fc2729d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc26c133ae0 0x7fc26c133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.521+0000 7fc2729d9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c151430 con 0x7fc26c133ae0 2023-12-22T09:16:13.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.521+0000 7fc2729d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c072ee0 con 0x7fc2580047c0 2023-12-22T09:16:13.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.521+0000 7fc2729d9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0c3e80 con 0x7fc26c151740 2023-12-22T09:16:13.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.521+0000 7fc270f76640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc26c133ae0 0x7fc26c133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:13.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.521+0000 7fc270f76640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc26c133ae0 0x7fc26c133f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48108/0 (socket says 172.21.15.106:48108) 2023-12-22T09:16:13.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.521+0000 7fc270f76640 1 -- 172.21.15.106:0/2763568395 learned_addr learned my addr 172.21.15.106:0/2763568395 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc263fff640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc26c151740 0x7fc26c0c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc26bfff640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2580047c0 0x7fc26c0c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc270f76640 1 -- 172.21.15.106:0/2763568395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc26c151740 msgr2=0x7fc26c0c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc270f76640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc26c151740 0x7fc26c0c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc270f76640 1 -- 172.21.15.106:0/2763568395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2580047c0 msgr2=0x7fc26c0c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc270f76640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2580047c0 0x7fc26c0c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc270f76640 1 -- 172.21.15.106:0/2763568395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c150b90 con 0x7fc26c133ae0 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc270f76640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc26c133ae0 0x7fc26c133f70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc264001370 tx=0x7fc26400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc2697fa640 1 -- 172.21.15.106:0/2763568395 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26400cea0 con 0x7fc26c133ae0 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc2697fa640 1 -- 172.21.15.106:0/2763568395 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26400a610 con 0x7fc26c133ae0 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc2697fa640 1 -- 172.21.15.106:0/2763568395 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26400a9c0 con 0x7fc26c133ae0 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.522+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c150e70 con 0x7fc26c133ae0 2023-12-22T09:16:13.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.523+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c1e8160 con 0x7fc26c133ae0 2023-12-22T09:16:13.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.524+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c1e8350 con 0x7fc26c133ae0 2023-12-22T09:16:13.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.525+0000 7fc2697fa640 1 -- 172.21.15.106:0/2763568395 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc26400ab20 con 0x7fc26c133ae0 2023-12-22T09:16:13.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.525+0000 7fc2697fa640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc24c06a430 0x7fc24c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.526+0000 7fc2697fa640 1 -- 172.21.15.106:0/2763568395 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fc264088740 con 0x7fc26c133ae0 2023-12-22T09:16:13.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.526+0000 7fc26bfff640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc24c06a430 0x7fc24c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:13.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.526+0000 7fc26bfff640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc24c06a430 0x7fc24c06c8f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0639d0 tx=0x7fc25c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:13.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.530+0000 7fc2697fa640 1 -- 172.21.15.106:0/2763568395 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc2640537f0 con 0x7fc26c133ae0 2023-12-22T09:16:13.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.758+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc26c073f10 con 0x7fc26c133ae0 2023-12-22T09:16:13.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.759+0000 7fc2697fa640 1 -- 172.21.15.106:0/2763568395 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5779 (secure 0 0 0) 0x7fc264056e10 con 0x7fc26c133ae0 2023-12-22T09:16:13.760 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:13.760 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:15:55.115066+0000","modified":"2023-12-22T09:15:58.132101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6835/3435163215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3435163215},{"type":"v1","addr":"172.21.15.132:6835","nonce":3435163215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:10.238217+0000","modified":"2023-12-22T09:16:13.270608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4792":{"gid":4792,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T09:16:13.760 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 21 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc24c06a430 msgr2=0x7fc24c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc24c06a430 0x7fc24c06c8f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0639d0 tx=0x7fc25c008040 comp rx=0 tx=0).stop 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc26c133ae0 msgr2=0x7fc26c133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc26c133ae0 0x7fc26c133f70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc264001370 tx=0x7fc26400cc50 comp rx=0 tx=0).stop 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 shutdown_connections 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc24c06a430 0x7fc24c06c8f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc26c133ae0 0x7fc26c133f70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc26c151740 0x7fc26c0c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 --2- 172.21.15.106:0/2763568395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2580047c0 0x7fc26c0c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 >> 172.21.15.106:0/2763568395 conn(0x7fc26c0c5360 msgr2=0x7fc26c0aa920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:13.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 shutdown_connections 2023-12-22T09:16:13.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.762+0000 7fc2729d9640 1 -- 172.21.15.106:0/2763568395 wait complete. 2023-12-22T09:16:13.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:13.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.996+0000 7f4546b3c640 1 Processor -- start 2023-12-22T09:16:13.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.996+0000 7f4546b3c640 1 -- start start 2023-12-22T09:16:13.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f4546b3c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4540157c80 0x7f4540070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f4546b3c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45400be700 0x7f4540071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:13.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f4546b3c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4540153e90 con 0x7f4540069e60 2023-12-22T09:16:13.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f4546b3c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4540153c80 con 0x7f45400be700 2023-12-22T09:16:13.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f4546b3c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4540158240 con 0x7f4540157c80 2023-12-22T09:16:13.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f45448d8640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4540069e60 0x7f454013cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39226/0 (socket says 172.21.15.106:39226) 2023-12-22T09:16:13.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f45448d8640 1 -- 172.21.15.106:0/814253701 learned_addr learned my addr 172.21.15.106:0/814253701 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:13.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f453ffff640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4540157c80 0x7f4540070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:13.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f45450d9640 1 --2- 172.21.15.106:0/814253701 >> v2:172.21.15.132:3300/0 conn(0x7f45400be700 0x7f4540071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.998+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376553913 0 0) 0x7f4540153e90 con 0x7f4540069e60 2023-12-22T09:16:14.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4530003520 con 0x7f4540069e60 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701634630 0 0) 0x7f4530003520 con 0x7f4540069e60 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4540157c80 msgr2=0x7f4540070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4540157c80 0x7f4540070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 >> v2:172.21.15.132:3300/0 conn(0x7f45400be700 msgr2=0x7f4540071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 --2- 172.21.15.106:0/814253701 >> v2:172.21.15.132:3300/0 conn(0x7f45400be700 0x7f4540071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540154c10 con 0x7f4540069e60 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f45340017f0 con 0x7f4540069e60 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 >> v1:172.21.15.106:6789/0 conn(0x7f4540069e60 legacy=0x7f454013cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f4530003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45300047c0 0x7f4530004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4540157c80 0x7f4530005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4540153c80 con 0x7f4530003970 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4540158240 con 0x7f45300047c0 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453000b980 con 0x7f4540157c80 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:13.999+0000 7f45448d8640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f4530003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.000+0000 7f453ffff640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45300047c0 0x7f4530004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.000+0000 7f45450d9640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4540157c80 0x7f4530005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.000+0000 7f45448d8640 1 -- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4540157c80 msgr2=0x7f4530005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.000+0000 7f45448d8640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4540157c80 0x7f4530005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.000+0000 7f45448d8640 1 -- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45300047c0 msgr2=0x7f4530004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.000+0000 7f45448d8640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45300047c0 0x7f4530004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.000+0000 7f45448d8640 1 -- 172.21.15.106:0/814253701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4530003520 con 0x7f4530003970 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.001+0000 7f45448d8640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f4530003d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f453400c110 tx=0x7f45300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c5bfacaa415f77 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:14.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.001+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534007270 con 0x7f4530003970 2023-12-22T09:16:14.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.001+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45340073f0 con 0x7f4530003970 2023-12-22T09:16:14.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.001+0000 7f453f7fe640 1 -- 172.21.15.106:0/814253701 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453402c830 con 0x7f4530003970 2023-12-22T09:16:14.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.002+0000 7f4546b3c640 1 -- 172.21.15.106:0/814253701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 msgr2=0x7f4530003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.002+0000 7f4546b3c640 1 --2- 172.21.15.106:0/814253701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f4530003d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f453400c110 tx=0x7f45300057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.002+0000 7f45450d9640 1 -- 172.21.15.106:0/814253701 reap_dead start 2023-12-22T09:16:14.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.002+0000 7f4546b3c640 1 -- 172.21.15.106:0/814253701 shutdown_connections 2023-12-22T09:16:14.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.002+0000 7f4546b3c640 1 -- 172.21.15.106:0/814253701 >> 172.21.15.106:0/814253701 conn(0x7f45400c5360 msgr2=0x7f45400c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:14.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.002+0000 7f4546b3c640 1 -- 172.21.15.106:0/814253701 shutdown_connections 2023-12-22T09:16:14.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.002+0000 7f4546b3c640 1 -- 172.21.15.106:0/814253701 wait complete. 2023-12-22T09:16:14.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.004+0000 7f4546b3c640 1 Processor -- start 2023-12-22T09:16:14.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.004+0000 7f4546b3c640 1 -- start start 2023-12-22T09:16:14.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f4546b3c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f45401ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f4546b3c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45400c4060 0x7f454013b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f4546b3c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4540155cb0 0x7f4540156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f4546b3c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400a84b0 con 0x7f4530003970 2023-12-22T09:16:14.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f4546b3c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45401ed910 con 0x7f4540155cb0 2023-12-22T09:16:14.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f4546b3c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400c45d0 con 0x7f45400c4060 2023-12-22T09:16:14.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f45448d8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f45401ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f45448d8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f45401ed3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48126/0 (socket says 172.21.15.106:48126) 2023-12-22T09:16:14.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f45448d8640 1 -- 172.21.15.106:0/3824549636 learned_addr learned my addr 172.21.15.106:0/3824549636 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f453ffff640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45400c4060 0x7f454013b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f45450d9640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4540155cb0 0x7f4540156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f45448d8640 1 -- 172.21.15.106:0/3824549636 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45400c4060 msgr2=0x7f454013b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f45448d8640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45400c4060 0x7f454013b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.005+0000 7f45448d8640 1 -- 172.21.15.106:0/3824549636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4540155cb0 msgr2=0x7f4540156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.006+0000 7f45448d8640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4540155cb0 0x7f4540156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.006+0000 7f45448d8640 1 -- 172.21.15.106:0/3824549636 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45401551d0 con 0x7f4530003970 2023-12-22T09:16:14.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.006+0000 7f45448d8640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f45401ed3d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f453402c3d0 tx=0x7f4534001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.006+0000 7f453d7fa640 1 -- 172.21.15.106:0/3824549636 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534039030 con 0x7f4530003970 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.006+0000 7f453d7fa640 1 -- 172.21.15.106:0/3824549636 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453402cc40 con 0x7f4530003970 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.006+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45401554b0 con 0x7f4530003970 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.006+0000 7f453d7fa640 1 -- 172.21.15.106:0/3824549636 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453403c040 con 0x7f4530003970 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.006+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454013be40 con 0x7f4530003970 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.007+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4540073f10 con 0x7f4530003970 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.008+0000 7f453d7fa640 1 -- 172.21.15.106:0/3824549636 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4534032070 con 0x7f4530003970 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.009+0000 7f453d7fa640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452406a460 0x7f452406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.009+0000 7f453d7fa640 1 -- 172.21.15.106:0/3824549636 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f45340aa260 con 0x7f4530003970 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.009+0000 7f453ffff640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452406a460 0x7f452406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.010+0000 7f453ffff640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452406a460 0x7f452406c920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4540151540 tx=0x7f452c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:14.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.014+0000 7f453d7fa640 1 -- 172.21.15.106:0/3824549636 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f45340753c0 con 0x7f4530003970 2023-12-22T09:16:14.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.204+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f454013bfd0 con 0x7f4530003970 2023-12-22T09:16:14.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.205+0000 7f453d7fa640 1 -- 172.21.15.106:0/3824549636 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20070 (secure 0 0 0) 0x7f45340789e0 con 0x7f4530003970 2023-12-22T09:16:14.206 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:14.207 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:11.243405+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452406a460 msgr2=0x7f452406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452406a460 0x7f452406c920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4540151540 tx=0x7f452c008040 comp rx=0 tx=0).stop 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 msgr2=0x7f45401ed3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f45401ed3d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f453402c3d0 tx=0x7f4534001ab0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 shutdown_connections 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452406a460 0x7f452406c920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4540155cb0 0x7f4540156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45400c4060 0x7f454013b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 --2- 172.21.15.106:0/3824549636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4530003970 0x7f45401ed3d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 >> 172.21.15.106:0/3824549636 conn(0x7f45400c5360 msgr2=0x7f4540071940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:14.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 shutdown_connections 2023-12-22T09:16:14.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.208+0000 7f4546b3c640 1 -- 172.21.15.106:0/3824549636 wait complete. 2023-12-22T09:16:14.229 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T09:16:14.229 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:16:14.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.441+0000 7f63732db640 1 Processor -- start 2023-12-22T09:16:14.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.441+0000 7f63732db640 1 -- start start 2023-12-22T09:16:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.443+0000 7f63732db640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f636c0c4130 0x7f636c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.443+0000 7f63732db640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636c0c4660 con 0x7f636c06aad0 2023-12-22T09:16:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.443+0000 7f63732db640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636c153d60 con 0x7f636c1514b0 2023-12-22T09:16:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.443+0000 7f63732db640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c154c50 con 0x7f636c0c4130 2023-12-22T09:16:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.443+0000 7f6370876640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f636c0c4130 0x7f636c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.443+0000 7f6371878640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f636c06aad0 0x7f636c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39238/0 (socket says 172.21.15.106:39238) 2023-12-22T09:16:14.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.443+0000 7f6371878640 1 -- 172.21.15.106:0/1784515159 learned_addr learned my addr 172.21.15.106:0/1784515159 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.444+0000 7f6370876640 1 -- 172.21.15.106:0/1784515159 >> v1:172.21.15.132:6789/0 conn(0x7f636c1514b0 legacy=0x7f636c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.444+0000 7f6370876640 1 -- 172.21.15.106:0/1784515159 >> v1:172.21.15.106:6789/0 conn(0x7f636c06aad0 legacy=0x7f636c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.444+0000 7f6363fff640 1 -- 172.21.15.106:0/1784515159 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281382867 0 0) 0x7f636c0c4660 con 0x7f636c06aad0 2023-12-22T09:16:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.444+0000 7f6370876640 1 -- 172.21.15.106:0/1784515159 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c06b250 con 0x7f636c0c4130 2023-12-22T09:16:14.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.445+0000 7f6370876640 1 --2- 172.21.15.106:0/1784515159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 0x7f636c0c75b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f635c0097a0 tx=0x7f635c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5657bd225b26b2a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:14.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.445+0000 7f6363fff640 1 -- 172.21.15.106:0/1784515159 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c031830 con 0x7f636c0c4130 2023-12-22T09:16:14.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.445+0000 7f6363fff640 1 -- 172.21.15.106:0/1784515159 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c031990 con 0x7f636c0c4130 2023-12-22T09:16:14.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.445+0000 7f6363fff640 1 -- 172.21.15.106:0/1784515159 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c031d20 con 0x7f636c0c4130 2023-12-22T09:16:14.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.446+0000 7f63732db640 1 -- 172.21.15.106:0/1784515159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 msgr2=0x7f636c0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.446+0000 7f63732db640 1 --2- 172.21.15.106:0/1784515159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 0x7f636c0c75b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f635c0097a0 tx=0x7f635c02b8d0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.446+0000 7f63732db640 1 -- 172.21.15.106:0/1784515159 shutdown_connections 2023-12-22T09:16:14.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.446+0000 7f63732db640 1 --2- 172.21.15.106:0/1784515159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 0x7f636c0c75b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.446+0000 7f63732db640 1 -- 172.21.15.106:0/1784515159 >> 172.21.15.106:0/1784515159 conn(0x7f636c0ab1a0 msgr2=0x7f636c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:14.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.446+0000 7f63732db640 1 -- 172.21.15.106:0/1784515159 shutdown_connections 2023-12-22T09:16:14.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.446+0000 7f63732db640 1 -- 172.21.15.106:0/1784515159 wait complete. 2023-12-22T09:16:14.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.448+0000 7f63732db640 1 Processor -- start 2023-12-22T09:16:14.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.448+0000 7f63732db640 1 -- start start 2023-12-22T09:16:14.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f63732db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f636c06aad0 0x7f636c0ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f63732db640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 0x7f636c1ec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f63732db640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f636c1514b0 0x7f636c1ec620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f63732db640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0bdda0 con 0x7f636c0c4130 2023-12-22T09:16:14.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f63732db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0c0590 con 0x7f636c06aad0 2023-12-22T09:16:14.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f63732db640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0c02b0 con 0x7f636c1514b0 2023-12-22T09:16:14.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f6370876640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 0x7f636c1ec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f6370876640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 0x7f636c1ec0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48138/0 (socket says 172.21.15.106:48138) 2023-12-22T09:16:14.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f6370876640 1 -- 172.21.15.106:0/835110640 learned_addr learned my addr 172.21.15.106:0/835110640 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:14.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f6370876640 1 -- 172.21.15.106:0/835110640 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f636c1514b0 msgr2=0x7f636c1ec620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f6370876640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f636c1514b0 0x7f636c1ec620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f6371077640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f636c06aad0 0x7f636c0ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f6370876640 1 -- 172.21.15.106:0/835110640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f636c06aad0 msgr2=0x7f636c0ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f6370876640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f636c06aad0 0x7f636c0ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.449+0000 7f6370876640 1 -- 172.21.15.106:0/835110640 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c009400 con 0x7f636c0c4130 2023-12-22T09:16:14.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.450+0000 7f6370876640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 0x7f636c1ec0e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f635c000c00 tx=0x7f635c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:14.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.450+0000 7f6361ffb640 1 -- 172.21.15.106:0/835110640 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c03ca00 con 0x7f636c0c4130 2023-12-22T09:16:14.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.450+0000 7f6361ffb640 1 -- 172.21.15.106:0/835110640 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c03cb60 con 0x7f636c0c4130 2023-12-22T09:16:14.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.450+0000 7f6361ffb640 1 -- 172.21.15.106:0/835110640 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c004030 con 0x7f636c0c4130 2023-12-22T09:16:14.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.450+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c0bed30 con 0x7f636c0c4130 2023-12-22T09:16:14.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.450+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c0bf2f0 con 0x7f636c0c4130 2023-12-22T09:16:14.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.451+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c04e080 con 0x7f636c0c4130 2023-12-22T09:16:14.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.452+0000 7f6361ffb640 1 -- 172.21.15.106:0/835110640 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f635c004190 con 0x7f636c0c4130 2023-12-22T09:16:14.455 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.453+0000 7f6361ffb640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f635006a430 0x7f635006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.453+0000 7f6361ffb640 1 -- 172.21.15.106:0/835110640 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f635c0ab610 con 0x7f636c0c4130 2023-12-22T09:16:14.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.454+0000 7f6371077640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f635006a430 0x7f635006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.454+0000 7f6371077640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f635006a430 0x7f635006c8f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6368000f60 tx=0x7f6368009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:14.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.458+0000 7f6361ffb640 1 -- 172.21.15.106:0/835110640 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f635c076770 con 0x7f636c0c4130 2023-12-22T09:16:14.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.641+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f636c0bebb0 con 0x7f635006a430 2023-12-22T09:16:14.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.683+0000 7f6361ffb640 1 -- 172.21.15.106:0/835110640 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525798 (secure 0 0 0) 0x7f63680012f0 con 0x7f635006a430 2023-12-22T09:16:14.695 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:14.700 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.694+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f635006a430 msgr2=0x7f635006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.694+0000 7f63732db640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f635006a430 0x7f635006c8f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6368000f60 tx=0x7f6368009040 comp rx=0 tx=0).stop 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 msgr2=0x7f636c1ec0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 0x7f636c1ec0e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f635c000c00 tx=0x7f635c0046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 shutdown_connections 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f635006a430 0x7f635006c8f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f636c1514b0 0x7f636c1ec620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f636c0c4130 0x7f636c1ec0e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 --2- 172.21.15.106:0/835110640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f636c06aad0 0x7f636c0ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 >> 172.21.15.106:0/835110640 conn(0x7f636c0ab1a0 msgr2=0x7f636c0c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:14.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 shutdown_connections 2023-12-22T09:16:14.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.695+0000 7f63732db640 1 -- 172.21.15.106:0/835110640 wait complete. 2023-12-22T09:16:14.720 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-12-22T09:16:12.731477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596587,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":303,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220800,"kb_used_data":5184,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753920,"statfs":{"total":773094113280,"available":772868014080,"internally_reserved":0,"allocated":5308416,"data_stored":2966496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001318"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.430255+0000","last_change":"2023-12-22T09:16:10.287747+0000","last_active":"2023-12-22T09:16:11.430255+0000","last_peered":"2023-12-22T09:16:11.430255+0000","last_clean":"2023-12-22T09:16:11.430255+0000","last_became_active":"2023-12-22T09:16:10.287472+0000","last_became_peered":"2023-12-22T09:16:10.287472+0000","last_unstale":"2023-12-22T09:16:11.430255+0000","last_undegraded":"2023-12-22T09:16:11.430255+0000","last_fullsized":"2023-12-22T09:16:11.430255+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:52.944802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.259281+0000","last_change":"2023-12-22T09:15:55.143366+0000","last_active":"2023-12-22T09:16:10.259281+0000","last_peered":"2023-12-22T09:16:10.259281+0000","last_clean":"2023-12-22T09:16:10.259281+0000","last_became_active":"2023-12-22T09:15:55.142565+0000","last_became_peered":"2023-12-22T09:15:55.142565+0000","last_unstale":"2023-12-22T09:16:10.259281+0000","last_undegraded":"2023-12-22T09:16:10.259281+0000","last_fullsized":"2023-12-22T09:16:10.259281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:59:15.395576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424257+0000","last_change":"2023-12-22T09:16:10.266999+0000","last_active":"2023-12-22T09:16:11.424257+0000","last_peered":"2023-12-22T09:16:11.424257+0000","last_clean":"2023-12-22T09:16:11.424257+0000","last_became_active":"2023-12-22T09:16:10.266132+0000","last_became_peered":"2023-12-22T09:16:10.266132+0000","last_unstale":"2023-12-22T09:16:11.424257+0000","last_undegraded":"2023-12-22T09:16:11.424257+0000","last_fullsized":"2023-12-22T09:16:11.424257+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:22:16.109685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258988+0000","last_change":"2023-12-22T09:15:55.150939+0000","last_active":"2023-12-22T09:16:10.258988+0000","last_peered":"2023-12-22T09:16:10.258988+0000","last_clean":"2023-12-22T09:16:10.258988+0000","last_became_active":"2023-12-22T09:15:55.150675+0000","last_became_peered":"2023-12-22T09:15:55.150675+0000","last_unstale":"2023-12-22T09:16:10.258988+0000","last_undegraded":"2023-12-22T09:16:10.258988+0000","last_fullsized":"2023-12-22T09:16:10.258988+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:55.417006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424741+0000","last_change":"2023-12-22T09:16:10.288580+0000","last_active":"2023-12-22T09:16:11.424741+0000","last_peered":"2023-12-22T09:16:11.424741+0000","last_clean":"2023-12-22T09:16:11.424741+0000","last_became_active":"2023-12-22T09:16:10.288305+0000","last_became_peered":"2023-12-22T09:16:10.288305+0000","last_unstale":"2023-12-22T09:16:11.424741+0000","last_undegraded":"2023-12-22T09:16:11.424741+0000","last_fullsized":"2023-12-22T09:16:11.424741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:22.458879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270578+0000","last_change":"2023-12-22T09:15:55.166248+0000","last_active":"2023-12-22T09:16:10.270578+0000","last_peered":"2023-12-22T09:16:10.270578+0000","last_clean":"2023-12-22T09:16:10.270578+0000","last_became_active":"2023-12-22T09:15:55.165994+0000","last_became_peered":"2023-12-22T09:15:55.165994+0000","last_unstale":"2023-12-22T09:16:10.270578+0000","last_undegraded":"2023-12-22T09:16:10.270578+0000","last_fullsized":"2023-12-22T09:16:10.270578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267166+0000","last_change":"2023-12-22T09:16:10.279983+0000","last_active":"2023-12-22T09:16:11.267166+0000","last_peered":"2023-12-22T09:16:11.267166+0000","last_clean":"2023-12-22T09:16:11.267166+0000","last_became_active":"2023-12-22T09:16:10.279654+0000","last_became_peered":"2023-12-22T09:16:10.279654+0000","last_unstale":"2023-12-22T09:16:11.267166+0000","last_undegraded":"2023-12-22T09:16:11.267166+0000","last_fullsized":"2023-12-22T09:16:11.267166+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:51:01.263941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248686+0000","last_change":"2023-12-22T09:15:55.158634+0000","last_active":"2023-12-22T09:16:10.248686+0000","last_peered":"2023-12-22T09:16:10.248686+0000","last_clean":"2023-12-22T09:16:10.248686+0000","last_became_active":"2023-12-22T09:15:55.157672+0000","last_became_peered":"2023-12-22T09:15:55.157672+0000","last_unstale":"2023-12-22T09:16:10.248686+0000","last_undegraded":"2023-12-22T09:16:10.248686+0000","last_fullsized":"2023-12-22T09:16:10.248686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:50.284022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.272176+0000","last_change":"2023-12-22T09:16:10.270429+0000","last_active":"2023-12-22T09:16:11.272176+0000","last_peered":"2023-12-22T09:16:11.272176+0000","last_clean":"2023-12-22T09:16:11.272176+0000","last_became_active":"2023-12-22T09:16:10.270151+0000","last_became_peered":"2023-12-22T09:16:10.270151+0000","last_unstale":"2023-12-22T09:16:11.272176+0000","last_undegraded":"2023-12-22T09:16:11.272176+0000","last_fullsized":"2023-12-22T09:16:11.272176+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:51:47.561948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248431+0000","last_change":"2023-12-22T09:15:55.157645+0000","last_active":"2023-12-22T09:16:10.248431+0000","last_peered":"2023-12-22T09:16:10.248431+0000","last_clean":"2023-12-22T09:16:10.248431+0000","last_became_active":"2023-12-22T09:15:55.157416+0000","last_became_peered":"2023-12-22T09:15:55.157416+0000","last_unstale":"2023-12-22T09:16:10.248431+0000","last_undegraded":"2023-12-22T09:16:10.248431+0000","last_fullsized":"2023-12-22T09:16:10.248431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:30.809324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264086+0000","last_change":"2023-12-22T09:16:10.260222+0000","last_active":"2023-12-22T09:16:11.264086+0000","last_peered":"2023-12-22T09:16:11.264086+0000","last_clean":"2023-12-22T09:16:11.264086+0000","last_became_active":"2023-12-22T09:16:10.259822+0000","last_became_peered":"2023-12-22T09:16:10.259822+0000","last_unstale":"2023-12-22T09:16:11.264086+0000","last_undegraded":"2023-12-22T09:16:11.264086+0000","last_fullsized":"2023-12-22T09:16:11.264086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:48.425223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251913+0000","last_change":"2023-12-22T09:15:55.131493+0000","last_active":"2023-12-22T09:16:10.251913+0000","last_peered":"2023-12-22T09:16:10.251913+0000","last_clean":"2023-12-22T09:16:10.251913+0000","last_became_active":"2023-12-22T09:15:55.131210+0000","last_became_peered":"2023-12-22T09:15:55.131210+0000","last_unstale":"2023-12-22T09:16:10.251913+0000","last_undegraded":"2023-12-22T09:16:10.251913+0000","last_fullsized":"2023-12-22T09:16:10.251913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.265084+0000","last_change":"2023-12-22T09:16:10.281847+0000","last_active":"2023-12-22T09:16:11.265084+0000","last_peered":"2023-12-22T09:16:11.265084+0000","last_clean":"2023-12-22T09:16:11.265084+0000","last_became_active":"2023-12-22T09:16:10.281603+0000","last_became_peered":"2023-12-22T09:16:10.281603+0000","last_unstale":"2023-12-22T09:16:11.265084+0000","last_undegraded":"2023-12-22T09:16:11.265084+0000","last_fullsized":"2023-12-22T09:16:11.265084+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:41.487761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.264985+0000","last_change":"2023-12-22T09:15:55.152987+0000","last_active":"2023-12-22T09:16:10.264985+0000","last_peered":"2023-12-22T09:16:10.264985+0000","last_clean":"2023-12-22T09:16:10.264985+0000","last_became_active":"2023-12-22T09:15:55.152690+0000","last_became_peered":"2023-12-22T09:15:55.152690+0000","last_unstale":"2023-12-22T09:16:10.264985+0000","last_undegraded":"2023-12-22T09:16:10.264985+0000","last_fullsized":"2023-12-22T09:16:10.264985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:57.296942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425119+0000","last_change":"2023-12-22T09:16:10.281647+0000","last_active":"2023-12-22T09:16:11.425119+0000","last_peered":"2023-12-22T09:16:11.425119+0000","last_clean":"2023-12-22T09:16:11.425119+0000","last_became_active":"2023-12-22T09:16:10.281421+0000","last_became_peered":"2023-12-22T09:16:10.281421+0000","last_unstale":"2023-12-22T09:16:11.425119+0000","last_undegraded":"2023-12-22T09:16:11.425119+0000","last_fullsized":"2023-12-22T09:16:11.425119+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:44:13.645736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.255808+0000","last_change":"2023-12-22T09:15:55.148098+0000","last_active":"2023-12-22T09:16:10.255808+0000","last_peered":"2023-12-22T09:16:10.255808+0000","last_clean":"2023-12-22T09:16:10.255808+0000","last_became_active":"2023-12-22T09:15:55.147830+0000","last_became_peered":"2023-12-22T09:15:55.147830+0000","last_unstale":"2023-12-22T09:16:10.255808+0000","last_undegraded":"2023-12-22T09:16:10.255808+0000","last_fullsized":"2023-12-22T09:16:10.255808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:51:32.442849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267322+0000","last_change":"2023-12-22T09:16:10.282432+0000","last_active":"2023-12-22T09:16:11.267322+0000","last_peered":"2023-12-22T09:16:11.267322+0000","last_clean":"2023-12-22T09:16:11.267322+0000","last_became_active":"2023-12-22T09:16:10.280706+0000","last_became_peered":"2023-12-22T09:16:10.280706+0000","last_unstale":"2023-12-22T09:16:11.267322+0000","last_undegraded":"2023-12-22T09:16:11.267322+0000","last_fullsized":"2023-12-22T09:16:11.267322+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:44:13.645736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.276632+0000","last_change":"2023-12-22T09:15:55.166247+0000","last_active":"2023-12-22T09:16:10.276632+0000","last_peered":"2023-12-22T09:16:10.276632+0000","last_clean":"2023-12-22T09:16:10.276632+0000","last_became_active":"2023-12-22T09:15:55.165299+0000","last_became_peered":"2023-12-22T09:15:55.165299+0000","last_unstale":"2023-12-22T09:16:10.276632+0000","last_undegraded":"2023-12-22T09:16:10.276632+0000","last_fullsized":"2023-12-22T09:16:10.276632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.262354+0000","last_change":"2023-12-22T09:16:10.281248+0000","last_active":"2023-12-22T09:16:11.262354+0000","last_peered":"2023-12-22T09:16:11.262354+0000","last_clean":"2023-12-22T09:16:11.262354+0000","last_became_active":"2023-12-22T09:16:10.280988+0000","last_became_peered":"2023-12-22T09:16:10.280988+0000","last_unstale":"2023-12-22T09:16:11.262354+0000","last_undegraded":"2023-12-22T09:16:11.262354+0000","last_fullsized":"2023-12-22T09:16:11.262354+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:45:00.599099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267052+0000","last_change":"2023-12-22T09:15:55.164570+0000","last_active":"2023-12-22T09:16:10.267052+0000","last_peered":"2023-12-22T09:16:10.267052+0000","last_clean":"2023-12-22T09:16:10.267052+0000","last_became_active":"2023-12-22T09:15:55.164287+0000","last_became_peered":"2023-12-22T09:15:55.164287+0000","last_unstale":"2023-12-22T09:16:10.267052+0000","last_undegraded":"2023-12-22T09:16:10.267052+0000","last_fullsized":"2023-12-22T09:16:10.267052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:14.590975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.428032+0000","last_change":"2023-12-22T09:16:10.290243+0000","last_active":"2023-12-22T09:16:11.428032+0000","last_peered":"2023-12-22T09:16:11.428032+0000","last_clean":"2023-12-22T09:16:11.428032+0000","last_became_active":"2023-12-22T09:16:10.290025+0000","last_became_peered":"2023-12-22T09:16:10.290025+0000","last_unstale":"2023-12-22T09:16:11.428032+0000","last_undegraded":"2023-12-22T09:16:11.428032+0000","last_fullsized":"2023-12-22T09:16:11.428032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:40:55.811459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270695+0000","last_change":"2023-12-22T09:15:55.160606+0000","last_active":"2023-12-22T09:16:10.270695+0000","last_peered":"2023-12-22T09:16:10.270695+0000","last_clean":"2023-12-22T09:16:10.270695+0000","last_became_active":"2023-12-22T09:15:55.160309+0000","last_became_peered":"2023-12-22T09:15:55.160309+0000","last_unstale":"2023-12-22T09:16:10.270695+0000","last_undegraded":"2023-12-22T09:16:10.270695+0000","last_fullsized":"2023-12-22T09:16:10.270695+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:36.666191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424243+0000","last_change":"2023-12-22T09:16:10.274521+0000","last_active":"2023-12-22T09:16:11.424243+0000","last_peered":"2023-12-22T09:16:11.424243+0000","last_clean":"2023-12-22T09:16:11.424243+0000","last_became_active":"2023-12-22T09:16:10.274206+0000","last_became_peered":"2023-12-22T09:16:10.274206+0000","last_unstale":"2023-12-22T09:16:11.424243+0000","last_undegraded":"2023-12-22T09:16:11.424243+0000","last_fullsized":"2023-12-22T09:16:11.424243+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:35.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270256+0000","last_change":"2023-12-22T09:15:55.154556+0000","last_active":"2023-12-22T09:16:10.270256+0000","last_peered":"2023-12-22T09:16:10.270256+0000","last_clean":"2023-12-22T09:16:10.270256+0000","last_became_active":"2023-12-22T09:15:55.154239+0000","last_became_peered":"2023-12-22T09:15:55.154239+0000","last_unstale":"2023-12-22T09:16:10.270256+0000","last_undegraded":"2023-12-22T09:16:10.270256+0000","last_fullsized":"2023-12-22T09:16:10.270256+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268358+0000","last_change":"2023-12-22T09:16:10.290868+0000","last_active":"2023-12-22T09:16:11.268358+0000","last_peered":"2023-12-22T09:16:11.268358+0000","last_clean":"2023-12-22T09:16:11.268358+0000","last_became_active":"2023-12-22T09:16:10.290673+0000","last_became_peered":"2023-12-22T09:16:10.290673+0000","last_unstale":"2023-12-22T09:16:11.268358+0000","last_undegraded":"2023-12-22T09:16:11.268358+0000","last_fullsized":"2023-12-22T09:16:11.268358+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:14:16.220685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267114+0000","last_change":"2023-12-22T09:15:55.164877+0000","last_active":"2023-12-22T09:16:10.267114+0000","last_peered":"2023-12-22T09:16:10.267114+0000","last_clean":"2023-12-22T09:16:10.267114+0000","last_became_active":"2023-12-22T09:15:55.164136+0000","last_became_peered":"2023-12-22T09:15:55.164136+0000","last_unstale":"2023-12-22T09:16:10.267114+0000","last_undegraded":"2023-12-22T09:16:10.267114+0000","last_fullsized":"2023-12-22T09:16:10.267114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:51.891518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.432392+0000","last_change":"2023-12-22T09:16:10.285614+0000","last_active":"2023-12-22T09:16:11.432392+0000","last_peered":"2023-12-22T09:16:11.432392+0000","last_clean":"2023-12-22T09:16:11.432392+0000","last_became_active":"2023-12-22T09:16:10.284755+0000","last_became_peered":"2023-12-22T09:16:10.284755+0000","last_unstale":"2023-12-22T09:16:11.432392+0000","last_undegraded":"2023-12-22T09:16:11.432392+0000","last_fullsized":"2023-12-22T09:16:11.432392+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:49:55.673155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.262744+0000","last_change":"2023-12-22T09:15:55.150441+0000","last_active":"2023-12-22T09:16:10.262744+0000","last_peered":"2023-12-22T09:16:10.262744+0000","last_clean":"2023-12-22T09:16:10.262744+0000","last_became_active":"2023-12-22T09:15:55.150060+0000","last_became_peered":"2023-12-22T09:15:55.150060+0000","last_unstale":"2023-12-22T09:16:10.262744+0000","last_undegraded":"2023-12-22T09:16:10.262744+0000","last_fullsized":"2023-12-22T09:16:10.262744+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:51.891518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425274+0000","last_change":"2023-12-22T09:16:10.270409+0000","last_active":"2023-12-22T09:16:11.425274+0000","last_peered":"2023-12-22T09:16:11.425274+0000","last_clean":"2023-12-22T09:16:11.425274+0000","last_became_active":"2023-12-22T09:16:10.265764+0000","last_became_peered":"2023-12-22T09:16:10.265764+0000","last_unstale":"2023-12-22T09:16:11.425274+0000","last_undegraded":"2023-12-22T09:16:11.425274+0000","last_fullsized":"2023-12-22T09:16:11.425274+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:40:55.811459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.265081+0000","last_change":"2023-12-22T09:15:55.162023+0000","last_active":"2023-12-22T09:16:10.265081+0000","last_peered":"2023-12-22T09:16:10.265081+0000","last_clean":"2023-12-22T09:16:10.265081+0000","last_became_active":"2023-12-22T09:15:55.161365+0000","last_became_peered":"2023-12-22T09:15:55.161365+0000","last_unstale":"2023-12-22T09:16:10.265081+0000","last_undegraded":"2023-12-22T09:16:10.265081+0000","last_fullsized":"2023-12-22T09:16:10.265081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:30.946693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.433891+0000","last_change":"2023-12-22T09:16:10.281978+0000","last_active":"2023-12-22T09:16:11.433891+0000","last_peered":"2023-12-22T09:16:11.433891+0000","last_clean":"2023-12-22T09:16:11.433891+0000","last_became_active":"2023-12-22T09:16:10.281683+0000","last_became_peered":"2023-12-22T09:16:10.281683+0000","last_unstale":"2023-12-22T09:16:11.433891+0000","last_undegraded":"2023-12-22T09:16:11.433891+0000","last_fullsized":"2023-12-22T09:16:11.433891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:22:16.109685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266764+0000","last_change":"2023-12-22T09:15:55.157211+0000","last_active":"2023-12-22T09:16:10.266764+0000","last_peered":"2023-12-22T09:16:10.266764+0000","last_clean":"2023-12-22T09:16:10.266764+0000","last_became_active":"2023-12-22T09:15:55.156865+0000","last_became_peered":"2023-12-22T09:15:55.156865+0000","last_unstale":"2023-12-22T09:16:10.266764+0000","last_undegraded":"2023-12-22T09:16:10.266764+0000","last_fullsized":"2023-12-22T09:16:10.266764+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:37.962424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267144+0000","last_change":"2023-12-22T09:16:10.291510+0000","last_active":"2023-12-22T09:16:11.267144+0000","last_peered":"2023-12-22T09:16:11.267144+0000","last_clean":"2023-12-22T09:16:11.267144+0000","last_became_active":"2023-12-22T09:16:10.291178+0000","last_became_peered":"2023-12-22T09:16:10.291178+0000","last_unstale":"2023-12-22T09:16:11.267144+0000","last_undegraded":"2023-12-22T09:16:11.267144+0000","last_fullsized":"2023-12-22T09:16:11.267144+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:22.458879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272006+0000","last_change":"2023-12-22T09:15:55.148229+0000","last_active":"2023-12-22T09:16:10.272006+0000","last_peered":"2023-12-22T09:16:10.272006+0000","last_clean":"2023-12-22T09:16:10.272006+0000","last_became_active":"2023-12-22T09:15:55.147954+0000","last_became_peered":"2023-12-22T09:15:55.147954+0000","last_unstale":"2023-12-22T09:16:10.272006+0000","last_undegraded":"2023-12-22T09:16:10.272006+0000","last_fullsized":"2023-12-22T09:16:10.272006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426997+0000","last_change":"2023-12-22T09:16:10.270464+0000","last_active":"2023-12-22T09:16:11.426997+0000","last_peered":"2023-12-22T09:16:11.426997+0000","last_clean":"2023-12-22T09:16:11.426997+0000","last_became_active":"2023-12-22T09:16:10.270115+0000","last_became_peered":"2023-12-22T09:16:10.270115+0000","last_unstale":"2023-12-22T09:16:11.426997+0000","last_undegraded":"2023-12-22T09:16:11.426997+0000","last_fullsized":"2023-12-22T09:16:11.426997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:14:54.123508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.756072+0000","last_change":"2023-12-22T09:15:55.158945+0000","last_active":"2023-12-22T09:16:09.756072+0000","last_peered":"2023-12-22T09:16:09.756072+0000","last_clean":"2023-12-22T09:16:09.756072+0000","last_became_active":"2023-12-22T09:15:55.158673+0000","last_became_peered":"2023-12-22T09:15:55.158673+0000","last_unstale":"2023-12-22T09:16:09.756072+0000","last_undegraded":"2023-12-22T09:16:09.756072+0000","last_fullsized":"2023-12-22T09:16:09.756072+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:02:09.511521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268724+0000","last_change":"2023-12-22T09:16:10.291014+0000","last_active":"2023-12-22T09:16:11.268724+0000","last_peered":"2023-12-22T09:16:11.268724+0000","last_clean":"2023-12-22T09:16:11.268724+0000","last_became_active":"2023-12-22T09:16:10.290860+0000","last_became_peered":"2023-12-22T09:16:10.290860+0000","last_unstale":"2023-12-22T09:16:11.268724+0000","last_undegraded":"2023-12-22T09:16:11.268724+0000","last_fullsized":"2023-12-22T09:16:11.268724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:35.591774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.250633+0000","last_change":"2023-12-22T09:15:55.154647+0000","last_active":"2023-12-22T09:16:10.250633+0000","last_peered":"2023-12-22T09:16:10.250633+0000","last_clean":"2023-12-22T09:16:10.250633+0000","last_became_active":"2023-12-22T09:15:55.154331+0000","last_became_peered":"2023-12-22T09:15:55.154331+0000","last_unstale":"2023-12-22T09:16:10.250633+0000","last_undegraded":"2023-12-22T09:16:10.250633+0000","last_fullsized":"2023-12-22T09:16:10.250633+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:08:11.667144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.432560+0000","last_change":"2023-12-22T09:16:10.284759+0000","last_active":"2023-12-22T09:16:11.432560+0000","last_peered":"2023-12-22T09:16:11.432560+0000","last_clean":"2023-12-22T09:16:11.432560+0000","last_became_active":"2023-12-22T09:16:10.284476+0000","last_became_peered":"2023-12-22T09:16:10.284476+0000","last_unstale":"2023-12-22T09:16:11.432560+0000","last_undegraded":"2023-12-22T09:16:11.432560+0000","last_fullsized":"2023-12-22T09:16:11.432560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:44:13.645736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.764263+0000","last_change":"2023-12-22T09:15:55.160338+0000","last_active":"2023-12-22T09:16:09.764263+0000","last_peered":"2023-12-22T09:16:09.764263+0000","last_clean":"2023-12-22T09:16:09.764263+0000","last_became_active":"2023-12-22T09:15:55.159705+0000","last_became_peered":"2023-12-22T09:15:55.159705+0000","last_unstale":"2023-12-22T09:16:09.764263+0000","last_undegraded":"2023-12-22T09:16:09.764263+0000","last_fullsized":"2023-12-22T09:16:09.764263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:34:05.506636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425263+0000","last_change":"2023-12-22T09:16:10.279334+0000","last_active":"2023-12-22T09:16:11.425263+0000","last_peered":"2023-12-22T09:16:11.425263+0000","last_clean":"2023-12-22T09:16:11.425263+0000","last_became_active":"2023-12-22T09:16:10.279035+0000","last_became_peered":"2023-12-22T09:16:10.279035+0000","last_unstale":"2023-12-22T09:16:11.425263+0000","last_undegraded":"2023-12-22T09:16:11.425263+0000","last_fullsized":"2023-12-22T09:16:11.425263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:42:53.326372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267214+0000","last_change":"2023-12-22T09:15:55.154883+0000","last_active":"2023-12-22T09:16:10.267214+0000","last_peered":"2023-12-22T09:16:10.267214+0000","last_clean":"2023-12-22T09:16:10.267214+0000","last_became_active":"2023-12-22T09:15:55.154588+0000","last_became_peered":"2023-12-22T09:15:55.154588+0000","last_unstale":"2023-12-22T09:16:10.267214+0000","last_undegraded":"2023-12-22T09:16:10.267214+0000","last_fullsized":"2023-12-22T09:16:10.267214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:40.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.269564+0000","last_change":"2023-12-22T09:16:10.263071+0000","last_active":"2023-12-22T09:16:10.269564+0000","last_peered":"2023-12-22T09:16:10.269564+0000","last_clean":"2023-12-22T09:16:10.269564+0000","last_became_active":"2023-12-22T09:16:10.262773+0000","last_became_peered":"2023-12-22T09:16:10.262773+0000","last_unstale":"2023-12-22T09:16:10.269564+0000","last_undegraded":"2023-12-22T09:16:10.269564+0000","last_fullsized":"2023-12-22T09:16:10.269564+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:00.420958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.263271+0000","last_change":"2023-12-22T09:15:55.156853+0000","last_active":"2023-12-22T09:16:10.263271+0000","last_peered":"2023-12-22T09:16:10.263271+0000","last_clean":"2023-12-22T09:16:10.263271+0000","last_became_active":"2023-12-22T09:15:55.156575+0000","last_became_peered":"2023-12-22T09:15:55.156575+0000","last_unstale":"2023-12-22T09:16:10.263271+0000","last_undegraded":"2023-12-22T09:16:10.263271+0000","last_fullsized":"2023-12-22T09:16:10.263271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:59.232942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267859+0000","last_change":"2023-12-22T09:16:10.286004+0000","last_active":"2023-12-22T09:16:11.267859+0000","last_peered":"2023-12-22T09:16:11.267859+0000","last_clean":"2023-12-22T09:16:11.267859+0000","last_became_active":"2023-12-22T09:16:10.285776+0000","last_became_peered":"2023-12-22T09:16:10.285776+0000","last_unstale":"2023-12-22T09:16:11.267859+0000","last_undegraded":"2023-12-22T09:16:11.267859+0000","last_fullsized":"2023-12-22T09:16:11.267859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:57.781728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272283+0000","last_change":"2023-12-22T09:15:55.149854+0000","last_active":"2023-12-22T09:16:10.272283+0000","last_peered":"2023-12-22T09:16:10.272283+0000","last_clean":"2023-12-22T09:16:10.272283+0000","last_became_active":"2023-12-22T09:15:55.149383+0000","last_became_peered":"2023-12-22T09:15:55.149383+0000","last_unstale":"2023-12-22T09:16:10.272283+0000","last_undegraded":"2023-12-22T09:16:10.272283+0000","last_fullsized":"2023-12-22T09:16:10.272283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:38:09.607747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264766+0000","last_change":"2023-12-22T09:16:10.265008+0000","last_active":"2023-12-22T09:16:11.264766+0000","last_peered":"2023-12-22T09:16:11.264766+0000","last_clean":"2023-12-22T09:16:11.264766+0000","last_became_active":"2023-12-22T09:16:10.264574+0000","last_became_peered":"2023-12-22T09:16:10.264574+0000","last_unstale":"2023-12-22T09:16:11.264766+0000","last_undegraded":"2023-12-22T09:16:11.264766+0000","last_fullsized":"2023-12-22T09:16:11.264766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:29:31.999438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.247987+0000","last_change":"2023-12-22T09:15:55.159003+0000","last_active":"2023-12-22T09:16:10.247987+0000","last_peered":"2023-12-22T09:16:10.247987+0000","last_clean":"2023-12-22T09:16:10.247987+0000","last_became_active":"2023-12-22T09:15:55.158806+0000","last_became_peered":"2023-12-22T09:15:55.158806+0000","last_unstale":"2023-12-22T09:16:10.247987+0000","last_undegraded":"2023-12-22T09:16:10.247987+0000","last_fullsized":"2023-12-22T09:16:10.247987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:17.416418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.266038+0000","last_change":"2023-12-22T09:16:10.275244+0000","last_active":"2023-12-22T09:16:11.266038+0000","last_peered":"2023-12-22T09:16:11.266038+0000","last_clean":"2023-12-22T09:16:11.266038+0000","last_became_active":"2023-12-22T09:16:10.274484+0000","last_became_peered":"2023-12-22T09:16:10.274484+0000","last_unstale":"2023-12-22T09:16:11.266038+0000","last_undegraded":"2023-12-22T09:16:11.266038+0000","last_fullsized":"2023-12-22T09:16:11.266038+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:22.165936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.758803+0000","last_change":"2023-12-22T09:15:55.141689+0000","last_active":"2023-12-22T09:16:09.758803+0000","last_peered":"2023-12-22T09:16:09.758803+0000","last_clean":"2023-12-22T09:16:09.758803+0000","last_became_active":"2023-12-22T09:15:55.141370+0000","last_became_peered":"2023-12-22T09:15:55.141370+0000","last_unstale":"2023-12-22T09:16:09.758803+0000","last_undegraded":"2023-12-22T09:16:09.758803+0000","last_fullsized":"2023-12-22T09:16:09.758803+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:46:11.778416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.266711+0000","last_change":"2023-12-22T09:16:10.289192+0000","last_active":"2023-12-22T09:16:11.266711+0000","last_peered":"2023-12-22T09:16:11.266711+0000","last_clean":"2023-12-22T09:16:11.266711+0000","last_became_active":"2023-12-22T09:16:10.288944+0000","last_became_peered":"2023-12-22T09:16:10.288944+0000","last_unstale":"2023-12-22T09:16:11.266711+0000","last_undegraded":"2023-12-22T09:16:11.266711+0000","last_fullsized":"2023-12-22T09:16:11.266711+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:06.507360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251104+0000","last_change":"2023-12-22T09:15:55.164805+0000","last_active":"2023-12-22T09:16:10.251104+0000","last_peered":"2023-12-22T09:16:10.251104+0000","last_clean":"2023-12-22T09:16:10.251104+0000","last_became_active":"2023-12-22T09:15:55.164583+0000","last_became_peered":"2023-12-22T09:15:55.164583+0000","last_unstale":"2023-12-22T09:16:10.251104+0000","last_undegraded":"2023-12-22T09:16:10.251104+0000","last_fullsized":"2023-12-22T09:16:10.251104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.276269+0000","last_change":"2023-12-22T09:16:10.268674+0000","last_active":"2023-12-22T09:16:10.276269+0000","last_peered":"2023-12-22T09:16:10.276269+0000","last_clean":"2023-12-22T09:16:10.276269+0000","last_became_active":"2023-12-22T09:16:10.268002+0000","last_became_peered":"2023-12-22T09:16:10.268002+0000","last_unstale":"2023-12-22T09:16:10.276269+0000","last_undegraded":"2023-12-22T09:16:10.276269+0000","last_fullsized":"2023-12-22T09:16:10.276269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:15.802261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.762624+0000","last_change":"2023-12-22T09:15:55.156206+0000","last_active":"2023-12-22T09:16:09.762624+0000","last_peered":"2023-12-22T09:16:09.762624+0000","last_clean":"2023-12-22T09:16:09.762624+0000","last_became_active":"2023-12-22T09:15:55.155875+0000","last_became_peered":"2023-12-22T09:15:55.155875+0000","last_unstale":"2023-12-22T09:16:09.762624+0000","last_undegraded":"2023-12-22T09:16:09.762624+0000","last_fullsized":"2023-12-22T09:16:09.762624+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:29.348560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.263426+0000","last_change":"2023-12-22T09:16:10.280591+0000","last_active":"2023-12-22T09:16:11.263426+0000","last_peered":"2023-12-22T09:16:11.263426+0000","last_clean":"2023-12-22T09:16:11.263426+0000","last_became_active":"2023-12-22T09:16:10.280305+0000","last_became_peered":"2023-12-22T09:16:10.280305+0000","last_unstale":"2023-12-22T09:16:11.263426+0000","last_undegraded":"2023-12-22T09:16:11.263426+0000","last_fullsized":"2023-12-22T09:16:11.263426+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:31.348386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.269164+0000","last_change":"2023-12-22T09:15:55.153391+0000","last_active":"2023-12-22T09:16:10.269164+0000","last_peered":"2023-12-22T09:16:10.269164+0000","last_clean":"2023-12-22T09:16:10.269164+0000","last_became_active":"2023-12-22T09:15:55.153161+0000","last_became_peered":"2023-12-22T09:15:55.153161+0000","last_unstale":"2023-12-22T09:16:10.269164+0000","last_undegraded":"2023-12-22T09:16:10.269164+0000","last_fullsized":"2023-12-22T09:16:10.269164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268582+0000","last_change":"2023-12-22T09:16:10.290774+0000","last_active":"2023-12-22T09:16:11.268582+0000","last_peered":"2023-12-22T09:16:11.268582+0000","last_clean":"2023-12-22T09:16:11.268582+0000","last_became_active":"2023-12-22T09:16:10.290611+0000","last_became_peered":"2023-12-22T09:16:10.290611+0000","last_unstale":"2023-12-22T09:16:11.268582+0000","last_undegraded":"2023-12-22T09:16:11.268582+0000","last_fullsized":"2023-12-22T09:16:11.268582+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:51:40.239522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.765148+0000","last_change":"2023-12-22T09:15:55.138160+0000","last_active":"2023-12-22T09:16:09.765148+0000","last_peered":"2023-12-22T09:16:09.765148+0000","last_clean":"2023-12-22T09:16:09.765148+0000","last_became_active":"2023-12-22T09:15:55.137859+0000","last_became_peered":"2023-12-22T09:15:55.137859+0000","last_unstale":"2023-12-22T09:16:09.765148+0000","last_undegraded":"2023-12-22T09:16:09.765148+0000","last_fullsized":"2023-12-22T09:16:09.765148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:37:03.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.285958+0000","last_change":"2023-12-22T09:16:10.280626+0000","last_active":"2023-12-22T09:16:10.285958+0000","last_peered":"2023-12-22T09:16:10.285958+0000","last_clean":"2023-12-22T09:16:10.285958+0000","last_became_active":"2023-12-22T09:16:10.280381+0000","last_became_peered":"2023-12-22T09:16:10.280381+0000","last_unstale":"2023-12-22T09:16:10.285958+0000","last_undegraded":"2023-12-22T09:16:10.285958+0000","last_fullsized":"2023-12-22T09:16:10.285958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:38:55.989666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.764128+0000","last_change":"2023-12-22T09:15:55.133273+0000","last_active":"2023-12-22T09:16:09.764128+0000","last_peered":"2023-12-22T09:16:09.764128+0000","last_clean":"2023-12-22T09:16:09.764128+0000","last_became_active":"2023-12-22T09:15:55.132514+0000","last_became_peered":"2023-12-22T09:15:55.132514+0000","last_unstale":"2023-12-22T09:16:09.764128+0000","last_undegraded":"2023-12-22T09:16:09.764128+0000","last_fullsized":"2023-12-22T09:16:09.764128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:07.778320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267697+0000","last_change":"2023-12-22T09:16:10.282735+0000","last_active":"2023-12-22T09:16:11.267697+0000","last_peered":"2023-12-22T09:16:11.267697+0000","last_clean":"2023-12-22T09:16:11.267697+0000","last_became_active":"2023-12-22T09:16:10.282154+0000","last_became_peered":"2023-12-22T09:16:10.282154+0000","last_unstale":"2023-12-22T09:16:11.267697+0000","last_undegraded":"2023-12-22T09:16:11.267697+0000","last_fullsized":"2023-12-22T09:16:11.267697+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:30.220686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272264+0000","last_change":"2023-12-22T09:15:55.149676+0000","last_active":"2023-12-22T09:16:10.272264+0000","last_peered":"2023-12-22T09:16:10.272264+0000","last_clean":"2023-12-22T09:16:10.272264+0000","last_became_active":"2023-12-22T09:15:55.148929+0000","last_became_peered":"2023-12-22T09:15:55.148929+0000","last_unstale":"2023-12-22T09:16:10.272264+0000","last_undegraded":"2023-12-22T09:16:10.272264+0000","last_fullsized":"2023-12-22T09:16:10.272264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.434070+0000","last_change":"2023-12-22T09:16:10.283138+0000","last_active":"2023-12-22T09:16:11.434070+0000","last_peered":"2023-12-22T09:16:11.434070+0000","last_clean":"2023-12-22T09:16:11.434070+0000","last_became_active":"2023-12-22T09:16:10.282802+0000","last_became_peered":"2023-12-22T09:16:10.282802+0000","last_unstale":"2023-12-22T09:16:11.434070+0000","last_undegraded":"2023-12-22T09:16:11.434070+0000","last_fullsized":"2023-12-22T09:16:11.434070+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:35.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249202+0000","last_change":"2023-12-22T09:15:55.150973+0000","last_active":"2023-12-22T09:16:10.249202+0000","last_peered":"2023-12-22T09:16:10.249202+0000","last_clean":"2023-12-22T09:16:10.249202+0000","last_became_active":"2023-12-22T09:15:55.150358+0000","last_became_peered":"2023-12-22T09:15:55.150358+0000","last_unstale":"2023-12-22T09:16:10.249202+0000","last_undegraded":"2023-12-22T09:16:10.249202+0000","last_fullsized":"2023-12-22T09:16:10.249202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.283705+0000","last_change":"2023-12-22T09:16:10.279659+0000","last_active":"2023-12-22T09:16:10.283705+0000","last_peered":"2023-12-22T09:16:10.283705+0000","last_clean":"2023-12-22T09:16:10.283705+0000","last_became_active":"2023-12-22T09:16:10.279167+0000","last_became_peered":"2023-12-22T09:16:10.279167+0000","last_unstale":"2023-12-22T09:16:10.283705+0000","last_undegraded":"2023-12-22T09:16:10.283705+0000","last_fullsized":"2023-12-22T09:16:10.283705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:44:20.340636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425690+0000","last_change":"2023-12-22T09:16:09.784658+0000","last_active":"2023-12-22T09:16:11.425690+0000","last_peered":"2023-12-22T09:16:11.425690+0000","last_clean":"2023-12-22T09:16:11.425690+0000","last_became_active":"2023-12-22T09:16:09.784290+0000","last_became_peered":"2023-12-22T09:16:09.784290+0000","last_unstale":"2023-12-22T09:16:11.425690+0000","last_undegraded":"2023-12-22T09:16:11.425690+0000","last_fullsized":"2023-12-22T09:16:11.425690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:57.339802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.273222+0000","last_change":"2023-12-22T09:15:55.166209+0000","last_active":"2023-12-22T09:16:10.273222+0000","last_peered":"2023-12-22T09:16:10.273222+0000","last_clean":"2023-12-22T09:16:10.273222+0000","last_became_active":"2023-12-22T09:15:55.165918+0000","last_became_peered":"2023-12-22T09:15:55.165918+0000","last_unstale":"2023-12-22T09:16:10.273222+0000","last_undegraded":"2023-12-22T09:16:10.273222+0000","last_fullsized":"2023-12-22T09:16:10.273222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.759089+0000","last_change":"2023-12-22T09:15:54.667477+0000","last_active":"2023-12-22T09:16:09.759089+0000","last_peered":"2023-12-22T09:16:09.759089+0000","last_clean":"2023-12-22T09:16:09.759089+0000","last_became_active":"2023-12-22T09:15:54.667221+0000","last_became_peered":"2023-12-22T09:15:54.667221+0000","last_unstale":"2023-12-22T09:16:09.759089+0000","last_undegraded":"2023-12-22T09:16:09.759089+0000","last_fullsized":"2023-12-22T09:16:09.759089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:24.188717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.263831+0000","last_change":"2023-12-22T09:16:10.265238+0000","last_active":"2023-12-22T09:16:11.263831+0000","last_peered":"2023-12-22T09:16:11.263831+0000","last_clean":"2023-12-22T09:16:11.263831+0000","last_became_active":"2023-12-22T09:16:10.262912+0000","last_became_peered":"2023-12-22T09:16:10.262912+0000","last_unstale":"2023-12-22T09:16:11.263831+0000","last_undegraded":"2023-12-22T09:16:11.263831+0000","last_fullsized":"2023-12-22T09:16:11.263831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:25.628702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.428230+0000","last_change":"2023-12-22T09:16:09.785331+0000","last_active":"2023-12-22T09:16:11.428230+0000","last_peered":"2023-12-22T09:16:11.428230+0000","last_clean":"2023-12-22T09:16:11.428230+0000","last_became_active":"2023-12-22T09:16:09.784464+0000","last_became_peered":"2023-12-22T09:16:09.784464+0000","last_unstale":"2023-12-22T09:16:11.428230+0000","last_undegraded":"2023-12-22T09:16:11.428230+0000","last_fullsized":"2023-12-22T09:16:11.428230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:05:44.480599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249813+0000","last_change":"2023-12-22T09:15:55.165566+0000","last_active":"2023-12-22T09:16:10.249813+0000","last_peered":"2023-12-22T09:16:10.249813+0000","last_clean":"2023-12-22T09:16:10.249813+0000","last_became_active":"2023-12-22T09:15:55.165257+0000","last_became_peered":"2023-12-22T09:15:55.165257+0000","last_unstale":"2023-12-22T09:16:10.249813+0000","last_undegraded":"2023-12-22T09:16:10.249813+0000","last_fullsized":"2023-12-22T09:16:10.249813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:08.180891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.271024+0000","last_change":"2023-12-22T09:15:54.671228+0000","last_active":"2023-12-22T09:16:10.271024+0000","last_peered":"2023-12-22T09:16:10.271024+0000","last_clean":"2023-12-22T09:16:10.271024+0000","last_became_active":"2023-12-22T09:15:54.670158+0000","last_became_peered":"2023-12-22T09:15:54.670158+0000","last_unstale":"2023-12-22T09:16:10.271024+0000","last_undegraded":"2023-12-22T09:16:10.271024+0000","last_fullsized":"2023-12-22T09:16:10.271024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.429954+0000","last_change":"2023-12-22T09:16:10.275878+0000","last_active":"2023-12-22T09:16:11.429954+0000","last_peered":"2023-12-22T09:16:11.429954+0000","last_clean":"2023-12-22T09:16:11.429954+0000","last_became_active":"2023-12-22T09:16:10.275638+0000","last_became_peered":"2023-12-22T09:16:10.275638+0000","last_unstale":"2023-12-22T09:16:11.429954+0000","last_undegraded":"2023-12-22T09:16:11.429954+0000","last_fullsized":"2023-12-22T09:16:11.429954+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:22.458879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"43'4","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.283814+0000","last_change":"2023-12-22T09:16:09.782069+0000","last_active":"2023-12-22T09:16:10.283814+0000","last_peered":"2023-12-22T09:16:10.283814+0000","last_clean":"2023-12-22T09:16:10.283814+0000","last_became_active":"2023-12-22T09:16:09.781084+0000","last_became_peered":"2023-12-22T09:16:09.781084+0000","last_unstale":"2023-12-22T09:16:10.283814+0000","last_undegraded":"2023-12-22T09:16:10.283814+0000","last_fullsized":"2023-12-22T09:16:10.283814+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:11:20.469907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267118+0000","last_change":"2023-12-22T09:15:55.155575+0000","last_active":"2023-12-22T09:16:10.267118+0000","last_peered":"2023-12-22T09:16:10.267118+0000","last_clean":"2023-12-22T09:16:10.267118+0000","last_became_active":"2023-12-22T09:15:55.154127+0000","last_became_peered":"2023-12-22T09:15:55.154127+0000","last_unstale":"2023-12-22T09:16:10.267118+0000","last_undegraded":"2023-12-22T09:16:10.267118+0000","last_fullsized":"2023-12-22T09:16:10.267118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:30.946693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249947+0000","last_change":"2023-12-22T09:15:54.671283+0000","last_active":"2023-12-22T09:16:10.249947+0000","last_peered":"2023-12-22T09:16:10.249947+0000","last_clean":"2023-12-22T09:16:10.249947+0000","last_became_active":"2023-12-22T09:15:54.671022+0000","last_became_peered":"2023-12-22T09:15:54.671022+0000","last_unstale":"2023-12-22T09:16:10.249947+0000","last_undegraded":"2023-12-22T09:16:10.249947+0000","last_fullsized":"2023-12-22T09:16:10.249947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:29:31.303313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426691+0000","last_change":"2023-12-22T09:16:10.278245+0000","last_active":"2023-12-22T09:16:11.426691+0000","last_peered":"2023-12-22T09:16:11.426691+0000","last_clean":"2023-12-22T09:16:11.426691+0000","last_became_active":"2023-12-22T09:16:10.277958+0000","last_became_peered":"2023-12-22T09:16:10.277958+0000","last_unstale":"2023-12-22T09:16:11.426691+0000","last_undegraded":"2023-12-22T09:16:11.426691+0000","last_fullsized":"2023-12-22T09:16:11.426691+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:07:40.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425349+0000","last_change":"2023-12-22T09:16:09.791997+0000","last_active":"2023-12-22T09:16:11.425349+0000","last_peered":"2023-12-22T09:16:11.425349+0000","last_clean":"2023-12-22T09:16:11.425349+0000","last_became_active":"2023-12-22T09:16:09.786143+0000","last_became_peered":"2023-12-22T09:16:09.786143+0000","last_unstale":"2023-12-22T09:16:11.425349+0000","last_undegraded":"2023-12-22T09:16:11.425349+0000","last_fullsized":"2023-12-22T09:16:11.425349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:10:11.728352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.259162+0000","last_change":"2023-12-22T09:15:55.143879+0000","last_active":"2023-12-22T09:16:10.259162+0000","last_peered":"2023-12-22T09:16:10.259162+0000","last_clean":"2023-12-22T09:16:10.259162+0000","last_became_active":"2023-12-22T09:15:55.143628+0000","last_became_peered":"2023-12-22T09:15:55.143628+0000","last_unstale":"2023-12-22T09:16:10.259162+0000","last_undegraded":"2023-12-22T09:16:10.259162+0000","last_fullsized":"2023-12-22T09:16:10.259162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:51.081158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266096+0000","last_change":"2023-12-22T09:15:54.671933+0000","last_active":"2023-12-22T09:16:10.266096+0000","last_peered":"2023-12-22T09:16:10.266096+0000","last_clean":"2023-12-22T09:16:10.266096+0000","last_became_active":"2023-12-22T09:15:54.671561+0000","last_became_peered":"2023-12-22T09:15:54.671561+0000","last_unstale":"2023-12-22T09:16:10.266096+0000","last_undegraded":"2023-12-22T09:16:10.266096+0000","last_fullsized":"2023-12-22T09:16:10.266096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:29.793501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.265400+0000","last_change":"2023-12-22T09:16:10.264853+0000","last_active":"2023-12-22T09:16:11.265400+0000","last_peered":"2023-12-22T09:16:11.265400+0000","last_clean":"2023-12-22T09:16:11.265400+0000","last_became_active":"2023-12-22T09:16:10.264257+0000","last_became_peered":"2023-12-22T09:16:10.264257+0000","last_unstale":"2023-12-22T09:16:11.265400+0000","last_undegraded":"2023-12-22T09:16:11.265400+0000","last_fullsized":"2023-12-22T09:16:11.265400+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:14.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.252183+0000","last_change":"2023-12-22T09:16:09.777600+0000","last_active":"2023-12-22T09:16:10.252183+0000","last_peered":"2023-12-22T09:16:10.252183+0000","last_clean":"2023-12-22T09:16:10.252183+0000","last_became_active":"2023-12-22T09:16:09.776824+0000","last_became_peered":"2023-12-22T09:16:09.776824+0000","last_unstale":"2023-12-22T09:16:10.252183+0000","last_undegraded":"2023-12-22T09:16:10.252183+0000","last_fullsized":"2023-12-22T09:16:10.252183+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:12:42.979533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270462+0000","last_change":"2023-12-22T09:15:55.146289+0000","last_active":"2023-12-22T09:16:10.270462+0000","last_peered":"2023-12-22T09:16:10.270462+0000","last_clean":"2023-12-22T09:16:10.270462+0000","last_became_active":"2023-12-22T09:15:55.146028+0000","last_became_peered":"2023-12-22T09:15:55.146028+0000","last_unstale":"2023-12-22T09:16:10.270462+0000","last_undegraded":"2023-12-22T09:16:10.270462+0000","last_fullsized":"2023-12-22T09:16:10.270462+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:30.809324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267313+0000","last_change":"2023-12-22T09:15:54.676125+0000","last_active":"2023-12-22T09:16:10.267313+0000","last_peered":"2023-12-22T09:16:10.267313+0000","last_clean":"2023-12-22T09:16:10.267313+0000","last_became_active":"2023-12-22T09:15:54.675809+0000","last_became_peered":"2023-12-22T09:15:54.675809+0000","last_unstale":"2023-12-22T09:16:10.267313+0000","last_undegraded":"2023-12-22T09:16:10.267313+0000","last_fullsized":"2023-12-22T09:16:10.267313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:29:31.303313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.434313+0000","last_change":"2023-12-22T09:16:10.294447+0000","last_active":"2023-12-22T09:16:11.434313+0000","last_peered":"2023-12-22T09:16:11.434313+0000","last_clean":"2023-12-22T09:16:11.434313+0000","last_became_active":"2023-12-22T09:16:10.293584+0000","last_became_peered":"2023-12-22T09:16:10.293584+0000","last_unstale":"2023-12-22T09:16:11.434313+0000","last_undegraded":"2023-12-22T09:16:11.434313+0000","last_fullsized":"2023-12-22T09:16:11.434313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:07:40.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.266422+0000","last_change":"2023-12-22T09:16:09.785196+0000","last_active":"2023-12-22T09:16:11.266422+0000","last_peered":"2023-12-22T09:16:11.266422+0000","last_clean":"2023-12-22T09:16:11.266422+0000","last_became_active":"2023-12-22T09:16:09.784947+0000","last_became_peered":"2023-12-22T09:16:09.784947+0000","last_unstale":"2023-12-22T09:16:11.266422+0000","last_undegraded":"2023-12-22T09:16:11.266422+0000","last_fullsized":"2023-12-22T09:16:11.266422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:50:22.723361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.265166+0000","last_change":"2023-12-22T09:15:55.148381+0000","last_active":"2023-12-22T09:16:10.265166+0000","last_peered":"2023-12-22T09:16:10.265166+0000","last_clean":"2023-12-22T09:16:10.265166+0000","last_became_active":"2023-12-22T09:15:55.148034+0000","last_became_peered":"2023-12-22T09:15:55.148034+0000","last_unstale":"2023-12-22T09:16:10.265166+0000","last_undegraded":"2023-12-22T09:16:10.265166+0000","last_fullsized":"2023-12-22T09:16:10.265166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:25.241349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270331+0000","last_change":"2023-12-22T09:15:54.674806+0000","last_active":"2023-12-22T09:16:10.270331+0000","last_peered":"2023-12-22T09:16:10.270331+0000","last_clean":"2023-12-22T09:16:10.270331+0000","last_became_active":"2023-12-22T09:15:54.673649+0000","last_became_peered":"2023-12-22T09:15:54.673649+0000","last_unstale":"2023-12-22T09:16:10.270331+0000","last_undegraded":"2023-12-22T09:16:10.270331+0000","last_fullsized":"2023-12-22T09:16:10.270331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:08.829353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426193+0000","last_change":"2023-12-22T09:16:10.291696+0000","last_active":"2023-12-22T09:16:11.426193+0000","last_peered":"2023-12-22T09:16:11.426193+0000","last_clean":"2023-12-22T09:16:11.426193+0000","last_became_active":"2023-12-22T09:16:10.291358+0000","last_became_peered":"2023-12-22T09:16:10.291358+0000","last_unstale":"2023-12-22T09:16:11.426193+0000","last_undegraded":"2023-12-22T09:16:11.426193+0000","last_fullsized":"2023-12-22T09:16:11.426193+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:44:13.645736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268007+0000","last_change":"2023-12-22T09:16:09.788858+0000","last_active":"2023-12-22T09:16:11.268007+0000","last_peered":"2023-12-22T09:16:11.268007+0000","last_clean":"2023-12-22T09:16:11.268007+0000","last_became_active":"2023-12-22T09:16:09.788590+0000","last_became_peered":"2023-12-22T09:16:09.788590+0000","last_unstale":"2023-12-22T09:16:11.268007+0000","last_undegraded":"2023-12-22T09:16:11.268007+0000","last_fullsized":"2023-12-22T09:16:11.268007+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:43:00.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.263087+0000","last_change":"2023-12-22T09:15:55.167800+0000","last_active":"2023-12-22T09:16:10.263087+0000","last_peered":"2023-12-22T09:16:10.263087+0000","last_clean":"2023-12-22T09:16:10.263087+0000","last_became_active":"2023-12-22T09:15:55.167492+0000","last_became_peered":"2023-12-22T09:15:55.167492+0000","last_unstale":"2023-12-22T09:16:10.263087+0000","last_undegraded":"2023-12-22T09:16:10.263087+0000","last_fullsized":"2023-12-22T09:16:10.263087+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:14.590975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249186+0000","last_change":"2023-12-22T09:15:54.677140+0000","last_active":"2023-12-22T09:16:10.249186+0000","last_peered":"2023-12-22T09:16:10.249186+0000","last_clean":"2023-12-22T09:16:10.249186+0000","last_became_active":"2023-12-22T09:15:54.676892+0000","last_became_peered":"2023-12-22T09:15:54.676892+0000","last_unstale":"2023-12-22T09:16:10.249186+0000","last_undegraded":"2023-12-22T09:16:10.249186+0000","last_fullsized":"2023-12-22T09:16:10.249186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:29.702956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.433668+0000","last_change":"2023-12-22T09:16:10.284760+0000","last_active":"2023-12-22T09:16:11.433668+0000","last_peered":"2023-12-22T09:16:11.433668+0000","last_clean":"2023-12-22T09:16:11.433668+0000","last_became_active":"2023-12-22T09:16:10.284512+0000","last_became_peered":"2023-12-22T09:16:10.284512+0000","last_unstale":"2023-12-22T09:16:11.433668+0000","last_undegraded":"2023-12-22T09:16:11.433668+0000","last_fullsized":"2023-12-22T09:16:11.433668+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:40:55.811459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426105+0000","last_change":"2023-12-22T09:16:09.781795+0000","last_active":"2023-12-22T09:16:11.426105+0000","last_peered":"2023-12-22T09:16:11.426105+0000","last_clean":"2023-12-22T09:16:11.426105+0000","last_became_active":"2023-12-22T09:16:09.781351+0000","last_became_peered":"2023-12-22T09:16:09.781351+0000","last_unstale":"2023-12-22T09:16:11.426105+0000","last_undegraded":"2023-12-22T09:16:11.426105+0000","last_fullsized":"2023-12-22T09:16:11.426105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:55:09.027625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258086+0000","last_change":"2023-12-22T09:15:55.135433+0000","last_active":"2023-12-22T09:16:10.258086+0000","last_peered":"2023-12-22T09:16:10.258086+0000","last_clean":"2023-12-22T09:16:10.258086+0000","last_became_active":"2023-12-22T09:15:55.135160+0000","last_became_peered":"2023-12-22T09:15:55.135160+0000","last_unstale":"2023-12-22T09:16:10.258086+0000","last_undegraded":"2023-12-22T09:16:10.258086+0000","last_fullsized":"2023-12-22T09:16:10.258086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:43.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.261013+0000","last_change":"2023-12-22T09:15:54.665511+0000","last_active":"2023-12-22T09:16:10.261013+0000","last_peered":"2023-12-22T09:16:10.261013+0000","last_clean":"2023-12-22T09:16:10.261013+0000","last_became_active":"2023-12-22T09:15:54.665202+0000","last_became_peered":"2023-12-22T09:15:54.665202+0000","last_unstale":"2023-12-22T09:16:10.261013+0000","last_undegraded":"2023-12-22T09:16:10.261013+0000","last_fullsized":"2023-12-22T09:16:10.261013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:00.147710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267439+0000","last_change":"2023-12-22T09:16:10.277900+0000","last_active":"2023-12-22T09:16:11.267439+0000","last_peered":"2023-12-22T09:16:11.267439+0000","last_clean":"2023-12-22T09:16:11.267439+0000","last_became_active":"2023-12-22T09:16:10.277666+0000","last_became_peered":"2023-12-22T09:16:10.277666+0000","last_unstale":"2023-12-22T09:16:11.267439+0000","last_undegraded":"2023-12-22T09:16:11.267439+0000","last_fullsized":"2023-12-22T09:16:11.267439+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:07:40.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"43'3","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.433380+0000","last_change":"2023-12-22T09:16:09.785358+0000","last_active":"2023-12-22T09:16:11.433380+0000","last_peered":"2023-12-22T09:16:11.433380+0000","last_clean":"2023-12-22T09:16:11.433380+0000","last_became_active":"2023-12-22T09:16:09.784903+0000","last_became_peered":"2023-12-22T09:16:09.784903+0000","last_unstale":"2023-12-22T09:16:11.433380+0000","last_undegraded":"2023-12-22T09:16:11.433380+0000","last_fullsized":"2023-12-22T09:16:11.433380+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:45.237557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248894+0000","last_change":"2023-12-22T09:15:55.158570+0000","last_active":"2023-12-22T09:16:10.248894+0000","last_peered":"2023-12-22T09:16:10.248894+0000","last_clean":"2023-12-22T09:16:10.248894+0000","last_became_active":"2023-12-22T09:15:55.157438+0000","last_became_peered":"2023-12-22T09:15:55.157438+0000","last_unstale":"2023-12-22T09:16:10.248894+0000","last_undegraded":"2023-12-22T09:16:10.248894+0000","last_fullsized":"2023-12-22T09:16:10.248894+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:37.962424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.259422+0000","last_change":"2023-12-22T09:15:54.659045+0000","last_active":"2023-12-22T09:16:10.259422+0000","last_peered":"2023-12-22T09:16:10.259422+0000","last_clean":"2023-12-22T09:16:10.259422+0000","last_became_active":"2023-12-22T09:15:54.658790+0000","last_became_peered":"2023-12-22T09:15:54.658790+0000","last_unstale":"2023-12-22T09:16:10.259422+0000","last_undegraded":"2023-12-22T09:16:10.259422+0000","last_fullsized":"2023-12-22T09:16:10.259422+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:37.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.428270+0000","last_change":"2023-12-22T09:16:10.280448+0000","last_active":"2023-12-22T09:16:11.428270+0000","last_peered":"2023-12-22T09:16:11.428270+0000","last_clean":"2023-12-22T09:16:11.428270+0000","last_became_active":"2023-12-22T09:16:10.278841+0000","last_became_peered":"2023-12-22T09:16:10.278841+0000","last_unstale":"2023-12-22T09:16:11.428270+0000","last_undegraded":"2023-12-22T09:16:11.428270+0000","last_fullsized":"2023-12-22T09:16:11.428270+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:52.944802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.263978+0000","last_change":"2023-12-22T09:16:09.776515+0000","last_active":"2023-12-22T09:16:11.263978+0000","last_peered":"2023-12-22T09:16:11.263978+0000","last_clean":"2023-12-22T09:16:11.263978+0000","last_became_active":"2023-12-22T09:16:09.775181+0000","last_became_peered":"2023-12-22T09:16:09.775181+0000","last_unstale":"2023-12-22T09:16:11.263978+0000","last_undegraded":"2023-12-22T09:16:11.263978+0000","last_fullsized":"2023-12-22T09:16:11.263978+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:30:49.569227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272571+0000","last_change":"2023-12-22T09:15:55.157643+0000","last_active":"2023-12-22T09:16:10.272571+0000","last_peered":"2023-12-22T09:16:10.272571+0000","last_clean":"2023-12-22T09:16:10.272571+0000","last_became_active":"2023-12-22T09:15:55.157227+0000","last_became_peered":"2023-12-22T09:15:55.157227+0000","last_unstale":"2023-12-22T09:16:10.272571+0000","last_undegraded":"2023-12-22T09:16:10.272571+0000","last_fullsized":"2023-12-22T09:16:10.272571+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:08.180891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267271+0000","last_change":"2023-12-22T09:15:54.676788+0000","last_active":"2023-12-22T09:16:10.267271+0000","last_peered":"2023-12-22T09:16:10.267271+0000","last_clean":"2023-12-22T09:16:10.267271+0000","last_became_active":"2023-12-22T09:15:54.676521+0000","last_became_peered":"2023-12-22T09:15:54.676521+0000","last_unstale":"2023-12-22T09:16:10.267271+0000","last_undegraded":"2023-12-22T09:16:10.267271+0000","last_fullsized":"2023-12-22T09:16:10.267271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:10:18.309697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425638+0000","last_change":"2023-12-22T09:16:10.285684+0000","last_active":"2023-12-22T09:16:11.425638+0000","last_peered":"2023-12-22T09:16:11.425638+0000","last_clean":"2023-12-22T09:16:11.425638+0000","last_became_active":"2023-12-22T09:16:10.284227+0000","last_became_peered":"2023-12-22T09:16:10.284227+0000","last_unstale":"2023-12-22T09:16:11.425638+0000","last_undegraded":"2023-12-22T09:16:11.425638+0000","last_fullsized":"2023-12-22T09:16:11.425638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:35.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.434410+0000","last_change":"2023-12-22T09:16:09.782613+0000","last_active":"2023-12-22T09:16:11.434410+0000","last_peered":"2023-12-22T09:16:11.434410+0000","last_clean":"2023-12-22T09:16:11.434410+0000","last_became_active":"2023-12-22T09:16:09.782307+0000","last_became_peered":"2023-12-22T09:16:09.782307+0000","last_unstale":"2023-12-22T09:16:11.434410+0000","last_undegraded":"2023-12-22T09:16:11.434410+0000","last_fullsized":"2023-12-22T09:16:11.434410+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:12.327698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270872+0000","last_change":"2023-12-22T09:15:55.150296+0000","last_active":"2023-12-22T09:16:10.270872+0000","last_peered":"2023-12-22T09:16:10.270872+0000","last_clean":"2023-12-22T09:16:10.270872+0000","last_became_active":"2023-12-22T09:15:55.150002+0000","last_became_peered":"2023-12-22T09:15:55.150002+0000","last_unstale":"2023-12-22T09:16:10.270872+0000","last_undegraded":"2023-12-22T09:16:10.270872+0000","last_fullsized":"2023-12-22T09:16:10.270872+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:38:09.607747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.271313+0000","last_change":"2023-12-22T09:15:54.734307+0000","last_active":"2023-12-22T09:16:10.271313+0000","last_peered":"2023-12-22T09:16:10.271313+0000","last_clean":"2023-12-22T09:16:10.271313+0000","last_became_active":"2023-12-22T09:15:54.733912+0000","last_became_peered":"2023-12-22T09:15:54.733912+0000","last_unstale":"2023-12-22T09:16:10.271313+0000","last_undegraded":"2023-12-22T09:16:10.271313+0000","last_fullsized":"2023-12-22T09:16:10.271313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:29.702956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426662+0000","last_change":"2023-12-22T09:16:10.284680+0000","last_active":"2023-12-22T09:16:11.426662+0000","last_peered":"2023-12-22T09:16:11.426662+0000","last_clean":"2023-12-22T09:16:11.426662+0000","last_became_active":"2023-12-22T09:16:10.284432+0000","last_became_peered":"2023-12-22T09:16:10.284432+0000","last_unstale":"2023-12-22T09:16:11.426662+0000","last_undegraded":"2023-12-22T09:16:11.426662+0000","last_fullsized":"2023-12-22T09:16:11.426662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:06.507360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426270+0000","last_change":"2023-12-22T09:16:09.795470+0000","last_active":"2023-12-22T09:16:11.426270+0000","last_peered":"2023-12-22T09:16:11.426270+0000","last_clean":"2023-12-22T09:16:11.426270+0000","last_became_active":"2023-12-22T09:16:09.795155+0000","last_became_peered":"2023-12-22T09:16:09.795155+0000","last_unstale":"2023-12-22T09:16:11.426270+0000","last_undegraded":"2023-12-22T09:16:11.426270+0000","last_fullsized":"2023-12-22T09:16:11.426270+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:05:44.480599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266454+0000","last_change":"2023-12-22T09:15:55.161558+0000","last_active":"2023-12-22T09:16:10.266454+0000","last_peered":"2023-12-22T09:16:10.266454+0000","last_clean":"2023-12-22T09:16:10.266454+0000","last_became_active":"2023-12-22T09:15:55.161234+0000","last_became_peered":"2023-12-22T09:15:55.161234+0000","last_unstale":"2023-12-22T09:16:10.266454+0000","last_undegraded":"2023-12-22T09:16:10.266454+0000","last_fullsized":"2023-12-22T09:16:10.266454+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:40.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'8","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258140+0000","last_change":"2023-12-22T09:15:54.667080+0000","last_active":"2023-12-22T09:16:10.258140+0000","last_peered":"2023-12-22T09:16:10.258140+0000","last_clean":"2023-12-22T09:16:10.258140+0000","last_became_active":"2023-12-22T09:15:54.666810+0000","last_became_peered":"2023-12-22T09:15:54.666810+0000","last_unstale":"2023-12-22T09:16:10.258140+0000","last_undegraded":"2023-12-22T09:16:10.258140+0000","last_fullsized":"2023-12-22T09:16:10.258140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:26.702306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.265001+0000","last_change":"2023-12-22T09:16:10.269909+0000","last_active":"2023-12-22T09:16:11.265001+0000","last_peered":"2023-12-22T09:16:11.265001+0000","last_clean":"2023-12-22T09:16:11.265001+0000","last_became_active":"2023-12-22T09:16:10.269614+0000","last_became_peered":"2023-12-22T09:16:10.269614+0000","last_unstale":"2023-12-22T09:16:11.265001+0000","last_undegraded":"2023-12-22T09:16:11.265001+0000","last_fullsized":"2023-12-22T09:16:11.265001+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:34.716420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.430494+0000","last_change":"2023-12-22T09:16:09.783531+0000","last_active":"2023-12-22T09:16:11.430494+0000","last_peered":"2023-12-22T09:16:11.430494+0000","last_clean":"2023-12-22T09:16:11.430494+0000","last_became_active":"2023-12-22T09:16:09.782039+0000","last_became_peered":"2023-12-22T09:16:09.782039+0000","last_unstale":"2023-12-22T09:16:11.430494+0000","last_undegraded":"2023-12-22T09:16:11.430494+0000","last_fullsized":"2023-12-22T09:16:11.430494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:57.339802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270556+0000","last_change":"2023-12-22T09:15:55.148900+0000","last_active":"2023-12-22T09:16:10.270556+0000","last_peered":"2023-12-22T09:16:10.270556+0000","last_clean":"2023-12-22T09:16:10.270556+0000","last_became_active":"2023-12-22T09:15:55.148615+0000","last_became_peered":"2023-12-22T09:15:55.148615+0000","last_unstale":"2023-12-22T09:16:10.270556+0000","last_undegraded":"2023-12-22T09:16:10.270556+0000","last_fullsized":"2023-12-22T09:16:10.270556+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258357+0000","last_change":"2023-12-22T09:15:54.654891+0000","last_active":"2023-12-22T09:16:10.258357+0000","last_peered":"2023-12-22T09:16:10.258357+0000","last_clean":"2023-12-22T09:16:10.258357+0000","last_became_active":"2023-12-22T09:15:54.654648+0000","last_became_peered":"2023-12-22T09:15:54.654648+0000","last_unstale":"2023-12-22T09:16:10.258357+0000","last_undegraded":"2023-12-22T09:16:10.258357+0000","last_fullsized":"2023-12-22T09:16:10.258357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:24.225526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.271082+0000","last_change":"2023-12-22T09:16:10.282894+0000","last_active":"2023-12-22T09:16:11.271082+0000","last_peered":"2023-12-22T09:16:11.271082+0000","last_clean":"2023-12-22T09:16:11.271082+0000","last_became_active":"2023-12-22T09:16:10.282501+0000","last_became_peered":"2023-12-22T09:16:10.282501+0000","last_unstale":"2023-12-22T09:16:11.271082+0000","last_undegraded":"2023-12-22T09:16:11.271082+0000","last_fullsized":"2023-12-22T09:16:11.271082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:26:20.795815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"43'8","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.262529+0000","last_change":"2023-12-22T09:16:09.777436+0000","last_active":"2023-12-22T09:16:11.262529+0000","last_peered":"2023-12-22T09:16:11.262529+0000","last_clean":"2023-12-22T09:16:11.262529+0000","last_became_active":"2023-12-22T09:16:09.777114+0000","last_became_peered":"2023-12-22T09:16:09.777114+0000","last_unstale":"2023-12-22T09:16:11.262529+0000","last_undegraded":"2023-12-22T09:16:11.262529+0000","last_fullsized":"2023-12-22T09:16:11.262529+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:14:53.107919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.254770+0000","last_change":"2023-12-22T09:15:55.144394+0000","last_active":"2023-12-22T09:16:10.254770+0000","last_peered":"2023-12-22T09:16:10.254770+0000","last_clean":"2023-12-22T09:16:10.254770+0000","last_became_active":"2023-12-22T09:15:55.143235+0000","last_became_peered":"2023-12-22T09:15:55.143235+0000","last_unstale":"2023-12-22T09:16:10.254770+0000","last_undegraded":"2023-12-22T09:16:10.254770+0000","last_fullsized":"2023-12-22T09:16:10.254770+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:07.046838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251965+0000","last_change":"2023-12-22T09:15:54.674073+0000","last_active":"2023-12-22T09:16:10.251965+0000","last_peered":"2023-12-22T09:16:10.251965+0000","last_clean":"2023-12-22T09:16:10.251965+0000","last_became_active":"2023-12-22T09:15:54.673820+0000","last_became_peered":"2023-12-22T09:15:54.673820+0000","last_unstale":"2023-12-22T09:16:10.251965+0000","last_undegraded":"2023-12-22T09:16:10.251965+0000","last_fullsized":"2023-12-22T09:16:10.251965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:38.639959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.427862+0000","last_change":"2023-12-22T09:16:10.279072+0000","last_active":"2023-12-22T09:16:11.427862+0000","last_peered":"2023-12-22T09:16:11.427862+0000","last_clean":"2023-12-22T09:16:11.427862+0000","last_became_active":"2023-12-22T09:16:10.278243+0000","last_became_peered":"2023-12-22T09:16:10.278243+0000","last_unstale":"2023-12-22T09:16:11.427862+0000","last_undegraded":"2023-12-22T09:16:11.427862+0000","last_fullsized":"2023-12-22T09:16:11.427862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:51:01.263941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.270812+0000","last_change":"2023-12-22T09:16:09.782812+0000","last_active":"2023-12-22T09:16:11.270812+0000","last_peered":"2023-12-22T09:16:11.270812+0000","last_clean":"2023-12-22T09:16:11.270812+0000","last_became_active":"2023-12-22T09:16:09.782512+0000","last_became_peered":"2023-12-22T09:16:09.782512+0000","last_unstale":"2023-12-22T09:16:11.270812+0000","last_undegraded":"2023-12-22T09:16:11.270812+0000","last_fullsized":"2023-12-22T09:16:11.270812+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:36.284381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270207+0000","last_change":"2023-12-22T09:15:55.151156+0000","last_active":"2023-12-22T09:16:10.270207+0000","last_peered":"2023-12-22T09:16:10.270207+0000","last_clean":"2023-12-22T09:16:10.270207+0000","last_became_active":"2023-12-22T09:15:55.150859+0000","last_became_peered":"2023-12-22T09:15:55.150859+0000","last_unstale":"2023-12-22T09:16:10.270207+0000","last_undegraded":"2023-12-22T09:16:10.270207+0000","last_fullsized":"2023-12-22T09:16:10.270207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:50.284022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.757699+0000","last_change":"2023-12-22T09:15:54.666683+0000","last_active":"2023-12-22T09:16:09.757699+0000","last_peered":"2023-12-22T09:16:09.757699+0000","last_clean":"2023-12-22T09:16:09.757699+0000","last_became_active":"2023-12-22T09:15:54.666419+0000","last_became_peered":"2023-12-22T09:15:54.666419+0000","last_unstale":"2023-12-22T09:16:09.757699+0000","last_undegraded":"2023-12-22T09:16:09.757699+0000","last_fullsized":"2023-12-22T09:16:09.757699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:25.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268735+0000","last_change":"2023-12-22T09:16:10.277004+0000","last_active":"2023-12-22T09:16:11.268735+0000","last_peered":"2023-12-22T09:16:11.268735+0000","last_clean":"2023-12-22T09:16:11.268735+0000","last_became_active":"2023-12-22T09:16:10.276637+0000","last_became_peered":"2023-12-22T09:16:10.276637+0000","last_unstale":"2023-12-22T09:16:11.268735+0000","last_undegraded":"2023-12-22T09:16:11.268735+0000","last_fullsized":"2023-12-22T09:16:11.268735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:08:08.054912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.253361+0000","last_change":"2023-12-22T09:16:09.780863+0000","last_active":"2023-12-22T09:16:10.253361+0000","last_peered":"2023-12-22T09:16:10.253361+0000","last_clean":"2023-12-22T09:16:10.253361+0000","last_became_active":"2023-12-22T09:16:09.780556+0000","last_became_peered":"2023-12-22T09:16:09.780556+0000","last_unstale":"2023-12-22T09:16:10.253361+0000","last_undegraded":"2023-12-22T09:16:10.253361+0000","last_fullsized":"2023-12-22T09:16:10.253361+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:28.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258177+0000","last_change":"2023-12-22T09:15:55.141694+0000","last_active":"2023-12-22T09:16:10.258177+0000","last_peered":"2023-12-22T09:16:10.258177+0000","last_clean":"2023-12-22T09:16:10.258177+0000","last_became_active":"2023-12-22T09:15:55.141460+0000","last_became_peered":"2023-12-22T09:15:55.141460+0000","last_unstale":"2023-12-22T09:16:10.258177+0000","last_undegraded":"2023-12-22T09:16:10.258177+0000","last_fullsized":"2023-12-22T09:16:10.258177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:14:34.300486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266797+0000","last_change":"2023-12-22T09:15:54.670469+0000","last_active":"2023-12-22T09:16:10.266797+0000","last_peered":"2023-12-22T09:16:10.266797+0000","last_clean":"2023-12-22T09:16:10.266797+0000","last_became_active":"2023-12-22T09:15:54.670183+0000","last_became_peered":"2023-12-22T09:15:54.670183+0000","last_unstale":"2023-12-22T09:16:10.266797+0000","last_undegraded":"2023-12-22T09:16:10.266797+0000","last_fullsized":"2023-12-22T09:16:10.266797+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425963+0000","last_change":"2023-12-22T09:16:10.291879+0000","last_active":"2023-12-22T09:16:11.425963+0000","last_peered":"2023-12-22T09:16:11.425963+0000","last_clean":"2023-12-22T09:16:11.425963+0000","last_became_active":"2023-12-22T09:16:10.291537+0000","last_became_peered":"2023-12-22T09:16:10.291537+0000","last_unstale":"2023-12-22T09:16:11.425963+0000","last_undegraded":"2023-12-22T09:16:11.425963+0000","last_fullsized":"2023-12-22T09:16:11.425963+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:22.458879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.273010+0000","last_change":"2023-12-22T09:16:09.779782+0000","last_active":"2023-12-22T09:16:10.273010+0000","last_peered":"2023-12-22T09:16:10.273010+0000","last_clean":"2023-12-22T09:16:10.273010+0000","last_became_active":"2023-12-22T09:16:09.779471+0000","last_became_peered":"2023-12-22T09:16:09.779471+0000","last_unstale":"2023-12-22T09:16:10.273010+0000","last_undegraded":"2023-12-22T09:16:10.273010+0000","last_fullsized":"2023-12-22T09:16:10.273010+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:01:41.703695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258108+0000","last_change":"2023-12-22T09:15:55.135884+0000","last_active":"2023-12-22T09:16:10.258108+0000","last_peered":"2023-12-22T09:16:10.258108+0000","last_clean":"2023-12-22T09:16:10.258108+0000","last_became_active":"2023-12-22T09:15:55.135599+0000","last_became_peered":"2023-12-22T09:15:55.135599+0000","last_unstale":"2023-12-22T09:16:10.258108+0000","last_undegraded":"2023-12-22T09:16:10.258108+0000","last_fullsized":"2023-12-22T09:16:10.258108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:23.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.268125+0000","last_change":"2023-12-22T09:15:54.675247+0000","last_active":"2023-12-22T09:16:10.268125+0000","last_peered":"2023-12-22T09:16:10.268125+0000","last_clean":"2023-12-22T09:16:10.268125+0000","last_became_active":"2023-12-22T09:15:54.674964+0000","last_became_peered":"2023-12-22T09:15:54.674964+0000","last_unstale":"2023-12-22T09:16:10.268125+0000","last_undegraded":"2023-12-22T09:16:10.268125+0000","last_fullsized":"2023-12-22T09:16:10.268125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:14.720567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425302+0000","last_change":"2023-12-22T09:16:10.264674+0000","last_active":"2023-12-22T09:16:11.425302+0000","last_peered":"2023-12-22T09:16:11.425302+0000","last_clean":"2023-12-22T09:16:11.425302+0000","last_became_active":"2023-12-22T09:16:10.264061+0000","last_became_peered":"2023-12-22T09:16:10.264061+0000","last_unstale":"2023-12-22T09:16:11.425302+0000","last_undegraded":"2023-12-22T09:16:11.425302+0000","last_fullsized":"2023-12-22T09:16:11.425302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:52.944802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.255380+0000","last_change":"2023-12-22T09:16:09.785281+0000","last_active":"2023-12-22T09:16:10.255380+0000","last_peered":"2023-12-22T09:16:10.255380+0000","last_clean":"2023-12-22T09:16:10.255380+0000","last_became_active":"2023-12-22T09:16:09.785035+0000","last_became_peered":"2023-12-22T09:16:09.785035+0000","last_unstale":"2023-12-22T09:16:10.255380+0000","last_undegraded":"2023-12-22T09:16:10.255380+0000","last_fullsized":"2023-12-22T09:16:10.255380+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:40:32.414006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270811+0000","last_change":"2023-12-22T09:15:55.159520+0000","last_active":"2023-12-22T09:16:10.270811+0000","last_peered":"2023-12-22T09:16:10.270811+0000","last_clean":"2023-12-22T09:16:10.270811+0000","last_became_active":"2023-12-22T09:15:55.159183+0000","last_became_peered":"2023-12-22T09:15:55.159183+0000","last_unstale":"2023-12-22T09:16:10.270811+0000","last_undegraded":"2023-12-22T09:16:10.270811+0000","last_fullsized":"2023-12-22T09:16:10.270811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:27.387730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267216+0000","last_change":"2023-12-22T09:15:54.678077+0000","last_active":"2023-12-22T09:16:10.267216+0000","last_peered":"2023-12-22T09:16:10.267216+0000","last_clean":"2023-12-22T09:16:10.267216+0000","last_became_active":"2023-12-22T09:15:54.677750+0000","last_became_peered":"2023-12-22T09:15:54.677750+0000","last_unstale":"2023-12-22T09:16:10.267216+0000","last_undegraded":"2023-12-22T09:16:10.267216+0000","last_fullsized":"2023-12-22T09:16:10.267216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:29.498658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.262319+0000","last_change":"2023-12-22T09:16:10.273445+0000","last_active":"2023-12-22T09:16:11.262319+0000","last_peered":"2023-12-22T09:16:11.262319+0000","last_clean":"2023-12-22T09:16:11.262319+0000","last_became_active":"2023-12-22T09:16:10.272492+0000","last_became_peered":"2023-12-22T09:16:10.272492+0000","last_unstale":"2023-12-22T09:16:11.262319+0000","last_undegraded":"2023-12-22T09:16:11.262319+0000","last_fullsized":"2023-12-22T09:16:11.262319+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:44.719369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267943+0000","last_change":"2023-12-22T09:16:09.795250+0000","last_active":"2023-12-22T09:16:11.267943+0000","last_peered":"2023-12-22T09:16:11.267943+0000","last_clean":"2023-12-22T09:16:11.267943+0000","last_became_active":"2023-12-22T09:16:09.794930+0000","last_became_peered":"2023-12-22T09:16:09.794930+0000","last_unstale":"2023-12-22T09:16:11.267943+0000","last_undegraded":"2023-12-22T09:16:11.267943+0000","last_fullsized":"2023-12-22T09:16:11.267943+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:35.929366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267076+0000","last_change":"2023-12-22T09:15:55.155587+0000","last_active":"2023-12-22T09:16:10.267076+0000","last_peered":"2023-12-22T09:16:10.267076+0000","last_clean":"2023-12-22T09:16:10.267076+0000","last_became_active":"2023-12-22T09:15:55.154482+0000","last_became_peered":"2023-12-22T09:15:55.154482+0000","last_unstale":"2023-12-22T09:16:10.267076+0000","last_undegraded":"2023-12-22T09:16:10.267076+0000","last_fullsized":"2023-12-22T09:16:10.267076+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:57.296942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.250854+0000","last_change":"2023-12-22T09:15:54.670898+0000","last_active":"2023-12-22T09:16:10.250854+0000","last_peered":"2023-12-22T09:16:10.250854+0000","last_clean":"2023-12-22T09:16:10.250854+0000","last_became_active":"2023-12-22T09:15:54.670474+0000","last_became_peered":"2023-12-22T09:15:54.670474+0000","last_unstale":"2023-12-22T09:16:10.250854+0000","last_undegraded":"2023-12-22T09:16:10.250854+0000","last_fullsized":"2023-12-22T09:16:10.250854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:08.829353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424248+0000","last_change":"2023-12-22T09:16:10.284310+0000","last_active":"2023-12-22T09:16:11.424248+0000","last_peered":"2023-12-22T09:16:11.424248+0000","last_clean":"2023-12-22T09:16:11.424248+0000","last_became_active":"2023-12-22T09:16:10.284036+0000","last_became_peered":"2023-12-22T09:16:10.284036+0000","last_unstale":"2023-12-22T09:16:11.424248+0000","last_undegraded":"2023-12-22T09:16:11.424248+0000","last_fullsized":"2023-12-22T09:16:11.424248+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:06.507360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.272690+0000","last_change":"2023-12-22T09:16:09.782700+0000","last_active":"2023-12-22T09:16:11.272690+0000","last_peered":"2023-12-22T09:16:11.272690+0000","last_clean":"2023-12-22T09:16:11.272690+0000","last_became_active":"2023-12-22T09:16:09.782407+0000","last_became_peered":"2023-12-22T09:16:09.782407+0000","last_unstale":"2023-12-22T09:16:11.272690+0000","last_undegraded":"2023-12-22T09:16:11.272690+0000","last_fullsized":"2023-12-22T09:16:11.272690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:13:52.771840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.252330+0000","last_change":"2023-12-22T09:15:55.153519+0000","last_active":"2023-12-22T09:16:10.252330+0000","last_peered":"2023-12-22T09:16:10.252330+0000","last_clean":"2023-12-22T09:16:10.252330+0000","last_became_active":"2023-12-22T09:15:55.153259+0000","last_became_peered":"2023-12-22T09:15:55.153259+0000","last_unstale":"2023-12-22T09:16:10.252330+0000","last_undegraded":"2023-12-22T09:16:10.252330+0000","last_fullsized":"2023-12-22T09:16:10.252330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:15.736391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251275+0000","last_change":"2023-12-22T09:15:54.668062+0000","last_active":"2023-12-22T09:16:10.251275+0000","last_peered":"2023-12-22T09:16:10.251275+0000","last_clean":"2023-12-22T09:16:10.251275+0000","last_became_active":"2023-12-22T09:15:54.667816+0000","last_became_peered":"2023-12-22T09:15:54.667816+0000","last_unstale":"2023-12-22T09:16:10.251275+0000","last_undegraded":"2023-12-22T09:16:10.251275+0000","last_fullsized":"2023-12-22T09:16:10.251275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:12.583708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.271203+0000","last_change":"2023-12-22T09:16:10.287810+0000","last_active":"2023-12-22T09:16:11.271203+0000","last_peered":"2023-12-22T09:16:11.271203+0000","last_clean":"2023-12-22T09:16:11.271203+0000","last_became_active":"2023-12-22T09:16:10.287572+0000","last_became_peered":"2023-12-22T09:16:10.287572+0000","last_unstale":"2023-12-22T09:16:11.271203+0000","last_undegraded":"2023-12-22T09:16:11.271203+0000","last_fullsized":"2023-12-22T09:16:11.271203+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:24:53.589809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.266849+0000","last_change":"2023-12-22T09:16:09.795180+0000","last_active":"2023-12-22T09:16:11.266849+0000","last_peered":"2023-12-22T09:16:11.266849+0000","last_clean":"2023-12-22T09:16:11.266849+0000","last_became_active":"2023-12-22T09:16:09.794900+0000","last_became_peered":"2023-12-22T09:16:09.794900+0000","last_unstale":"2023-12-22T09:16:11.266849+0000","last_undegraded":"2023-12-22T09:16:11.266849+0000","last_fullsized":"2023-12-22T09:16:11.266849+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:12.327698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266898+0000","last_change":"2023-12-22T09:15:55.149199+0000","last_active":"2023-12-22T09:16:10.266898+0000","last_peered":"2023-12-22T09:16:10.266898+0000","last_clean":"2023-12-22T09:16:10.266898+0000","last_became_active":"2023-12-22T09:15:55.148960+0000","last_became_peered":"2023-12-22T09:15:55.148960+0000","last_unstale":"2023-12-22T09:16:10.266898+0000","last_undegraded":"2023-12-22T09:16:10.266898+0000","last_fullsized":"2023-12-22T09:16:10.266898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:01.163534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248589+0000","last_change":"2023-12-22T09:15:54.656366+0000","last_active":"2023-12-22T09:16:10.248589+0000","last_peered":"2023-12-22T09:16:10.248589+0000","last_clean":"2023-12-22T09:16:10.248589+0000","last_became_active":"2023-12-22T09:15:54.656119+0000","last_became_peered":"2023-12-22T09:15:54.656119+0000","last_unstale":"2023-12-22T09:16:10.248589+0000","last_undegraded":"2023-12-22T09:16:10.248589+0000","last_fullsized":"2023-12-22T09:16:10.248589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:23.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425512+0000","last_change":"2023-12-22T09:16:10.264835+0000","last_active":"2023-12-22T09:16:11.425512+0000","last_peered":"2023-12-22T09:16:11.425512+0000","last_clean":"2023-12-22T09:16:11.425512+0000","last_became_active":"2023-12-22T09:16:10.264143+0000","last_became_peered":"2023-12-22T09:16:10.264143+0000","last_unstale":"2023-12-22T09:16:11.425512+0000","last_undegraded":"2023-12-22T09:16:11.425512+0000","last_fullsized":"2023-12-22T09:16:11.425512+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:07:40.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264956+0000","last_change":"2023-12-22T09:16:09.776310+0000","last_active":"2023-12-22T09:16:11.264956+0000","last_peered":"2023-12-22T09:16:11.264956+0000","last_clean":"2023-12-22T09:16:11.264956+0000","last_became_active":"2023-12-22T09:16:09.776031+0000","last_became_peered":"2023-12-22T09:16:09.776031+0000","last_unstale":"2023-12-22T09:16:11.264956+0000","last_undegraded":"2023-12-22T09:16:11.264956+0000","last_fullsized":"2023-12-22T09:16:11.264956+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:42:53.400156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.269029+0000","last_change":"2023-12-22T09:15:55.150507+0000","last_active":"2023-12-22T09:16:10.269029+0000","last_peered":"2023-12-22T09:16:10.269029+0000","last_clean":"2023-12-22T09:16:10.269029+0000","last_became_active":"2023-12-22T09:15:55.149174+0000","last_became_peered":"2023-12-22T09:15:55.149174+0000","last_unstale":"2023-12-22T09:16:10.269029+0000","last_undegraded":"2023-12-22T09:16:10.269029+0000","last_fullsized":"2023-12-22T09:16:10.269029+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:01.163534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248068+0000","last_change":"2023-12-22T09:15:54.666529+0000","last_active":"2023-12-22T09:16:10.248068+0000","last_peered":"2023-12-22T09:16:10.248068+0000","last_clean":"2023-12-22T09:16:10.248068+0000","last_became_active":"2023-12-22T09:15:54.666198+0000","last_became_peered":"2023-12-22T09:15:54.666198+0000","last_unstale":"2023-12-22T09:16:10.248068+0000","last_undegraded":"2023-12-22T09:16:10.248068+0000","last_fullsized":"2023-12-22T09:16:10.248068+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:59.323545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.428141+0000","last_change":"2023-12-22T09:16:10.284556+0000","last_active":"2023-12-22T09:16:11.428141+0000","last_peered":"2023-12-22T09:16:11.428141+0000","last_clean":"2023-12-22T09:16:11.428141+0000","last_became_active":"2023-12-22T09:16:10.284268+0000","last_became_peered":"2023-12-22T09:16:10.284268+0000","last_unstale":"2023-12-22T09:16:11.428141+0000","last_undegraded":"2023-12-22T09:16:11.428141+0000","last_fullsized":"2023-12-22T09:16:11.428141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:42:53.326372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424980+0000","last_change":"2023-12-22T09:16:09.781136+0000","last_active":"2023-12-22T09:16:11.424980+0000","last_peered":"2023-12-22T09:16:11.424980+0000","last_clean":"2023-12-22T09:16:11.424980+0000","last_became_active":"2023-12-22T09:16:09.780826+0000","last_became_peered":"2023-12-22T09:16:09.780826+0000","last_unstale":"2023-12-22T09:16:11.424980+0000","last_undegraded":"2023-12-22T09:16:11.424980+0000","last_fullsized":"2023-12-22T09:16:11.424980+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:45.237557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266600+0000","last_change":"2023-12-22T09:15:55.154765+0000","last_active":"2023-12-22T09:16:10.266600+0000","last_peered":"2023-12-22T09:16:10.266600+0000","last_clean":"2023-12-22T09:16:10.266600+0000","last_became_active":"2023-12-22T09:15:55.154461+0000","last_became_peered":"2023-12-22T09:15:55.154461+0000","last_unstale":"2023-12-22T09:16:10.266600+0000","last_undegraded":"2023-12-22T09:16:10.266600+0000","last_fullsized":"2023-12-22T09:16:10.266600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:59.232942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272341+0000","last_change":"2023-12-22T09:15:54.670745+0000","last_active":"2023-12-22T09:16:10.272341+0000","last_peered":"2023-12-22T09:16:10.272341+0000","last_clean":"2023-12-22T09:16:10.272341+0000","last_became_active":"2023-12-22T09:15:54.670471+0000","last_became_peered":"2023-12-22T09:15:54.670471+0000","last_unstale":"2023-12-22T09:16:10.272341+0000","last_undegraded":"2023-12-22T09:16:10.272341+0000","last_fullsized":"2023-12-22T09:16:10.272341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:18:34.722029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.286740+0000","last_change":"2023-12-22T09:16:10.281332+0000","last_active":"2023-12-22T09:16:10.286740+0000","last_peered":"2023-12-22T09:16:10.286740+0000","last_clean":"2023-12-22T09:16:10.286740+0000","last_became_active":"2023-12-22T09:16:10.281029+0000","last_became_peered":"2023-12-22T09:16:10.281029+0000","last_unstale":"2023-12-22T09:16:10.286740+0000","last_undegraded":"2023-12-22T09:16:10.286740+0000","last_fullsized":"2023-12-22T09:16:10.286740+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:06:06.908886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.262963+0000","last_change":"2023-12-22T09:16:09.786634+0000","last_active":"2023-12-22T09:16:11.262963+0000","last_peered":"2023-12-22T09:16:11.262963+0000","last_clean":"2023-12-22T09:16:11.262963+0000","last_became_active":"2023-12-22T09:16:09.784245+0000","last_became_peered":"2023-12-22T09:16:09.784245+0000","last_unstale":"2023-12-22T09:16:11.262963+0000","last_undegraded":"2023-12-22T09:16:11.262963+0000","last_fullsized":"2023-12-22T09:16:11.262963+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:26:38.071351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258264+0000","last_change":"2023-12-22T09:15:55.135327+0000","last_active":"2023-12-22T09:16:10.258264+0000","last_peered":"2023-12-22T09:16:10.258264+0000","last_clean":"2023-12-22T09:16:10.258264+0000","last_became_active":"2023-12-22T09:15:55.135121+0000","last_became_peered":"2023-12-22T09:15:55.135121+0000","last_unstale":"2023-12-22T09:16:10.258264+0000","last_undegraded":"2023-12-22T09:16:10.258264+0000","last_fullsized":"2023-12-22T09:16:10.258264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:55.239397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248130+0000","last_change":"2023-12-22T09:15:54.653992+0000","last_active":"2023-12-22T09:16:10.248130+0000","last_peered":"2023-12-22T09:16:10.248130+0000","last_clean":"2023-12-22T09:16:10.248130+0000","last_became_active":"2023-12-22T09:15:54.653705+0000","last_became_peered":"2023-12-22T09:15:54.653705+0000","last_unstale":"2023-12-22T09:16:10.248130+0000","last_undegraded":"2023-12-22T09:16:10.248130+0000","last_fullsized":"2023-12-22T09:16:10.248130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:25.659639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424551+0000","last_change":"2023-12-22T09:16:10.261672+0000","last_active":"2023-12-22T09:16:11.424551+0000","last_peered":"2023-12-22T09:16:11.424551+0000","last_clean":"2023-12-22T09:16:11.424551+0000","last_became_active":"2023-12-22T09:16:10.261281+0000","last_became_peered":"2023-12-22T09:16:10.261281+0000","last_unstale":"2023-12-22T09:16:11.424551+0000","last_undegraded":"2023-12-22T09:16:11.424551+0000","last_fullsized":"2023-12-22T09:16:11.424551+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:43.341805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.433493+0000","last_change":"2023-12-22T09:16:09.785157+0000","last_active":"2023-12-22T09:16:11.433493+0000","last_peered":"2023-12-22T09:16:11.433493+0000","last_clean":"2023-12-22T09:16:11.433493+0000","last_became_active":"2023-12-22T09:16:09.784542+0000","last_became_peered":"2023-12-22T09:16:09.784542+0000","last_unstale":"2023-12-22T09:16:11.433493+0000","last_undegraded":"2023-12-22T09:16:11.433493+0000","last_fullsized":"2023-12-22T09:16:11.433493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:35.929366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251196+0000","last_change":"2023-12-22T09:15:55.164900+0000","last_active":"2023-12-22T09:16:10.251196+0000","last_peered":"2023-12-22T09:16:10.251196+0000","last_clean":"2023-12-22T09:16:10.251196+0000","last_became_active":"2023-12-22T09:15:55.164618+0000","last_became_peered":"2023-12-22T09:15:55.164618+0000","last_unstale":"2023-12-22T09:16:10.251196+0000","last_undegraded":"2023-12-22T09:16:10.251196+0000","last_fullsized":"2023-12-22T09:16:10.251196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.268281+0000","last_change":"2023-12-22T09:15:54.733914+0000","last_active":"2023-12-22T09:16:10.268281+0000","last_peered":"2023-12-22T09:16:10.268281+0000","last_clean":"2023-12-22T09:16:10.268281+0000","last_became_active":"2023-12-22T09:15:54.733504+0000","last_became_peered":"2023-12-22T09:15:54.733504+0000","last_unstale":"2023-12-22T09:16:10.268281+0000","last_undegraded":"2023-12-22T09:16:10.268281+0000","last_fullsized":"2023-12-22T09:16:10.268281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:38.639959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264084+0000","last_change":"2023-12-22T09:16:10.293110+0000","last_active":"2023-12-22T09:16:11.264084+0000","last_peered":"2023-12-22T09:16:11.264084+0000","last_clean":"2023-12-22T09:16:11.264084+0000","last_became_active":"2023-12-22T09:16:10.292834+0000","last_became_peered":"2023-12-22T09:16:10.292834+0000","last_unstale":"2023-12-22T09:16:11.264084+0000","last_undegraded":"2023-12-22T09:16:11.264084+0000","last_fullsized":"2023-12-22T09:16:11.264084+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:03:30.809612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.270284+0000","last_change":"2023-12-22T09:16:09.790734+0000","last_active":"2023-12-22T09:16:11.270284+0000","last_peered":"2023-12-22T09:16:11.270284+0000","last_clean":"2023-12-22T09:16:11.270284+0000","last_became_active":"2023-12-22T09:16:09.790423+0000","last_became_peered":"2023-12-22T09:16:09.790423+0000","last_unstale":"2023-12-22T09:16:11.270284+0000","last_undegraded":"2023-12-22T09:16:11.270284+0000","last_fullsized":"2023-12-22T09:16:11.270284+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:55:09.027625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.273329+0000","last_change":"2023-12-22T09:15:55.157481+0000","last_active":"2023-12-22T09:16:10.273329+0000","last_peered":"2023-12-22T09:16:10.273329+0000","last_clean":"2023-12-22T09:16:10.273329+0000","last_became_active":"2023-12-22T09:15:55.156846+0000","last_became_peered":"2023-12-22T09:15:55.156846+0000","last_unstale":"2023-12-22T09:16:10.273329+0000","last_undegraded":"2023-12-22T09:16:10.273329+0000","last_fullsized":"2023-12-22T09:16:10.273329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.252213+0000","last_change":"2023-12-22T09:15:54.678864+0000","last_active":"2023-12-22T09:16:10.252213+0000","last_peered":"2023-12-22T09:16:10.252213+0000","last_clean":"2023-12-22T09:16:10.252213+0000","last_became_active":"2023-12-22T09:15:54.678585+0000","last_became_peered":"2023-12-22T09:15:54.678585+0000","last_unstale":"2023-12-22T09:16:10.252213+0000","last_undegraded":"2023-12-22T09:16:10.252213+0000","last_fullsized":"2023-12-22T09:16:10.252213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.427249+0000","last_change":"2023-12-22T09:16:10.270029+0000","last_active":"2023-12-22T09:16:11.427249+0000","last_peered":"2023-12-22T09:16:11.427249+0000","last_clean":"2023-12-22T09:16:11.427249+0000","last_became_active":"2023-12-22T09:16:10.269655+0000","last_became_peered":"2023-12-22T09:16:10.269655+0000","last_unstale":"2023-12-22T09:16:11.427249+0000","last_undegraded":"2023-12-22T09:16:11.427249+0000","last_fullsized":"2023-12-22T09:16:11.427249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:35.591774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.265738+0000","last_change":"2023-12-22T09:16:09.789363+0000","last_active":"2023-12-22T09:16:10.265738+0000","last_peered":"2023-12-22T09:16:10.265738+0000","last_clean":"2023-12-22T09:16:10.265738+0000","last_became_active":"2023-12-22T09:16:09.789051+0000","last_became_peered":"2023-12-22T09:16:09.789051+0000","last_unstale":"2023-12-22T09:16:10.265738+0000","last_undegraded":"2023-12-22T09:16:10.265738+0000","last_fullsized":"2023-12-22T09:16:10.265738+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:55.378925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.259119+0000","last_change":"2023-12-22T09:15:55.154994+0000","last_active":"2023-12-22T09:16:10.259119+0000","last_peered":"2023-12-22T09:16:10.259119+0000","last_clean":"2023-12-22T09:16:10.259119+0000","last_became_active":"2023-12-22T09:15:55.154803+0000","last_became_peered":"2023-12-22T09:15:55.154803+0000","last_unstale":"2023-12-22T09:16:10.259119+0000","last_undegraded":"2023-12-22T09:16:10.259119+0000","last_fullsized":"2023-12-22T09:16:10.259119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:57.624842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270660+0000","last_change":"2023-12-22T09:15:54.665822+0000","last_active":"2023-12-22T09:16:10.270660+0000","last_peered":"2023-12-22T09:16:10.270660+0000","last_clean":"2023-12-22T09:16:10.270660+0000","last_became_active":"2023-12-22T09:15:54.665585+0000","last_became_peered":"2023-12-22T09:15:54.665585+0000","last_unstale":"2023-12-22T09:16:10.270660+0000","last_undegraded":"2023-12-22T09:16:10.270660+0000","last_fullsized":"2023-12-22T09:16:10.270660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:17.033333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.271036+0000","last_change":"2023-12-22T09:16:10.292334+0000","last_active":"2023-12-22T09:16:11.271036+0000","last_peered":"2023-12-22T09:16:11.271036+0000","last_clean":"2023-12-22T09:16:11.271036+0000","last_became_active":"2023-12-22T09:16:10.292061+0000","last_became_peered":"2023-12-22T09:16:10.292061+0000","last_unstale":"2023-12-22T09:16:11.271036+0000","last_undegraded":"2023-12-22T09:16:11.271036+0000","last_fullsized":"2023-12-22T09:16:11.271036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:18:32.297692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425491+0000","last_change":"2023-12-22T09:16:09.780152+0000","last_active":"2023-12-22T09:16:11.425491+0000","last_peered":"2023-12-22T09:16:11.425491+0000","last_clean":"2023-12-22T09:16:11.425491+0000","last_became_active":"2023-12-22T09:16:09.779196+0000","last_became_peered":"2023-12-22T09:16:09.779196+0000","last_unstale":"2023-12-22T09:16:11.425491+0000","last_undegraded":"2023-12-22T09:16:11.425491+0000","last_fullsized":"2023-12-22T09:16:11.425491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:36.284381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270714+0000","last_change":"2023-12-22T09:15:55.140870+0000","last_active":"2023-12-22T09:16:10.270714+0000","last_peered":"2023-12-22T09:16:10.270714+0000","last_clean":"2023-12-22T09:16:10.270714+0000","last_became_active":"2023-12-22T09:15:55.140487+0000","last_became_peered":"2023-12-22T09:15:55.140487+0000","last_unstale":"2023-12-22T09:16:10.270714+0000","last_undegraded":"2023-12-22T09:16:10.270714+0000","last_fullsized":"2023-12-22T09:16:10.270714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:17.416418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.269206+0000","last_change":"2023-12-22T09:15:54.667519+0000","last_active":"2023-12-22T09:16:10.269206+0000","last_peered":"2023-12-22T09:16:10.269206+0000","last_clean":"2023-12-22T09:16:10.269206+0000","last_became_active":"2023-12-22T09:15:54.667275+0000","last_became_peered":"2023-12-22T09:15:54.667275+0000","last_unstale":"2023-12-22T09:16:10.269206+0000","last_undegraded":"2023-12-22T09:16:10.269206+0000","last_fullsized":"2023-12-22T09:16:10.269206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:22:27.185341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.265161+0000","last_change":"2023-12-22T09:16:10.263595+0000","last_active":"2023-12-22T09:16:11.265161+0000","last_peered":"2023-12-22T09:16:11.265161+0000","last_clean":"2023-12-22T09:16:11.265161+0000","last_became_active":"2023-12-22T09:16:10.263274+0000","last_became_peered":"2023-12-22T09:16:10.263274+0000","last_unstale":"2023-12-22T09:16:11.265161+0000","last_undegraded":"2023-12-22T09:16:11.265161+0000","last_fullsized":"2023-12-22T09:16:11.265161+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:47.603779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.427487+0000","last_change":"2023-12-22T09:16:09.778980+0000","last_active":"2023-12-22T09:16:11.427487+0000","last_peered":"2023-12-22T09:16:11.427487+0000","last_clean":"2023-12-22T09:16:11.427487+0000","last_became_active":"2023-12-22T09:16:09.778566+0000","last_became_peered":"2023-12-22T09:16:09.778566+0000","last_unstale":"2023-12-22T09:16:11.427487+0000","last_undegraded":"2023-12-22T09:16:11.427487+0000","last_fullsized":"2023-12-22T09:16:11.427487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:36.284381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249043+0000","last_change":"2023-12-22T09:15:55.141979+0000","last_active":"2023-12-22T09:16:10.249043+0000","last_peered":"2023-12-22T09:16:10.249043+0000","last_clean":"2023-12-22T09:16:10.249043+0000","last_became_active":"2023-12-22T09:15:55.141734+0000","last_became_peered":"2023-12-22T09:15:55.141734+0000","last_unstale":"2023-12-22T09:16:10.249043+0000","last_undegraded":"2023-12-22T09:16:10.249043+0000","last_fullsized":"2023-12-22T09:16:10.249043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.764312+0000","last_change":"2023-12-22T09:15:54.658826+0000","last_active":"2023-12-22T09:16:09.764312+0000","last_peered":"2023-12-22T09:16:09.764312+0000","last_clean":"2023-12-22T09:16:09.764312+0000","last_became_active":"2023-12-22T09:15:54.658206+0000","last_became_peered":"2023-12-22T09:15:54.658206+0000","last_unstale":"2023-12-22T09:16:09.764312+0000","last_undegraded":"2023-12-22T09:16:09.764312+0000","last_fullsized":"2023-12-22T09:16:09.764312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:19.574375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.270065+0000","last_change":"2023-12-22T09:16:10.288236+0000","last_active":"2023-12-22T09:16:11.270065+0000","last_peered":"2023-12-22T09:16:11.270065+0000","last_clean":"2023-12-22T09:16:11.270065+0000","last_became_active":"2023-12-22T09:16:10.287301+0000","last_became_peered":"2023-12-22T09:16:10.287301+0000","last_unstale":"2023-12-22T09:16:11.270065+0000","last_undegraded":"2023-12-22T09:16:11.270065+0000","last_fullsized":"2023-12-22T09:16:11.270065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:05:21.100101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264003+0000","last_change":"2023-12-22T09:16:09.785145+0000","last_active":"2023-12-22T09:16:11.264003+0000","last_peered":"2023-12-22T09:16:11.264003+0000","last_clean":"2023-12-22T09:16:11.264003+0000","last_became_active":"2023-12-22T09:16:09.784881+0000","last_became_peered":"2023-12-22T09:16:09.784881+0000","last_unstale":"2023-12-22T09:16:11.264003+0000","last_undegraded":"2023-12-22T09:16:11.264003+0000","last_fullsized":"2023-12-22T09:16:11.264003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:07:47.003153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.262829+0000","last_change":"2023-12-22T09:15:55.152664+0000","last_active":"2023-12-22T09:16:10.262829+0000","last_peered":"2023-12-22T09:16:10.262829+0000","last_clean":"2023-12-22T09:16:10.262829+0000","last_became_active":"2023-12-22T09:15:55.152395+0000","last_became_peered":"2023-12-22T09:15:55.152395+0000","last_unstale":"2023-12-22T09:16:10.262829+0000","last_undegraded":"2023-12-22T09:16:10.262829+0000","last_fullsized":"2023-12-22T09:16:10.262829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:27.387730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266794+0000","last_change":"2023-12-22T09:15:54.672839+0000","last_active":"2023-12-22T09:16:10.266794+0000","last_peered":"2023-12-22T09:16:10.266794+0000","last_clean":"2023-12-22T09:16:10.266794+0000","last_became_active":"2023-12-22T09:15:54.672501+0000","last_became_peered":"2023-12-22T09:15:54.672501+0000","last_unstale":"2023-12-22T09:16:10.266794+0000","last_undegraded":"2023-12-22T09:16:10.266794+0000","last_fullsized":"2023-12-22T09:16:10.266794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:16.400594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426672+0000","last_change":"2023-12-22T09:16:10.283245+0000","last_active":"2023-12-22T09:16:11.426672+0000","last_peered":"2023-12-22T09:16:11.426672+0000","last_clean":"2023-12-22T09:16:11.426672+0000","last_became_active":"2023-12-22T09:16:10.282930+0000","last_became_peered":"2023-12-22T09:16:10.282930+0000","last_unstale":"2023-12-22T09:16:11.426672+0000","last_undegraded":"2023-12-22T09:16:11.426672+0000","last_fullsized":"2023-12-22T09:16:11.426672+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:22:16.109685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.263179+0000","last_change":"2023-12-22T09:16:09.781083+0000","last_active":"2023-12-22T09:16:11.263179+0000","last_peered":"2023-12-22T09:16:11.263179+0000","last_clean":"2023-12-22T09:16:11.263179+0000","last_became_active":"2023-12-22T09:16:09.780777+0000","last_became_peered":"2023-12-22T09:16:09.780777+0000","last_unstale":"2023-12-22T09:16:11.263179+0000","last_undegraded":"2023-12-22T09:16:11.263179+0000","last_fullsized":"2023-12-22T09:16:11.263179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:34.576185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.271652+0000","last_change":"2023-12-22T09:15:55.142126+0000","last_active":"2023-12-22T09:16:10.271652+0000","last_peered":"2023-12-22T09:16:10.271652+0000","last_clean":"2023-12-22T09:16:10.271652+0000","last_became_active":"2023-12-22T09:15:55.138650+0000","last_became_peered":"2023-12-22T09:15:55.138650+0000","last_unstale":"2023-12-22T09:16:10.271652+0000","last_undegraded":"2023-12-22T09:16:10.271652+0000","last_fullsized":"2023-12-22T09:16:10.271652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.255920+0000","last_change":"2023-12-22T09:15:54.661513+0000","last_active":"2023-12-22T09:16:10.255920+0000","last_peered":"2023-12-22T09:16:10.255920+0000","last_clean":"2023-12-22T09:16:10.255920+0000","last_became_active":"2023-12-22T09:15:54.658499+0000","last_became_peered":"2023-12-22T09:15:54.658499+0000","last_unstale":"2023-12-22T09:16:10.255920+0000","last_undegraded":"2023-12-22T09:16:10.255920+0000","last_fullsized":"2023-12-22T09:16:10.255920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:07.165067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272817+0000","last_change":"2023-12-22T09:16:10.266538+0000","last_active":"2023-12-22T09:16:10.272817+0000","last_peered":"2023-12-22T09:16:10.272817+0000","last_clean":"2023-12-22T09:16:10.272817+0000","last_became_active":"2023-12-22T09:16:10.266281+0000","last_became_peered":"2023-12-22T09:16:10.266281+0000","last_unstale":"2023-12-22T09:16:10.272817+0000","last_undegraded":"2023-12-22T09:16:10.272817+0000","last_fullsized":"2023-12-22T09:16:10.272817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:36:50.883597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"44'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.506166+0000","last_change":"2023-12-22T09:16:09.790626+0000","last_active":"2023-12-22T09:16:11.506166+0000","last_peered":"2023-12-22T09:16:11.506166+0000","last_clean":"2023-12-22T09:16:11.506166+0000","last_became_active":"2023-12-22T09:16:09.790338+0000","last_became_peered":"2023-12-22T09:16:09.790338+0000","last_unstale":"2023-12-22T09:16:11.506166+0000","last_undegraded":"2023-12-22T09:16:11.506166+0000","last_fullsized":"2023-12-22T09:16:11.506166+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:05:44.480599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267958+0000","last_change":"2023-12-22T09:15:55.165334+0000","last_active":"2023-12-22T09:16:10.267958+0000","last_peered":"2023-12-22T09:16:10.267958+0000","last_clean":"2023-12-22T09:16:10.267958+0000","last_became_active":"2023-12-22T09:15:55.165009+0000","last_became_peered":"2023-12-22T09:15:55.165009+0000","last_unstale":"2023-12-22T09:16:10.267958+0000","last_undegraded":"2023-12-22T09:16:10.267958+0000","last_fullsized":"2023-12-22T09:16:10.267958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.273393+0000","last_change":"2023-12-22T09:15:54.671832+0000","last_active":"2023-12-22T09:16:10.273393+0000","last_peered":"2023-12-22T09:16:10.273393+0000","last_clean":"2023-12-22T09:16:10.273393+0000","last_became_active":"2023-12-22T09:15:54.671542+0000","last_became_peered":"2023-12-22T09:15:54.671542+0000","last_unstale":"2023-12-22T09:16:10.273393+0000","last_undegraded":"2023-12-22T09:16:10.273393+0000","last_fullsized":"2023-12-22T09:16:10.273393+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:23.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266939+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:16:10.266939+0000","last_peered":"2023-12-22T09:16:10.266939+0000","last_clean":"2023-12-22T09:16:10.266939+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:16:10.266939+0000","last_undegraded":"2023-12-22T09:16:10.266939+0000","last_fullsized":"2023-12-22T09:16:10.266939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3857,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1114112,"data_stored":813417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.6070000000000002,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.05},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.88800000000000001}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":0.94099999999999995}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.389},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.4570000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.139},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.1679999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.5089999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":221030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.3639999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1160000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.093}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.262},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.4350000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.23},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.3620000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":3.3399999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.393}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.7849999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":219908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.401}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.371},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.615}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.46},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.4419999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.5}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":3.298,"5min":3.298,"15min":3.298},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.2390000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":220982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.157}]},{"osd":1,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.85499999999999998}]},{"osd":2,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.93400000000000005}]},{"osd":3,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.2969999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.25},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.2050000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.47},{"interface":"front","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.5}]},{"osd":7,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.54},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.5820000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":224475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2290000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.3779999999999999}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.5329999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":24.245999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":1.573},{"interface":"front","average":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":32.527999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":1.6739999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.722,"5min":2.722,"15min":2.722},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":33.103999999999999,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":27.181999999999999,"5min":27.181999999999999,"15min":27.181999999999999},"last":1.722}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":22.715,"5min":22.715,"15min":22.715},"last":1.1240000000000001},{"interface":"front","average":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":30.108000000000001,"5min":30.108000000000001,"15min":30.108000000000001},"last":1.2729999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":524288,"data_stored":228907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.495},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.044}]},{"osd":5,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.3929999999999998,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.85799999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":220046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.86599999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.97499999999999998}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.5640000000000001,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":1.163},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.4430000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.2669999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.524,"5min":4.524,"15min":4.524},"last":1.2150000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.381},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.3120000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.353},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":1.4910000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1114112,"data_stored":817731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.753},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.91500000000000004}]},{"osd":2,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.083},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.1000000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.383},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.96899999999999997}]},{"osd":5,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.038}]},{"osd":6,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.474},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.4339999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.621},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:16:14.731 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:16:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.973+0000 7fe87bd5c640 1 Processor -- start 2023-12-22T09:16:14.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.973+0000 7fe87bd5c640 1 -- start start 2023-12-22T09:16:14.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.974+0000 7fe87bd5c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe874152680 0x7fe87415c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.974+0000 7fe87bd5c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8740bfce0 con 0x7fe874069e60 2023-12-22T09:16:14.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.974+0000 7fe87bd5c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8740bffc0 con 0x7fe874150a80 2023-12-22T09:16:14.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.974+0000 7fe87bd5c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8740c0960 con 0x7fe874152680 2023-12-22T09:16:14.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.974+0000 7fe879af8640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe874069e60 0x7fe87414a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39246/0 (socket says 172.21.15.106:39246) 2023-12-22T09:16:14.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.974+0000 7fe879af8640 1 -- 172.21.15.106:0/1315706166 learned_addr learned my addr 172.21.15.106:0/1315706166 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591899597 0 0) 0x7fe8740bfce0 con 0x7fe874069e60 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe860003520 con 0x7fe874069e60 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe87a2f9640 1 --2- 172.21.15.106:0/1315706166 >> v2:172.21.15.132:3300/0 conn(0x7fe874152680 0x7fe87415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1448332564 0 0) 0x7fe860003520 con 0x7fe874069e60 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 >> v2:172.21.15.132:3300/0 conn(0x7fe874152680 msgr2=0x7fe87415c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 --2- 172.21.15.106:0/1315706166 >> v2:172.21.15.132:3300/0 conn(0x7fe874152680 0x7fe87415c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 >> v1:172.21.15.132:6789/0 conn(0x7fe874150a80 legacy=0x7fe874151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740c02a0 con 0x7fe874069e60 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fe8700017f0 con 0x7fe874069e60 2023-12-22T09:16:14.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 >> v1:172.21.15.106:6789/0 conn(0x7fe874069e60 legacy=0x7fe87414a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8600039c0 0x7fe860003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8600047c0 0x7fe860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe86000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740c0960 con 0x7fe860005380 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.975+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86000c240 con 0x7fe8600039c0 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.976+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86000c400 con 0x7fe8600047c0 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.976+0000 7fe87a2f9640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe86000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.976+0000 7fe879af8640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8600039c0 0x7fe860003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.976+0000 7fe87a2f9640 1 -- 172.21.15.106:0/1315706166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8600047c0 msgr2=0x7fe860004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.976+0000 7fe87a2f9640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8600047c0 0x7fe860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.976+0000 7fe87a2f9640 1 -- 172.21.15.106:0/1315706166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8600039c0 msgr2=0x7fe860003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.976+0000 7fe87a2f9640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8600039c0 0x7fe860003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.976+0000 7fe87a2f9640 1 -- 172.21.15.106:0/1315706166 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe860003520 con 0x7fe860005380 2023-12-22T09:16:14.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.977+0000 7fe87a2f9640 1 -- 172.21.15.106:0/1315706166 reap_dead start 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.977+0000 7fe87a2f9640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe86000b980 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe86c007360 tx=0x7fe8600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca03b242496e04 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.977+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c02ccf0 con 0x7fe860005380 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.977+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c02ce50 con 0x7fe860005380 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.977+0000 7fe878af6640 1 -- 172.21.15.106:0/1315706166 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c003bd0 con 0x7fe860005380 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.978+0000 7fe87bd5c640 1 -- 172.21.15.106:0/1315706166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 msgr2=0x7fe86000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.978+0000 7fe87bd5c640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe86000b980 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe86c007360 tx=0x7fe8600057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.978+0000 7fe87bd5c640 1 -- 172.21.15.106:0/1315706166 shutdown_connections 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.978+0000 7fe87bd5c640 1 --2- 172.21.15.106:0/1315706166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe86000b980 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.978+0000 7fe87bd5c640 1 -- 172.21.15.106:0/1315706166 >> 172.21.15.106:0/1315706166 conn(0x7fe8740c5360 msgr2=0x7fe8740c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.978+0000 7fe87bd5c640 1 -- 172.21.15.106:0/1315706166 shutdown_connections 2023-12-22T09:16:14.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.978+0000 7fe87bd5c640 1 -- 172.21.15.106:0/1315706166 wait complete. 2023-12-22T09:16:14.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.980+0000 7fe87bd5c640 1 Processor -- start 2023-12-22T09:16:14.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.980+0000 7fe87bd5c640 1 -- start start 2023-12-22T09:16:14.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.981+0000 7fe87bd5c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe874148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.981+0000 7fe87bd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8740aa890 0x7fe8741549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.981+0000 7fe87bd5c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe874070a80 0x7fe874070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.981+0000 7fe87bd5c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740c4310 con 0x7fe860005380 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.981+0000 7fe87bd5c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe874148640 con 0x7fe8740aa890 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.981+0000 7fe87bd5c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8741e8aa0 con 0x7fe874070a80 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.981+0000 7fe879af8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe874148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.981+0000 7fe879af8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe874148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48152/0 (socket says 172.21.15.106:48152) 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.981+0000 7fe879af8640 1 -- 172.21.15.106:0/301382239 learned_addr learned my addr 172.21.15.106:0/301382239 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe87a2f9640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe874070a80 0x7fe874070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe8792f7640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8740aa890 0x7fe8741549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe879af8640 1 -- 172.21.15.106:0/301382239 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe874070a80 msgr2=0x7fe874070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe879af8640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe874070a80 0x7fe874070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe879af8640 1 -- 172.21.15.106:0/301382239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8740aa890 msgr2=0x7fe8741549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe879af8640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8740aa890 0x7fe8741549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe879af8640 1 -- 172.21.15.106:0/301382239 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8741e8d60 con 0x7fe860005380 2023-12-22T09:16:14.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe879af8640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe874148100 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe87000e780 tx=0x7fe87000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:14.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe86a7fc640 1 -- 172.21.15.106:0/301382239 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8700070d0 con 0x7fe860005380 2023-12-22T09:16:14.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe86a7fc640 1 -- 172.21.15.106:0/301382239 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870007230 con 0x7fe860005380 2023-12-22T09:16:14.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8741e9040 con 0x7fe860005380 2023-12-22T09:16:14.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.982+0000 7fe86a7fc640 1 -- 172.21.15.106:0/301382239 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8700075e0 con 0x7fe860005380 2023-12-22T09:16:14.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.983+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8741e9600 con 0x7fe860005380 2023-12-22T09:16:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.984+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe874073f10 con 0x7fe860005380 2023-12-22T09:16:14.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.985+0000 7fe86a7fc640 1 -- 172.21.15.106:0/301382239 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe8700057a0 con 0x7fe860005380 2023-12-22T09:16:14.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.986+0000 7fe86a7fc640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a450 0x7fe85806c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:14.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.986+0000 7fe86a7fc640 1 -- 172.21.15.106:0/301382239 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe870088d20 con 0x7fe860005380 2023-12-22T09:16:14.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.986+0000 7fe8792f7640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a450 0x7fe85806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:14.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.987+0000 7fe8792f7640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a450 0x7fe85806c910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe8741428c0 tx=0x7fe864009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:14.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:14.990+0000 7fe86a7fc640 1 -- 172.21.15.106:0/301382239 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe870053f00 con 0x7fe860005380 2023-12-22T09:16:15.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.174+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8740c0580 con 0x7fe85806a450 2023-12-22T09:16:15.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.189+0000 7fe86a7fc640 1 -- 172.21.15.106:0/301382239 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525798 (secure 0 0 0) 0x7fe8640039f0 con 0x7fe85806a450 2023-12-22T09:16:15.198 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:15.202 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.199+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a450 msgr2=0x7fe85806c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.199+0000 7fe87bd5c640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a450 0x7fe85806c910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe8741428c0 tx=0x7fe864009040 comp rx=0 tx=0).stop 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.199+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 msgr2=0x7fe874148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.199+0000 7fe87bd5c640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe874148100 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe87000e780 tx=0x7fe87000ec40 comp rx=0 tx=0).stop 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.200+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 shutdown_connections 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.200+0000 7fe87bd5c640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe85806a450 0x7fe85806c910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.200+0000 7fe87bd5c640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe874070a80 0x7fe874070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.200+0000 7fe87bd5c640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8740aa890 0x7fe8741549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.200+0000 7fe87bd5c640 1 --2- 172.21.15.106:0/301382239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe860005380 0x7fe874148100 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.200+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 >> 172.21.15.106:0/301382239 conn(0x7fe8740c5360 msgr2=0x7fe87414e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:15.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.200+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 shutdown_connections 2023-12-22T09:16:15.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.200+0000 7fe87bd5c640 1 -- 172.21.15.106:0/301382239 wait complete. 2023-12-22T09:16:15.219 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-12-22T09:16:14.732593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596587,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":303,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220800,"kb_used_data":5184,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753920,"statfs":{"total":773094113280,"available":772868014080,"internally_reserved":0,"allocated":5308416,"data_stored":2966496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.991970"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.430255+0000","last_change":"2023-12-22T09:16:10.287747+0000","last_active":"2023-12-22T09:16:11.430255+0000","last_peered":"2023-12-22T09:16:11.430255+0000","last_clean":"2023-12-22T09:16:11.430255+0000","last_became_active":"2023-12-22T09:16:10.287472+0000","last_became_peered":"2023-12-22T09:16:10.287472+0000","last_unstale":"2023-12-22T09:16:11.430255+0000","last_undegraded":"2023-12-22T09:16:11.430255+0000","last_fullsized":"2023-12-22T09:16:11.430255+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:52.944802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.259281+0000","last_change":"2023-12-22T09:15:55.143366+0000","last_active":"2023-12-22T09:16:10.259281+0000","last_peered":"2023-12-22T09:16:10.259281+0000","last_clean":"2023-12-22T09:16:10.259281+0000","last_became_active":"2023-12-22T09:15:55.142565+0000","last_became_peered":"2023-12-22T09:15:55.142565+0000","last_unstale":"2023-12-22T09:16:10.259281+0000","last_undegraded":"2023-12-22T09:16:10.259281+0000","last_fullsized":"2023-12-22T09:16:10.259281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:59:15.395576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424257+0000","last_change":"2023-12-22T09:16:10.266999+0000","last_active":"2023-12-22T09:16:11.424257+0000","last_peered":"2023-12-22T09:16:11.424257+0000","last_clean":"2023-12-22T09:16:11.424257+0000","last_became_active":"2023-12-22T09:16:10.266132+0000","last_became_peered":"2023-12-22T09:16:10.266132+0000","last_unstale":"2023-12-22T09:16:11.424257+0000","last_undegraded":"2023-12-22T09:16:11.424257+0000","last_fullsized":"2023-12-22T09:16:11.424257+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:22:16.109685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258988+0000","last_change":"2023-12-22T09:15:55.150939+0000","last_active":"2023-12-22T09:16:10.258988+0000","last_peered":"2023-12-22T09:16:10.258988+0000","last_clean":"2023-12-22T09:16:10.258988+0000","last_became_active":"2023-12-22T09:15:55.150675+0000","last_became_peered":"2023-12-22T09:15:55.150675+0000","last_unstale":"2023-12-22T09:16:10.258988+0000","last_undegraded":"2023-12-22T09:16:10.258988+0000","last_fullsized":"2023-12-22T09:16:10.258988+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:55.417006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424741+0000","last_change":"2023-12-22T09:16:10.288580+0000","last_active":"2023-12-22T09:16:11.424741+0000","last_peered":"2023-12-22T09:16:11.424741+0000","last_clean":"2023-12-22T09:16:11.424741+0000","last_became_active":"2023-12-22T09:16:10.288305+0000","last_became_peered":"2023-12-22T09:16:10.288305+0000","last_unstale":"2023-12-22T09:16:11.424741+0000","last_undegraded":"2023-12-22T09:16:11.424741+0000","last_fullsized":"2023-12-22T09:16:11.424741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:22.458879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270578+0000","last_change":"2023-12-22T09:15:55.166248+0000","last_active":"2023-12-22T09:16:10.270578+0000","last_peered":"2023-12-22T09:16:10.270578+0000","last_clean":"2023-12-22T09:16:10.270578+0000","last_became_active":"2023-12-22T09:15:55.165994+0000","last_became_peered":"2023-12-22T09:15:55.165994+0000","last_unstale":"2023-12-22T09:16:10.270578+0000","last_undegraded":"2023-12-22T09:16:10.270578+0000","last_fullsized":"2023-12-22T09:16:10.270578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267166+0000","last_change":"2023-12-22T09:16:10.279983+0000","last_active":"2023-12-22T09:16:11.267166+0000","last_peered":"2023-12-22T09:16:11.267166+0000","last_clean":"2023-12-22T09:16:11.267166+0000","last_became_active":"2023-12-22T09:16:10.279654+0000","last_became_peered":"2023-12-22T09:16:10.279654+0000","last_unstale":"2023-12-22T09:16:11.267166+0000","last_undegraded":"2023-12-22T09:16:11.267166+0000","last_fullsized":"2023-12-22T09:16:11.267166+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:51:01.263941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248686+0000","last_change":"2023-12-22T09:15:55.158634+0000","last_active":"2023-12-22T09:16:10.248686+0000","last_peered":"2023-12-22T09:16:10.248686+0000","last_clean":"2023-12-22T09:16:10.248686+0000","last_became_active":"2023-12-22T09:15:55.157672+0000","last_became_peered":"2023-12-22T09:15:55.157672+0000","last_unstale":"2023-12-22T09:16:10.248686+0000","last_undegraded":"2023-12-22T09:16:10.248686+0000","last_fullsized":"2023-12-22T09:16:10.248686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:50.284022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.272176+0000","last_change":"2023-12-22T09:16:10.270429+0000","last_active":"2023-12-22T09:16:11.272176+0000","last_peered":"2023-12-22T09:16:11.272176+0000","last_clean":"2023-12-22T09:16:11.272176+0000","last_became_active":"2023-12-22T09:16:10.270151+0000","last_became_peered":"2023-12-22T09:16:10.270151+0000","last_unstale":"2023-12-22T09:16:11.272176+0000","last_undegraded":"2023-12-22T09:16:11.272176+0000","last_fullsized":"2023-12-22T09:16:11.272176+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:51:47.561948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248431+0000","last_change":"2023-12-22T09:15:55.157645+0000","last_active":"2023-12-22T09:16:10.248431+0000","last_peered":"2023-12-22T09:16:10.248431+0000","last_clean":"2023-12-22T09:16:10.248431+0000","last_became_active":"2023-12-22T09:15:55.157416+0000","last_became_peered":"2023-12-22T09:15:55.157416+0000","last_unstale":"2023-12-22T09:16:10.248431+0000","last_undegraded":"2023-12-22T09:16:10.248431+0000","last_fullsized":"2023-12-22T09:16:10.248431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:30.809324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264086+0000","last_change":"2023-12-22T09:16:10.260222+0000","last_active":"2023-12-22T09:16:11.264086+0000","last_peered":"2023-12-22T09:16:11.264086+0000","last_clean":"2023-12-22T09:16:11.264086+0000","last_became_active":"2023-12-22T09:16:10.259822+0000","last_became_peered":"2023-12-22T09:16:10.259822+0000","last_unstale":"2023-12-22T09:16:11.264086+0000","last_undegraded":"2023-12-22T09:16:11.264086+0000","last_fullsized":"2023-12-22T09:16:11.264086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:48.425223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251913+0000","last_change":"2023-12-22T09:15:55.131493+0000","last_active":"2023-12-22T09:16:10.251913+0000","last_peered":"2023-12-22T09:16:10.251913+0000","last_clean":"2023-12-22T09:16:10.251913+0000","last_became_active":"2023-12-22T09:15:55.131210+0000","last_became_peered":"2023-12-22T09:15:55.131210+0000","last_unstale":"2023-12-22T09:16:10.251913+0000","last_undegraded":"2023-12-22T09:16:10.251913+0000","last_fullsized":"2023-12-22T09:16:10.251913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.265084+0000","last_change":"2023-12-22T09:16:10.281847+0000","last_active":"2023-12-22T09:16:11.265084+0000","last_peered":"2023-12-22T09:16:11.265084+0000","last_clean":"2023-12-22T09:16:11.265084+0000","last_became_active":"2023-12-22T09:16:10.281603+0000","last_became_peered":"2023-12-22T09:16:10.281603+0000","last_unstale":"2023-12-22T09:16:11.265084+0000","last_undegraded":"2023-12-22T09:16:11.265084+0000","last_fullsized":"2023-12-22T09:16:11.265084+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:41.487761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.264985+0000","last_change":"2023-12-22T09:15:55.152987+0000","last_active":"2023-12-22T09:16:10.264985+0000","last_peered":"2023-12-22T09:16:10.264985+0000","last_clean":"2023-12-22T09:16:10.264985+0000","last_became_active":"2023-12-22T09:15:55.152690+0000","last_became_peered":"2023-12-22T09:15:55.152690+0000","last_unstale":"2023-12-22T09:16:10.264985+0000","last_undegraded":"2023-12-22T09:16:10.264985+0000","last_fullsized":"2023-12-22T09:16:10.264985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:57.296942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425119+0000","last_change":"2023-12-22T09:16:10.281647+0000","last_active":"2023-12-22T09:16:11.425119+0000","last_peered":"2023-12-22T09:16:11.425119+0000","last_clean":"2023-12-22T09:16:11.425119+0000","last_became_active":"2023-12-22T09:16:10.281421+0000","last_became_peered":"2023-12-22T09:16:10.281421+0000","last_unstale":"2023-12-22T09:16:11.425119+0000","last_undegraded":"2023-12-22T09:16:11.425119+0000","last_fullsized":"2023-12-22T09:16:11.425119+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:44:13.645736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.255808+0000","last_change":"2023-12-22T09:15:55.148098+0000","last_active":"2023-12-22T09:16:10.255808+0000","last_peered":"2023-12-22T09:16:10.255808+0000","last_clean":"2023-12-22T09:16:10.255808+0000","last_became_active":"2023-12-22T09:15:55.147830+0000","last_became_peered":"2023-12-22T09:15:55.147830+0000","last_unstale":"2023-12-22T09:16:10.255808+0000","last_undegraded":"2023-12-22T09:16:10.255808+0000","last_fullsized":"2023-12-22T09:16:10.255808+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:51:32.442849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267322+0000","last_change":"2023-12-22T09:16:10.282432+0000","last_active":"2023-12-22T09:16:11.267322+0000","last_peered":"2023-12-22T09:16:11.267322+0000","last_clean":"2023-12-22T09:16:11.267322+0000","last_became_active":"2023-12-22T09:16:10.280706+0000","last_became_peered":"2023-12-22T09:16:10.280706+0000","last_unstale":"2023-12-22T09:16:11.267322+0000","last_undegraded":"2023-12-22T09:16:11.267322+0000","last_fullsized":"2023-12-22T09:16:11.267322+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:44:13.645736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.276632+0000","last_change":"2023-12-22T09:15:55.166247+0000","last_active":"2023-12-22T09:16:10.276632+0000","last_peered":"2023-12-22T09:16:10.276632+0000","last_clean":"2023-12-22T09:16:10.276632+0000","last_became_active":"2023-12-22T09:15:55.165299+0000","last_became_peered":"2023-12-22T09:15:55.165299+0000","last_unstale":"2023-12-22T09:16:10.276632+0000","last_undegraded":"2023-12-22T09:16:10.276632+0000","last_fullsized":"2023-12-22T09:16:10.276632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.262354+0000","last_change":"2023-12-22T09:16:10.281248+0000","last_active":"2023-12-22T09:16:11.262354+0000","last_peered":"2023-12-22T09:16:11.262354+0000","last_clean":"2023-12-22T09:16:11.262354+0000","last_became_active":"2023-12-22T09:16:10.280988+0000","last_became_peered":"2023-12-22T09:16:10.280988+0000","last_unstale":"2023-12-22T09:16:11.262354+0000","last_undegraded":"2023-12-22T09:16:11.262354+0000","last_fullsized":"2023-12-22T09:16:11.262354+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:45:00.599099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267052+0000","last_change":"2023-12-22T09:15:55.164570+0000","last_active":"2023-12-22T09:16:10.267052+0000","last_peered":"2023-12-22T09:16:10.267052+0000","last_clean":"2023-12-22T09:16:10.267052+0000","last_became_active":"2023-12-22T09:15:55.164287+0000","last_became_peered":"2023-12-22T09:15:55.164287+0000","last_unstale":"2023-12-22T09:16:10.267052+0000","last_undegraded":"2023-12-22T09:16:10.267052+0000","last_fullsized":"2023-12-22T09:16:10.267052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:14.590975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.428032+0000","last_change":"2023-12-22T09:16:10.290243+0000","last_active":"2023-12-22T09:16:11.428032+0000","last_peered":"2023-12-22T09:16:11.428032+0000","last_clean":"2023-12-22T09:16:11.428032+0000","last_became_active":"2023-12-22T09:16:10.290025+0000","last_became_peered":"2023-12-22T09:16:10.290025+0000","last_unstale":"2023-12-22T09:16:11.428032+0000","last_undegraded":"2023-12-22T09:16:11.428032+0000","last_fullsized":"2023-12-22T09:16:11.428032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:40:55.811459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270695+0000","last_change":"2023-12-22T09:15:55.160606+0000","last_active":"2023-12-22T09:16:10.270695+0000","last_peered":"2023-12-22T09:16:10.270695+0000","last_clean":"2023-12-22T09:16:10.270695+0000","last_became_active":"2023-12-22T09:15:55.160309+0000","last_became_peered":"2023-12-22T09:15:55.160309+0000","last_unstale":"2023-12-22T09:16:10.270695+0000","last_undegraded":"2023-12-22T09:16:10.270695+0000","last_fullsized":"2023-12-22T09:16:10.270695+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:36.666191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424243+0000","last_change":"2023-12-22T09:16:10.274521+0000","last_active":"2023-12-22T09:16:11.424243+0000","last_peered":"2023-12-22T09:16:11.424243+0000","last_clean":"2023-12-22T09:16:11.424243+0000","last_became_active":"2023-12-22T09:16:10.274206+0000","last_became_peered":"2023-12-22T09:16:10.274206+0000","last_unstale":"2023-12-22T09:16:11.424243+0000","last_undegraded":"2023-12-22T09:16:11.424243+0000","last_fullsized":"2023-12-22T09:16:11.424243+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:35.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270256+0000","last_change":"2023-12-22T09:15:55.154556+0000","last_active":"2023-12-22T09:16:10.270256+0000","last_peered":"2023-12-22T09:16:10.270256+0000","last_clean":"2023-12-22T09:16:10.270256+0000","last_became_active":"2023-12-22T09:15:55.154239+0000","last_became_peered":"2023-12-22T09:15:55.154239+0000","last_unstale":"2023-12-22T09:16:10.270256+0000","last_undegraded":"2023-12-22T09:16:10.270256+0000","last_fullsized":"2023-12-22T09:16:10.270256+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268358+0000","last_change":"2023-12-22T09:16:10.290868+0000","last_active":"2023-12-22T09:16:11.268358+0000","last_peered":"2023-12-22T09:16:11.268358+0000","last_clean":"2023-12-22T09:16:11.268358+0000","last_became_active":"2023-12-22T09:16:10.290673+0000","last_became_peered":"2023-12-22T09:16:10.290673+0000","last_unstale":"2023-12-22T09:16:11.268358+0000","last_undegraded":"2023-12-22T09:16:11.268358+0000","last_fullsized":"2023-12-22T09:16:11.268358+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:14:16.220685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267114+0000","last_change":"2023-12-22T09:15:55.164877+0000","last_active":"2023-12-22T09:16:10.267114+0000","last_peered":"2023-12-22T09:16:10.267114+0000","last_clean":"2023-12-22T09:16:10.267114+0000","last_became_active":"2023-12-22T09:15:55.164136+0000","last_became_peered":"2023-12-22T09:15:55.164136+0000","last_unstale":"2023-12-22T09:16:10.267114+0000","last_undegraded":"2023-12-22T09:16:10.267114+0000","last_fullsized":"2023-12-22T09:16:10.267114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:51.891518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.432392+0000","last_change":"2023-12-22T09:16:10.285614+0000","last_active":"2023-12-22T09:16:11.432392+0000","last_peered":"2023-12-22T09:16:11.432392+0000","last_clean":"2023-12-22T09:16:11.432392+0000","last_became_active":"2023-12-22T09:16:10.284755+0000","last_became_peered":"2023-12-22T09:16:10.284755+0000","last_unstale":"2023-12-22T09:16:11.432392+0000","last_undegraded":"2023-12-22T09:16:11.432392+0000","last_fullsized":"2023-12-22T09:16:11.432392+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:49:55.673155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.262744+0000","last_change":"2023-12-22T09:15:55.150441+0000","last_active":"2023-12-22T09:16:10.262744+0000","last_peered":"2023-12-22T09:16:10.262744+0000","last_clean":"2023-12-22T09:16:10.262744+0000","last_became_active":"2023-12-22T09:15:55.150060+0000","last_became_peered":"2023-12-22T09:15:55.150060+0000","last_unstale":"2023-12-22T09:16:10.262744+0000","last_undegraded":"2023-12-22T09:16:10.262744+0000","last_fullsized":"2023-12-22T09:16:10.262744+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:51.891518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425274+0000","last_change":"2023-12-22T09:16:10.270409+0000","last_active":"2023-12-22T09:16:11.425274+0000","last_peered":"2023-12-22T09:16:11.425274+0000","last_clean":"2023-12-22T09:16:11.425274+0000","last_became_active":"2023-12-22T09:16:10.265764+0000","last_became_peered":"2023-12-22T09:16:10.265764+0000","last_unstale":"2023-12-22T09:16:11.425274+0000","last_undegraded":"2023-12-22T09:16:11.425274+0000","last_fullsized":"2023-12-22T09:16:11.425274+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:40:55.811459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.265081+0000","last_change":"2023-12-22T09:15:55.162023+0000","last_active":"2023-12-22T09:16:10.265081+0000","last_peered":"2023-12-22T09:16:10.265081+0000","last_clean":"2023-12-22T09:16:10.265081+0000","last_became_active":"2023-12-22T09:15:55.161365+0000","last_became_peered":"2023-12-22T09:15:55.161365+0000","last_unstale":"2023-12-22T09:16:10.265081+0000","last_undegraded":"2023-12-22T09:16:10.265081+0000","last_fullsized":"2023-12-22T09:16:10.265081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:30.946693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.433891+0000","last_change":"2023-12-22T09:16:10.281978+0000","last_active":"2023-12-22T09:16:11.433891+0000","last_peered":"2023-12-22T09:16:11.433891+0000","last_clean":"2023-12-22T09:16:11.433891+0000","last_became_active":"2023-12-22T09:16:10.281683+0000","last_became_peered":"2023-12-22T09:16:10.281683+0000","last_unstale":"2023-12-22T09:16:11.433891+0000","last_undegraded":"2023-12-22T09:16:11.433891+0000","last_fullsized":"2023-12-22T09:16:11.433891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:22:16.109685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266764+0000","last_change":"2023-12-22T09:15:55.157211+0000","last_active":"2023-12-22T09:16:10.266764+0000","last_peered":"2023-12-22T09:16:10.266764+0000","last_clean":"2023-12-22T09:16:10.266764+0000","last_became_active":"2023-12-22T09:15:55.156865+0000","last_became_peered":"2023-12-22T09:15:55.156865+0000","last_unstale":"2023-12-22T09:16:10.266764+0000","last_undegraded":"2023-12-22T09:16:10.266764+0000","last_fullsized":"2023-12-22T09:16:10.266764+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:37.962424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267144+0000","last_change":"2023-12-22T09:16:10.291510+0000","last_active":"2023-12-22T09:16:11.267144+0000","last_peered":"2023-12-22T09:16:11.267144+0000","last_clean":"2023-12-22T09:16:11.267144+0000","last_became_active":"2023-12-22T09:16:10.291178+0000","last_became_peered":"2023-12-22T09:16:10.291178+0000","last_unstale":"2023-12-22T09:16:11.267144+0000","last_undegraded":"2023-12-22T09:16:11.267144+0000","last_fullsized":"2023-12-22T09:16:11.267144+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:22.458879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272006+0000","last_change":"2023-12-22T09:15:55.148229+0000","last_active":"2023-12-22T09:16:10.272006+0000","last_peered":"2023-12-22T09:16:10.272006+0000","last_clean":"2023-12-22T09:16:10.272006+0000","last_became_active":"2023-12-22T09:15:55.147954+0000","last_became_peered":"2023-12-22T09:15:55.147954+0000","last_unstale":"2023-12-22T09:16:10.272006+0000","last_undegraded":"2023-12-22T09:16:10.272006+0000","last_fullsized":"2023-12-22T09:16:10.272006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426997+0000","last_change":"2023-12-22T09:16:10.270464+0000","last_active":"2023-12-22T09:16:11.426997+0000","last_peered":"2023-12-22T09:16:11.426997+0000","last_clean":"2023-12-22T09:16:11.426997+0000","last_became_active":"2023-12-22T09:16:10.270115+0000","last_became_peered":"2023-12-22T09:16:10.270115+0000","last_unstale":"2023-12-22T09:16:11.426997+0000","last_undegraded":"2023-12-22T09:16:11.426997+0000","last_fullsized":"2023-12-22T09:16:11.426997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:14:54.123508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.756072+0000","last_change":"2023-12-22T09:15:55.158945+0000","last_active":"2023-12-22T09:16:09.756072+0000","last_peered":"2023-12-22T09:16:09.756072+0000","last_clean":"2023-12-22T09:16:09.756072+0000","last_became_active":"2023-12-22T09:15:55.158673+0000","last_became_peered":"2023-12-22T09:15:55.158673+0000","last_unstale":"2023-12-22T09:16:09.756072+0000","last_undegraded":"2023-12-22T09:16:09.756072+0000","last_fullsized":"2023-12-22T09:16:09.756072+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:02:09.511521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268724+0000","last_change":"2023-12-22T09:16:10.291014+0000","last_active":"2023-12-22T09:16:11.268724+0000","last_peered":"2023-12-22T09:16:11.268724+0000","last_clean":"2023-12-22T09:16:11.268724+0000","last_became_active":"2023-12-22T09:16:10.290860+0000","last_became_peered":"2023-12-22T09:16:10.290860+0000","last_unstale":"2023-12-22T09:16:11.268724+0000","last_undegraded":"2023-12-22T09:16:11.268724+0000","last_fullsized":"2023-12-22T09:16:11.268724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:35.591774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.250633+0000","last_change":"2023-12-22T09:15:55.154647+0000","last_active":"2023-12-22T09:16:10.250633+0000","last_peered":"2023-12-22T09:16:10.250633+0000","last_clean":"2023-12-22T09:16:10.250633+0000","last_became_active":"2023-12-22T09:15:55.154331+0000","last_became_peered":"2023-12-22T09:15:55.154331+0000","last_unstale":"2023-12-22T09:16:10.250633+0000","last_undegraded":"2023-12-22T09:16:10.250633+0000","last_fullsized":"2023-12-22T09:16:10.250633+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:08:11.667144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.432560+0000","last_change":"2023-12-22T09:16:10.284759+0000","last_active":"2023-12-22T09:16:11.432560+0000","last_peered":"2023-12-22T09:16:11.432560+0000","last_clean":"2023-12-22T09:16:11.432560+0000","last_became_active":"2023-12-22T09:16:10.284476+0000","last_became_peered":"2023-12-22T09:16:10.284476+0000","last_unstale":"2023-12-22T09:16:11.432560+0000","last_undegraded":"2023-12-22T09:16:11.432560+0000","last_fullsized":"2023-12-22T09:16:11.432560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:44:13.645736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.764263+0000","last_change":"2023-12-22T09:15:55.160338+0000","last_active":"2023-12-22T09:16:09.764263+0000","last_peered":"2023-12-22T09:16:09.764263+0000","last_clean":"2023-12-22T09:16:09.764263+0000","last_became_active":"2023-12-22T09:15:55.159705+0000","last_became_peered":"2023-12-22T09:15:55.159705+0000","last_unstale":"2023-12-22T09:16:09.764263+0000","last_undegraded":"2023-12-22T09:16:09.764263+0000","last_fullsized":"2023-12-22T09:16:09.764263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:34:05.506636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425263+0000","last_change":"2023-12-22T09:16:10.279334+0000","last_active":"2023-12-22T09:16:11.425263+0000","last_peered":"2023-12-22T09:16:11.425263+0000","last_clean":"2023-12-22T09:16:11.425263+0000","last_became_active":"2023-12-22T09:16:10.279035+0000","last_became_peered":"2023-12-22T09:16:10.279035+0000","last_unstale":"2023-12-22T09:16:11.425263+0000","last_undegraded":"2023-12-22T09:16:11.425263+0000","last_fullsized":"2023-12-22T09:16:11.425263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:42:53.326372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267214+0000","last_change":"2023-12-22T09:15:55.154883+0000","last_active":"2023-12-22T09:16:10.267214+0000","last_peered":"2023-12-22T09:16:10.267214+0000","last_clean":"2023-12-22T09:16:10.267214+0000","last_became_active":"2023-12-22T09:15:55.154588+0000","last_became_peered":"2023-12-22T09:15:55.154588+0000","last_unstale":"2023-12-22T09:16:10.267214+0000","last_undegraded":"2023-12-22T09:16:10.267214+0000","last_fullsized":"2023-12-22T09:16:10.267214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:40.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.269564+0000","last_change":"2023-12-22T09:16:10.263071+0000","last_active":"2023-12-22T09:16:10.269564+0000","last_peered":"2023-12-22T09:16:10.269564+0000","last_clean":"2023-12-22T09:16:10.269564+0000","last_became_active":"2023-12-22T09:16:10.262773+0000","last_became_peered":"2023-12-22T09:16:10.262773+0000","last_unstale":"2023-12-22T09:16:10.269564+0000","last_undegraded":"2023-12-22T09:16:10.269564+0000","last_fullsized":"2023-12-22T09:16:10.269564+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:00.420958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.263271+0000","last_change":"2023-12-22T09:15:55.156853+0000","last_active":"2023-12-22T09:16:10.263271+0000","last_peered":"2023-12-22T09:16:10.263271+0000","last_clean":"2023-12-22T09:16:10.263271+0000","last_became_active":"2023-12-22T09:15:55.156575+0000","last_became_peered":"2023-12-22T09:15:55.156575+0000","last_unstale":"2023-12-22T09:16:10.263271+0000","last_undegraded":"2023-12-22T09:16:10.263271+0000","last_fullsized":"2023-12-22T09:16:10.263271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:59.232942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267859+0000","last_change":"2023-12-22T09:16:10.286004+0000","last_active":"2023-12-22T09:16:11.267859+0000","last_peered":"2023-12-22T09:16:11.267859+0000","last_clean":"2023-12-22T09:16:11.267859+0000","last_became_active":"2023-12-22T09:16:10.285776+0000","last_became_peered":"2023-12-22T09:16:10.285776+0000","last_unstale":"2023-12-22T09:16:11.267859+0000","last_undegraded":"2023-12-22T09:16:11.267859+0000","last_fullsized":"2023-12-22T09:16:11.267859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:57.781728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272283+0000","last_change":"2023-12-22T09:15:55.149854+0000","last_active":"2023-12-22T09:16:10.272283+0000","last_peered":"2023-12-22T09:16:10.272283+0000","last_clean":"2023-12-22T09:16:10.272283+0000","last_became_active":"2023-12-22T09:15:55.149383+0000","last_became_peered":"2023-12-22T09:15:55.149383+0000","last_unstale":"2023-12-22T09:16:10.272283+0000","last_undegraded":"2023-12-22T09:16:10.272283+0000","last_fullsized":"2023-12-22T09:16:10.272283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:38:09.607747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264766+0000","last_change":"2023-12-22T09:16:10.265008+0000","last_active":"2023-12-22T09:16:11.264766+0000","last_peered":"2023-12-22T09:16:11.264766+0000","last_clean":"2023-12-22T09:16:11.264766+0000","last_became_active":"2023-12-22T09:16:10.264574+0000","last_became_peered":"2023-12-22T09:16:10.264574+0000","last_unstale":"2023-12-22T09:16:11.264766+0000","last_undegraded":"2023-12-22T09:16:11.264766+0000","last_fullsized":"2023-12-22T09:16:11.264766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:29:31.999438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.247987+0000","last_change":"2023-12-22T09:15:55.159003+0000","last_active":"2023-12-22T09:16:10.247987+0000","last_peered":"2023-12-22T09:16:10.247987+0000","last_clean":"2023-12-22T09:16:10.247987+0000","last_became_active":"2023-12-22T09:15:55.158806+0000","last_became_peered":"2023-12-22T09:15:55.158806+0000","last_unstale":"2023-12-22T09:16:10.247987+0000","last_undegraded":"2023-12-22T09:16:10.247987+0000","last_fullsized":"2023-12-22T09:16:10.247987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:17.416418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.266038+0000","last_change":"2023-12-22T09:16:10.275244+0000","last_active":"2023-12-22T09:16:11.266038+0000","last_peered":"2023-12-22T09:16:11.266038+0000","last_clean":"2023-12-22T09:16:11.266038+0000","last_became_active":"2023-12-22T09:16:10.274484+0000","last_became_peered":"2023-12-22T09:16:10.274484+0000","last_unstale":"2023-12-22T09:16:11.266038+0000","last_undegraded":"2023-12-22T09:16:11.266038+0000","last_fullsized":"2023-12-22T09:16:11.266038+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:22.165936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.758803+0000","last_change":"2023-12-22T09:15:55.141689+0000","last_active":"2023-12-22T09:16:09.758803+0000","last_peered":"2023-12-22T09:16:09.758803+0000","last_clean":"2023-12-22T09:16:09.758803+0000","last_became_active":"2023-12-22T09:15:55.141370+0000","last_became_peered":"2023-12-22T09:15:55.141370+0000","last_unstale":"2023-12-22T09:16:09.758803+0000","last_undegraded":"2023-12-22T09:16:09.758803+0000","last_fullsized":"2023-12-22T09:16:09.758803+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:46:11.778416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.266711+0000","last_change":"2023-12-22T09:16:10.289192+0000","last_active":"2023-12-22T09:16:11.266711+0000","last_peered":"2023-12-22T09:16:11.266711+0000","last_clean":"2023-12-22T09:16:11.266711+0000","last_became_active":"2023-12-22T09:16:10.288944+0000","last_became_peered":"2023-12-22T09:16:10.288944+0000","last_unstale":"2023-12-22T09:16:11.266711+0000","last_undegraded":"2023-12-22T09:16:11.266711+0000","last_fullsized":"2023-12-22T09:16:11.266711+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:06.507360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251104+0000","last_change":"2023-12-22T09:15:55.164805+0000","last_active":"2023-12-22T09:16:10.251104+0000","last_peered":"2023-12-22T09:16:10.251104+0000","last_clean":"2023-12-22T09:16:10.251104+0000","last_became_active":"2023-12-22T09:15:55.164583+0000","last_became_peered":"2023-12-22T09:15:55.164583+0000","last_unstale":"2023-12-22T09:16:10.251104+0000","last_undegraded":"2023-12-22T09:16:10.251104+0000","last_fullsized":"2023-12-22T09:16:10.251104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.276269+0000","last_change":"2023-12-22T09:16:10.268674+0000","last_active":"2023-12-22T09:16:10.276269+0000","last_peered":"2023-12-22T09:16:10.276269+0000","last_clean":"2023-12-22T09:16:10.276269+0000","last_became_active":"2023-12-22T09:16:10.268002+0000","last_became_peered":"2023-12-22T09:16:10.268002+0000","last_unstale":"2023-12-22T09:16:10.276269+0000","last_undegraded":"2023-12-22T09:16:10.276269+0000","last_fullsized":"2023-12-22T09:16:10.276269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:16:15.802261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.762624+0000","last_change":"2023-12-22T09:15:55.156206+0000","last_active":"2023-12-22T09:16:09.762624+0000","last_peered":"2023-12-22T09:16:09.762624+0000","last_clean":"2023-12-22T09:16:09.762624+0000","last_became_active":"2023-12-22T09:15:55.155875+0000","last_became_peered":"2023-12-22T09:15:55.155875+0000","last_unstale":"2023-12-22T09:16:09.762624+0000","last_undegraded":"2023-12-22T09:16:09.762624+0000","last_fullsized":"2023-12-22T09:16:09.762624+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:29.348560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.263426+0000","last_change":"2023-12-22T09:16:10.280591+0000","last_active":"2023-12-22T09:16:11.263426+0000","last_peered":"2023-12-22T09:16:11.263426+0000","last_clean":"2023-12-22T09:16:11.263426+0000","last_became_active":"2023-12-22T09:16:10.280305+0000","last_became_peered":"2023-12-22T09:16:10.280305+0000","last_unstale":"2023-12-22T09:16:11.263426+0000","last_undegraded":"2023-12-22T09:16:11.263426+0000","last_fullsized":"2023-12-22T09:16:11.263426+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:31.348386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.269164+0000","last_change":"2023-12-22T09:15:55.153391+0000","last_active":"2023-12-22T09:16:10.269164+0000","last_peered":"2023-12-22T09:16:10.269164+0000","last_clean":"2023-12-22T09:16:10.269164+0000","last_became_active":"2023-12-22T09:15:55.153161+0000","last_became_peered":"2023-12-22T09:15:55.153161+0000","last_unstale":"2023-12-22T09:16:10.269164+0000","last_undegraded":"2023-12-22T09:16:10.269164+0000","last_fullsized":"2023-12-22T09:16:10.269164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268582+0000","last_change":"2023-12-22T09:16:10.290774+0000","last_active":"2023-12-22T09:16:11.268582+0000","last_peered":"2023-12-22T09:16:11.268582+0000","last_clean":"2023-12-22T09:16:11.268582+0000","last_became_active":"2023-12-22T09:16:10.290611+0000","last_became_peered":"2023-12-22T09:16:10.290611+0000","last_unstale":"2023-12-22T09:16:11.268582+0000","last_undegraded":"2023-12-22T09:16:11.268582+0000","last_fullsized":"2023-12-22T09:16:11.268582+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:51:40.239522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.765148+0000","last_change":"2023-12-22T09:15:55.138160+0000","last_active":"2023-12-22T09:16:09.765148+0000","last_peered":"2023-12-22T09:16:09.765148+0000","last_clean":"2023-12-22T09:16:09.765148+0000","last_became_active":"2023-12-22T09:15:55.137859+0000","last_became_peered":"2023-12-22T09:15:55.137859+0000","last_unstale":"2023-12-22T09:16:09.765148+0000","last_undegraded":"2023-12-22T09:16:09.765148+0000","last_fullsized":"2023-12-22T09:16:09.765148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:37:03.909540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.285958+0000","last_change":"2023-12-22T09:16:10.280626+0000","last_active":"2023-12-22T09:16:10.285958+0000","last_peered":"2023-12-22T09:16:10.285958+0000","last_clean":"2023-12-22T09:16:10.285958+0000","last_became_active":"2023-12-22T09:16:10.280381+0000","last_became_peered":"2023-12-22T09:16:10.280381+0000","last_unstale":"2023-12-22T09:16:10.285958+0000","last_undegraded":"2023-12-22T09:16:10.285958+0000","last_fullsized":"2023-12-22T09:16:10.285958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:38:55.989666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.764128+0000","last_change":"2023-12-22T09:15:55.133273+0000","last_active":"2023-12-22T09:16:09.764128+0000","last_peered":"2023-12-22T09:16:09.764128+0000","last_clean":"2023-12-22T09:16:09.764128+0000","last_became_active":"2023-12-22T09:15:55.132514+0000","last_became_peered":"2023-12-22T09:15:55.132514+0000","last_unstale":"2023-12-22T09:16:09.764128+0000","last_undegraded":"2023-12-22T09:16:09.764128+0000","last_fullsized":"2023-12-22T09:16:09.764128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:07.778320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267697+0000","last_change":"2023-12-22T09:16:10.282735+0000","last_active":"2023-12-22T09:16:11.267697+0000","last_peered":"2023-12-22T09:16:11.267697+0000","last_clean":"2023-12-22T09:16:11.267697+0000","last_became_active":"2023-12-22T09:16:10.282154+0000","last_became_peered":"2023-12-22T09:16:10.282154+0000","last_unstale":"2023-12-22T09:16:11.267697+0000","last_undegraded":"2023-12-22T09:16:11.267697+0000","last_fullsized":"2023-12-22T09:16:11.267697+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:30.220686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272264+0000","last_change":"2023-12-22T09:15:55.149676+0000","last_active":"2023-12-22T09:16:10.272264+0000","last_peered":"2023-12-22T09:16:10.272264+0000","last_clean":"2023-12-22T09:16:10.272264+0000","last_became_active":"2023-12-22T09:15:55.148929+0000","last_became_peered":"2023-12-22T09:15:55.148929+0000","last_unstale":"2023-12-22T09:16:10.272264+0000","last_undegraded":"2023-12-22T09:16:10.272264+0000","last_fullsized":"2023-12-22T09:16:10.272264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.434070+0000","last_change":"2023-12-22T09:16:10.283138+0000","last_active":"2023-12-22T09:16:11.434070+0000","last_peered":"2023-12-22T09:16:11.434070+0000","last_clean":"2023-12-22T09:16:11.434070+0000","last_became_active":"2023-12-22T09:16:10.282802+0000","last_became_peered":"2023-12-22T09:16:10.282802+0000","last_unstale":"2023-12-22T09:16:11.434070+0000","last_undegraded":"2023-12-22T09:16:11.434070+0000","last_fullsized":"2023-12-22T09:16:11.434070+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:35.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249202+0000","last_change":"2023-12-22T09:15:55.150973+0000","last_active":"2023-12-22T09:16:10.249202+0000","last_peered":"2023-12-22T09:16:10.249202+0000","last_clean":"2023-12-22T09:16:10.249202+0000","last_became_active":"2023-12-22T09:15:55.150358+0000","last_became_peered":"2023-12-22T09:15:55.150358+0000","last_unstale":"2023-12-22T09:16:10.249202+0000","last_undegraded":"2023-12-22T09:16:10.249202+0000","last_fullsized":"2023-12-22T09:16:10.249202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:30.514481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.283705+0000","last_change":"2023-12-22T09:16:10.279659+0000","last_active":"2023-12-22T09:16:10.283705+0000","last_peered":"2023-12-22T09:16:10.283705+0000","last_clean":"2023-12-22T09:16:10.283705+0000","last_became_active":"2023-12-22T09:16:10.279167+0000","last_became_peered":"2023-12-22T09:16:10.279167+0000","last_unstale":"2023-12-22T09:16:10.283705+0000","last_undegraded":"2023-12-22T09:16:10.283705+0000","last_fullsized":"2023-12-22T09:16:10.283705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:44:20.340636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425690+0000","last_change":"2023-12-22T09:16:09.784658+0000","last_active":"2023-12-22T09:16:11.425690+0000","last_peered":"2023-12-22T09:16:11.425690+0000","last_clean":"2023-12-22T09:16:11.425690+0000","last_became_active":"2023-12-22T09:16:09.784290+0000","last_became_peered":"2023-12-22T09:16:09.784290+0000","last_unstale":"2023-12-22T09:16:11.425690+0000","last_undegraded":"2023-12-22T09:16:11.425690+0000","last_fullsized":"2023-12-22T09:16:11.425690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:57.339802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.273222+0000","last_change":"2023-12-22T09:15:55.166209+0000","last_active":"2023-12-22T09:16:10.273222+0000","last_peered":"2023-12-22T09:16:10.273222+0000","last_clean":"2023-12-22T09:16:10.273222+0000","last_became_active":"2023-12-22T09:15:55.165918+0000","last_became_peered":"2023-12-22T09:15:55.165918+0000","last_unstale":"2023-12-22T09:16:10.273222+0000","last_undegraded":"2023-12-22T09:16:10.273222+0000","last_fullsized":"2023-12-22T09:16:10.273222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.759089+0000","last_change":"2023-12-22T09:15:54.667477+0000","last_active":"2023-12-22T09:16:09.759089+0000","last_peered":"2023-12-22T09:16:09.759089+0000","last_clean":"2023-12-22T09:16:09.759089+0000","last_became_active":"2023-12-22T09:15:54.667221+0000","last_became_peered":"2023-12-22T09:15:54.667221+0000","last_unstale":"2023-12-22T09:16:09.759089+0000","last_undegraded":"2023-12-22T09:16:09.759089+0000","last_fullsized":"2023-12-22T09:16:09.759089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:24.188717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.263831+0000","last_change":"2023-12-22T09:16:10.265238+0000","last_active":"2023-12-22T09:16:11.263831+0000","last_peered":"2023-12-22T09:16:11.263831+0000","last_clean":"2023-12-22T09:16:11.263831+0000","last_became_active":"2023-12-22T09:16:10.262912+0000","last_became_peered":"2023-12-22T09:16:10.262912+0000","last_unstale":"2023-12-22T09:16:11.263831+0000","last_undegraded":"2023-12-22T09:16:11.263831+0000","last_fullsized":"2023-12-22T09:16:11.263831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:25.628702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.428230+0000","last_change":"2023-12-22T09:16:09.785331+0000","last_active":"2023-12-22T09:16:11.428230+0000","last_peered":"2023-12-22T09:16:11.428230+0000","last_clean":"2023-12-22T09:16:11.428230+0000","last_became_active":"2023-12-22T09:16:09.784464+0000","last_became_peered":"2023-12-22T09:16:09.784464+0000","last_unstale":"2023-12-22T09:16:11.428230+0000","last_undegraded":"2023-12-22T09:16:11.428230+0000","last_fullsized":"2023-12-22T09:16:11.428230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:05:44.480599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249813+0000","last_change":"2023-12-22T09:15:55.165566+0000","last_active":"2023-12-22T09:16:10.249813+0000","last_peered":"2023-12-22T09:16:10.249813+0000","last_clean":"2023-12-22T09:16:10.249813+0000","last_became_active":"2023-12-22T09:15:55.165257+0000","last_became_peered":"2023-12-22T09:15:55.165257+0000","last_unstale":"2023-12-22T09:16:10.249813+0000","last_undegraded":"2023-12-22T09:16:10.249813+0000","last_fullsized":"2023-12-22T09:16:10.249813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:08.180891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.271024+0000","last_change":"2023-12-22T09:15:54.671228+0000","last_active":"2023-12-22T09:16:10.271024+0000","last_peered":"2023-12-22T09:16:10.271024+0000","last_clean":"2023-12-22T09:16:10.271024+0000","last_became_active":"2023-12-22T09:15:54.670158+0000","last_became_peered":"2023-12-22T09:15:54.670158+0000","last_unstale":"2023-12-22T09:16:10.271024+0000","last_undegraded":"2023-12-22T09:16:10.271024+0000","last_fullsized":"2023-12-22T09:16:10.271024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.429954+0000","last_change":"2023-12-22T09:16:10.275878+0000","last_active":"2023-12-22T09:16:11.429954+0000","last_peered":"2023-12-22T09:16:11.429954+0000","last_clean":"2023-12-22T09:16:11.429954+0000","last_became_active":"2023-12-22T09:16:10.275638+0000","last_became_peered":"2023-12-22T09:16:10.275638+0000","last_unstale":"2023-12-22T09:16:11.429954+0000","last_undegraded":"2023-12-22T09:16:11.429954+0000","last_fullsized":"2023-12-22T09:16:11.429954+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:22.458879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"43'4","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.283814+0000","last_change":"2023-12-22T09:16:09.782069+0000","last_active":"2023-12-22T09:16:10.283814+0000","last_peered":"2023-12-22T09:16:10.283814+0000","last_clean":"2023-12-22T09:16:10.283814+0000","last_became_active":"2023-12-22T09:16:09.781084+0000","last_became_peered":"2023-12-22T09:16:09.781084+0000","last_unstale":"2023-12-22T09:16:10.283814+0000","last_undegraded":"2023-12-22T09:16:10.283814+0000","last_fullsized":"2023-12-22T09:16:10.283814+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:11:20.469907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267118+0000","last_change":"2023-12-22T09:15:55.155575+0000","last_active":"2023-12-22T09:16:10.267118+0000","last_peered":"2023-12-22T09:16:10.267118+0000","last_clean":"2023-12-22T09:16:10.267118+0000","last_became_active":"2023-12-22T09:15:55.154127+0000","last_became_peered":"2023-12-22T09:15:55.154127+0000","last_unstale":"2023-12-22T09:16:10.267118+0000","last_undegraded":"2023-12-22T09:16:10.267118+0000","last_fullsized":"2023-12-22T09:16:10.267118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:30.946693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249947+0000","last_change":"2023-12-22T09:15:54.671283+0000","last_active":"2023-12-22T09:16:10.249947+0000","last_peered":"2023-12-22T09:16:10.249947+0000","last_clean":"2023-12-22T09:16:10.249947+0000","last_became_active":"2023-12-22T09:15:54.671022+0000","last_became_peered":"2023-12-22T09:15:54.671022+0000","last_unstale":"2023-12-22T09:16:10.249947+0000","last_undegraded":"2023-12-22T09:16:10.249947+0000","last_fullsized":"2023-12-22T09:16:10.249947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:29:31.303313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426691+0000","last_change":"2023-12-22T09:16:10.278245+0000","last_active":"2023-12-22T09:16:11.426691+0000","last_peered":"2023-12-22T09:16:11.426691+0000","last_clean":"2023-12-22T09:16:11.426691+0000","last_became_active":"2023-12-22T09:16:10.277958+0000","last_became_peered":"2023-12-22T09:16:10.277958+0000","last_unstale":"2023-12-22T09:16:11.426691+0000","last_undegraded":"2023-12-22T09:16:11.426691+0000","last_fullsized":"2023-12-22T09:16:11.426691+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:07:40.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425349+0000","last_change":"2023-12-22T09:16:09.791997+0000","last_active":"2023-12-22T09:16:11.425349+0000","last_peered":"2023-12-22T09:16:11.425349+0000","last_clean":"2023-12-22T09:16:11.425349+0000","last_became_active":"2023-12-22T09:16:09.786143+0000","last_became_peered":"2023-12-22T09:16:09.786143+0000","last_unstale":"2023-12-22T09:16:11.425349+0000","last_undegraded":"2023-12-22T09:16:11.425349+0000","last_fullsized":"2023-12-22T09:16:11.425349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:10:11.728352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.259162+0000","last_change":"2023-12-22T09:15:55.143879+0000","last_active":"2023-12-22T09:16:10.259162+0000","last_peered":"2023-12-22T09:16:10.259162+0000","last_clean":"2023-12-22T09:16:10.259162+0000","last_became_active":"2023-12-22T09:15:55.143628+0000","last_became_peered":"2023-12-22T09:15:55.143628+0000","last_unstale":"2023-12-22T09:16:10.259162+0000","last_undegraded":"2023-12-22T09:16:10.259162+0000","last_fullsized":"2023-12-22T09:16:10.259162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:51.081158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266096+0000","last_change":"2023-12-22T09:15:54.671933+0000","last_active":"2023-12-22T09:16:10.266096+0000","last_peered":"2023-12-22T09:16:10.266096+0000","last_clean":"2023-12-22T09:16:10.266096+0000","last_became_active":"2023-12-22T09:15:54.671561+0000","last_became_peered":"2023-12-22T09:15:54.671561+0000","last_unstale":"2023-12-22T09:16:10.266096+0000","last_undegraded":"2023-12-22T09:16:10.266096+0000","last_fullsized":"2023-12-22T09:16:10.266096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:29.793501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.265400+0000","last_change":"2023-12-22T09:16:10.264853+0000","last_active":"2023-12-22T09:16:11.265400+0000","last_peered":"2023-12-22T09:16:11.265400+0000","last_clean":"2023-12-22T09:16:11.265400+0000","last_became_active":"2023-12-22T09:16:10.264257+0000","last_became_peered":"2023-12-22T09:16:10.264257+0000","last_unstale":"2023-12-22T09:16:11.265400+0000","last_undegraded":"2023-12-22T09:16:11.265400+0000","last_fullsized":"2023-12-22T09:16:11.265400+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:14.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.252183+0000","last_change":"2023-12-22T09:16:09.777600+0000","last_active":"2023-12-22T09:16:10.252183+0000","last_peered":"2023-12-22T09:16:10.252183+0000","last_clean":"2023-12-22T09:16:10.252183+0000","last_became_active":"2023-12-22T09:16:09.776824+0000","last_became_peered":"2023-12-22T09:16:09.776824+0000","last_unstale":"2023-12-22T09:16:10.252183+0000","last_undegraded":"2023-12-22T09:16:10.252183+0000","last_fullsized":"2023-12-22T09:16:10.252183+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:12:42.979533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270462+0000","last_change":"2023-12-22T09:15:55.146289+0000","last_active":"2023-12-22T09:16:10.270462+0000","last_peered":"2023-12-22T09:16:10.270462+0000","last_clean":"2023-12-22T09:16:10.270462+0000","last_became_active":"2023-12-22T09:15:55.146028+0000","last_became_peered":"2023-12-22T09:15:55.146028+0000","last_unstale":"2023-12-22T09:16:10.270462+0000","last_undegraded":"2023-12-22T09:16:10.270462+0000","last_fullsized":"2023-12-22T09:16:10.270462+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:22:30.809324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267313+0000","last_change":"2023-12-22T09:15:54.676125+0000","last_active":"2023-12-22T09:16:10.267313+0000","last_peered":"2023-12-22T09:16:10.267313+0000","last_clean":"2023-12-22T09:16:10.267313+0000","last_became_active":"2023-12-22T09:15:54.675809+0000","last_became_peered":"2023-12-22T09:15:54.675809+0000","last_unstale":"2023-12-22T09:16:10.267313+0000","last_undegraded":"2023-12-22T09:16:10.267313+0000","last_fullsized":"2023-12-22T09:16:10.267313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:29:31.303313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.434313+0000","last_change":"2023-12-22T09:16:10.294447+0000","last_active":"2023-12-22T09:16:11.434313+0000","last_peered":"2023-12-22T09:16:11.434313+0000","last_clean":"2023-12-22T09:16:11.434313+0000","last_became_active":"2023-12-22T09:16:10.293584+0000","last_became_peered":"2023-12-22T09:16:10.293584+0000","last_unstale":"2023-12-22T09:16:11.434313+0000","last_undegraded":"2023-12-22T09:16:11.434313+0000","last_fullsized":"2023-12-22T09:16:11.434313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:07:40.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.266422+0000","last_change":"2023-12-22T09:16:09.785196+0000","last_active":"2023-12-22T09:16:11.266422+0000","last_peered":"2023-12-22T09:16:11.266422+0000","last_clean":"2023-12-22T09:16:11.266422+0000","last_became_active":"2023-12-22T09:16:09.784947+0000","last_became_peered":"2023-12-22T09:16:09.784947+0000","last_unstale":"2023-12-22T09:16:11.266422+0000","last_undegraded":"2023-12-22T09:16:11.266422+0000","last_fullsized":"2023-12-22T09:16:11.266422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:50:22.723361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.265166+0000","last_change":"2023-12-22T09:15:55.148381+0000","last_active":"2023-12-22T09:16:10.265166+0000","last_peered":"2023-12-22T09:16:10.265166+0000","last_clean":"2023-12-22T09:16:10.265166+0000","last_became_active":"2023-12-22T09:15:55.148034+0000","last_became_peered":"2023-12-22T09:15:55.148034+0000","last_unstale":"2023-12-22T09:16:10.265166+0000","last_undegraded":"2023-12-22T09:16:10.265166+0000","last_fullsized":"2023-12-22T09:16:10.265166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:25.241349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270331+0000","last_change":"2023-12-22T09:15:54.674806+0000","last_active":"2023-12-22T09:16:10.270331+0000","last_peered":"2023-12-22T09:16:10.270331+0000","last_clean":"2023-12-22T09:16:10.270331+0000","last_became_active":"2023-12-22T09:15:54.673649+0000","last_became_peered":"2023-12-22T09:15:54.673649+0000","last_unstale":"2023-12-22T09:16:10.270331+0000","last_undegraded":"2023-12-22T09:16:10.270331+0000","last_fullsized":"2023-12-22T09:16:10.270331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:08.829353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426193+0000","last_change":"2023-12-22T09:16:10.291696+0000","last_active":"2023-12-22T09:16:11.426193+0000","last_peered":"2023-12-22T09:16:11.426193+0000","last_clean":"2023-12-22T09:16:11.426193+0000","last_became_active":"2023-12-22T09:16:10.291358+0000","last_became_peered":"2023-12-22T09:16:10.291358+0000","last_unstale":"2023-12-22T09:16:11.426193+0000","last_undegraded":"2023-12-22T09:16:11.426193+0000","last_fullsized":"2023-12-22T09:16:11.426193+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:44:13.645736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268007+0000","last_change":"2023-12-22T09:16:09.788858+0000","last_active":"2023-12-22T09:16:11.268007+0000","last_peered":"2023-12-22T09:16:11.268007+0000","last_clean":"2023-12-22T09:16:11.268007+0000","last_became_active":"2023-12-22T09:16:09.788590+0000","last_became_peered":"2023-12-22T09:16:09.788590+0000","last_unstale":"2023-12-22T09:16:11.268007+0000","last_undegraded":"2023-12-22T09:16:11.268007+0000","last_fullsized":"2023-12-22T09:16:11.268007+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:43:00.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.263087+0000","last_change":"2023-12-22T09:15:55.167800+0000","last_active":"2023-12-22T09:16:10.263087+0000","last_peered":"2023-12-22T09:16:10.263087+0000","last_clean":"2023-12-22T09:16:10.263087+0000","last_became_active":"2023-12-22T09:15:55.167492+0000","last_became_peered":"2023-12-22T09:15:55.167492+0000","last_unstale":"2023-12-22T09:16:10.263087+0000","last_undegraded":"2023-12-22T09:16:10.263087+0000","last_fullsized":"2023-12-22T09:16:10.263087+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:14.590975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249186+0000","last_change":"2023-12-22T09:15:54.677140+0000","last_active":"2023-12-22T09:16:10.249186+0000","last_peered":"2023-12-22T09:16:10.249186+0000","last_clean":"2023-12-22T09:16:10.249186+0000","last_became_active":"2023-12-22T09:15:54.676892+0000","last_became_peered":"2023-12-22T09:15:54.676892+0000","last_unstale":"2023-12-22T09:16:10.249186+0000","last_undegraded":"2023-12-22T09:16:10.249186+0000","last_fullsized":"2023-12-22T09:16:10.249186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:29.702956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.433668+0000","last_change":"2023-12-22T09:16:10.284760+0000","last_active":"2023-12-22T09:16:11.433668+0000","last_peered":"2023-12-22T09:16:11.433668+0000","last_clean":"2023-12-22T09:16:11.433668+0000","last_became_active":"2023-12-22T09:16:10.284512+0000","last_became_peered":"2023-12-22T09:16:10.284512+0000","last_unstale":"2023-12-22T09:16:11.433668+0000","last_undegraded":"2023-12-22T09:16:11.433668+0000","last_fullsized":"2023-12-22T09:16:11.433668+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:40:55.811459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426105+0000","last_change":"2023-12-22T09:16:09.781795+0000","last_active":"2023-12-22T09:16:11.426105+0000","last_peered":"2023-12-22T09:16:11.426105+0000","last_clean":"2023-12-22T09:16:11.426105+0000","last_became_active":"2023-12-22T09:16:09.781351+0000","last_became_peered":"2023-12-22T09:16:09.781351+0000","last_unstale":"2023-12-22T09:16:11.426105+0000","last_undegraded":"2023-12-22T09:16:11.426105+0000","last_fullsized":"2023-12-22T09:16:11.426105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:55:09.027625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258086+0000","last_change":"2023-12-22T09:15:55.135433+0000","last_active":"2023-12-22T09:16:10.258086+0000","last_peered":"2023-12-22T09:16:10.258086+0000","last_clean":"2023-12-22T09:16:10.258086+0000","last_became_active":"2023-12-22T09:15:55.135160+0000","last_became_peered":"2023-12-22T09:15:55.135160+0000","last_unstale":"2023-12-22T09:16:10.258086+0000","last_undegraded":"2023-12-22T09:16:10.258086+0000","last_fullsized":"2023-12-22T09:16:10.258086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:43.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.261013+0000","last_change":"2023-12-22T09:15:54.665511+0000","last_active":"2023-12-22T09:16:10.261013+0000","last_peered":"2023-12-22T09:16:10.261013+0000","last_clean":"2023-12-22T09:16:10.261013+0000","last_became_active":"2023-12-22T09:15:54.665202+0000","last_became_peered":"2023-12-22T09:15:54.665202+0000","last_unstale":"2023-12-22T09:16:10.261013+0000","last_undegraded":"2023-12-22T09:16:10.261013+0000","last_fullsized":"2023-12-22T09:16:10.261013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:00.147710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267439+0000","last_change":"2023-12-22T09:16:10.277900+0000","last_active":"2023-12-22T09:16:11.267439+0000","last_peered":"2023-12-22T09:16:11.267439+0000","last_clean":"2023-12-22T09:16:11.267439+0000","last_became_active":"2023-12-22T09:16:10.277666+0000","last_became_peered":"2023-12-22T09:16:10.277666+0000","last_unstale":"2023-12-22T09:16:11.267439+0000","last_undegraded":"2023-12-22T09:16:11.267439+0000","last_fullsized":"2023-12-22T09:16:11.267439+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:07:40.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"43'3","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.433380+0000","last_change":"2023-12-22T09:16:09.785358+0000","last_active":"2023-12-22T09:16:11.433380+0000","last_peered":"2023-12-22T09:16:11.433380+0000","last_clean":"2023-12-22T09:16:11.433380+0000","last_became_active":"2023-12-22T09:16:09.784903+0000","last_became_peered":"2023-12-22T09:16:09.784903+0000","last_unstale":"2023-12-22T09:16:11.433380+0000","last_undegraded":"2023-12-22T09:16:11.433380+0000","last_fullsized":"2023-12-22T09:16:11.433380+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:45.237557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248894+0000","last_change":"2023-12-22T09:15:55.158570+0000","last_active":"2023-12-22T09:16:10.248894+0000","last_peered":"2023-12-22T09:16:10.248894+0000","last_clean":"2023-12-22T09:16:10.248894+0000","last_became_active":"2023-12-22T09:15:55.157438+0000","last_became_peered":"2023-12-22T09:15:55.157438+0000","last_unstale":"2023-12-22T09:16:10.248894+0000","last_undegraded":"2023-12-22T09:16:10.248894+0000","last_fullsized":"2023-12-22T09:16:10.248894+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:37.962424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.259422+0000","last_change":"2023-12-22T09:15:54.659045+0000","last_active":"2023-12-22T09:16:10.259422+0000","last_peered":"2023-12-22T09:16:10.259422+0000","last_clean":"2023-12-22T09:16:10.259422+0000","last_became_active":"2023-12-22T09:15:54.658790+0000","last_became_peered":"2023-12-22T09:15:54.658790+0000","last_unstale":"2023-12-22T09:16:10.259422+0000","last_undegraded":"2023-12-22T09:16:10.259422+0000","last_fullsized":"2023-12-22T09:16:10.259422+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:37.303096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.428270+0000","last_change":"2023-12-22T09:16:10.280448+0000","last_active":"2023-12-22T09:16:11.428270+0000","last_peered":"2023-12-22T09:16:11.428270+0000","last_clean":"2023-12-22T09:16:11.428270+0000","last_became_active":"2023-12-22T09:16:10.278841+0000","last_became_peered":"2023-12-22T09:16:10.278841+0000","last_unstale":"2023-12-22T09:16:11.428270+0000","last_undegraded":"2023-12-22T09:16:11.428270+0000","last_fullsized":"2023-12-22T09:16:11.428270+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:52.944802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"43'6","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.263978+0000","last_change":"2023-12-22T09:16:09.776515+0000","last_active":"2023-12-22T09:16:11.263978+0000","last_peered":"2023-12-22T09:16:11.263978+0000","last_clean":"2023-12-22T09:16:11.263978+0000","last_became_active":"2023-12-22T09:16:09.775181+0000","last_became_peered":"2023-12-22T09:16:09.775181+0000","last_unstale":"2023-12-22T09:16:11.263978+0000","last_undegraded":"2023-12-22T09:16:11.263978+0000","last_fullsized":"2023-12-22T09:16:11.263978+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:30:49.569227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272571+0000","last_change":"2023-12-22T09:15:55.157643+0000","last_active":"2023-12-22T09:16:10.272571+0000","last_peered":"2023-12-22T09:16:10.272571+0000","last_clean":"2023-12-22T09:16:10.272571+0000","last_became_active":"2023-12-22T09:15:55.157227+0000","last_became_peered":"2023-12-22T09:15:55.157227+0000","last_unstale":"2023-12-22T09:16:10.272571+0000","last_undegraded":"2023-12-22T09:16:10.272571+0000","last_fullsized":"2023-12-22T09:16:10.272571+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:08.180891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267271+0000","last_change":"2023-12-22T09:15:54.676788+0000","last_active":"2023-12-22T09:16:10.267271+0000","last_peered":"2023-12-22T09:16:10.267271+0000","last_clean":"2023-12-22T09:16:10.267271+0000","last_became_active":"2023-12-22T09:15:54.676521+0000","last_became_peered":"2023-12-22T09:15:54.676521+0000","last_unstale":"2023-12-22T09:16:10.267271+0000","last_undegraded":"2023-12-22T09:16:10.267271+0000","last_fullsized":"2023-12-22T09:16:10.267271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:10:18.309697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425638+0000","last_change":"2023-12-22T09:16:10.285684+0000","last_active":"2023-12-22T09:16:11.425638+0000","last_peered":"2023-12-22T09:16:11.425638+0000","last_clean":"2023-12-22T09:16:11.425638+0000","last_became_active":"2023-12-22T09:16:10.284227+0000","last_became_peered":"2023-12-22T09:16:10.284227+0000","last_unstale":"2023-12-22T09:16:11.425638+0000","last_undegraded":"2023-12-22T09:16:11.425638+0000","last_fullsized":"2023-12-22T09:16:11.425638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:35.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.434410+0000","last_change":"2023-12-22T09:16:09.782613+0000","last_active":"2023-12-22T09:16:11.434410+0000","last_peered":"2023-12-22T09:16:11.434410+0000","last_clean":"2023-12-22T09:16:11.434410+0000","last_became_active":"2023-12-22T09:16:09.782307+0000","last_became_peered":"2023-12-22T09:16:09.782307+0000","last_unstale":"2023-12-22T09:16:11.434410+0000","last_undegraded":"2023-12-22T09:16:11.434410+0000","last_fullsized":"2023-12-22T09:16:11.434410+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:12.327698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270872+0000","last_change":"2023-12-22T09:15:55.150296+0000","last_active":"2023-12-22T09:16:10.270872+0000","last_peered":"2023-12-22T09:16:10.270872+0000","last_clean":"2023-12-22T09:16:10.270872+0000","last_became_active":"2023-12-22T09:15:55.150002+0000","last_became_peered":"2023-12-22T09:15:55.150002+0000","last_unstale":"2023-12-22T09:16:10.270872+0000","last_undegraded":"2023-12-22T09:16:10.270872+0000","last_fullsized":"2023-12-22T09:16:10.270872+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:38:09.607747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.271313+0000","last_change":"2023-12-22T09:15:54.734307+0000","last_active":"2023-12-22T09:16:10.271313+0000","last_peered":"2023-12-22T09:16:10.271313+0000","last_clean":"2023-12-22T09:16:10.271313+0000","last_became_active":"2023-12-22T09:15:54.733912+0000","last_became_peered":"2023-12-22T09:15:54.733912+0000","last_unstale":"2023-12-22T09:16:10.271313+0000","last_undegraded":"2023-12-22T09:16:10.271313+0000","last_fullsized":"2023-12-22T09:16:10.271313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:29.702956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426662+0000","last_change":"2023-12-22T09:16:10.284680+0000","last_active":"2023-12-22T09:16:11.426662+0000","last_peered":"2023-12-22T09:16:11.426662+0000","last_clean":"2023-12-22T09:16:11.426662+0000","last_became_active":"2023-12-22T09:16:10.284432+0000","last_became_peered":"2023-12-22T09:16:10.284432+0000","last_unstale":"2023-12-22T09:16:11.426662+0000","last_undegraded":"2023-12-22T09:16:11.426662+0000","last_fullsized":"2023-12-22T09:16:11.426662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:06.507360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426270+0000","last_change":"2023-12-22T09:16:09.795470+0000","last_active":"2023-12-22T09:16:11.426270+0000","last_peered":"2023-12-22T09:16:11.426270+0000","last_clean":"2023-12-22T09:16:11.426270+0000","last_became_active":"2023-12-22T09:16:09.795155+0000","last_became_peered":"2023-12-22T09:16:09.795155+0000","last_unstale":"2023-12-22T09:16:11.426270+0000","last_undegraded":"2023-12-22T09:16:11.426270+0000","last_fullsized":"2023-12-22T09:16:11.426270+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:05:44.480599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266454+0000","last_change":"2023-12-22T09:15:55.161558+0000","last_active":"2023-12-22T09:16:10.266454+0000","last_peered":"2023-12-22T09:16:10.266454+0000","last_clean":"2023-12-22T09:16:10.266454+0000","last_became_active":"2023-12-22T09:15:55.161234+0000","last_became_peered":"2023-12-22T09:15:55.161234+0000","last_unstale":"2023-12-22T09:16:10.266454+0000","last_undegraded":"2023-12-22T09:16:10.266454+0000","last_fullsized":"2023-12-22T09:16:10.266454+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:48:40.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'8","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258140+0000","last_change":"2023-12-22T09:15:54.667080+0000","last_active":"2023-12-22T09:16:10.258140+0000","last_peered":"2023-12-22T09:16:10.258140+0000","last_clean":"2023-12-22T09:16:10.258140+0000","last_became_active":"2023-12-22T09:15:54.666810+0000","last_became_peered":"2023-12-22T09:15:54.666810+0000","last_unstale":"2023-12-22T09:16:10.258140+0000","last_undegraded":"2023-12-22T09:16:10.258140+0000","last_fullsized":"2023-12-22T09:16:10.258140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:26.702306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.265001+0000","last_change":"2023-12-22T09:16:10.269909+0000","last_active":"2023-12-22T09:16:11.265001+0000","last_peered":"2023-12-22T09:16:11.265001+0000","last_clean":"2023-12-22T09:16:11.265001+0000","last_became_active":"2023-12-22T09:16:10.269614+0000","last_became_peered":"2023-12-22T09:16:10.269614+0000","last_unstale":"2023-12-22T09:16:11.265001+0000","last_undegraded":"2023-12-22T09:16:11.265001+0000","last_fullsized":"2023-12-22T09:16:11.265001+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:34.716420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.430494+0000","last_change":"2023-12-22T09:16:09.783531+0000","last_active":"2023-12-22T09:16:11.430494+0000","last_peered":"2023-12-22T09:16:11.430494+0000","last_clean":"2023-12-22T09:16:11.430494+0000","last_became_active":"2023-12-22T09:16:09.782039+0000","last_became_peered":"2023-12-22T09:16:09.782039+0000","last_unstale":"2023-12-22T09:16:11.430494+0000","last_undegraded":"2023-12-22T09:16:11.430494+0000","last_fullsized":"2023-12-22T09:16:11.430494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:57.339802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270556+0000","last_change":"2023-12-22T09:15:55.148900+0000","last_active":"2023-12-22T09:16:10.270556+0000","last_peered":"2023-12-22T09:16:10.270556+0000","last_clean":"2023-12-22T09:16:10.270556+0000","last_became_active":"2023-12-22T09:15:55.148615+0000","last_became_peered":"2023-12-22T09:15:55.148615+0000","last_unstale":"2023-12-22T09:16:10.270556+0000","last_undegraded":"2023-12-22T09:16:10.270556+0000","last_fullsized":"2023-12-22T09:16:10.270556+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:18.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258357+0000","last_change":"2023-12-22T09:15:54.654891+0000","last_active":"2023-12-22T09:16:10.258357+0000","last_peered":"2023-12-22T09:16:10.258357+0000","last_clean":"2023-12-22T09:16:10.258357+0000","last_became_active":"2023-12-22T09:15:54.654648+0000","last_became_peered":"2023-12-22T09:15:54.654648+0000","last_unstale":"2023-12-22T09:16:10.258357+0000","last_undegraded":"2023-12-22T09:16:10.258357+0000","last_fullsized":"2023-12-22T09:16:10.258357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:24.225526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.271082+0000","last_change":"2023-12-22T09:16:10.282894+0000","last_active":"2023-12-22T09:16:11.271082+0000","last_peered":"2023-12-22T09:16:11.271082+0000","last_clean":"2023-12-22T09:16:11.271082+0000","last_became_active":"2023-12-22T09:16:10.282501+0000","last_became_peered":"2023-12-22T09:16:10.282501+0000","last_unstale":"2023-12-22T09:16:11.271082+0000","last_undegraded":"2023-12-22T09:16:11.271082+0000","last_fullsized":"2023-12-22T09:16:11.271082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:26:20.795815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"43'8","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.262529+0000","last_change":"2023-12-22T09:16:09.777436+0000","last_active":"2023-12-22T09:16:11.262529+0000","last_peered":"2023-12-22T09:16:11.262529+0000","last_clean":"2023-12-22T09:16:11.262529+0000","last_became_active":"2023-12-22T09:16:09.777114+0000","last_became_peered":"2023-12-22T09:16:09.777114+0000","last_unstale":"2023-12-22T09:16:11.262529+0000","last_undegraded":"2023-12-22T09:16:11.262529+0000","last_fullsized":"2023-12-22T09:16:11.262529+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:14:53.107919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.254770+0000","last_change":"2023-12-22T09:15:55.144394+0000","last_active":"2023-12-22T09:16:10.254770+0000","last_peered":"2023-12-22T09:16:10.254770+0000","last_clean":"2023-12-22T09:16:10.254770+0000","last_became_active":"2023-12-22T09:15:55.143235+0000","last_became_peered":"2023-12-22T09:15:55.143235+0000","last_unstale":"2023-12-22T09:16:10.254770+0000","last_undegraded":"2023-12-22T09:16:10.254770+0000","last_fullsized":"2023-12-22T09:16:10.254770+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:07.046838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251965+0000","last_change":"2023-12-22T09:15:54.674073+0000","last_active":"2023-12-22T09:16:10.251965+0000","last_peered":"2023-12-22T09:16:10.251965+0000","last_clean":"2023-12-22T09:16:10.251965+0000","last_became_active":"2023-12-22T09:15:54.673820+0000","last_became_peered":"2023-12-22T09:15:54.673820+0000","last_unstale":"2023-12-22T09:16:10.251965+0000","last_undegraded":"2023-12-22T09:16:10.251965+0000","last_fullsized":"2023-12-22T09:16:10.251965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:38.639959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.427862+0000","last_change":"2023-12-22T09:16:10.279072+0000","last_active":"2023-12-22T09:16:11.427862+0000","last_peered":"2023-12-22T09:16:11.427862+0000","last_clean":"2023-12-22T09:16:11.427862+0000","last_became_active":"2023-12-22T09:16:10.278243+0000","last_became_peered":"2023-12-22T09:16:10.278243+0000","last_unstale":"2023-12-22T09:16:11.427862+0000","last_undegraded":"2023-12-22T09:16:11.427862+0000","last_fullsized":"2023-12-22T09:16:11.427862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:51:01.263941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.270812+0000","last_change":"2023-12-22T09:16:09.782812+0000","last_active":"2023-12-22T09:16:11.270812+0000","last_peered":"2023-12-22T09:16:11.270812+0000","last_clean":"2023-12-22T09:16:11.270812+0000","last_became_active":"2023-12-22T09:16:09.782512+0000","last_became_peered":"2023-12-22T09:16:09.782512+0000","last_unstale":"2023-12-22T09:16:11.270812+0000","last_undegraded":"2023-12-22T09:16:11.270812+0000","last_fullsized":"2023-12-22T09:16:11.270812+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:36.284381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270207+0000","last_change":"2023-12-22T09:15:55.151156+0000","last_active":"2023-12-22T09:16:10.270207+0000","last_peered":"2023-12-22T09:16:10.270207+0000","last_clean":"2023-12-22T09:16:10.270207+0000","last_became_active":"2023-12-22T09:15:55.150859+0000","last_became_peered":"2023-12-22T09:15:55.150859+0000","last_unstale":"2023-12-22T09:16:10.270207+0000","last_undegraded":"2023-12-22T09:16:10.270207+0000","last_fullsized":"2023-12-22T09:16:10.270207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:50.284022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.757699+0000","last_change":"2023-12-22T09:15:54.666683+0000","last_active":"2023-12-22T09:16:09.757699+0000","last_peered":"2023-12-22T09:16:09.757699+0000","last_clean":"2023-12-22T09:16:09.757699+0000","last_became_active":"2023-12-22T09:15:54.666419+0000","last_became_peered":"2023-12-22T09:15:54.666419+0000","last_unstale":"2023-12-22T09:16:09.757699+0000","last_undegraded":"2023-12-22T09:16:09.757699+0000","last_fullsized":"2023-12-22T09:16:09.757699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:25.807943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.268735+0000","last_change":"2023-12-22T09:16:10.277004+0000","last_active":"2023-12-22T09:16:11.268735+0000","last_peered":"2023-12-22T09:16:11.268735+0000","last_clean":"2023-12-22T09:16:11.268735+0000","last_became_active":"2023-12-22T09:16:10.276637+0000","last_became_peered":"2023-12-22T09:16:10.276637+0000","last_unstale":"2023-12-22T09:16:11.268735+0000","last_undegraded":"2023-12-22T09:16:11.268735+0000","last_fullsized":"2023-12-22T09:16:11.268735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:08:08.054912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.253361+0000","last_change":"2023-12-22T09:16:09.780863+0000","last_active":"2023-12-22T09:16:10.253361+0000","last_peered":"2023-12-22T09:16:10.253361+0000","last_clean":"2023-12-22T09:16:10.253361+0000","last_became_active":"2023-12-22T09:16:09.780556+0000","last_became_peered":"2023-12-22T09:16:09.780556+0000","last_unstale":"2023-12-22T09:16:10.253361+0000","last_undegraded":"2023-12-22T09:16:10.253361+0000","last_fullsized":"2023-12-22T09:16:10.253361+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:28.087862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258177+0000","last_change":"2023-12-22T09:15:55.141694+0000","last_active":"2023-12-22T09:16:10.258177+0000","last_peered":"2023-12-22T09:16:10.258177+0000","last_clean":"2023-12-22T09:16:10.258177+0000","last_became_active":"2023-12-22T09:15:55.141460+0000","last_became_peered":"2023-12-22T09:15:55.141460+0000","last_unstale":"2023-12-22T09:16:10.258177+0000","last_undegraded":"2023-12-22T09:16:10.258177+0000","last_fullsized":"2023-12-22T09:16:10.258177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:14:34.300486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266797+0000","last_change":"2023-12-22T09:15:54.670469+0000","last_active":"2023-12-22T09:16:10.266797+0000","last_peered":"2023-12-22T09:16:10.266797+0000","last_clean":"2023-12-22T09:16:10.266797+0000","last_became_active":"2023-12-22T09:15:54.670183+0000","last_became_peered":"2023-12-22T09:15:54.670183+0000","last_unstale":"2023-12-22T09:16:10.266797+0000","last_undegraded":"2023-12-22T09:16:10.266797+0000","last_fullsized":"2023-12-22T09:16:10.266797+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425963+0000","last_change":"2023-12-22T09:16:10.291879+0000","last_active":"2023-12-22T09:16:11.425963+0000","last_peered":"2023-12-22T09:16:11.425963+0000","last_clean":"2023-12-22T09:16:11.425963+0000","last_became_active":"2023-12-22T09:16:10.291537+0000","last_became_peered":"2023-12-22T09:16:10.291537+0000","last_unstale":"2023-12-22T09:16:11.425963+0000","last_undegraded":"2023-12-22T09:16:11.425963+0000","last_fullsized":"2023-12-22T09:16:11.425963+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:22.458879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"43'1","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.273010+0000","last_change":"2023-12-22T09:16:09.779782+0000","last_active":"2023-12-22T09:16:10.273010+0000","last_peered":"2023-12-22T09:16:10.273010+0000","last_clean":"2023-12-22T09:16:10.273010+0000","last_became_active":"2023-12-22T09:16:09.779471+0000","last_became_peered":"2023-12-22T09:16:09.779471+0000","last_unstale":"2023-12-22T09:16:10.273010+0000","last_undegraded":"2023-12-22T09:16:10.273010+0000","last_fullsized":"2023-12-22T09:16:10.273010+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:01:41.703695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258108+0000","last_change":"2023-12-22T09:15:55.135884+0000","last_active":"2023-12-22T09:16:10.258108+0000","last_peered":"2023-12-22T09:16:10.258108+0000","last_clean":"2023-12-22T09:16:10.258108+0000","last_became_active":"2023-12-22T09:15:55.135599+0000","last_became_peered":"2023-12-22T09:15:55.135599+0000","last_unstale":"2023-12-22T09:16:10.258108+0000","last_undegraded":"2023-12-22T09:16:10.258108+0000","last_fullsized":"2023-12-22T09:16:10.258108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:23.704284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.268125+0000","last_change":"2023-12-22T09:15:54.675247+0000","last_active":"2023-12-22T09:16:10.268125+0000","last_peered":"2023-12-22T09:16:10.268125+0000","last_clean":"2023-12-22T09:16:10.268125+0000","last_became_active":"2023-12-22T09:15:54.674964+0000","last_became_peered":"2023-12-22T09:15:54.674964+0000","last_unstale":"2023-12-22T09:16:10.268125+0000","last_undegraded":"2023-12-22T09:16:10.268125+0000","last_fullsized":"2023-12-22T09:16:10.268125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:14.720567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425302+0000","last_change":"2023-12-22T09:16:10.264674+0000","last_active":"2023-12-22T09:16:11.425302+0000","last_peered":"2023-12-22T09:16:11.425302+0000","last_clean":"2023-12-22T09:16:11.425302+0000","last_became_active":"2023-12-22T09:16:10.264061+0000","last_became_peered":"2023-12-22T09:16:10.264061+0000","last_unstale":"2023-12-22T09:16:11.425302+0000","last_undegraded":"2023-12-22T09:16:11.425302+0000","last_fullsized":"2023-12-22T09:16:11.425302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:52.944802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.255380+0000","last_change":"2023-12-22T09:16:09.785281+0000","last_active":"2023-12-22T09:16:10.255380+0000","last_peered":"2023-12-22T09:16:10.255380+0000","last_clean":"2023-12-22T09:16:10.255380+0000","last_became_active":"2023-12-22T09:16:09.785035+0000","last_became_peered":"2023-12-22T09:16:09.785035+0000","last_unstale":"2023-12-22T09:16:10.255380+0000","last_undegraded":"2023-12-22T09:16:10.255380+0000","last_fullsized":"2023-12-22T09:16:10.255380+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:40:32.414006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270811+0000","last_change":"2023-12-22T09:15:55.159520+0000","last_active":"2023-12-22T09:16:10.270811+0000","last_peered":"2023-12-22T09:16:10.270811+0000","last_clean":"2023-12-22T09:16:10.270811+0000","last_became_active":"2023-12-22T09:15:55.159183+0000","last_became_peered":"2023-12-22T09:15:55.159183+0000","last_unstale":"2023-12-22T09:16:10.270811+0000","last_undegraded":"2023-12-22T09:16:10.270811+0000","last_fullsized":"2023-12-22T09:16:10.270811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:27.387730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267216+0000","last_change":"2023-12-22T09:15:54.678077+0000","last_active":"2023-12-22T09:16:10.267216+0000","last_peered":"2023-12-22T09:16:10.267216+0000","last_clean":"2023-12-22T09:16:10.267216+0000","last_became_active":"2023-12-22T09:15:54.677750+0000","last_became_peered":"2023-12-22T09:15:54.677750+0000","last_unstale":"2023-12-22T09:16:10.267216+0000","last_undegraded":"2023-12-22T09:16:10.267216+0000","last_fullsized":"2023-12-22T09:16:10.267216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:29.498658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.262319+0000","last_change":"2023-12-22T09:16:10.273445+0000","last_active":"2023-12-22T09:16:11.262319+0000","last_peered":"2023-12-22T09:16:11.262319+0000","last_clean":"2023-12-22T09:16:11.262319+0000","last_became_active":"2023-12-22T09:16:10.272492+0000","last_became_peered":"2023-12-22T09:16:10.272492+0000","last_unstale":"2023-12-22T09:16:11.262319+0000","last_undegraded":"2023-12-22T09:16:11.262319+0000","last_fullsized":"2023-12-22T09:16:11.262319+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:44.719369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"43'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.267943+0000","last_change":"2023-12-22T09:16:09.795250+0000","last_active":"2023-12-22T09:16:11.267943+0000","last_peered":"2023-12-22T09:16:11.267943+0000","last_clean":"2023-12-22T09:16:11.267943+0000","last_became_active":"2023-12-22T09:16:09.794930+0000","last_became_peered":"2023-12-22T09:16:09.794930+0000","last_unstale":"2023-12-22T09:16:11.267943+0000","last_undegraded":"2023-12-22T09:16:11.267943+0000","last_fullsized":"2023-12-22T09:16:11.267943+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:35.929366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267076+0000","last_change":"2023-12-22T09:15:55.155587+0000","last_active":"2023-12-22T09:16:10.267076+0000","last_peered":"2023-12-22T09:16:10.267076+0000","last_clean":"2023-12-22T09:16:10.267076+0000","last_became_active":"2023-12-22T09:15:55.154482+0000","last_became_peered":"2023-12-22T09:15:55.154482+0000","last_unstale":"2023-12-22T09:16:10.267076+0000","last_undegraded":"2023-12-22T09:16:10.267076+0000","last_fullsized":"2023-12-22T09:16:10.267076+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:57.296942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.250854+0000","last_change":"2023-12-22T09:15:54.670898+0000","last_active":"2023-12-22T09:16:10.250854+0000","last_peered":"2023-12-22T09:16:10.250854+0000","last_clean":"2023-12-22T09:16:10.250854+0000","last_became_active":"2023-12-22T09:15:54.670474+0000","last_became_peered":"2023-12-22T09:15:54.670474+0000","last_unstale":"2023-12-22T09:16:10.250854+0000","last_undegraded":"2023-12-22T09:16:10.250854+0000","last_fullsized":"2023-12-22T09:16:10.250854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:08.829353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424248+0000","last_change":"2023-12-22T09:16:10.284310+0000","last_active":"2023-12-22T09:16:11.424248+0000","last_peered":"2023-12-22T09:16:11.424248+0000","last_clean":"2023-12-22T09:16:11.424248+0000","last_became_active":"2023-12-22T09:16:10.284036+0000","last_became_peered":"2023-12-22T09:16:10.284036+0000","last_unstale":"2023-12-22T09:16:11.424248+0000","last_undegraded":"2023-12-22T09:16:11.424248+0000","last_fullsized":"2023-12-22T09:16:11.424248+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:06.507360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.272690+0000","last_change":"2023-12-22T09:16:09.782700+0000","last_active":"2023-12-22T09:16:11.272690+0000","last_peered":"2023-12-22T09:16:11.272690+0000","last_clean":"2023-12-22T09:16:11.272690+0000","last_became_active":"2023-12-22T09:16:09.782407+0000","last_became_peered":"2023-12-22T09:16:09.782407+0000","last_unstale":"2023-12-22T09:16:11.272690+0000","last_undegraded":"2023-12-22T09:16:11.272690+0000","last_fullsized":"2023-12-22T09:16:11.272690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:13:52.771840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.252330+0000","last_change":"2023-12-22T09:15:55.153519+0000","last_active":"2023-12-22T09:16:10.252330+0000","last_peered":"2023-12-22T09:16:10.252330+0000","last_clean":"2023-12-22T09:16:10.252330+0000","last_became_active":"2023-12-22T09:15:55.153259+0000","last_became_peered":"2023-12-22T09:15:55.153259+0000","last_unstale":"2023-12-22T09:16:10.252330+0000","last_undegraded":"2023-12-22T09:16:10.252330+0000","last_fullsized":"2023-12-22T09:16:10.252330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:15.736391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251275+0000","last_change":"2023-12-22T09:15:54.668062+0000","last_active":"2023-12-22T09:16:10.251275+0000","last_peered":"2023-12-22T09:16:10.251275+0000","last_clean":"2023-12-22T09:16:10.251275+0000","last_became_active":"2023-12-22T09:15:54.667816+0000","last_became_peered":"2023-12-22T09:15:54.667816+0000","last_unstale":"2023-12-22T09:16:10.251275+0000","last_undegraded":"2023-12-22T09:16:10.251275+0000","last_fullsized":"2023-12-22T09:16:10.251275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:12.583708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.271203+0000","last_change":"2023-12-22T09:16:10.287810+0000","last_active":"2023-12-22T09:16:11.271203+0000","last_peered":"2023-12-22T09:16:11.271203+0000","last_clean":"2023-12-22T09:16:11.271203+0000","last_became_active":"2023-12-22T09:16:10.287572+0000","last_became_peered":"2023-12-22T09:16:10.287572+0000","last_unstale":"2023-12-22T09:16:11.271203+0000","last_undegraded":"2023-12-22T09:16:11.271203+0000","last_fullsized":"2023-12-22T09:16:11.271203+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:24:53.589809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.266849+0000","last_change":"2023-12-22T09:16:09.795180+0000","last_active":"2023-12-22T09:16:11.266849+0000","last_peered":"2023-12-22T09:16:11.266849+0000","last_clean":"2023-12-22T09:16:11.266849+0000","last_became_active":"2023-12-22T09:16:09.794900+0000","last_became_peered":"2023-12-22T09:16:09.794900+0000","last_unstale":"2023-12-22T09:16:11.266849+0000","last_undegraded":"2023-12-22T09:16:11.266849+0000","last_fullsized":"2023-12-22T09:16:11.266849+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:12.327698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266898+0000","last_change":"2023-12-22T09:15:55.149199+0000","last_active":"2023-12-22T09:16:10.266898+0000","last_peered":"2023-12-22T09:16:10.266898+0000","last_clean":"2023-12-22T09:16:10.266898+0000","last_became_active":"2023-12-22T09:15:55.148960+0000","last_became_peered":"2023-12-22T09:15:55.148960+0000","last_unstale":"2023-12-22T09:16:10.266898+0000","last_undegraded":"2023-12-22T09:16:10.266898+0000","last_fullsized":"2023-12-22T09:16:10.266898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:01.163534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248589+0000","last_change":"2023-12-22T09:15:54.656366+0000","last_active":"2023-12-22T09:16:10.248589+0000","last_peered":"2023-12-22T09:16:10.248589+0000","last_clean":"2023-12-22T09:16:10.248589+0000","last_became_active":"2023-12-22T09:15:54.656119+0000","last_became_peered":"2023-12-22T09:15:54.656119+0000","last_unstale":"2023-12-22T09:16:10.248589+0000","last_undegraded":"2023-12-22T09:16:10.248589+0000","last_fullsized":"2023-12-22T09:16:10.248589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:23.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425512+0000","last_change":"2023-12-22T09:16:10.264835+0000","last_active":"2023-12-22T09:16:11.425512+0000","last_peered":"2023-12-22T09:16:11.425512+0000","last_clean":"2023-12-22T09:16:11.425512+0000","last_became_active":"2023-12-22T09:16:10.264143+0000","last_became_peered":"2023-12-22T09:16:10.264143+0000","last_unstale":"2023-12-22T09:16:11.425512+0000","last_undegraded":"2023-12-22T09:16:11.425512+0000","last_fullsized":"2023-12-22T09:16:11.425512+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:07:40.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264956+0000","last_change":"2023-12-22T09:16:09.776310+0000","last_active":"2023-12-22T09:16:11.264956+0000","last_peered":"2023-12-22T09:16:11.264956+0000","last_clean":"2023-12-22T09:16:11.264956+0000","last_became_active":"2023-12-22T09:16:09.776031+0000","last_became_peered":"2023-12-22T09:16:09.776031+0000","last_unstale":"2023-12-22T09:16:11.264956+0000","last_undegraded":"2023-12-22T09:16:11.264956+0000","last_fullsized":"2023-12-22T09:16:11.264956+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:42:53.400156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.269029+0000","last_change":"2023-12-22T09:15:55.150507+0000","last_active":"2023-12-22T09:16:10.269029+0000","last_peered":"2023-12-22T09:16:10.269029+0000","last_clean":"2023-12-22T09:16:10.269029+0000","last_became_active":"2023-12-22T09:15:55.149174+0000","last_became_peered":"2023-12-22T09:15:55.149174+0000","last_unstale":"2023-12-22T09:16:10.269029+0000","last_undegraded":"2023-12-22T09:16:10.269029+0000","last_fullsized":"2023-12-22T09:16:10.269029+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:01.163534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248068+0000","last_change":"2023-12-22T09:15:54.666529+0000","last_active":"2023-12-22T09:16:10.248068+0000","last_peered":"2023-12-22T09:16:10.248068+0000","last_clean":"2023-12-22T09:16:10.248068+0000","last_became_active":"2023-12-22T09:15:54.666198+0000","last_became_peered":"2023-12-22T09:15:54.666198+0000","last_unstale":"2023-12-22T09:16:10.248068+0000","last_undegraded":"2023-12-22T09:16:10.248068+0000","last_fullsized":"2023-12-22T09:16:10.248068+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:59.323545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.428141+0000","last_change":"2023-12-22T09:16:10.284556+0000","last_active":"2023-12-22T09:16:11.428141+0000","last_peered":"2023-12-22T09:16:11.428141+0000","last_clean":"2023-12-22T09:16:11.428141+0000","last_became_active":"2023-12-22T09:16:10.284268+0000","last_became_peered":"2023-12-22T09:16:10.284268+0000","last_unstale":"2023-12-22T09:16:11.428141+0000","last_undegraded":"2023-12-22T09:16:11.428141+0000","last_fullsized":"2023-12-22T09:16:11.428141+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:42:53.326372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"43'2","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424980+0000","last_change":"2023-12-22T09:16:09.781136+0000","last_active":"2023-12-22T09:16:11.424980+0000","last_peered":"2023-12-22T09:16:11.424980+0000","last_clean":"2023-12-22T09:16:11.424980+0000","last_became_active":"2023-12-22T09:16:09.780826+0000","last_became_peered":"2023-12-22T09:16:09.780826+0000","last_unstale":"2023-12-22T09:16:11.424980+0000","last_undegraded":"2023-12-22T09:16:11.424980+0000","last_fullsized":"2023-12-22T09:16:11.424980+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:45.237557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266600+0000","last_change":"2023-12-22T09:15:55.154765+0000","last_active":"2023-12-22T09:16:10.266600+0000","last_peered":"2023-12-22T09:16:10.266600+0000","last_clean":"2023-12-22T09:16:10.266600+0000","last_became_active":"2023-12-22T09:15:55.154461+0000","last_became_peered":"2023-12-22T09:15:55.154461+0000","last_unstale":"2023-12-22T09:16:10.266600+0000","last_undegraded":"2023-12-22T09:16:10.266600+0000","last_fullsized":"2023-12-22T09:16:10.266600+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:59.232942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272341+0000","last_change":"2023-12-22T09:15:54.670745+0000","last_active":"2023-12-22T09:16:10.272341+0000","last_peered":"2023-12-22T09:16:10.272341+0000","last_clean":"2023-12-22T09:16:10.272341+0000","last_became_active":"2023-12-22T09:15:54.670471+0000","last_became_peered":"2023-12-22T09:15:54.670471+0000","last_unstale":"2023-12-22T09:16:10.272341+0000","last_undegraded":"2023-12-22T09:16:10.272341+0000","last_fullsized":"2023-12-22T09:16:10.272341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:18:34.722029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.286740+0000","last_change":"2023-12-22T09:16:10.281332+0000","last_active":"2023-12-22T09:16:10.286740+0000","last_peered":"2023-12-22T09:16:10.286740+0000","last_clean":"2023-12-22T09:16:10.286740+0000","last_became_active":"2023-12-22T09:16:10.281029+0000","last_became_peered":"2023-12-22T09:16:10.281029+0000","last_unstale":"2023-12-22T09:16:10.286740+0000","last_undegraded":"2023-12-22T09:16:10.286740+0000","last_fullsized":"2023-12-22T09:16:10.286740+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:06:06.908886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.262963+0000","last_change":"2023-12-22T09:16:09.786634+0000","last_active":"2023-12-22T09:16:11.262963+0000","last_peered":"2023-12-22T09:16:11.262963+0000","last_clean":"2023-12-22T09:16:11.262963+0000","last_became_active":"2023-12-22T09:16:09.784245+0000","last_became_peered":"2023-12-22T09:16:09.784245+0000","last_unstale":"2023-12-22T09:16:11.262963+0000","last_undegraded":"2023-12-22T09:16:11.262963+0000","last_fullsized":"2023-12-22T09:16:11.262963+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:26:38.071351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.258264+0000","last_change":"2023-12-22T09:15:55.135327+0000","last_active":"2023-12-22T09:16:10.258264+0000","last_peered":"2023-12-22T09:16:10.258264+0000","last_clean":"2023-12-22T09:16:10.258264+0000","last_became_active":"2023-12-22T09:15:55.135121+0000","last_became_peered":"2023-12-22T09:15:55.135121+0000","last_unstale":"2023-12-22T09:16:10.258264+0000","last_undegraded":"2023-12-22T09:16:10.258264+0000","last_fullsized":"2023-12-22T09:16:10.258264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:55.239397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.248130+0000","last_change":"2023-12-22T09:15:54.653992+0000","last_active":"2023-12-22T09:16:10.248130+0000","last_peered":"2023-12-22T09:16:10.248130+0000","last_clean":"2023-12-22T09:16:10.248130+0000","last_became_active":"2023-12-22T09:15:54.653705+0000","last_became_peered":"2023-12-22T09:15:54.653705+0000","last_unstale":"2023-12-22T09:16:10.248130+0000","last_undegraded":"2023-12-22T09:16:10.248130+0000","last_fullsized":"2023-12-22T09:16:10.248130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:25.659639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.424551+0000","last_change":"2023-12-22T09:16:10.261672+0000","last_active":"2023-12-22T09:16:11.424551+0000","last_peered":"2023-12-22T09:16:11.424551+0000","last_clean":"2023-12-22T09:16:11.424551+0000","last_became_active":"2023-12-22T09:16:10.261281+0000","last_became_peered":"2023-12-22T09:16:10.261281+0000","last_unstale":"2023-12-22T09:16:11.424551+0000","last_undegraded":"2023-12-22T09:16:11.424551+0000","last_fullsized":"2023-12-22T09:16:11.424551+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:43.341805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.433493+0000","last_change":"2023-12-22T09:16:09.785157+0000","last_active":"2023-12-22T09:16:11.433493+0000","last_peered":"2023-12-22T09:16:11.433493+0000","last_clean":"2023-12-22T09:16:11.433493+0000","last_became_active":"2023-12-22T09:16:09.784542+0000","last_became_peered":"2023-12-22T09:16:09.784542+0000","last_unstale":"2023-12-22T09:16:11.433493+0000","last_undegraded":"2023-12-22T09:16:11.433493+0000","last_fullsized":"2023-12-22T09:16:11.433493+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:35.929366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.251196+0000","last_change":"2023-12-22T09:15:55.164900+0000","last_active":"2023-12-22T09:16:10.251196+0000","last_peered":"2023-12-22T09:16:10.251196+0000","last_clean":"2023-12-22T09:16:10.251196+0000","last_became_active":"2023-12-22T09:15:55.164618+0000","last_became_peered":"2023-12-22T09:15:55.164618+0000","last_unstale":"2023-12-22T09:16:10.251196+0000","last_undegraded":"2023-12-22T09:16:10.251196+0000","last_fullsized":"2023-12-22T09:16:10.251196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.268281+0000","last_change":"2023-12-22T09:15:54.733914+0000","last_active":"2023-12-22T09:16:10.268281+0000","last_peered":"2023-12-22T09:16:10.268281+0000","last_clean":"2023-12-22T09:16:10.268281+0000","last_became_active":"2023-12-22T09:15:54.733504+0000","last_became_peered":"2023-12-22T09:15:54.733504+0000","last_unstale":"2023-12-22T09:16:10.268281+0000","last_undegraded":"2023-12-22T09:16:10.268281+0000","last_fullsized":"2023-12-22T09:16:10.268281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:38.639959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264084+0000","last_change":"2023-12-22T09:16:10.293110+0000","last_active":"2023-12-22T09:16:11.264084+0000","last_peered":"2023-12-22T09:16:11.264084+0000","last_clean":"2023-12-22T09:16:11.264084+0000","last_became_active":"2023-12-22T09:16:10.292834+0000","last_became_peered":"2023-12-22T09:16:10.292834+0000","last_unstale":"2023-12-22T09:16:11.264084+0000","last_undegraded":"2023-12-22T09:16:11.264084+0000","last_fullsized":"2023-12-22T09:16:11.264084+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:03:30.809612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.270284+0000","last_change":"2023-12-22T09:16:09.790734+0000","last_active":"2023-12-22T09:16:11.270284+0000","last_peered":"2023-12-22T09:16:11.270284+0000","last_clean":"2023-12-22T09:16:11.270284+0000","last_became_active":"2023-12-22T09:16:09.790423+0000","last_became_peered":"2023-12-22T09:16:09.790423+0000","last_unstale":"2023-12-22T09:16:11.270284+0000","last_undegraded":"2023-12-22T09:16:11.270284+0000","last_fullsized":"2023-12-22T09:16:11.270284+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:55:09.027625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.273329+0000","last_change":"2023-12-22T09:15:55.157481+0000","last_active":"2023-12-22T09:16:10.273329+0000","last_peered":"2023-12-22T09:16:10.273329+0000","last_clean":"2023-12-22T09:16:10.273329+0000","last_became_active":"2023-12-22T09:15:55.156846+0000","last_became_peered":"2023-12-22T09:15:55.156846+0000","last_unstale":"2023-12-22T09:16:10.273329+0000","last_undegraded":"2023-12-22T09:16:10.273329+0000","last_fullsized":"2023-12-22T09:16:10.273329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:27.718130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.252213+0000","last_change":"2023-12-22T09:15:54.678864+0000","last_active":"2023-12-22T09:16:10.252213+0000","last_peered":"2023-12-22T09:16:10.252213+0000","last_clean":"2023-12-22T09:16:10.252213+0000","last_became_active":"2023-12-22T09:15:54.678585+0000","last_became_peered":"2023-12-22T09:15:54.678585+0000","last_unstale":"2023-12-22T09:16:10.252213+0000","last_undegraded":"2023-12-22T09:16:10.252213+0000","last_fullsized":"2023-12-22T09:16:10.252213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:15:27.844098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.427249+0000","last_change":"2023-12-22T09:16:10.270029+0000","last_active":"2023-12-22T09:16:11.427249+0000","last_peered":"2023-12-22T09:16:11.427249+0000","last_clean":"2023-12-22T09:16:11.427249+0000","last_became_active":"2023-12-22T09:16:10.269655+0000","last_became_peered":"2023-12-22T09:16:10.269655+0000","last_unstale":"2023-12-22T09:16:11.427249+0000","last_undegraded":"2023-12-22T09:16:11.427249+0000","last_fullsized":"2023-12-22T09:16:11.427249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:35.591774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"43'2","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.265738+0000","last_change":"2023-12-22T09:16:09.789363+0000","last_active":"2023-12-22T09:16:10.265738+0000","last_peered":"2023-12-22T09:16:10.265738+0000","last_clean":"2023-12-22T09:16:10.265738+0000","last_became_active":"2023-12-22T09:16:09.789051+0000","last_became_peered":"2023-12-22T09:16:09.789051+0000","last_unstale":"2023-12-22T09:16:10.265738+0000","last_undegraded":"2023-12-22T09:16:10.265738+0000","last_fullsized":"2023-12-22T09:16:10.265738+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:55.378925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.259119+0000","last_change":"2023-12-22T09:15:55.154994+0000","last_active":"2023-12-22T09:16:10.259119+0000","last_peered":"2023-12-22T09:16:10.259119+0000","last_clean":"2023-12-22T09:16:10.259119+0000","last_became_active":"2023-12-22T09:15:55.154803+0000","last_became_peered":"2023-12-22T09:15:55.154803+0000","last_unstale":"2023-12-22T09:16:10.259119+0000","last_undegraded":"2023-12-22T09:16:10.259119+0000","last_fullsized":"2023-12-22T09:16:10.259119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:57.624842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270660+0000","last_change":"2023-12-22T09:15:54.665822+0000","last_active":"2023-12-22T09:16:10.270660+0000","last_peered":"2023-12-22T09:16:10.270660+0000","last_clean":"2023-12-22T09:16:10.270660+0000","last_became_active":"2023-12-22T09:15:54.665585+0000","last_became_peered":"2023-12-22T09:15:54.665585+0000","last_unstale":"2023-12-22T09:16:10.270660+0000","last_undegraded":"2023-12-22T09:16:10.270660+0000","last_fullsized":"2023-12-22T09:16:10.270660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:17.033333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.271036+0000","last_change":"2023-12-22T09:16:10.292334+0000","last_active":"2023-12-22T09:16:11.271036+0000","last_peered":"2023-12-22T09:16:11.271036+0000","last_clean":"2023-12-22T09:16:11.271036+0000","last_became_active":"2023-12-22T09:16:10.292061+0000","last_became_peered":"2023-12-22T09:16:10.292061+0000","last_unstale":"2023-12-22T09:16:11.271036+0000","last_undegraded":"2023-12-22T09:16:11.271036+0000","last_fullsized":"2023-12-22T09:16:11.271036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:18:32.297692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.425491+0000","last_change":"2023-12-22T09:16:09.780152+0000","last_active":"2023-12-22T09:16:11.425491+0000","last_peered":"2023-12-22T09:16:11.425491+0000","last_clean":"2023-12-22T09:16:11.425491+0000","last_became_active":"2023-12-22T09:16:09.779196+0000","last_became_peered":"2023-12-22T09:16:09.779196+0000","last_unstale":"2023-12-22T09:16:11.425491+0000","last_undegraded":"2023-12-22T09:16:11.425491+0000","last_fullsized":"2023-12-22T09:16:11.425491+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:36.284381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.270714+0000","last_change":"2023-12-22T09:15:55.140870+0000","last_active":"2023-12-22T09:16:10.270714+0000","last_peered":"2023-12-22T09:16:10.270714+0000","last_clean":"2023-12-22T09:16:10.270714+0000","last_became_active":"2023-12-22T09:15:55.140487+0000","last_became_peered":"2023-12-22T09:15:55.140487+0000","last_unstale":"2023-12-22T09:16:10.270714+0000","last_undegraded":"2023-12-22T09:16:10.270714+0000","last_fullsized":"2023-12-22T09:16:10.270714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:17.416418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.269206+0000","last_change":"2023-12-22T09:15:54.667519+0000","last_active":"2023-12-22T09:16:10.269206+0000","last_peered":"2023-12-22T09:16:10.269206+0000","last_clean":"2023-12-22T09:16:10.269206+0000","last_became_active":"2023-12-22T09:15:54.667275+0000","last_became_peered":"2023-12-22T09:15:54.667275+0000","last_unstale":"2023-12-22T09:16:10.269206+0000","last_undegraded":"2023-12-22T09:16:10.269206+0000","last_fullsized":"2023-12-22T09:16:10.269206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:22:27.185341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.265161+0000","last_change":"2023-12-22T09:16:10.263595+0000","last_active":"2023-12-22T09:16:11.265161+0000","last_peered":"2023-12-22T09:16:11.265161+0000","last_clean":"2023-12-22T09:16:11.265161+0000","last_became_active":"2023-12-22T09:16:10.263274+0000","last_became_peered":"2023-12-22T09:16:10.263274+0000","last_unstale":"2023-12-22T09:16:11.265161+0000","last_undegraded":"2023-12-22T09:16:11.265161+0000","last_fullsized":"2023-12-22T09:16:11.265161+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:47.603779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.427487+0000","last_change":"2023-12-22T09:16:09.778980+0000","last_active":"2023-12-22T09:16:11.427487+0000","last_peered":"2023-12-22T09:16:11.427487+0000","last_clean":"2023-12-22T09:16:11.427487+0000","last_became_active":"2023-12-22T09:16:09.778566+0000","last_became_peered":"2023-12-22T09:16:09.778566+0000","last_unstale":"2023-12-22T09:16:11.427487+0000","last_undegraded":"2023-12-22T09:16:11.427487+0000","last_fullsized":"2023-12-22T09:16:11.427487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:36.284381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.249043+0000","last_change":"2023-12-22T09:15:55.141979+0000","last_active":"2023-12-22T09:16:10.249043+0000","last_peered":"2023-12-22T09:16:10.249043+0000","last_clean":"2023-12-22T09:16:10.249043+0000","last_became_active":"2023-12-22T09:15:55.141734+0000","last_became_peered":"2023-12-22T09:15:55.141734+0000","last_unstale":"2023-12-22T09:16:10.249043+0000","last_undegraded":"2023-12-22T09:16:10.249043+0000","last_fullsized":"2023-12-22T09:16:10.249043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:02:32.105674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T09:16:09.764312+0000","last_change":"2023-12-22T09:15:54.658826+0000","last_active":"2023-12-22T09:16:09.764312+0000","last_peered":"2023-12-22T09:16:09.764312+0000","last_clean":"2023-12-22T09:16:09.764312+0000","last_became_active":"2023-12-22T09:15:54.658206+0000","last_became_peered":"2023-12-22T09:15:54.658206+0000","last_unstale":"2023-12-22T09:16:09.764312+0000","last_undegraded":"2023-12-22T09:16:09.764312+0000","last_fullsized":"2023-12-22T09:16:09.764312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:19.574375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.270065+0000","last_change":"2023-12-22T09:16:10.288236+0000","last_active":"2023-12-22T09:16:11.270065+0000","last_peered":"2023-12-22T09:16:11.270065+0000","last_clean":"2023-12-22T09:16:11.270065+0000","last_became_active":"2023-12-22T09:16:10.287301+0000","last_became_peered":"2023-12-22T09:16:10.287301+0000","last_unstale":"2023-12-22T09:16:11.270065+0000","last_undegraded":"2023-12-22T09:16:11.270065+0000","last_fullsized":"2023-12-22T09:16:11.270065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:05:21.100101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.264003+0000","last_change":"2023-12-22T09:16:09.785145+0000","last_active":"2023-12-22T09:16:11.264003+0000","last_peered":"2023-12-22T09:16:11.264003+0000","last_clean":"2023-12-22T09:16:11.264003+0000","last_became_active":"2023-12-22T09:16:09.784881+0000","last_became_peered":"2023-12-22T09:16:09.784881+0000","last_unstale":"2023-12-22T09:16:11.264003+0000","last_undegraded":"2023-12-22T09:16:11.264003+0000","last_fullsized":"2023-12-22T09:16:11.264003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:07:47.003153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.262829+0000","last_change":"2023-12-22T09:15:55.152664+0000","last_active":"2023-12-22T09:16:10.262829+0000","last_peered":"2023-12-22T09:16:10.262829+0000","last_clean":"2023-12-22T09:16:10.262829+0000","last_became_active":"2023-12-22T09:15:55.152395+0000","last_became_peered":"2023-12-22T09:15:55.152395+0000","last_unstale":"2023-12-22T09:16:10.262829+0000","last_undegraded":"2023-12-22T09:16:10.262829+0000","last_fullsized":"2023-12-22T09:16:10.262829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:27.387730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266794+0000","last_change":"2023-12-22T09:15:54.672839+0000","last_active":"2023-12-22T09:16:10.266794+0000","last_peered":"2023-12-22T09:16:10.266794+0000","last_clean":"2023-12-22T09:16:10.266794+0000","last_became_active":"2023-12-22T09:15:54.672501+0000","last_became_peered":"2023-12-22T09:15:54.672501+0000","last_unstale":"2023-12-22T09:16:10.266794+0000","last_undegraded":"2023-12-22T09:16:10.266794+0000","last_fullsized":"2023-12-22T09:16:10.266794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:16.400594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.426672+0000","last_change":"2023-12-22T09:16:10.283245+0000","last_active":"2023-12-22T09:16:11.426672+0000","last_peered":"2023-12-22T09:16:11.426672+0000","last_clean":"2023-12-22T09:16:11.426672+0000","last_became_active":"2023-12-22T09:16:10.282930+0000","last_became_peered":"2023-12-22T09:16:10.282930+0000","last_unstale":"2023-12-22T09:16:11.426672+0000","last_undegraded":"2023-12-22T09:16:11.426672+0000","last_fullsized":"2023-12-22T09:16:11.426672+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:22:16.109685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.263179+0000","last_change":"2023-12-22T09:16:09.781083+0000","last_active":"2023-12-22T09:16:11.263179+0000","last_peered":"2023-12-22T09:16:11.263179+0000","last_clean":"2023-12-22T09:16:11.263179+0000","last_became_active":"2023-12-22T09:16:09.780777+0000","last_became_peered":"2023-12-22T09:16:09.780777+0000","last_unstale":"2023-12-22T09:16:11.263179+0000","last_undegraded":"2023-12-22T09:16:11.263179+0000","last_fullsized":"2023-12-22T09:16:11.263179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:34.576185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.271652+0000","last_change":"2023-12-22T09:15:55.142126+0000","last_active":"2023-12-22T09:16:10.271652+0000","last_peered":"2023-12-22T09:16:10.271652+0000","last_clean":"2023-12-22T09:16:10.271652+0000","last_became_active":"2023-12-22T09:15:55.138650+0000","last_became_peered":"2023-12-22T09:15:55.138650+0000","last_unstale":"2023-12-22T09:16:10.271652+0000","last_undegraded":"2023-12-22T09:16:10.271652+0000","last_fullsized":"2023-12-22T09:16:10.271652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.255920+0000","last_change":"2023-12-22T09:15:54.661513+0000","last_active":"2023-12-22T09:16:10.255920+0000","last_peered":"2023-12-22T09:16:10.255920+0000","last_clean":"2023-12-22T09:16:10.255920+0000","last_became_active":"2023-12-22T09:15:54.658499+0000","last_became_peered":"2023-12-22T09:15:54.658499+0000","last_unstale":"2023-12-22T09:16:10.255920+0000","last_undegraded":"2023-12-22T09:16:10.255920+0000","last_fullsized":"2023-12-22T09:16:10.255920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:59:07.165067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.272817+0000","last_change":"2023-12-22T09:16:10.266538+0000","last_active":"2023-12-22T09:16:10.272817+0000","last_peered":"2023-12-22T09:16:10.272817+0000","last_clean":"2023-12-22T09:16:10.272817+0000","last_became_active":"2023-12-22T09:16:10.266281+0000","last_became_peered":"2023-12-22T09:16:10.266281+0000","last_unstale":"2023-12-22T09:16:10.272817+0000","last_undegraded":"2023-12-22T09:16:10.272817+0000","last_fullsized":"2023-12-22T09:16:10.272817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:09.738949+0000","last_clean_scrub_stamp":"2023-12-22T09:16:09.738949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:36:50.883597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"44'1","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-22T09:16:11.506166+0000","last_change":"2023-12-22T09:16:09.790626+0000","last_active":"2023-12-22T09:16:11.506166+0000","last_peered":"2023-12-22T09:16:11.506166+0000","last_clean":"2023-12-22T09:16:11.506166+0000","last_became_active":"2023-12-22T09:16:09.790338+0000","last_became_peered":"2023-12-22T09:16:09.790338+0000","last_unstale":"2023-12-22T09:16:11.506166+0000","last_undegraded":"2023-12-22T09:16:11.506166+0000","last_fullsized":"2023-12-22T09:16:11.506166+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:08.723359+0000","last_clean_scrub_stamp":"2023-12-22T09:16:08.723359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:05:44.480599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.267958+0000","last_change":"2023-12-22T09:15:55.165334+0000","last_active":"2023-12-22T09:16:10.267958+0000","last_peered":"2023-12-22T09:16:10.267958+0000","last_clean":"2023-12-22T09:16:10.267958+0000","last_became_active":"2023-12-22T09:15:55.165009+0000","last_became_peered":"2023-12-22T09:15:55.165009+0000","last_unstale":"2023-12-22T09:16:10.267958+0000","last_undegraded":"2023-12-22T09:16:10.267958+0000","last_fullsized":"2023-12-22T09:16:10.267958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:54.619850+0000","last_clean_scrub_stamp":"2023-12-22T09:15:54.619850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:43.073682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.273393+0000","last_change":"2023-12-22T09:15:54.671832+0000","last_active":"2023-12-22T09:16:10.273393+0000","last_peered":"2023-12-22T09:16:10.273393+0000","last_clean":"2023-12-22T09:16:10.273393+0000","last_became_active":"2023-12-22T09:15:54.671542+0000","last_became_peered":"2023-12-22T09:15:54.671542+0000","last_unstale":"2023-12-22T09:16:10.273393+0000","last_undegraded":"2023-12-22T09:16:10.273393+0000","last_fullsized":"2023-12-22T09:16:10.273393+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:15:53.604026+0000","last_clean_scrub_stamp":"2023-12-22T09:15:53.604026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:23.694814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T09:16:10.266939+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:16:10.266939+0000","last_peered":"2023-12-22T09:16:10.266939+0000","last_clean":"2023-12-22T09:16:10.266939+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:16:10.266939+0000","last_undegraded":"2023-12-22T09:16:10.266939+0000","last_fullsized":"2023-12-22T09:16:10.266939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3857,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1114112,"data_stored":813417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.6070000000000002,"5min":2.6070000000000002,"15min":2.6070000000000002},"last":1.05},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.88800000000000001}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":0.94099999999999995}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.389},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":3.0419999999999998,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.4570000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.139},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.1679999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.5089999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":221030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.3639999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1160000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.093}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.262},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.4350000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.23},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.3620000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":3.3399999999999999,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.393}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.7849999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":219908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.401}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.371},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.615}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.46},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.4419999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.5}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":3.298,"5min":3.298,"15min":3.298},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.2390000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":220982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.157}]},{"osd":1,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.85499999999999998}]},{"osd":2,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.93400000000000005}]},{"osd":3,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.2969999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.25},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.2050000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.47},{"interface":"front","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.5}]},{"osd":7,"last update":"Fri Dec 22 09:15:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.54},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.5820000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":224475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2290000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.3779999999999999}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.5329999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":24.245999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":1.573},{"interface":"front","average":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":32.527999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":1.6739999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.722,"5min":2.722,"15min":2.722},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":33.103999999999999,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":27.181999999999999,"5min":27.181999999999999,"15min":27.181999999999999},"last":1.722}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":22.715,"5min":22.715,"15min":22.715},"last":1.1240000000000001},{"interface":"front","average":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":30.108000000000001,"5min":30.108000000000001,"15min":30.108000000000001},"last":1.2729999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":524288,"data_stored":228907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.495},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.044}]},{"osd":5,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Dec 22 09:15:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":3.3929999999999998,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.85799999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":220046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.86599999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.97499999999999998}]},{"osd":3,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.5640000000000001,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":1.163},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.4430000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.2669999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.524,"5min":4.524,"15min":4.524},"last":1.2150000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":4.4189999999999996,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.381},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.3120000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.353},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":1.4910000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1114112,"data_stored":817731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.753},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.91500000000000004}]},{"osd":2,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.083},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.1000000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.383},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":0.96899999999999997}]},{"osd":5,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.038}]},{"osd":6,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.474},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.4339999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:15:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.621},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:16:15.227 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T09:16:15.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-22T09:16:15.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.469+0000 7f749f59e640 1 Processor -- start 2023-12-22T09:16:15.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.470+0000 7f749f59e640 1 -- start start 2023-12-22T09:16:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.471+0000 7f749f59e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74a00a8360 0x7f74a00a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.471+0000 7f749f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f74a00c0050 0x7f74a0152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.471+0000 7f749f59e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a01550b0 con 0x7f74a00bfb40 2023-12-22T09:16:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.471+0000 7f749f59e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a00a93d0 con 0x7f74a00a8360 2023-12-22T09:16:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.471+0000 7f749f59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a0155390 con 0x7f74a00c0050 2023-12-22T09:16:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.471+0000 7f749e59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74a00a8360 0x7f74a00a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.472+0000 7f749e59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74a00a8360 0x7f74a00a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48158/0 (socket says 172.21.15.106:48158) 2023-12-22T09:16:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.472+0000 7f749e59c640 1 -- 172.21.15.106:0/2417777509 learned_addr learned my addr 172.21.15.106:0/2417777509 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.472+0000 7f749e59c640 1 -- 172.21.15.106:0/2417777509 >> v2:172.21.15.132:3300/0 conn(0x7f74a00c0050 msgr2=0x7f74a0152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.472+0000 7f749ed9d640 1 --2- 172.21.15.106:0/2417777509 >> v2:172.21.15.132:3300/0 conn(0x7f74a00c0050 0x7f74a0152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.472+0000 7f749e59c640 1 --2- 172.21.15.106:0/2417777509 >> v2:172.21.15.132:3300/0 conn(0x7f74a00c0050 0x7f74a0152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.472+0000 7f749e59c640 1 -- 172.21.15.106:0/2417777509 >> v1:172.21.15.106:6789/0 conn(0x7f74a00bfb40 legacy=0x7f74a0151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.472+0000 7f749e59c640 1 -- 172.21.15.106:0/2417777509 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0155670 con 0x7f74a00a8360 2023-12-22T09:16:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.473+0000 7f749e59c640 1 --2- 172.21.15.106:0/2417777509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00a8360 0x7f74a00a8740 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f74a006c880 tx=0x7f749002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfeca7fe346ba74 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:15.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.473+0000 7f749dd9b640 1 -- 172.21.15.106:0/2417777509 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490031870 con 0x7f74a00a8360 2023-12-22T09:16:15.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.473+0000 7f749dd9b640 1 -- 172.21.15.106:0/2417777509 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74900319d0 con 0x7f74a00a8360 2023-12-22T09:16:15.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.473+0000 7f749dd9b640 1 -- 172.21.15.106:0/2417777509 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490031d60 con 0x7f74a00a8360 2023-12-22T09:16:15.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.474+0000 7f749f59e640 1 -- 172.21.15.106:0/2417777509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00a8360 msgr2=0x7f74a00a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:15.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.474+0000 7f749f59e640 1 --2- 172.21.15.106:0/2417777509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00a8360 0x7f74a00a8740 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f74a006c880 tx=0x7f749002b910 comp rx=0 tx=0).stop 2023-12-22T09:16:15.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.474+0000 7f749f59e640 1 -- 172.21.15.106:0/2417777509 shutdown_connections 2023-12-22T09:16:15.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.474+0000 7f749f59e640 1 --2- 172.21.15.106:0/2417777509 >> v2:172.21.15.132:3300/0 conn(0x7f74a00c0050 0x7f74a0152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.474+0000 7f749f59e640 1 --2- 172.21.15.106:0/2417777509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00a8360 0x7f74a00a8740 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.474+0000 7f749f59e640 1 -- 172.21.15.106:0/2417777509 >> 172.21.15.106:0/2417777509 conn(0x7f74a0069bf0 msgr2=0x7f74a0069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:15.476 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.474+0000 7f749f59e640 1 -- 172.21.15.106:0/2417777509 shutdown_connections 2023-12-22T09:16:15.476 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.474+0000 7f749f59e640 1 -- 172.21.15.106:0/2417777509 wait complete. 2023-12-22T09:16:15.476 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.476+0000 7f749f59e640 1 Processor -- start 2023-12-22T09:16:15.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.476+0000 7f749f59e640 1 -- start start 2023-12-22T09:16:15.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.477+0000 7f749f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a00a8360 0x7f74a01e7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:15.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.477+0000 7f749f59e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00bfb40 0x7f74a014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:15.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.477+0000 7f749f59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74a00c0050 0x7f74a01418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:15.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.477+0000 7f749f59e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a014bf40 con 0x7f74a00bfb40 2023-12-22T09:16:15.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.477+0000 7f749f59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a014fd00 con 0x7f74a00a8360 2023-12-22T09:16:15.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.477+0000 7f749f59e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a014c750 con 0x7f74a00c0050 2023-12-22T09:16:15.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f7497fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00bfb40 0x7f74a014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:15.478 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f7497fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00bfb40 0x7f74a014e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48166/0 (socket says 172.21.15.106:48166) 2023-12-22T09:16:15.479 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f7497fff640 1 -- 172.21.15.106:0/2541188672 learned_addr learned my addr 172.21.15.106:0/2541188672 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:15.479 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f7497fff640 1 -- 172.21.15.106:0/2541188672 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74a00c0050 msgr2=0x7f74a01418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:15.480 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f749e59c640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a00a8360 0x7f74a01e7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:15.480 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f7497fff640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74a00c0050 0x7f74a01418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.480 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f7497fff640 1 -- 172.21.15.106:0/2541188672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a00a8360 msgr2=0x7f74a01e7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:15.480 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f7497fff640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a00a8360 0x7f74a01e7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.480 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f7497fff640 1 -- 172.21.15.106:0/2541188672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74900094d0 con 0x7f74a00bfb40 2023-12-22T09:16:15.480 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.478+0000 7f7497fff640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00bfb40 0x7f74a014e6a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f748800c450 tx=0x7f748800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:15.480 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.479+0000 7f7496ffd640 1 -- 172.21.15.106:0/2541188672 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74880052d0 con 0x7f74a00bfb40 2023-12-22T09:16:15.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.479+0000 7f7496ffd640 1 -- 172.21.15.106:0/2541188672 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7488005430 con 0x7f74a00bfb40 2023-12-22T09:16:15.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.479+0000 7f7496ffd640 1 -- 172.21.15.106:0/2541188672 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488012870 con 0x7f74a00bfb40 2023-12-22T09:16:15.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.479+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a014ca30 con 0x7f74a00bfb40 2023-12-22T09:16:15.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.479+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a014ffc0 con 0x7f74a00bfb40 2023-12-22T09:16:15.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.480+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a00bf3e0 con 0x7f74a00bfb40 2023-12-22T09:16:15.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.481+0000 7f7496ffd640 1 -- 172.21.15.106:0/2541188672 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f74880129d0 con 0x7f74a00bfb40 2023-12-22T09:16:15.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.482+0000 7f7496ffd640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f748006a430 0x7f748006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:15.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.482+0000 7f7496ffd640 1 -- 172.21.15.106:0/2541188672 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7488088890 con 0x7f74a00bfb40 2023-12-22T09:16:15.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.482+0000 7f749e59c640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f748006a430 0x7f748006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:15.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.483+0000 7f749e59c640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f748006a430 0x7f748006c8f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7490036000 tx=0x7f749003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:15.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.486+0000 7f7496ffd640 1 -- 172.21.15.106:0/2541188672 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7488053a70 con 0x7f74a00bfb40 2023-12-22T09:16:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.739+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f74a004e8d0 con 0x7f74a00bfb40 2023-12-22T09:16:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.746+0000 7f7496ffd640 1 -- 172.21.15.106:0/2541188672 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v13) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7488057090 con 0x7f74a00bfb40 2023-12-22T09:16:15.747 INFO:teuthology.orchestra.run.smithi106.stderr:updated caps for client.1 2023-12-22T09:16:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.748+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f748006a430 msgr2=0x7f748006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.748+0000 7f749f59e640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f748006a430 0x7f748006c8f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7490036000 tx=0x7f749003c040 comp rx=0 tx=0).stop 2023-12-22T09:16:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.748+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00bfb40 msgr2=0x7f74a014e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.748+0000 7f749f59e640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00bfb40 0x7f74a014e6a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f748800c450 tx=0x7f748800c910 comp rx=0 tx=0).stop 2023-12-22T09:16:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.749+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 shutdown_connections 2023-12-22T09:16:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.749+0000 7f749f59e640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f748006a430 0x7f748006c8f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.749+0000 7f749f59e640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74a00c0050 0x7f74a01418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.749+0000 7f749f59e640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a00bfb40 0x7f74a014e6a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.749+0000 7f749f59e640 1 --2- 172.21.15.106:0/2541188672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a00a8360 0x7f74a01e7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.749+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 >> 172.21.15.106:0/2541188672 conn(0x7f74a0069bf0 msgr2=0x7f74a0149e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.749+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 shutdown_connections 2023-12-22T09:16:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:15.749+0000 7f749f59e640 1 -- 172.21.15.106:0/2541188672 wait complete. 2023-12-22T09:16:15.767 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:16:15.768 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:15.828 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:16:15.828 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:15.882 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.099+0000 7fae7d8fa640 1 Processor -- start 2023-12-22T09:16:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.099+0000 7fae7d8fa640 1 -- start start 2023-12-22T09:16:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.101+0000 7fae7d8fa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781571a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.101+0000 7fae7d8fa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae780c7410 0x7fae780c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.101+0000 7fae7d8fa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae78153ed0 con 0x7fae78154360 2023-12-22T09:16:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.101+0000 7fae7d8fa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780c5e20 con 0x7fae780c7410 2023-12-22T09:16:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.101+0000 7fae7d8fa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae78153c30 con 0x7fae780c4100 2023-12-22T09:16:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.102+0000 7fae7c8f8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.102+0000 7fae77fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae780c7410 0x7fae780c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.102+0000 7fae7c8f8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:58028/0 (socket says 172.21.15.106:58028) 2023-12-22T09:16:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.102+0000 7fae7c8f8640 1 -- 172.21.15.106:0/1531353794 learned_addr learned my addr 172.21.15.106:0/1531353794 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.102+0000 7fae7c8f8640 1 -- 172.21.15.106:0/1531353794 >> v2:172.21.15.132:3300/0 conn(0x7fae780c7410 msgr2=0x7fae780c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.102+0000 7fae7c8f8640 1 --2- 172.21.15.106:0/1531353794 >> v2:172.21.15.132:3300/0 conn(0x7fae780c7410 0x7fae780c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.103+0000 7fae7c8f8640 1 -- 172.21.15.106:0/1531353794 >> v1:172.21.15.132:6789/0 conn(0x7fae78154360 legacy=0x7fae78151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.103+0000 7fae7c8f8640 1 -- 172.21.15.106:0/1531353794 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae781578f0 con 0x7fae780c4100 2023-12-22T09:16:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.103+0000 7fae777fe640 1 -- 172.21.15.106:0/1531353794 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901195093 0 0) 0x7fae78153ed0 con 0x7fae78154360 2023-12-22T09:16:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.104+0000 7fae7c8f8640 1 --2- 172.21.15.106:0/1531353794 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781571a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009870 tx=0x7fae6c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=106c1f86936342e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.104+0000 7fae777fe640 1 -- 172.21.15.106:0/1531353794 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0317c0 con 0x7fae780c4100 2023-12-22T09:16:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.104+0000 7fae777fe640 1 -- 172.21.15.106:0/1531353794 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c031920 con 0x7fae780c4100 2023-12-22T09:16:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.104+0000 7fae777fe640 1 -- 172.21.15.106:0/1531353794 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c031cb0 con 0x7fae780c4100 2023-12-22T09:16:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.105+0000 7fae7d8fa640 1 -- 172.21.15.106:0/1531353794 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 msgr2=0x7fae781571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.105+0000 7fae7d8fa640 1 --2- 172.21.15.106:0/1531353794 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781571a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009870 tx=0x7fae6c02b860 comp rx=0 tx=0).stop 2023-12-22T09:16:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.105+0000 7fae7d8fa640 1 -- 172.21.15.106:0/1531353794 shutdown_connections 2023-12-22T09:16:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.105+0000 7fae7d8fa640 1 --2- 172.21.15.106:0/1531353794 >> v2:172.21.15.132:3300/0 conn(0x7fae780c7410 0x7fae780c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.105+0000 7fae7d8fa640 1 --2- 172.21.15.106:0/1531353794 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781571a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.105+0000 7fae7d8fa640 1 -- 172.21.15.106:0/1531353794 >> 172.21.15.106:0/1531353794 conn(0x7fae780c5f90 msgr2=0x7fae780c63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.105+0000 7fae7d8fa640 1 -- 172.21.15.106:0/1531353794 shutdown_connections 2023-12-22T09:16:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.105+0000 7fae7d8fa640 1 -- 172.21.15.106:0/1531353794 wait complete. 2023-12-22T09:16:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.107+0000 7fae7d8fa640 1 Processor -- start 2023-12-22T09:16:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.107+0000 7fae7d8fa640 1 -- start start 2023-12-22T09:16:16.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.108+0000 7fae7d8fa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781e9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.108+0000 7fae7d8fa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae780c7410 0x7fae78156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.108+0000 7fae7d8fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae78154360 0x7fae7814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.108+0000 7fae7d8fa640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780ac340 con 0x7fae780c7410 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.108+0000 7fae7d8fa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7814b770 con 0x7fae78154360 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.108+0000 7fae7d8fa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7814cdf0 con 0x7fae780c4100 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.108+0000 7fae77fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae780c7410 0x7fae78156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.108+0000 7fae77fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae780c7410 0x7fae78156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48174/0 (socket says 172.21.15.106:48174) 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.108+0000 7fae77fff640 1 -- 172.21.15.106:0/3480468164 learned_addr learned my addr 172.21.15.106:0/3480468164 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae7c8f8640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae7d0f9640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae78154360 0x7fae7814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae77fff640 1 -- 172.21.15.106:0/3480468164 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 msgr2=0x7fae781e9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae77fff640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781e9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae77fff640 1 -- 172.21.15.106:0/3480468164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae78154360 msgr2=0x7fae7814a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae77fff640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae78154360 0x7fae7814a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae77fff640 1 -- 172.21.15.106:0/3480468164 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0094d0 con 0x7fae780c7410 2023-12-22T09:16:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae7c8f8640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781e9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae77fff640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae780c7410 0x7fae78156da0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fae6400e8a0 tx=0x7fae6400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae757fa640 1 -- 172.21.15.106:0/3480468164 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640094f0 con 0x7fae780c7410 2023-12-22T09:16:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae757fa640 1 -- 172.21.15.106:0/3480468164 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6400c940 con 0x7fae780c7410 2023-12-22T09:16:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae757fa640 1 -- 172.21.15.106:0/3480468164 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6400ccf0 con 0x7fae780c7410 2023-12-22T09:16:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.109+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7814d0d0 con 0x7fae780c7410 2023-12-22T09:16:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.110+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae780c02f0 con 0x7fae780c7410 2023-12-22T09:16:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.111+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7814b520 con 0x7fae780c7410 2023-12-22T09:16:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.111+0000 7fae757fa640 1 -- 172.21.15.106:0/3480468164 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae64013470 con 0x7fae780c7410 2023-12-22T09:16:16.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.113+0000 7fae757fa640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a460 0x7fae5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.113+0000 7fae757fa640 1 -- 172.21.15.106:0/3480468164 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fae64088e90 con 0x7fae780c7410 2023-12-22T09:16:16.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.113+0000 7fae7c8f8640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a460 0x7fae5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.114+0000 7fae7c8f8640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a460 0x7fae5c06c920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fae6c036000 tx=0x7fae6c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:16.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.117+0000 7fae757fa640 1 -- 172.21.15.106:0/3480468164 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae64053fd0 con 0x7fae780c7410 2023-12-22T09:16:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.310+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae7804e8d0 con 0x7fae780c7410 2023-12-22T09:16:16.312 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.311+0000 7fae757fa640 1 -- 172.21.15.106:0/3480468164 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20070 (secure 0 0 0) 0x7fae64021090 con 0x7fae780c7410 2023-12-22T09:16:16.312 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:16.313 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:11.243405+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:16.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a460 msgr2=0x7fae5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a460 0x7fae5c06c920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fae6c036000 tx=0x7fae6c03d040 comp rx=0 tx=0).stop 2023-12-22T09:16:16.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae780c7410 msgr2=0x7fae78156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae780c7410 0x7fae78156da0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fae6400e8a0 tx=0x7fae6400ed60 comp rx=0 tx=0).stop 2023-12-22T09:16:16.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 shutdown_connections 2023-12-22T09:16:16.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a460 0x7fae5c06c920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae78154360 0x7fae7814a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae780c7410 0x7fae78156da0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 --2- 172.21.15.106:0/3480468164 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae780c4100 0x7fae781e9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.316 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 >> 172.21.15.106:0/3480468164 conn(0x7fae780c5f90 msgr2=0x7fae78072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:16.316 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 shutdown_connections 2023-12-22T09:16:16.316 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.314+0000 7fae7d8fa640 1 -- 172.21.15.106:0/3480468164 wait complete. 2023-12-22T09:16:16.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:15:52.874302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:15:54.136774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-22T09:16:08.066634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-22T09:16:09.242570+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:16:16.333 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:16:16.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.540+0000 7f245b12e640 1 Processor -- start 2023-12-22T09:16:16.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.540+0000 7f245b12e640 1 -- start start 2023-12-22T09:16:16.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.542+0000 7f245b12e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245414f090 0x7f2454151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.542+0000 7f245b12e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f245406b960 0x7f24540c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.542+0000 7f245b12e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2454155120 con 0x7f24540c1910 2023-12-22T09:16:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.542+0000 7f245b12e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245406e080 con 0x7f245406b960 2023-12-22T09:16:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.542+0000 7f245b12e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2454155fa0 con 0x7f245414f090 2023-12-22T09:16:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.543+0000 7f2458eca640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245414f090 0x7f2454151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.543+0000 7f2458eca640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245414f090 0x7f2454151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:58042/0 (socket says 172.21.15.106:58042) 2023-12-22T09:16:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.543+0000 7f2458eca640 1 -- 172.21.15.106:0/3802764887 learned_addr learned my addr 172.21.15.106:0/3802764887 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.543+0000 7f24596cb640 1 --2- 172.21.15.106:0/3802764887 >> v2:172.21.15.132:3300/0 conn(0x7f245406b960 0x7f24540c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.543+0000 7f2458eca640 1 -- 172.21.15.106:0/3802764887 >> v2:172.21.15.132:3300/0 conn(0x7f245406b960 msgr2=0x7f24540c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:16.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.543+0000 7f2458eca640 1 --2- 172.21.15.106:0/3802764887 >> v2:172.21.15.132:3300/0 conn(0x7f245406b960 0x7f24540c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.543+0000 7f2458eca640 1 -- 172.21.15.106:0/3802764887 >> v1:172.21.15.132:6789/0 conn(0x7f24540c1910 legacy=0x7f2454155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.543+0000 7f2458eca640 1 -- 172.21.15.106:0/3802764887 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540a8720 con 0x7f245414f090 2023-12-22T09:16:16.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.545+0000 7f2458eca640 1 --2- 172.21.15.106:0/3802764887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245414f090 0x7f2454151b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2448009870 tx=0x7f244802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84b2740aacf93e31 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:16.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.545+0000 7f24537fe640 1 -- 172.21.15.106:0/3802764887 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448031640 con 0x7f245414f090 2023-12-22T09:16:16.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.545+0000 7f24537fe640 1 -- 172.21.15.106:0/3802764887 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24480317a0 con 0x7f245414f090 2023-12-22T09:16:16.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.545+0000 7f24537fe640 1 -- 172.21.15.106:0/3802764887 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448031b30 con 0x7f245414f090 2023-12-22T09:16:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.546+0000 7f245b12e640 1 -- 172.21.15.106:0/3802764887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245414f090 msgr2=0x7f2454151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.546+0000 7f245b12e640 1 --2- 172.21.15.106:0/3802764887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245414f090 0x7f2454151b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2448009870 tx=0x7f244802b8f0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.546+0000 7f245b12e640 1 -- 172.21.15.106:0/3802764887 shutdown_connections 2023-12-22T09:16:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.546+0000 7f245b12e640 1 --2- 172.21.15.106:0/3802764887 >> v2:172.21.15.132:3300/0 conn(0x7f245406b960 0x7f24540c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.546+0000 7f245b12e640 1 --2- 172.21.15.106:0/3802764887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f245414f090 0x7f2454151b30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.546+0000 7f245b12e640 1 -- 172.21.15.106:0/3802764887 >> 172.21.15.106:0/3802764887 conn(0x7f2454069dd0 msgr2=0x7f245406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.546+0000 7f245b12e640 1 -- 172.21.15.106:0/3802764887 shutdown_connections 2023-12-22T09:16:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.546+0000 7f245b12e640 1 -- 172.21.15.106:0/3802764887 wait complete. 2023-12-22T09:16:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.548+0000 7f245b12e640 1 Processor -- start 2023-12-22T09:16:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.548+0000 7f245b12e640 1 -- start start 2023-12-22T09:16:16.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.549+0000 7f245b12e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245406b960 0x7f2454151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.549+0000 7f245b12e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24540c1910 0x7f24541510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.549+0000 7f245b12e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f245414f090 0x7f2454149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.549+0000 7f245b12e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245414bde0 con 0x7f245414f090 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.549+0000 7f245b12e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2454148c20 con 0x7f245406b960 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.549+0000 7f245b12e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245414e1c0 con 0x7f24540c1910 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.549+0000 7f24596cb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f245414f090 0x7f2454149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.549+0000 7f24596cb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f245414f090 0x7f2454149450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48182/0 (socket says 172.21.15.106:48182) 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.549+0000 7f24596cb640 1 -- 172.21.15.106:0/1104988243 learned_addr learned my addr 172.21.15.106:0/1104988243 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f2458eca640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245406b960 0x7f2454151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f2453fff640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24540c1910 0x7f24541510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f24596cb640 1 -- 172.21.15.106:0/1104988243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24540c1910 msgr2=0x7f24541510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f24596cb640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24540c1910 0x7f24541510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f24596cb640 1 -- 172.21.15.106:0/1104988243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245406b960 msgr2=0x7f2454151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f24596cb640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245406b960 0x7f2454151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f24596cb640 1 -- 172.21.15.106:0/1104988243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480094d0 con 0x7f245414f090 2023-12-22T09:16:16.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f24596cb640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f245414f090 0x7f2454149450 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f244c009d30 tx=0x7f244c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:16.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f24517fa640 1 -- 172.21.15.106:0/1104988243 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c009ba0 con 0x7f245414f090 2023-12-22T09:16:16.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f24517fa640 1 -- 172.21.15.106:0/1104988243 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00f040 con 0x7f245414f090 2023-12-22T09:16:16.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f24517fa640 1 -- 172.21.15.106:0/1104988243 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0146c0 con 0x7f245414f090 2023-12-22T09:16:16.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.550+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245414b540 con 0x7f245414f090 2023-12-22T09:16:16.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.551+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245414bb00 con 0x7f245414f090 2023-12-22T09:16:16.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.552+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2454073f10 con 0x7f245414f090 2023-12-22T09:16:16.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.553+0000 7f24517fa640 1 -- 172.21.15.106:0/1104988243 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f244c014820 con 0x7f245414f090 2023-12-22T09:16:16.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.554+0000 7f24517fa640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f243806a430 0x7f243806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.554+0000 7f24517fa640 1 -- 172.21.15.106:0/1104988243 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f244c089880 con 0x7f245414f090 2023-12-22T09:16:16.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.554+0000 7f2458eca640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f243806a430 0x7f243806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.555+0000 7f2458eca640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f243806a430 0x7f243806c8f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2448036000 tx=0x7f244803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:16.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.558+0000 7f24517fa640 1 -- 172.21.15.106:0/1104988243 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f244c054a60 con 0x7f245414f090 2023-12-22T09:16:16.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.750+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2454155340 con 0x7f245414f090 2023-12-22T09:16:16.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.751+0000 7f24517fa640 1 -- 172.21.15.106:0/1104988243 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f244c0180a0 con 0x7f245414f090 2023-12-22T09:16:16.752 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f243806a430 msgr2=0x7f243806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f243806a430 0x7f243806c8f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2448036000 tx=0x7f244803c040 comp rx=0 tx=0).stop 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f245414f090 msgr2=0x7f2454149450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f245414f090 0x7f2454149450 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f244c009d30 tx=0x7f244c00c490 comp rx=0 tx=0).stop 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 shutdown_connections 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f243806a430 0x7f243806c8f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f245414f090 0x7f2454149450 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24540c1910 0x7f24541510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 --2- 172.21.15.106:0/1104988243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245406b960 0x7f2454151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 >> 172.21.15.106:0/1104988243 conn(0x7f2454069dd0 msgr2=0x7f24540a8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 shutdown_connections 2023-12-22T09:16:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.754+0000 7f245b12e640 1 -- 172.21.15.106:0/1104988243 wait complete. 2023-12-22T09:16:16.774 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:16:16.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.988+0000 7fe0684db640 1 Processor -- start 2023-12-22T09:16:16.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.988+0000 7fe0684db640 1 -- start start 2023-12-22T09:16:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.989+0000 7fe0684db640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe06006bdc0 0x7fe0601557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.989+0000 7fe0684db640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06014f570 con 0x7fe06006c2d0 2023-12-22T09:16:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.989+0000 7fe0684db640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0600c0b00 con 0x7fe0600c5a30 2023-12-22T09:16:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.989+0000 7fe0684db640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0600a90f0 con 0x7fe06006bdc0 2023-12-22T09:16:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.990+0000 7fe066a78640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe06006c2d0 0x7fe06015c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39264/0 (socket says 172.21.15.106:39264) 2023-12-22T09:16:16.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.990+0000 7fe066a78640 1 -- 172.21.15.106:0/2461989893 learned_addr learned my addr 172.21.15.106:0/2461989893 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:16.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.990+0000 7fe065a76640 1 --2- 172.21.15.106:0/2461989893 >> v2:172.21.15.132:3300/0 conn(0x7fe06006bdc0 0x7fe0601557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.990+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44914590 0 0) 0x7fe06014f570 con 0x7fe06006c2d0 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.990+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe04c003520 con 0x7fe06006c2d0 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069247973 0 0) 0x7fe04c003520 con 0x7fe06006c2d0 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 >> v2:172.21.15.132:3300/0 conn(0x7fe06006bdc0 msgr2=0x7fe0601557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 --2- 172.21.15.106:0/2461989893 >> v2:172.21.15.132:3300/0 conn(0x7fe06006bdc0 0x7fe0601557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 >> v1:172.21.15.132:6789/0 conn(0x7fe0600c5a30 legacy=0x7fe0601550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0600bfd40 con 0x7fe06006c2d0 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fe0580019f0 con 0x7fe06006c2d0 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 >> v1:172.21.15.106:6789/0 conn(0x7fe06006c2d0 legacy=0x7fe06015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe04c003970 0x7fe04c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe04c0047c0 0x7fe04c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe04c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600a90f0 con 0x7fe04c005180 2023-12-22T09:16:16.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c00c120 con 0x7fe04c003970 2023-12-22T09:16:16.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c00c2e0 con 0x7fe04c0047c0 2023-12-22T09:16:16.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe066a78640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe04c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.991+0000 7fe066277640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe04c003970 0x7fe04c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.992+0000 7fe066a78640 1 -- 172.21.15.106:0/2461989893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe04c0047c0 msgr2=0x7fe04c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.992+0000 7fe066a78640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe04c0047c0 0x7fe04c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.992+0000 7fe066a78640 1 -- 172.21.15.106:0/2461989893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe04c003970 msgr2=0x7fe04c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.992+0000 7fe066a78640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe04c003970 0x7fe04c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.992+0000 7fe066a78640 1 -- 172.21.15.106:0/2461989893 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c003520 con 0x7fe04c005180 2023-12-22T09:16:16.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.992+0000 7fe066a78640 1 -- 172.21.15.106:0/2461989893 reap_dead start 2023-12-22T09:16:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.993+0000 7fe066a78640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe04c00b980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe05800a830 tx=0x7fe04c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e634e2a81b493ad5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.993+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580072d0 con 0x7fe04c005180 2023-12-22T09:16:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.993+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05802f070 con 0x7fe04c005180 2023-12-22T09:16:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.993+0000 7fe065275640 1 -- 172.21.15.106:0/2461989893 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580076b0 con 0x7fe04c005180 2023-12-22T09:16:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.993+0000 7fe0684db640 1 -- 172.21.15.106:0/2461989893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 msgr2=0x7fe04c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.993+0000 7fe0684db640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe04c00b980 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe05800a830 tx=0x7fe04c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.994+0000 7fe0684db640 1 -- 172.21.15.106:0/2461989893 shutdown_connections 2023-12-22T09:16:16.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.994+0000 7fe0684db640 1 --2- 172.21.15.106:0/2461989893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe04c00b980 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.994+0000 7fe0684db640 1 -- 172.21.15.106:0/2461989893 >> 172.21.15.106:0/2461989893 conn(0x7fe06006a220 msgr2=0x7fe0600c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:16.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.994+0000 7fe0684db640 1 -- 172.21.15.106:0/2461989893 shutdown_connections 2023-12-22T09:16:16.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.994+0000 7fe0684db640 1 -- 172.21.15.106:0/2461989893 wait complete. 2023-12-22T09:16:16.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.995+0000 7fe0684db640 1 Processor -- start 2023-12-22T09:16:16.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.996+0000 7fe0684db640 1 -- start start 2023-12-22T09:16:16.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.996+0000 7fe0684db640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe06014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.996+0000 7fe0684db640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe060155880 0x7fe060148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.996+0000 7fe0684db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0601ecf40 0x7fe0601ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.996+0000 7fe0684db640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0601474f0 con 0x7fe04c005180 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.996+0000 7fe0684db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe060146770 con 0x7fe0601ecf40 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.996+0000 7fe0684db640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe060147740 con 0x7fe060155880 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.997+0000 7fe066277640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe06014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.997+0000 7fe066277640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe06014f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48200/0 (socket says 172.21.15.106:48200) 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.997+0000 7fe066277640 1 -- 172.21.15.106:0/1360836075 learned_addr learned my addr 172.21.15.106:0/1360836075 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.997+0000 7fe066277640 1 -- 172.21.15.106:0/1360836075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe060155880 msgr2=0x7fe060148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.997+0000 7fe066277640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe060155880 0x7fe060148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.997+0000 7fe066277640 1 -- 172.21.15.106:0/1360836075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0601ecf40 msgr2=0x7fe0601ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.997+0000 7fe066277640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0601ecf40 0x7fe0601ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.997+0000 7fe066277640 1 -- 172.21.15.106:0/1360836075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060147a20 con 0x7fe04c005180 2023-12-22T09:16:16.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.997+0000 7fe066277640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe06014f810 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00e4d0 tx=0x7fe05c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:17.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.998+0000 7fe056ffd640 1 -- 172.21.15.106:0/1360836075 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0052e0 con 0x7fe04c005180 2023-12-22T09:16:17.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.998+0000 7fe056ffd640 1 -- 172.21.15.106:0/1360836075 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c005440 con 0x7fe04c005180 2023-12-22T09:16:17.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.998+0000 7fe056ffd640 1 -- 172.21.15.106:0/1360836075 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c003810 con 0x7fe04c005180 2023-12-22T09:16:17.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.998+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe060147d00 con 0x7fe04c005180 2023-12-22T09:16:17.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.998+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0600bf6c0 con 0x7fe04c005180 2023-12-22T09:16:17.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:16.999+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe060073f10 con 0x7fe04c005180 2023-12-22T09:16:17.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.000+0000 7fe056ffd640 1 -- 172.21.15.106:0/1360836075 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe05c003970 con 0x7fe04c005180 2023-12-22T09:16:17.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.001+0000 7fe056ffd640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe04406a460 0x7fe04406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.001+0000 7fe056ffd640 1 -- 172.21.15.106:0/1360836075 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe05c088ae0 con 0x7fe04c005180 2023-12-22T09:16:17.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.002+0000 7fe065a76640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe04406a460 0x7fe04406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.002+0000 7fe065a76640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe04406a460 0x7fe04406c920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe050006a90 tx=0x7fe050006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:17.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.006+0000 7fe056ffd640 1 -- 172.21.15.106:0/1360836075 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe05c053c30 con 0x7fe04c005180 2023-12-22T09:16:17.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.198+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe06015d9c0 con 0x7fe04c005180 2023-12-22T09:16:17.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.199+0000 7fe056ffd640 1 -- 172.21.15.106:0/1360836075 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe05c057250 con 0x7fe04c005180 2023-12-22T09:16:17.200 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:17.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe04406a460 msgr2=0x7fe04406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe04406a460 0x7fe04406c920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe050006a90 tx=0x7fe050006a20 comp rx=0 tx=0).stop 2023-12-22T09:16:17.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 msgr2=0x7fe06014f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe06014f810 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00e4d0 tx=0x7fe05c00e990 comp rx=0 tx=0).stop 2023-12-22T09:16:17.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 shutdown_connections 2023-12-22T09:16:17.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe04406a460 0x7fe04406c920 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0601ecf40 0x7fe0601ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe060155880 0x7fe060148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 --2- 172.21.15.106:0/1360836075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe04c005180 0x7fe06014f810 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 >> 172.21.15.106:0/1360836075 conn(0x7fe06006a220 msgr2=0x7fe0600c1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:17.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 shutdown_connections 2023-12-22T09:16:17.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.202+0000 7fe0684db640 1 -- 172.21.15.106:0/1360836075 wait complete. 2023-12-22T09:16:17.222 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:16:17.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.443+0000 7f8adf59e640 1 Processor -- start 2023-12-22T09:16:17.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.443+0000 7f8adf59e640 1 -- start start 2023-12-22T09:16:17.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8adf59e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8ae014dfd0 0x7f8ae0150880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8adf59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ae00bfb00 0x7f8ae00c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8adf59e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae00c0c10 con 0x7f8ae00c20d0 2023-12-22T09:16:17.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8adf59e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae0071940 con 0x7f8ae014dfd0 2023-12-22T09:16:17.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8adf59e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00c0000 con 0x7f8ae00bfb00 2023-12-22T09:16:17.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8ade59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8ae014dfd0 0x7f8ae0150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8aded9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8ae00c20d0 0x7f8ae0151fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39280/0 (socket says 172.21.15.106:39280) 2023-12-22T09:16:17.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8aded9d640 1 -- 172.21.15.106:0/505800324 learned_addr learned my addr 172.21.15.106:0/505800324 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:17.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8ade59c640 1 -- 172.21.15.106:0/505800324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ae00bfb00 msgr2=0x7f8ae00c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:17.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8ade59c640 1 --2- 172.21.15.106:0/505800324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ae00bfb00 0x7f8ae00c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8ade59c640 1 -- 172.21.15.106:0/505800324 >> v1:172.21.15.106:6789/0 conn(0x7f8ae00c20d0 legacy=0x7f8ae0151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.445+0000 7f8ade59c640 1 -- 172.21.15.106:0/505800324 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00c02e0 con 0x7f8ae014dfd0 2023-12-22T09:16:17.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.447+0000 7f8ade59c640 1 --2- 172.21.15.106:0/505800324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae014dfd0 0x7f8ae0150880 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097a0 tx=0x7f8ad002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d758dccab8d5151 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:17.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.447+0000 7f8addd9b640 1 -- 172.21.15.106:0/505800324 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0031780 con 0x7f8ae014dfd0 2023-12-22T09:16:17.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.447+0000 7f8addd9b640 1 -- 172.21.15.106:0/505800324 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad00318e0 con 0x7f8ae014dfd0 2023-12-22T09:16:17.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.447+0000 7f8addd9b640 1 -- 172.21.15.106:0/505800324 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0031c70 con 0x7f8ae014dfd0 2023-12-22T09:16:17.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.447+0000 7f8adf59e640 1 -- 172.21.15.106:0/505800324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae014dfd0 msgr2=0x7f8ae0150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.447+0000 7f8adf59e640 1 --2- 172.21.15.106:0/505800324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae014dfd0 0x7f8ae0150880 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097a0 tx=0x7f8ad002b820 comp rx=0 tx=0).stop 2023-12-22T09:16:17.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.448+0000 7f8adf59e640 1 -- 172.21.15.106:0/505800324 shutdown_connections 2023-12-22T09:16:17.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.448+0000 7f8adf59e640 1 --2- 172.21.15.106:0/505800324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ae00bfb00 0x7f8ae00c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.448+0000 7f8adf59e640 1 --2- 172.21.15.106:0/505800324 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae014dfd0 0x7f8ae0150880 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.448+0000 7f8adf59e640 1 -- 172.21.15.106:0/505800324 >> 172.21.15.106:0/505800324 conn(0x7f8ae0069bf0 msgr2=0x7f8ae0069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:17.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.448+0000 7f8adf59e640 1 -- 172.21.15.106:0/505800324 shutdown_connections 2023-12-22T09:16:17.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.448+0000 7f8adf59e640 1 -- 172.21.15.106:0/505800324 wait complete. 2023-12-22T09:16:17.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.449+0000 7f8adf59e640 1 Processor -- start 2023-12-22T09:16:17.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.450+0000 7f8adf59e640 1 -- start start 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.450+0000 7f8adf59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ae00bfb00 0x7f8ae00c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.450+0000 7f8adf59e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae00c20d0 0x7f8ae0146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.450+0000 7f8adf59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae014dfd0 0x7f8ae00aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.450+0000 7f8adf59e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00c5c80 con 0x7f8ae00c20d0 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.450+0000 7f8adf59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae00c39b0 con 0x7f8ae014dfd0 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.450+0000 7f8adf59e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0147270 con 0x7f8ae00bfb00 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.451+0000 7f8ad7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae00c20d0 0x7f8ae0146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.451+0000 7f8ad7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae00c20d0 0x7f8ae0146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48206/0 (socket says 172.21.15.106:48206) 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.451+0000 7f8ad7fff640 1 -- 172.21.15.106:0/962700536 learned_addr learned my addr 172.21.15.106:0/962700536 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:17.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.451+0000 7f8ade59c640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ae00bfb00 0x7f8ae00c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.451+0000 7f8ad7fff640 1 -- 172.21.15.106:0/962700536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ae00bfb00 msgr2=0x7f8ae00c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.451+0000 7f8ad7fff640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ae00bfb00 0x7f8ae00c2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.451+0000 7f8ad7fff640 1 -- 172.21.15.106:0/962700536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae014dfd0 msgr2=0x7f8ae00aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.451+0000 7f8ad7fff640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae014dfd0 0x7f8ae00aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.451+0000 7f8ad7fff640 1 -- 172.21.15.106:0/962700536 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0009400 con 0x7f8ae00c20d0 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.452+0000 7f8ad7fff640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae00c20d0 0x7f8ae0146d30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800b410 tx=0x7f8ac800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.452+0000 7f8ad6ffd640 1 -- 172.21.15.106:0/962700536 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8011830 con 0x7f8ae00c20d0 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.452+0000 7f8ad6ffd640 1 -- 172.21.15.106:0/962700536 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac80119b0 con 0x7f8ae00c20d0 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.452+0000 7f8ad6ffd640 1 -- 172.21.15.106:0/962700536 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8011d60 con 0x7f8ae00c20d0 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.452+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae00c35f0 con 0x7f8ae00c20d0 2023-12-22T09:16:17.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.452+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae00c59a0 con 0x7f8ae00c20d0 2023-12-22T09:16:17.455 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.453+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae004e8d0 con 0x7f8ae00c20d0 2023-12-22T09:16:17.455 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.454+0000 7f8ad6ffd640 1 -- 172.21.15.106:0/962700536 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ac801a400 con 0x7f8ae00c20d0 2023-12-22T09:16:17.455 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.455+0000 7f8ad6ffd640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8ac006a430 0x7f8ac006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.455+0000 7f8ad6ffd640 1 -- 172.21.15.106:0/962700536 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8ac8088e90 con 0x7f8ae00c20d0 2023-12-22T09:16:17.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.455+0000 7f8ade59c640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8ac006a430 0x7f8ac006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.456+0000 7f8ade59c640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8ac006a430 0x7f8ac006c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0036000 tx=0x7f8ad003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:17.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.459+0000 7f8ad6ffd640 1 -- 172.21.15.106:0/962700536 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8ac8054070 con 0x7f8ae00c20d0 2023-12-22T09:16:17.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.646+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ae00a8150 con 0x7f8ae00c20d0 2023-12-22T09:16:17.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.647+0000 7f8ad6ffd640 1 -- 172.21.15.106:0/962700536 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ac8015020 con 0x7f8ae00c20d0 2023-12-22T09:16:17.647 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:17.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.649+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8ac006a430 msgr2=0x7f8ac006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.649+0000 7f8adf59e640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8ac006a430 0x7f8ac006c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0036000 tx=0x7f8ad003d040 comp rx=0 tx=0).stop 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.649+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae00c20d0 msgr2=0x7f8ae0146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.649+0000 7f8adf59e640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae00c20d0 0x7f8ae0146d30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800b410 tx=0x7f8ac800b8d0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.649+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 shutdown_connections 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.649+0000 7f8adf59e640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8ac006a430 0x7f8ac006c8f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.650+0000 7f8adf59e640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae014dfd0 0x7f8ae00aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.650+0000 7f8adf59e640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ae00c20d0 0x7f8ae0146d30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.650+0000 7f8adf59e640 1 --2- 172.21.15.106:0/962700536 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ae00bfb00 0x7f8ae00c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.650+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 >> 172.21.15.106:0/962700536 conn(0x7f8ae0069bf0 msgr2=0x7f8ae014b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.650+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 shutdown_connections 2023-12-22T09:16:17.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.650+0000 7f8adf59e640 1 -- 172.21.15.106:0/962700536 wait complete. 2023-12-22T09:16:17.670 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-22T09:16:17.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.890+0000 7f4ef6a26640 1 Processor -- start 2023-12-22T09:16:17.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.890+0000 7f4ef6a26640 1 -- start start 2023-12-22T09:16:17.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.891+0000 7f4ef6a26640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ef006bdc0 0x7f4ef01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.891+0000 7f4ef6a26640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 0x7f4ef00c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.892+0000 7f4ef6a26640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef014f570 con 0x7f4ef00c5a30 2023-12-22T09:16:17.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.892+0000 7f4ef6a26640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef00a90f0 con 0x7f4ef006bdc0 2023-12-22T09:16:17.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.892+0000 7f4ef6a26640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00c0b00 con 0x7f4ef006c2d0 2023-12-22T09:16:17.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.892+0000 7f4ef4fc3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 0x7f4ef00c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.892+0000 7f4ee7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ef006bdc0 0x7f4ef01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.892+0000 7f4ee7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ef006bdc0 0x7f4ef01557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:46574/0 (socket says 172.21.15.106:46574) 2023-12-22T09:16:17.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.892+0000 7f4ee7fff640 1 -- 172.21.15.106:0/1767956440 learned_addr learned my addr 172.21.15.106:0/1767956440 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:17.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.893+0000 7f4ef4fc3640 1 -- 172.21.15.106:0/1767956440 >> v2:172.21.15.132:3300/0 conn(0x7f4ef006bdc0 msgr2=0x7f4ef01557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:17.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.893+0000 7f4ef4fc3640 1 --2- 172.21.15.106:0/1767956440 >> v2:172.21.15.132:3300/0 conn(0x7f4ef006bdc0 0x7f4ef01557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.893+0000 7f4ef4fc3640 1 -- 172.21.15.106:0/1767956440 >> v1:172.21.15.132:6789/0 conn(0x7f4ef00c5a30 legacy=0x7f4ef01550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.893+0000 7f4ef4fc3640 1 -- 172.21.15.106:0/1767956440 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00bfd40 con 0x7f4ef006c2d0 2023-12-22T09:16:17.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.893+0000 7f4ee7fff640 1 --2- 172.21.15.106:0/1767956440 >> v2:172.21.15.132:3300/0 conn(0x7f4ef006bdc0 0x7f4ef01557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:16:17.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.895+0000 7f4ef4fc3640 1 --2- 172.21.15.106:0/1767956440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 0x7f4ef00c5e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009d90 tx=0x7f4ee802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b69fc1948a560a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:17.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.895+0000 7f4eef7fe640 1 -- 172.21.15.106:0/1767956440 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee802cbd0 con 0x7f4ef006c2d0 2023-12-22T09:16:17.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.895+0000 7f4eef7fe640 1 -- 172.21.15.106:0/1767956440 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee802cd30 con 0x7f4ef006c2d0 2023-12-22T09:16:17.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.895+0000 7f4eef7fe640 1 -- 172.21.15.106:0/1767956440 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee802cea0 con 0x7f4ef006c2d0 2023-12-22T09:16:17.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.896+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1767956440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 msgr2=0x7f4ef00c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.896+0000 7f4ef6a26640 1 --2- 172.21.15.106:0/1767956440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 0x7f4ef00c5e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009d90 tx=0x7f4ee802be20 comp rx=0 tx=0).stop 2023-12-22T09:16:17.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.896+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1767956440 shutdown_connections 2023-12-22T09:16:17.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.896+0000 7f4ef6a26640 1 --2- 172.21.15.106:0/1767956440 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 0x7f4ef00c5e10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.896+0000 7f4ef6a26640 1 --2- 172.21.15.106:0/1767956440 >> v2:172.21.15.132:3300/0 conn(0x7f4ef006bdc0 0x7f4ef01557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.896+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1767956440 >> 172.21.15.106:0/1767956440 conn(0x7f4ef006a220 msgr2=0x7f4ef00c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:17.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.896+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1767956440 shutdown_connections 2023-12-22T09:16:17.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.896+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1767956440 wait complete. 2023-12-22T09:16:17.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.898+0000 7f4ef6a26640 1 Processor -- start 2023-12-22T09:16:17.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.898+0000 7f4ef6a26640 1 -- start start 2023-12-22T09:16:17.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef6a26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef006bdc0 0x7f4ef014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef6a26640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 0x7f4ef01ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef6a26640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c5a30 0x7f4ef01ead10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef6a26640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef01ea340 con 0x7f4ef00c5a30 2023-12-22T09:16:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef6a26640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef01eb250 con 0x7f4ef006bdc0 2023-12-22T09:16:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef6a26640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0151990 con 0x7f4ef006c2d0 2023-12-22T09:16:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef4fc3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c5a30 0x7f4ef01ead10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef4fc3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c5a30 0x7f4ef01ead10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48208/0 (socket says 172.21.15.106:48208) 2023-12-22T09:16:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef4fc3640 1 -- 172.21.15.106:0/1396110783 learned_addr learned my addr 172.21.15.106:0/1396110783 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4eeffff640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef006bdc0 0x7f4ef014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ee7fff640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 0x7f4ef01ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef4fc3640 1 -- 172.21.15.106:0/1396110783 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 msgr2=0x7f4ef01ea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef4fc3640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 0x7f4ef01ea7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef4fc3640 1 -- 172.21.15.106:0/1396110783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef006bdc0 msgr2=0x7f4ef014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef4fc3640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef006bdc0 0x7f4ef014fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.899+0000 7f4ef4fc3640 1 -- 172.21.15.106:0/1396110783 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80094d0 con 0x7f4ef00c5a30 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.900+0000 7f4ef4fc3640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c5a30 0x7f4ef01ead10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009d90 tx=0x7f4ee8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.900+0000 7f4eed7fa640 1 -- 172.21.15.106:0/1396110783 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee802cea0 con 0x7f4ef00c5a30 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.900+0000 7f4eed7fa640 1 -- 172.21.15.106:0/1396110783 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee8040650 con 0x7f4ef00c5a30 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.900+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee8009a70 con 0x7f4ef00c5a30 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.900+0000 7f4eed7fa640 1 -- 172.21.15.106:0/1396110783 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8040a00 con 0x7f4ef00c5a30 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.900+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef0151f50 con 0x7f4ef00c5a30 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.901+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef014a820 con 0x7f4ef00c5a30 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.902+0000 7f4eed7fa640 1 -- 172.21.15.106:0/1396110783 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4ee8040b60 con 0x7f4ef00c5a30 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.903+0000 7f4eed7fa640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4ed006a460 0x7f4ed006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.903+0000 7f4eed7fa640 1 -- 172.21.15.106:0/1396110783 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f4ee80ab950 con 0x7f4ef00c5a30 2023-12-22T09:16:17.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.903+0000 7f4eeffff640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4ed006a460 0x7f4ed006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:17.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.904+0000 7f4eeffff640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4ed006a460 0x7f4ed006c920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0000f60 tx=0x7f4ee0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:17.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:17.907+0000 7f4eed7fa640 1 -- 172.21.15.106:0/1396110783 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4ee8076a80 con 0x7f4ef00c5a30 2023-12-22T09:16:18.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.096+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ef0073f10 con 0x7f4ef00c5a30 2023-12-22T09:16:18.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.096+0000 7f4eed7fa640 1 -- 172.21.15.106:0/1396110783 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4ee8009450 con 0x7f4ef00c5a30 2023-12-22T09:16:18.097 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:18.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4ed006a460 msgr2=0x7f4ed006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4ed006a460 0x7f4ed006c920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0000f60 tx=0x7f4ee0009040 comp rx=0 tx=0).stop 2023-12-22T09:16:18.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c5a30 msgr2=0x7f4ef01ead10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c5a30 0x7f4ef01ead10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009d90 tx=0x7f4ee8004a40 comp rx=0 tx=0).stop 2023-12-22T09:16:18.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 shutdown_connections 2023-12-22T09:16:18.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4ed006a460 0x7f4ed006c920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c5a30 0x7f4ef01ead10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ef006c2d0 0x7f4ef01ea7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 --2- 172.21.15.106:0/1396110783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef006bdc0 0x7f4ef014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.099+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 >> 172.21.15.106:0/1396110783 conn(0x7f4ef006a220 msgr2=0x7f4ef014e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:18.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.100+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 shutdown_connections 2023-12-22T09:16:18.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.100+0000 7f4ef6a26640 1 -- 172.21.15.106:0/1396110783 wait complete. 2023-12-22T09:16:18.120 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-22T09:16:18.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.329+0000 7f7603fff640 1 Processor -- start 2023-12-22T09:16:18.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.329+0000 7f7603fff640 1 -- start start 2023-12-22T09:16:18.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.330+0000 7f7603fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76040a83c0 0x7f7604147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.330+0000 7f7603fff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7604151970 con 0x7f76040c2830 2023-12-22T09:16:18.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.331+0000 7f7603fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7604151bc0 con 0x7f76040bfb00 2023-12-22T09:16:18.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.331+0000 7f7603fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76040a9a20 con 0x7f76040a83c0 2023-12-22T09:16:18.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.331+0000 7f76027fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f76040c2830 0x7f76040a9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39284/0 (socket says 172.21.15.106:39284) 2023-12-22T09:16:18.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.331+0000 7f76027fc640 1 -- 172.21.15.106:0/3241987688 learned_addr learned my addr 172.21.15.106:0/3241987688 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:18.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.331+0000 7f7602ffd640 1 --2- 172.21.15.106:0/3241987688 >> v2:172.21.15.132:3300/0 conn(0x7f76040a83c0 0x7f7604147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:18.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.331+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260938854 0 0) 0x7f7604151970 con 0x7f76040c2830 2023-12-22T09:16:18.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.331+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ec003520 con 0x7f76040c2830 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1642866066 0 0) 0x7f75ec003520 con 0x7f76040c2830 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 >> v2:172.21.15.132:3300/0 conn(0x7f76040a83c0 msgr2=0x7f7604147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 --2- 172.21.15.106:0/3241987688 >> v2:172.21.15.132:3300/0 conn(0x7f76040a83c0 0x7f7604147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 >> v1:172.21.15.132:6789/0 conn(0x7f76040bfb00 legacy=0x7f760415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604151ea0 con 0x7f76040c2830 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f75f8001670 con 0x7f76040c2830 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 >> v1:172.21.15.106:6789/0 conn(0x7f76040c2830 legacy=0x7f76040a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75ec003970 0x7f75ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75ec0047c0 0x7f75ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75ec005180 0x7f75ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76040a9a20 con 0x7f75ec005180 2023-12-22T09:16:18.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec00c020 con 0x7f75ec0047c0 2023-12-22T09:16:18.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec00c1e0 con 0x7f75ec003970 2023-12-22T09:16:18.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f76037fe640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75ec005180 0x7f75ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:18.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f76037fe640 1 -- 172.21.15.106:0/3241987688 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75ec003970 msgr2=0x7f75ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:18.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f76037fe640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75ec003970 0x7f75ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f76037fe640 1 -- 172.21.15.106:0/3241987688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75ec0047c0 msgr2=0x7f75ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:18.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f76027fc640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75ec0047c0 0x7f75ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:18.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f76037fe640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75ec0047c0 0x7f75ec004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.332+0000 7f76037fe640 1 -- 172.21.15.106:0/3241987688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec003520 con 0x7f75ec005180 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.333+0000 7f76037fe640 1 -- 172.21.15.106:0/3241987688 reap_dead start 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.333+0000 7f76037fe640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75ec005180 0x7f75ec00b980 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f75fc001e20 tx=0x7f75ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1c58fccdbbef0a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc003b70 con 0x7f75ec005180 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc003cd0 con 0x7f75ec005180 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7601ffb640 1 -- 172.21.15.106:0/3241987688 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc005310 con 0x7f75ec005180 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7603fff640 1 -- 172.21.15.106:0/3241987688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75ec005180 msgr2=0x7f75ec00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7603fff640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75ec005180 0x7f75ec00b980 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f75fc001e20 tx=0x7f75ec0057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7603fff640 1 -- 172.21.15.106:0/3241987688 shutdown_connections 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7603fff640 1 --2- 172.21.15.106:0/3241987688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75ec005180 0x7f75ec00b980 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7603fff640 1 -- 172.21.15.106:0/3241987688 >> 172.21.15.106:0/3241987688 conn(0x7f7604069bf0 msgr2=0x7f7604069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7603fff640 1 -- 172.21.15.106:0/3241987688 shutdown_connections 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.334+0000 7f7603fff640 1 -- 172.21.15.106:0/3241987688 wait complete. 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.336+0000 7f7603fff640 1 Processor -- start 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.336+0000 7f7603fff640 1 -- start start 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.337+0000 7f7603fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75ec005180 0x7f7604154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.337+0000 7f7603fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7604150460 0x7f760413fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.337+0000 7f7603fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76041deab0 0x7f76041def40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.337+0000 7f7603fff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7604152e80 con 0x7f7604150460 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.337+0000 7f7603fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76041ed430 con 0x7f75ec005180 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.337+0000 7f7603fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76041ec8b0 con 0x7f76041deab0 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.337+0000 7f76027fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7604150460 0x7f760413fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.337+0000 7f76027fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7604150460 0x7f760413fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48216/0 (socket says 172.21.15.106:48216) 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.337+0000 7f76027fc640 1 -- 172.21.15.106:0/2645511557 learned_addr learned my addr 172.21.15.106:0/2645511557 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:18.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f76027fc640 1 -- 172.21.15.106:0/2645511557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76041deab0 msgr2=0x7f76041def40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f76027fc640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76041deab0 0x7f76041def40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f76027fc640 1 -- 172.21.15.106:0/2645511557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75ec005180 msgr2=0x7f7604154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f76027fc640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75ec005180 0x7f7604154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f76027fc640 1 -- 172.21.15.106:0/2645511557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76041ecb90 con 0x7f7604150460 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f76027fc640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7604150460 0x7f760413fd60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f75f800d7c0 tx=0x7f75f800dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f75eb7fe640 1 -- 172.21.15.106:0/2645511557 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80074e0 con 0x7f7604150460 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f75eb7fe640 1 -- 172.21.15.106:0/2645511557 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8007640 con 0x7f7604150460 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f75eb7fe640 1 -- 172.21.15.106:0/2645511557 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8004a00 con 0x7f7604150460 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.338+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76041ece70 con 0x7f7604150460 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.339+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76041ec540 con 0x7f7604150460 2023-12-22T09:16:18.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.340+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760404e8d0 con 0x7f7604150460 2023-12-22T09:16:18.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.341+0000 7f75eb7fe640 1 -- 172.21.15.106:0/2645511557 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f75f8004b60 con 0x7f7604150460 2023-12-22T09:16:18.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.341+0000 7f75eb7fe640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f75f006a460 0x7f75f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.342+0000 7f75eb7fe640 1 -- 172.21.15.106:0/2645511557 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f75f80885f0 con 0x7f7604150460 2023-12-22T09:16:18.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.342+0000 7f7602ffd640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f75f006a460 0x7f75f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:18.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.342+0000 7f7602ffd640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f75f006a460 0x7f75f006c920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f75f4006a90 tx=0x7f75f4006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:18.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.346+0000 7f75eb7fe640 1 -- 172.21.15.106:0/2645511557 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f75f80537e0 con 0x7f7604150460 2023-12-22T09:16:18.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.535+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7604152430 con 0x7f7604150460 2023-12-22T09:16:18.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.536+0000 7f75eb7fe640 1 -- 172.21.15.106:0/2645511557 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f75f8056e00 con 0x7f7604150460 2023-12-22T09:16:18.537 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:18.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.538+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f75f006a460 msgr2=0x7f75f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.538+0000 7f7603fff640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f75f006a460 0x7f75f006c920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f75f4006a90 tx=0x7f75f4006a20 comp rx=0 tx=0).stop 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.538+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7604150460 msgr2=0x7f760413fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.538+0000 7f7603fff640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7604150460 0x7f760413fd60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f75f800d7c0 tx=0x7f75f800dc80 comp rx=0 tx=0).stop 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.539+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 shutdown_connections 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.539+0000 7f7603fff640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f75f006a460 0x7f75f006c920 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.539+0000 7f7603fff640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76041deab0 0x7f76041def40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.539+0000 7f7603fff640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7604150460 0x7f760413fd60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.539+0000 7f7603fff640 1 --2- 172.21.15.106:0/2645511557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75ec005180 0x7f7604154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.539+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 >> 172.21.15.106:0/2645511557 conn(0x7f7604069bf0 msgr2=0x7f7604141c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.539+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 shutdown_connections 2023-12-22T09:16:18.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.539+0000 7f7603fff640 1 -- 172.21.15.106:0/2645511557 wait complete. 2023-12-22T09:16:18.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T09:16:18.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.767+0000 7f7920fae640 1 Processor -- start 2023-12-22T09:16:18.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.768+0000 7f7920fae640 1 -- start start 2023-12-22T09:16:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.769+0000 7f7920fae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f791c0c5790 0x7f791c0c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.769+0000 7f7920fae640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f791c06ae80 0x7f791c0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.769+0000 7f7920fae640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c06a6c0 con 0x7f791c0c45b0 2023-12-22T09:16:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.769+0000 7f7920fae640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c06aa60 con 0x7f791c06ae80 2023-12-22T09:16:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.769+0000 7f7920fae640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c0c5060 con 0x7f791c0c5790 2023-12-22T09:16:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.769+0000 7f791ad9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f791c0c45b0 0x7f791c151210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39286/0 (socket says 172.21.15.106:39286) 2023-12-22T09:16:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.769+0000 7f791ad9d640 1 -- 172.21.15.106:0/2025130468 learned_addr learned my addr 172.21.15.106:0/2025130468 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:18.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.769+0000 7f7919d9b640 1 --2- 172.21.15.106:0/2025130468 >> v2:172.21.15.106:3300/0 conn(0x7f791c06ae80 0x7f791c0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.770+0000 7f791a59c640 1 --2- 172.21.15.106:0/2025130468 >> v2:172.21.15.132:3300/0 conn(0x7f791c0c5790 0x7f791c0c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.770+0000 7f791959a640 1 -- 172.21.15.106:0/2025130468 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718159793 0 0) 0x7f791c06a6c0 con 0x7f791c0c45b0 2023-12-22T09:16:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.770+0000 7f791959a640 1 -- 172.21.15.106:0/2025130468 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7908003520 con 0x7f791c0c45b0 2023-12-22T09:16:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.770+0000 7f7919d9b640 1 -- 172.21.15.106:0/2025130468 >> v2:172.21.15.132:3300/0 conn(0x7f791c0c5790 msgr2=0x7f791c0c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.770+0000 7f7919d9b640 1 --2- 172.21.15.106:0/2025130468 >> v2:172.21.15.132:3300/0 conn(0x7f791c0c5790 0x7f791c0c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.770+0000 7f7919d9b640 1 -- 172.21.15.106:0/2025130468 >> v1:172.21.15.106:6789/0 conn(0x7f791c0c45b0 legacy=0x7f791c151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.770+0000 7f7919d9b640 1 -- 172.21.15.106:0/2025130468 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c0c4aa0 con 0x7f791c06ae80 2023-12-22T09:16:18.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.771+0000 7f7919d9b640 1 --2- 172.21.15.106:0/2025130468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c06ae80 0x7f791c0c4070 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f791c067040 tx=0x7f790c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4566860d8669536 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:18.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.771+0000 7f791959a640 1 -- 172.21.15.106:0/2025130468 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c02cc80 con 0x7f791c06ae80 2023-12-22T09:16:18.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.771+0000 7f791959a640 1 -- 172.21.15.106:0/2025130468 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c02cde0 con 0x7f791c06ae80 2023-12-22T09:16:18.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.771+0000 7f791959a640 1 -- 172.21.15.106:0/2025130468 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c034660 con 0x7f791c06ae80 2023-12-22T09:16:18.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.772+0000 7f7920fae640 1 -- 172.21.15.106:0/2025130468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c06ae80 msgr2=0x7f791c0c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.772+0000 7f7920fae640 1 --2- 172.21.15.106:0/2025130468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c06ae80 0x7f791c0c4070 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f791c067040 tx=0x7f790c02bed0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.772+0000 7f7920fae640 1 -- 172.21.15.106:0/2025130468 shutdown_connections 2023-12-22T09:16:18.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.772+0000 7f7920fae640 1 --2- 172.21.15.106:0/2025130468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c06ae80 0x7f791c0c4070 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.772+0000 7f7920fae640 1 --2- 172.21.15.106:0/2025130468 >> v2:172.21.15.132:3300/0 conn(0x7f791c0c5790 0x7f791c0c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.772+0000 7f7920fae640 1 -- 172.21.15.106:0/2025130468 >> 172.21.15.106:0/2025130468 conn(0x7f791c0c96f0 msgr2=0x7f791c0c9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:18.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.772+0000 7f7920fae640 1 -- 172.21.15.106:0/2025130468 shutdown_connections 2023-12-22T09:16:18.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.772+0000 7f7920fae640 1 -- 172.21.15.106:0/2025130468 wait complete. 2023-12-22T09:16:18.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.773+0000 7f7920fae640 1 Processor -- start 2023-12-22T09:16:18.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.774+0000 7f7920fae640 1 -- start start 2023-12-22T09:16:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.774+0000 7f7920fae640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f791c06ae80 0x7f791c0ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7920fae640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c0c45b0 0x7f791c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7920fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c0c5790 0x7f791c1da540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7920fae640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c1dcbf0 con 0x7f791c0c45b0 2023-12-22T09:16:18.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7920fae640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0adde0 con 0x7f791c0c5790 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7920fae640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0aef80 con 0x7f791c06ae80 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7919d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c0c45b0 0x7f791c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7919d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c0c45b0 0x7f791c0aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48222/0 (socket says 172.21.15.106:48222) 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7919d9b640 1 -- 172.21.15.106:0/486376055 learned_addr learned my addr 172.21.15.106:0/486376055 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7919d9b640 1 -- 172.21.15.106:0/486376055 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f791c06ae80 msgr2=0x7f791c0ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7919d9b640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f791c06ae80 0x7f791c0ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7919d9b640 1 -- 172.21.15.106:0/486376055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c0c5790 msgr2=0x7f791c1da540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7919d9b640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c0c5790 0x7f791c1da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7919d9b640 1 -- 172.21.15.106:0/486376055 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c009a70 con 0x7f791c0c45b0 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.775+0000 7f7919d9b640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c0c45b0 0x7f791c0aea40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f790c037040 tx=0x7f790c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.776+0000 7f7912ffd640 1 -- 172.21.15.106:0/486376055 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c040650 con 0x7f791c0c45b0 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.776+0000 7f7912ffd640 1 -- 172.21.15.106:0/486376055 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c0407b0 con 0x7f791c0c45b0 2023-12-22T09:16:18.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.776+0000 7f7912ffd640 1 -- 172.21.15.106:0/486376055 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c040b60 con 0x7f791c0c45b0 2023-12-22T09:16:18.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.776+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c1dc910 con 0x7f791c0c45b0 2023-12-22T09:16:18.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.776+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791c0ac930 con 0x7f791c0c45b0 2023-12-22T09:16:18.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.777+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791c1db240 con 0x7f791c0c45b0 2023-12-22T09:16:18.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.778+0000 7f7912ffd640 1 -- 172.21.15.106:0/486376055 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f790c040cc0 con 0x7f791c0c45b0 2023-12-22T09:16:18.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.779+0000 7f7912ffd640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78fc06a430 0x7f78fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:18.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.779+0000 7f7912ffd640 1 -- 172.21.15.106:0/486376055 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f790c0abb20 con 0x7f791c0c45b0 2023-12-22T09:16:18.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.779+0000 7f791a59c640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78fc06a430 0x7f78fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:18.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.780+0000 7f791a59c640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78fc06a430 0x7f78fc06c8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7904006fd0 tx=0x7f7904008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:18.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.783+0000 7f7912ffd640 1 -- 172.21.15.106:0/486376055 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f790c076d20 con 0x7f791c0c45b0 2023-12-22T09:16:18.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.986+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f791c073f10 con 0x7f791c0c45b0 2023-12-22T09:16:18.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.986+0000 7f7912ffd640 1 -- 172.21.15.106:0/486376055 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f790c009450 con 0x7f791c0c45b0 2023-12-22T09:16:18.987 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78fc06a430 msgr2=0x7f78fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78fc06a430 0x7f78fc06c8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7904006fd0 tx=0x7f7904008040 comp rx=0 tx=0).stop 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c0c45b0 msgr2=0x7f791c0aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c0c45b0 0x7f791c0aea40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f790c037040 tx=0x7f790c004a40 comp rx=0 tx=0).stop 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 shutdown_connections 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f78fc06a430 0x7f78fc06c8f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c0c5790 0x7f791c1da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f791c0c45b0 0x7f791c0aea40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 --2- 172.21.15.106:0/486376055 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f791c06ae80 0x7f791c0ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:18.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 >> 172.21.15.106:0/486376055 conn(0x7f791c0c96f0 msgr2=0x7f791c14ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:18.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 shutdown_connections 2023-12-22T09:16:18.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:18.989+0000 7f7920fae640 1 -- 172.21.15.106:0/486376055 wait complete. 2023-12-22T09:16:19.009 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T09:16:19.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:19.009 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:19.124 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T09:16:19.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:19.125 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T09:16:19.180 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:16:19.180 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:19.277 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-22T09:16:19.277 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:16:19.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.493+0000 7f0b094c7640 1 Processor -- start 2023-12-22T09:16:19.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.493+0000 7f0b094c7640 1 -- start start 2023-12-22T09:16:19.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b094c7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b040bfce0 0x7f0b0406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:19.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b094c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b04151b30 0x7f0b04151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:19.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b094c7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b040bf770 con 0x7f0b0413b060 2023-12-22T09:16:19.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b094c7640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b04155120 con 0x7f0b040bfce0 2023-12-22T09:16:19.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b094c7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b04155400 con 0x7f0b04151b30 2023-12-22T09:16:19.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b027fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b040bfce0 0x7f0b0406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:19.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b027fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b040bfce0 0x7f0b0406a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48228/0 (socket says 172.21.15.106:48228) 2023-12-22T09:16:19.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b027fc640 1 -- 172.21.15.106:0/58846554 learned_addr learned my addr 172.21.15.106:0/58846554 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:19.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b037fe640 1 --2- 172.21.15.106:0/58846554 >> v2:172.21.15.132:3300/0 conn(0x7f0b04151b30 0x7f0b04151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:19.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b027fc640 1 -- 172.21.15.106:0/58846554 >> v2:172.21.15.132:3300/0 conn(0x7f0b04151b30 msgr2=0x7f0b04151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:19.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b027fc640 1 --2- 172.21.15.106:0/58846554 >> v2:172.21.15.132:3300/0 conn(0x7f0b04151b30 0x7f0b04151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b027fc640 1 -- 172.21.15.106:0/58846554 >> v1:172.21.15.132:6789/0 conn(0x7f0b0413b060 legacy=0x7f0b04069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:19.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.495+0000 7f0b027fc640 1 -- 172.21.15.106:0/58846554 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b041556e0 con 0x7f0b040bfce0 2023-12-22T09:16:19.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.497+0000 7f0b027fc640 1 --2- 172.21.15.106:0/58846554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b040bfce0 0x7f0b0406a6b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0b040c02a0 tx=0x7f0aec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc2f0eb3ba5487a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:19.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.497+0000 7f0b01ffb640 1 -- 172.21.15.106:0/58846554 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0317e0 con 0x7f0b040bfce0 2023-12-22T09:16:19.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.497+0000 7f0b01ffb640 1 -- 172.21.15.106:0/58846554 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec031940 con 0x7f0b040bfce0 2023-12-22T09:16:19.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.497+0000 7f0b01ffb640 1 -- 172.21.15.106:0/58846554 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec031cd0 con 0x7f0b040bfce0 2023-12-22T09:16:19.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.498+0000 7f0b094c7640 1 -- 172.21.15.106:0/58846554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b040bfce0 msgr2=0x7f0b0406a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:19.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.498+0000 7f0b094c7640 1 --2- 172.21.15.106:0/58846554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b040bfce0 0x7f0b0406a6b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0b040c02a0 tx=0x7f0aec02b880 comp rx=0 tx=0).stop 2023-12-22T09:16:19.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.498+0000 7f0b094c7640 1 -- 172.21.15.106:0/58846554 shutdown_connections 2023-12-22T09:16:19.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.498+0000 7f0b094c7640 1 --2- 172.21.15.106:0/58846554 >> v2:172.21.15.132:3300/0 conn(0x7f0b04151b30 0x7f0b04151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.498+0000 7f0b094c7640 1 --2- 172.21.15.106:0/58846554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b040bfce0 0x7f0b0406a6b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.498+0000 7f0b094c7640 1 -- 172.21.15.106:0/58846554 >> 172.21.15.106:0/58846554 conn(0x7f0b040c5360 msgr2=0x7f0b040c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:19.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.498+0000 7f0b094c7640 1 -- 172.21.15.106:0/58846554 shutdown_connections 2023-12-22T09:16:19.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.498+0000 7f0b094c7640 1 -- 172.21.15.106:0/58846554 wait complete. 2023-12-22T09:16:19.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.499+0000 7f0b094c7640 1 Processor -- start 2023-12-22T09:16:19.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.500+0000 7f0b094c7640 1 -- start start 2023-12-22T09:16:19.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.500+0000 7f0b094c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b040bfce0 0x7f0b04154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:19.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.500+0000 7f0b094c7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0413b060 0x7f0b041ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:19.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.500+0000 7f0b094c7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b04151b30 0x7f0b04136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:19.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.500+0000 7f0b094c7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040ba870 con 0x7f0b04151b30 2023-12-22T09:16:19.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.500+0000 7f0b094c7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040bf170 con 0x7f0b040bfce0 2023-12-22T09:16:19.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.500+0000 7f0b094c7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b041e6be0 con 0x7f0b0413b060 2023-12-22T09:16:19.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b04151b30 0x7f0b04136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:19.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b04151b30 0x7f0b04136ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48244/0 (socket says 172.21.15.106:48244) 2023-12-22T09:16:19.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b037fe640 1 -- 172.21.15.106:0/1850283697 learned_addr learned my addr 172.21.15.106:0/1850283697 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:19.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b02ffd640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b040bfce0 0x7f0b04154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:19.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b027fc640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0413b060 0x7f0b041ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:19.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b037fe640 1 -- 172.21.15.106:0/1850283697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0413b060 msgr2=0x7f0b041ea0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:19.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b037fe640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0413b060 0x7f0b041ea0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b037fe640 1 -- 172.21.15.106:0/1850283697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b040bfce0 msgr2=0x7f0b04154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:19.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b037fe640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b040bfce0 0x7f0b04154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.501+0000 7f0b037fe640 1 -- 172.21.15.106:0/1850283697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0094d0 con 0x7f0b04151b30 2023-12-22T09:16:19.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.502+0000 7f0b037fe640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b04151b30 0x7f0b04136ca0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0afc007e40 tx=0x7f0afc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:19.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.502+0000 7f0afb7fe640 1 -- 172.21.15.106:0/1850283697 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc014620 con 0x7f0b04151b30 2023-12-22T09:16:19.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.502+0000 7f0afb7fe640 1 -- 172.21.15.106:0/1850283697 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc00ee90 con 0x7f0b04151b30 2023-12-22T09:16:19.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.502+0000 7f0afb7fe640 1 -- 172.21.15.106:0/1850283697 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0149e0 con 0x7f0b04151b30 2023-12-22T09:16:19.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.502+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b041e6ec0 con 0x7f0b04151b30 2023-12-22T09:16:19.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.502+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b040bf450 con 0x7f0b04151b30 2023-12-22T09:16:19.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.503+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b04073f10 con 0x7f0b04151b30 2023-12-22T09:16:19.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.504+0000 7f0afb7fe640 1 -- 172.21.15.106:0/1850283697 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0afc014b40 con 0x7f0b04151b30 2023-12-22T09:16:19.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.505+0000 7f0afb7fe640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0ae406a460 0x7f0ae406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:19.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.505+0000 7f0afb7fe640 1 -- 172.21.15.106:0/1850283697 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f0afc089730 con 0x7f0b04151b30 2023-12-22T09:16:19.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.505+0000 7f0b02ffd640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0ae406a460 0x7f0ae406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:19.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.506+0000 7f0b02ffd640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0ae406a460 0x7f0ae406c920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0af400b7f0 tx=0x7f0af4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:19.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.510+0000 7f0afb7fe640 1 -- 172.21.15.106:0/1850283697 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0afc054870 con 0x7f0b04151b30 2023-12-22T09:16:19.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.736+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0b04155c70 con 0x7f0b04151b30 2023-12-22T09:16:19.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.736+0000 7f0afb7fe640 1 -- 172.21.15.106:0/1850283697 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7f0afc057e90 con 0x7f0b04151b30 2023-12-22T09:16:19.737 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T09:16:19.737 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-22T09:16:19.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.739+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0ae406a460 msgr2=0x7f0ae406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:19.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.739+0000 7f0b094c7640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0ae406a460 0x7f0ae406c920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0af400b7f0 tx=0x7f0af4008040 comp rx=0 tx=0).stop 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.739+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b04151b30 msgr2=0x7f0b04136ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.739+0000 7f0b094c7640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b04151b30 0x7f0b04136ca0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0afc007e40 tx=0x7f0afc00e4b0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.740+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 shutdown_connections 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.740+0000 7f0b094c7640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0ae406a460 0x7f0ae406c920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.740+0000 7f0b094c7640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b04151b30 0x7f0b04136ca0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.740+0000 7f0b094c7640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0413b060 0x7f0b041ea0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.740+0000 7f0b094c7640 1 --2- 172.21.15.106:0/1850283697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b040bfce0 0x7f0b04154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.740+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 >> 172.21.15.106:0/1850283697 conn(0x7f0b040c5360 msgr2=0x7f0b040aabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.740+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 shutdown_connections 2023-12-22T09:16:19.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:19.740+0000 7f0b094c7640 1 -- 172.21.15.106:0/1850283697 wait complete. 2023-12-22T09:16:19.758 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-22T09:16:19.758 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:16:19.758 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-22T09:16:19.758 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T09:16:19.758 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:19.758 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-22T09:16:19.758 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T09:16:19.759 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T09:16:19.759 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:16:19.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:19.759 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-22T09:16:19.819 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-22T09:16:19.820 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42255sec preferred_lft 42255sec 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 9e:b3:3a:4a:07:97 brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T09:16:19.821 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:19.822 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::fc76:1aff:fe8a:2e61/64 scope link 2023-12-22T09:16:19.822 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:19.822 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T09:16:19.822 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 9e:b3:3a:4a:07:97 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T09:16:19.822 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::9cb3:3aff:fe4a:797/64 scope link 2023-12-22T09:16:19.822 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:19.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:19.823 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:16:19.911 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-22T09:16:19.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:19.916 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-22T09:16:19.970 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-22T09:16:19.970 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:16:19.970 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:16:19.970 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:16:19.970 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:16:19.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:19.970 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-22T09:16:19.970 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-22T09:16:19.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:16:19.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:16:19.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:16:19.971 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-22T09:16:20.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:20.145 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-22T09:16:20.196 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T09:16:20.196 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:16:20.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:20.196 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-22T09:16:20.290 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:16:20.290 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:20.344 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:16:20.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:16:20.345 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:20.395 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T09:16:20.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:20.396 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-12-22T09:16:20.398 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:16:20.408 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:16:20.516 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-12-22T09:16:20.516 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-12-22T09:16:20.516 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:16:20.535 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-12-22T09:16:20.535 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-12-22T09:16:20.535 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:16:20.535 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:16:20.535 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:16:20.560 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-12-22T09:16:20.560 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-12-22T09:16:20.560 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:16:20.560 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:16:20.560 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:16:20.560 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790" 2023-12-22T09:16:20.560 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2023-12-22T09:16:20.561 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=c9422aac-a1e3-428b-87d0-2dbf321c6b46" will pass to kernel 2023-12-22T09:16:20.562 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T09:16:20.562 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-12-22T09:16:20.562 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T09:16:20.562 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T09:16:20.562 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T09:16:20.566 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T09:16:20.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:20.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:20.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:20.703 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:16:20.772 INFO:teuthology.orchestra.run.smithi132.stdout:client5571 2023-12-22T09:16:20.772 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:16:20.772 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:20.819 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-12-22T09:16:21.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.048+0000 7f252141b640 1 Processor -- start 2023-12-22T09:16:21.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.049+0000 7f252141b640 1 -- start start 2023-12-22T09:16:21.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.050+0000 7f252141b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 0x7f251c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.050+0000 7f252141b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f251c0c7420 0x7f251c1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.050+0000 7f252141b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c0c3ea0 con 0x7f251c0aebb0 2023-12-22T09:16:21.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.050+0000 7f252141b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c0aef90 con 0x7f251c0c7420 2023-12-22T09:16:21.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.050+0000 7f252141b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c157c30 con 0x7f251c0bcbe0 2023-12-22T09:16:21.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.051+0000 7f2520c1a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f251c0c7420 0x7f251c1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:21.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.051+0000 7f251b7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 0x7f251c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:21.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.051+0000 7f2520c1a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f251c0c7420 0x7f251c1541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:46648/0 (socket says 172.21.15.106:46648) 2023-12-22T09:16:21.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.051+0000 7f2520c1a640 1 -- 172.21.15.106:0/2998110591 learned_addr learned my addr 172.21.15.106:0/2998110591 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:21.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.052+0000 7f2520c1a640 1 -- 172.21.15.106:0/2998110591 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 msgr2=0x7f251c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:21.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.052+0000 7f2520c1a640 1 --2- 172.21.15.106:0/2998110591 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 0x7f251c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.052+0000 7f2520c1a640 1 -- 172.21.15.106:0/2998110591 >> v1:172.21.15.132:6789/0 conn(0x7f251c0aebb0 legacy=0x7f251c0ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:21.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.052+0000 7f2520c1a640 1 -- 172.21.15.106:0/2998110591 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c157f10 con 0x7f251c0c7420 2023-12-22T09:16:21.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.052+0000 7f251b7fe640 1 --2- 172.21.15.106:0/2998110591 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 0x7f251c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:16:21.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.053+0000 7f2520c1a640 1 --2- 172.21.15.106:0/2998110591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 0x7f251c1541d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2514009870 tx=0x7f251402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72a13bd0243877f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:21.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.054+0000 7f251affd640 1 -- 172.21.15.106:0/2998110591 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140317c0 con 0x7f251c0c7420 2023-12-22T09:16:21.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.054+0000 7f251affd640 1 -- 172.21.15.106:0/2998110591 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2514031920 con 0x7f251c0c7420 2023-12-22T09:16:21.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.054+0000 7f251affd640 1 -- 172.21.15.106:0/2998110591 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514031cb0 con 0x7f251c0c7420 2023-12-22T09:16:21.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.054+0000 7f252141b640 1 -- 172.21.15.106:0/2998110591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 msgr2=0x7f251c1541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:21.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.054+0000 7f252141b640 1 --2- 172.21.15.106:0/2998110591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 0x7f251c1541d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2514009870 tx=0x7f251402b860 comp rx=0 tx=0).stop 2023-12-22T09:16:21.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.055+0000 7f252141b640 1 -- 172.21.15.106:0/2998110591 shutdown_connections 2023-12-22T09:16:21.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.055+0000 7f252141b640 1 --2- 172.21.15.106:0/2998110591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 0x7f251c1541d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.055+0000 7f252141b640 1 --2- 172.21.15.106:0/2998110591 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 0x7f251c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.055+0000 7f252141b640 1 -- 172.21.15.106:0/2998110591 >> 172.21.15.106:0/2998110591 conn(0x7f251c0c9520 msgr2=0x7f251c0c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:21.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.055+0000 7f252141b640 1 -- 172.21.15.106:0/2998110591 shutdown_connections 2023-12-22T09:16:21.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.055+0000 7f252141b640 1 -- 172.21.15.106:0/2998110591 wait complete. 2023-12-22T09:16:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.057+0000 7f252141b640 1 Processor -- start 2023-12-22T09:16:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.057+0000 7f252141b640 1 -- start start 2023-12-22T09:16:21.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.058+0000 7f252141b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f251c0aebb0 0x7f251c14bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.058+0000 7f252141b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 0x7f251c1ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.058+0000 7f252141b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 0x7f251c1ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.058+0000 7f252141b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1ec740 con 0x7f251c0aebb0 2023-12-22T09:16:21.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.058+0000 7f252141b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0c1ab0 con 0x7f251c0c7420 2023-12-22T09:16:21.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.058+0000 7f252141b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0c09d0 con 0x7f251c0bcbe0 2023-12-22T09:16:21.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.058+0000 7f251bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f251c0aebb0 0x7f251c14bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:21.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.058+0000 7f251bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f251c0aebb0 0x7f251c14bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48258/0 (socket says 172.21.15.106:48258) 2023-12-22T09:16:21.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.058+0000 7f251bfff640 1 -- 172.21.15.106:0/3768440078 learned_addr learned my addr 172.21.15.106:0/3768440078 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:21.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.059+0000 7f251b7fe640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 0x7f251c1ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:21.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.059+0000 7f2520c1a640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 0x7f251c1ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.059+0000 7f251bfff640 1 -- 172.21.15.106:0/3768440078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 msgr2=0x7f251c1ecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.059+0000 7f251bfff640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 0x7f251c1ecb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.059+0000 7f251bfff640 1 -- 172.21.15.106:0/3768440078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 msgr2=0x7f251c1ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.059+0000 7f251bfff640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 0x7f251c1ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.059+0000 7f251bfff640 1 -- 172.21.15.106:0/3768440078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c009a70 con 0x7f251c0aebb0 2023-12-22T09:16:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.059+0000 7f2520c1a640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 0x7f251c1ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:16:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.059+0000 7f251bfff640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f251c0aebb0 0x7f251c14bb10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f250400c400 tx=0x7f250400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.060+0000 7f2518ff9640 1 -- 172.21.15.106:0/3768440078 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040052d0 con 0x7f251c0aebb0 2023-12-22T09:16:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.060+0000 7f2518ff9640 1 -- 172.21.15.106:0/3768440078 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2504005430 con 0x7f251c0aebb0 2023-12-22T09:16:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.060+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25140094d0 con 0x7f251c0aebb0 2023-12-22T09:16:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.060+0000 7f2518ff9640 1 -- 172.21.15.106:0/3768440078 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504003830 con 0x7f251c0aebb0 2023-12-22T09:16:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.060+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c0c0f90 con 0x7f251c0aebb0 2023-12-22T09:16:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.061+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c04e8d0 con 0x7f251c0aebb0 2023-12-22T09:16:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.062+0000 7f2518ff9640 1 -- 172.21.15.106:0/3768440078 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2504003990 con 0x7f251c0aebb0 2023-12-22T09:16:21.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.063+0000 7f2518ff9640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f24fc06a430 0x7f24fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.063+0000 7f2518ff9640 1 -- 172.21.15.106:0/3768440078 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f25040882c0 con 0x7f251c0aebb0 2023-12-22T09:16:21.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.063+0000 7f251b7fe640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f24fc06a430 0x7f24fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:21.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.064+0000 7f251b7fe640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f24fc06a430 0x7f24fc06c8f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f251c0ab1f0 tx=0x7f250c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.068+0000 7f2518ff9640 1 -- 172.21.15.106:0/3768440078 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25040534a0 con 0x7f251c0aebb0 2023-12-22T09:16:21.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.299+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f251c06c620 con 0x7f251c0aebb0 2023-12-22T09:16:21.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.305+0000 7f2518ff9640 1 -- 172.21.15.106:0/3768440078 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v14) v1 ==== 134+0+66 (secure 0 0 0) 0x7f2504056ac0 con 0x7f251c0aebb0 2023-12-22T09:16:21.306 INFO:teuthology.orchestra.run.smithi106.stdout:[client.testuser] 2023-12-22T09:16:21.306 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDlU4Vl1ynpERAA6q6kdszVDJYSaGfqTWAiYw== 2023-12-22T09:16:21.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f24fc06a430 msgr2=0x7f24fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:21.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f24fc06a430 0x7f24fc06c8f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f251c0ab1f0 tx=0x7f250c00b040 comp rx=0 tx=0).stop 2023-12-22T09:16:21.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f251c0aebb0 msgr2=0x7f251c14bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:21.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f251c0aebb0 0x7f251c14bb10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f250400c400 tx=0x7f250400c8c0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 shutdown_connections 2023-12-22T09:16:21.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f24fc06a430 0x7f24fc06c8f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f251c0c7420 0x7f251c1ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f251c0bcbe0 0x7f251c1ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 --2- 172.21.15.106:0/3768440078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f251c0aebb0 0x7f251c14bb10 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.308+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 >> 172.21.15.106:0/3768440078 conn(0x7f251c0c9520 msgr2=0x7f251c14f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:21.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.309+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 shutdown_connections 2023-12-22T09:16:21.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.309+0000 7f252141b640 1 -- 172.21.15.106:0/3768440078 wait complete. 2023-12-22T09:16:21.325 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2023-12-22T09:16:21.375 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.MRHPcSSACd 2023-12-22T09:16:21.376 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:16:21.376 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/tmp/tmp.MRHPcSSACd 2023-12-22T09:16:21.420 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:16:21.420 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:21.521 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:16:21.521 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:21.573 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:21.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.790+0000 7f956258b640 1 Processor -- start 2023-12-22T09:16:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.790+0000 7f956258b640 1 -- start start 2023-12-22T09:16:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.791+0000 7f956258b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f955c14d980 0x7f955c1537e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.791+0000 7f956258b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f955c0aaca0 0x7f955c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.791+0000 7f956258b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f955c071e60 0x7f955c06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.791+0000 7f956258b640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955c0c1720 con 0x7f955c14d980 2023-12-22T09:16:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.791+0000 7f956258b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955c0c1a00 con 0x7f955c071e60 2023-12-22T09:16:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.791+0000 7f956258b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955c0706d0 con 0x7f955c0aaca0 2023-12-22T09:16:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.792+0000 7f955bfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f955c14d980 0x7f955c1537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.792+0000 7f955bfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f955c14d980 0x7f955c1537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48262/0 (socket says 172.21.15.106:48262) 2023-12-22T09:16:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.792+0000 7f955bfff640 1 -- 172.21.15.106:0/2396440082 learned_addr learned my addr 172.21.15.106:0/2396440082 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.792+0000 7f955bfff640 1 -- 172.21.15.106:0/2396440082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f955c0aaca0 msgr2=0x7f955c070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.792+0000 7f955bfff640 1 --2- 172.21.15.106:0/2396440082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f955c0aaca0 0x7f955c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.792+0000 7f955bfff640 1 -- 172.21.15.106:0/2396440082 >> v2:172.21.15.132:3300/0 conn(0x7f955c071e60 msgr2=0x7f955c06fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:21.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.792+0000 7f955bfff640 1 --2- 172.21.15.106:0/2396440082 >> v2:172.21.15.132:3300/0 conn(0x7f955c071e60 0x7f955c06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.792+0000 7f955bfff640 1 -- 172.21.15.106:0/2396440082 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c153d20 con 0x7f955c14d980 2023-12-22T09:16:21.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.793+0000 7f955bfff640 1 --2- 172.21.15.106:0/2396440082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c14d980 0x7f955c1537e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f955c154900 tx=0x7f954c02de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a80fd5b6b23180 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:21.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f955affd640 1 -- 172.21.15.106:0/2396440082 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c02ebc0 con 0x7f955c14d980 2023-12-22T09:16:21.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f955affd640 1 -- 172.21.15.106:0/2396440082 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c032070 con 0x7f955c14d980 2023-12-22T09:16:21.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f955affd640 1 -- 172.21.15.106:0/2396440082 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c038400 con 0x7f955c14d980 2023-12-22T09:16:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f956258b640 1 -- 172.21.15.106:0/2396440082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c14d980 msgr2=0x7f955c1537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f956258b640 1 --2- 172.21.15.106:0/2396440082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c14d980 0x7f955c1537e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f955c154900 tx=0x7f954c02de10 comp rx=0 tx=0).stop 2023-12-22T09:16:21.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f956258b640 1 -- 172.21.15.106:0/2396440082 shutdown_connections 2023-12-22T09:16:21.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f956258b640 1 --2- 172.21.15.106:0/2396440082 >> v2:172.21.15.132:3300/0 conn(0x7f955c071e60 0x7f955c06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f956258b640 1 --2- 172.21.15.106:0/2396440082 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f955c0aaca0 0x7f955c070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f956258b640 1 --2- 172.21.15.106:0/2396440082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c14d980 0x7f955c1537e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f956258b640 1 -- 172.21.15.106:0/2396440082 >> 172.21.15.106:0/2396440082 conn(0x7f955c0c5360 msgr2=0x7f955c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:21.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f956258b640 1 -- 172.21.15.106:0/2396440082 shutdown_connections 2023-12-22T09:16:21.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.794+0000 7f956258b640 1 -- 172.21.15.106:0/2396440082 wait complete. 2023-12-22T09:16:21.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.796+0000 7f956258b640 1 Processor -- start 2023-12-22T09:16:21.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.796+0000 7f956258b640 1 -- start start 2023-12-22T09:16:21.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.797+0000 7f956258b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c071e60 0x7f955c1452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.797+0000 7f956258b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f955c0aaca0 0x7f955c152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.797+0000 7f956258b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f955c14d980 0x7f955c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.797+0000 7f956258b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c1536f0 con 0x7f955c071e60 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.797+0000 7f956258b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c142a20 con 0x7f955c0aaca0 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.797+0000 7f956258b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955c14d090 con 0x7f955c14d980 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.797+0000 7f955bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c071e60 0x7f955c1452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.797+0000 7f955bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c071e60 0x7f955c1452c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48272/0 (socket says 172.21.15.106:48272) 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.797+0000 7f955bfff640 1 -- 172.21.15.106:0/29819703 learned_addr learned my addr 172.21.15.106:0/29819703 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f955bfff640 1 -- 172.21.15.106:0/29819703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f955c14d980 msgr2=0x7f955c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f955bfff640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f955c14d980 0x7f955c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f955bfff640 1 -- 172.21.15.106:0/29819703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f955c0aaca0 msgr2=0x7f955c152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f955bfff640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f955c0aaca0 0x7f955c152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f955bfff640 1 -- 172.21.15.106:0/29819703 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c00b710 con 0x7f955c071e60 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f955bfff640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c071e60 0x7f955c1452c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f954c00bbf0 tx=0x7f954c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:21.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f9558ff9640 1 -- 172.21.15.106:0/29819703 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c046070 con 0x7f955c071e60 2023-12-22T09:16:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f9558ff9640 1 -- 172.21.15.106:0/29819703 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c038cc0 con 0x7f955c071e60 2023-12-22T09:16:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955c14cdb0 con 0x7f955c071e60 2023-12-22T09:16:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.798+0000 7f9558ff9640 1 -- 172.21.15.106:0/29819703 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c005bb0 con 0x7f955c071e60 2023-12-22T09:16:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.799+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955c1426b0 con 0x7f955c071e60 2023-12-22T09:16:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.800+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955c073f10 con 0x7f955c071e60 2023-12-22T09:16:21.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.801+0000 7f9558ff9640 1 -- 172.21.15.106:0/29819703 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f954c042430 con 0x7f955c071e60 2023-12-22T09:16:21.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.802+0000 7f9558ff9640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f954806a430 0x7f954806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:21.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.802+0000 7f9558ff9640 1 -- 172.21.15.106:0/29819703 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f954c0ab2d0 con 0x7f955c071e60 2023-12-22T09:16:21.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.802+0000 7f955b7fe640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f954806a430 0x7f954806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:21.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.803+0000 7f955b7fe640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f954806a430 0x7f954806c8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f955c14ae20 tx=0x7f9550006bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:21.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:21.807+0000 7f9558ff9640 1 -- 172.21.15.106:0/29819703 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f954c0764b0 con 0x7f955c071e60 2023-12-22T09:16:21.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.000+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f955c150240 con 0x7f955c071e60 2023-12-22T09:16:22.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.004+0000 7f9558ff9640 1 -- 172.21.15.106:0/29819703 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20070 (secure 0 0 0) 0x7f954c005d10 con 0x7f955c071e60 2023-12-22T09:16:22.006 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:22.006 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:11.243405+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f954806a430 msgr2=0x7f954806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f954806a430 0x7f954806c8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f955c14ae20 tx=0x7f9550006bf0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c071e60 msgr2=0x7f955c1452c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c071e60 0x7f955c1452c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f954c00bbf0 tx=0x7f954c0046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 shutdown_connections 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f954806a430 0x7f954806c8f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f955c14d980 0x7f955c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f955c0aaca0 0x7f955c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 --2- 172.21.15.106:0/29819703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f955c071e60 0x7f955c1452c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 >> 172.21.15.106:0/29819703 conn(0x7f955c0c5360 msgr2=0x7f955c145f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:22.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 shutdown_connections 2023-12-22T09:16:22.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.007+0000 7f956258b640 1 -- 172.21.15.106:0/29819703 wait complete. 2023-12-22T09:16:22.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:15:52.874302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:15:54.136774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-22T09:16:08.066634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-22T09:16:09.242570+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:16:22.027 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:16:22.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.241+0000 7f38bcdab640 1 Processor -- start 2023-12-22T09:16:22.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.241+0000 7f38bcdab640 1 -- start start 2023-12-22T09:16:22.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.242+0000 7f38bcdab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38b80c7640 0x7f38b80c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.242+0000 7f38bcdab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f38b806ca00 0x7f38b806b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.242+0000 7f38bcdab640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b80c4560 con 0x7f38b80c6150 2023-12-22T09:16:22.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.242+0000 7f38bcdab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b80c4f90 con 0x7f38b806ca00 2023-12-22T09:16:22.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.242+0000 7f38bcdab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b8154720 con 0x7f38b80c7640 2023-12-22T09:16:22.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f38b80c6150 0x7f38b806b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39292/0 (socket says 172.21.15.106:39292) 2023-12-22T09:16:22.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b659c640 1 -- 172.21.15.106:0/2515554158 learned_addr learned my addr 172.21.15.106:0/2515554158 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:22.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b6d9d640 1 --2- 172.21.15.106:0/2515554158 >> v2:172.21.15.132:3300/0 conn(0x7f38b806ca00 0x7f38b806b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b5d9b640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38b80c7640 0x7f38b80c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758233270 0 0) 0x7f38b80c4560 con 0x7f38b80c6150 2023-12-22T09:16:22.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38a4003520 con 0x7f38b80c6150 2023-12-22T09:16:22.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2243357273 0 0) 0x7f38a4003520 con 0x7f38b80c6150 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38b80c7640 msgr2=0x7f38b80c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b559a640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38b80c7640 0x7f38b80c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 >> v2:172.21.15.132:3300/0 conn(0x7f38b806ca00 msgr2=0x7f38b806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b559a640 1 --2- 172.21.15.106:0/2515554158 >> v2:172.21.15.132:3300/0 conn(0x7f38b806ca00 0x7f38b806b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8154c50 con 0x7f38b80c6150 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f38a80019f0 con 0x7f38b80c6150 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.243+0000 7f38b6d9d640 1 --2- 172.21.15.106:0/2515554158 >> v2:172.21.15.132:3300/0 conn(0x7f38b806ca00 0x7f38b806b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 >> v1:172.21.15.106:6789/0 conn(0x7f38b80c6150 legacy=0x7f38b806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b559a640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38b80c7640 0x7f38a4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b559a640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38a4003fa0 0x7f38a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b559a640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38a4004d00 0x7f38a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b8154720 con 0x7f38a4003fa0 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a400bb70 con 0x7f38a4004d00 2023-12-22T09:16:22.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a400bd30 con 0x7f38b80c7640 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b5d9b640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38a4003fa0 0x7f38a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b6d9d640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38a4004d00 0x7f38a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b659c640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38b80c7640 0x7f38a4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b5d9b640 1 -- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38b80c7640 msgr2=0x7f38a4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b5d9b640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38b80c7640 0x7f38a4003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b5d9b640 1 -- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38a4004d00 msgr2=0x7f38a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b5d9b640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38a4004d00 0x7f38a4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.244+0000 7f38b5d9b640 1 -- 172.21.15.106:0/2515554158 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a4003520 con 0x7f38a4003fa0 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.245+0000 7f38b5d9b640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38a4003fa0 0x7f38a40047c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f38a000ba10 tx=0x7f38a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f67fdadeb1d1a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.246+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0032630 con 0x7f38a4003fa0 2023-12-22T09:16:22.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.246+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0032790 con 0x7f38a4003fa0 2023-12-22T09:16:22.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.246+0000 7f38b559a640 1 -- 172.21.15.106:0/2515554158 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0032b20 con 0x7f38a4003fa0 2023-12-22T09:16:22.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.246+0000 7f38bcdab640 1 -- 172.21.15.106:0/2515554158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38a4003fa0 msgr2=0x7f38a40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.246+0000 7f38bcdab640 1 --2- 172.21.15.106:0/2515554158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38a4003fa0 0x7f38a40047c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f38a000ba10 tx=0x7f38a40057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.246+0000 7f38b6d9d640 1 -- 172.21.15.106:0/2515554158 reap_dead start 2023-12-22T09:16:22.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.246+0000 7f38bcdab640 1 -- 172.21.15.106:0/2515554158 shutdown_connections 2023-12-22T09:16:22.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.246+0000 7f38bcdab640 1 -- 172.21.15.106:0/2515554158 >> 172.21.15.106:0/2515554158 conn(0x7f38b80ab330 msgr2=0x7f38b80ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:22.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.247+0000 7f38bcdab640 1 -- 172.21.15.106:0/2515554158 shutdown_connections 2023-12-22T09:16:22.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.247+0000 7f38bcdab640 1 -- 172.21.15.106:0/2515554158 wait complete. 2023-12-22T09:16:22.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.248+0000 7f38bcdab640 1 Processor -- start 2023-12-22T09:16:22.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.248+0000 7f38bcdab640 1 -- start start 2023-12-22T09:16:22.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.249+0000 7f38bcdab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38a4003fa0 0x7f38b81ea200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.249+0000 7f38bcdab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38b814dda0 0x7f38b814ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.249+0000 7f38bcdab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38b80aeb70 0x7f38b80af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.249+0000 7f38bcdab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b814e810 con 0x7f38b814dda0 2023-12-22T09:16:22.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.249+0000 7f38bcdab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b814e250 con 0x7f38b80aeb70 2023-12-22T09:16:22.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.249+0000 7f38bcdab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b814e530 con 0x7f38a4003fa0 2023-12-22T09:16:22.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.249+0000 7f38b5d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38b814dda0 0x7f38b814ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.250+0000 7f38b5d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38b814dda0 0x7f38b814ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48294/0 (socket says 172.21.15.106:48294) 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.250+0000 7f38b5d9b640 1 -- 172.21.15.106:0/4134225127 learned_addr learned my addr 172.21.15.106:0/4134225127 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.250+0000 7f38b5d9b640 1 -- 172.21.15.106:0/4134225127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38a4003fa0 msgr2=0x7f38b81ea200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.250+0000 7f38b5d9b640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38a4003fa0 0x7f38b81ea200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.250+0000 7f38b5d9b640 1 -- 172.21.15.106:0/4134225127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38b80aeb70 msgr2=0x7f38b80af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.250+0000 7f38b5d9b640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38b80aeb70 0x7f38b80af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.250+0000 7f38b5d9b640 1 -- 172.21.15.106:0/4134225127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b814c4b0 con 0x7f38b814dda0 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.250+0000 7f38b5d9b640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38b814dda0 0x7f38b814ccb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f38a002beb0 tx=0x7f38a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.250+0000 7f38aeffd640 1 -- 172.21.15.106:0/4134225127 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a003b9b0 con 0x7f38b814dda0 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.251+0000 7f38aeffd640 1 -- 172.21.15.106:0/4134225127 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a003bb10 con 0x7f38b814dda0 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.251+0000 7f38aeffd640 1 -- 172.21.15.106:0/4134225127 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0030400 con 0x7f38b814dda0 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.251+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b814c790 con 0x7f38b814dda0 2023-12-22T09:16:22.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.251+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b814d3d0 con 0x7f38b814dda0 2023-12-22T09:16:22.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.252+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b814c2f0 con 0x7f38b814dda0 2023-12-22T09:16:22.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.253+0000 7f38aeffd640 1 -- 172.21.15.106:0/4134225127 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f38a0030560 con 0x7f38b814dda0 2023-12-22T09:16:22.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.254+0000 7f38aeffd640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f389806a460 0x7f389806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.254+0000 7f38aeffd640 1 -- 172.21.15.106:0/4134225127 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f38a00ab320 con 0x7f38b814dda0 2023-12-22T09:16:22.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.254+0000 7f38b659c640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f389806a460 0x7f389806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.255+0000 7f38b659c640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f389806a460 0x7f389806c920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f38a8007c40 tx=0x7f38a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:22.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.258+0000 7f38aeffd640 1 -- 172.21.15.106:0/4134225127 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f38a0076580 con 0x7f38b814dda0 2023-12-22T09:16:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.447+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38b814d3d0 con 0x7f38b814dda0 2023-12-22T09:16:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.448+0000 7f38aeffd640 1 -- 172.21.15.106:0/4134225127 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38b814d3d0 con 0x7f38b814dda0 2023-12-22T09:16:22.448 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.450+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f389806a460 msgr2=0x7f389806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.450+0000 7f38bcdab640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f389806a460 0x7f389806c920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f38a8007c40 tx=0x7f38a8009040 comp rx=0 tx=0).stop 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.450+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38b814dda0 msgr2=0x7f38b814ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.451+0000 7f38bcdab640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38b814dda0 0x7f38b814ccb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f38a002beb0 tx=0x7f38a0004730 comp rx=0 tx=0).stop 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.451+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 shutdown_connections 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.451+0000 7f38bcdab640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f389806a460 0x7f389806c920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.451+0000 7f38bcdab640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38b80aeb70 0x7f38b80af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.451+0000 7f38bcdab640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38b814dda0 0x7f38b814ccb0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.451+0000 7f38bcdab640 1 --2- 172.21.15.106:0/4134225127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38a4003fa0 0x7f38b81ea200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.451+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 >> 172.21.15.106:0/4134225127 conn(0x7f38b80ab330 msgr2=0x7f38b80aa760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.451+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 shutdown_connections 2023-12-22T09:16:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.451+0000 7f38bcdab640 1 -- 172.21.15.106:0/4134225127 wait complete. 2023-12-22T09:16:22.470 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:16:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.688+0000 7f4f72f92640 1 Processor -- start 2023-12-22T09:16:22.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.689+0000 7f4f72f92640 1 -- start start 2023-12-22T09:16:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.690+0000 7f4f72f92640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4f6c06bdc0 0x7f4f6c1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.690+0000 7f4f72f92640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c14f570 con 0x7f4f6c06c2d0 2023-12-22T09:16:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.690+0000 7f4f72f92640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c0c0b00 con 0x7f4f6c0c5a30 2023-12-22T09:16:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.690+0000 7f4f72f92640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0a90f0 con 0x7f4f6c06bdc0 2023-12-22T09:16:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.690+0000 7f4f7152f640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4f6c06c2d0 0x7f4f6c15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39306/0 (socket says 172.21.15.106:39306) 2023-12-22T09:16:22.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.690+0000 7f4f7152f640 1 -- 172.21.15.106:0/2790282404 learned_addr learned my addr 172.21.15.106:0/2790282404 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:22.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6bfff640 1 --2- 172.21.15.106:0/2790282404 >> v2:172.21.15.132:3300/0 conn(0x7f4f6c06bdc0 0x7f4f6c1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260205002 0 0) 0x7f4f6c14f570 con 0x7f4f6c06c2d0 2023-12-22T09:16:22.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f5c003520 con 0x7f4f6c06c2d0 2023-12-22T09:16:22.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2333255887 0 0) 0x7f4f5c003520 con 0x7f4f6c06c2d0 2023-12-22T09:16:22.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 >> v2:172.21.15.132:3300/0 conn(0x7f4f6c06bdc0 msgr2=0x7f4f6c1557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:22.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 --2- 172.21.15.106:0/2790282404 >> v2:172.21.15.132:3300/0 conn(0x7f4f6c06bdc0 0x7f4f6c1557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 >> v1:172.21.15.132:6789/0 conn(0x7f4f6c0c5a30 legacy=0x7f4f6c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0bfd40 con 0x7f4f6c06c2d0 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f4f640019f0 con 0x7f4f6c06c2d0 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 >> v1:172.21.15.106:6789/0 conn(0x7f4f6c06c2d0 legacy=0x7f4f6c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f5c003970 0x7f4f5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.691+0000 7f4f6b7fe640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4f5c0047c0 0x7f4f5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f6b7fe640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0a90f0 con 0x7f4f5c005180 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c00c120 con 0x7f4f5c003970 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c00c2e0 con 0x7f4f5c0047c0 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f7152f640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f70d2e640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f5c003970 0x7f4f5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f6bfff640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4f5c0047c0 0x7f4f5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f7152f640 1 -- 172.21.15.106:0/2790282404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4f5c0047c0 msgr2=0x7f4f5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:22.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f7152f640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4f5c0047c0 0x7f4f5c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f7152f640 1 -- 172.21.15.106:0/2790282404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f5c003970 msgr2=0x7f4f5c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:22.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f7152f640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f5c003970 0x7f4f5c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.692+0000 7f4f7152f640 1 -- 172.21.15.106:0/2790282404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c003520 con 0x7f4f5c005180 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.693+0000 7f4f7152f640 1 -- 172.21.15.106:0/2790282404 reap_dead start 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.693+0000 7f4f7152f640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f5c00b980 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400a830 tx=0x7f4f5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f0c77319aa2868 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f640072d0 con 0x7f4f5c005180 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6402f070 con 0x7f4f5c005180 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f6b7fe640 1 -- 172.21.15.106:0/2790282404 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f640076b0 con 0x7f4f5c005180 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f72f92640 1 -- 172.21.15.106:0/2790282404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 msgr2=0x7f4f5c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f72f92640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f5c00b980 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400a830 tx=0x7f4f5c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f72f92640 1 -- 172.21.15.106:0/2790282404 shutdown_connections 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f72f92640 1 --2- 172.21.15.106:0/2790282404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f5c00b980 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f72f92640 1 -- 172.21.15.106:0/2790282404 >> 172.21.15.106:0/2790282404 conn(0x7f4f6c06a220 msgr2=0x7f4f6c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f72f92640 1 -- 172.21.15.106:0/2790282404 shutdown_connections 2023-12-22T09:16:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.694+0000 7f4f72f92640 1 -- 172.21.15.106:0/2790282404 wait complete. 2023-12-22T09:16:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.696+0000 7f4f72f92640 1 Processor -- start 2023-12-22T09:16:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.696+0000 7f4f72f92640 1 -- start start 2023-12-22T09:16:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.697+0000 7f4f72f92640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f6c150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.697+0000 7f4f72f92640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c1517a0 0x7f4f6c1454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.697+0000 7f4f72f92640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4f6c151c20 0x7f4f6c1459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.697+0000 7f4f72f92640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c1e6fb0 con 0x7f4f5c005180 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.697+0000 7f4f72f92640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c155870 con 0x7f4f6c1517a0 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.697+0000 7f4f72f92640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c155b50 con 0x7f4f6c151c20 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.697+0000 7f4f70d2e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f6c150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.698+0000 7f4f70d2e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f6c150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48300/0 (socket says 172.21.15.106:48300) 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.698+0000 7f4f70d2e640 1 -- 172.21.15.106:0/3484798824 learned_addr learned my addr 172.21.15.106:0/3484798824 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.698+0000 7f4f70d2e640 1 -- 172.21.15.106:0/3484798824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4f6c151c20 msgr2=0x7f4f6c1459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.698+0000 7f4f70d2e640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4f6c151c20 0x7f4f6c1459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.698+0000 7f4f70d2e640 1 -- 172.21.15.106:0/3484798824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c1517a0 msgr2=0x7f4f6c1454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.698+0000 7f4f70d2e640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c1517a0 0x7f4f6c1454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.698+0000 7f4f70d2e640 1 -- 172.21.15.106:0/3484798824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c155e30 con 0x7f4f5c005180 2023-12-22T09:16:22.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.698+0000 7f4f70d2e640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f6c150f90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000e480 tx=0x7f4f6000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.698+0000 7f4f697fa640 1 -- 172.21.15.106:0/3484798824 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f600052e0 con 0x7f4f5c005180 2023-12-22T09:16:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.699+0000 7f4f697fa640 1 -- 172.21.15.106:0/3484798824 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f60005440 con 0x7f4f5c005180 2023-12-22T09:16:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.699+0000 7f4f697fa640 1 -- 172.21.15.106:0/3484798824 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60003830 con 0x7f4f5c005180 2023-12-22T09:16:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.699+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c145f20 con 0x7f4f5c005180 2023-12-22T09:16:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.699+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c155500 con 0x7f4f5c005180 2023-12-22T09:16:22.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.700+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c0c0000 con 0x7f4f5c005180 2023-12-22T09:16:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.701+0000 7f4f697fa640 1 -- 172.21.15.106:0/3484798824 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f60003990 con 0x7f4f5c005180 2023-12-22T09:16:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.702+0000 7f4f697fa640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4f5006a460 0x7f4f5006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.702+0000 7f4f697fa640 1 -- 172.21.15.106:0/3484798824 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f4f60088af0 con 0x7f4f5c005180 2023-12-22T09:16:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.702+0000 7f4f6bfff640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4f5006a460 0x7f4f5006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.703+0000 7f4f6bfff640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4f5006a460 0x7f4f5006c920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0bf740 tx=0x7f4f58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:22.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.706+0000 7f4f697fa640 1 -- 172.21.15.106:0/3484798824 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4f6c0c0000 con 0x7f4f5c005180 2023-12-22T09:16:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.894+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f6c0c0000 con 0x7f4f5c005180 2023-12-22T09:16:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.895+0000 7f4f697fa640 1 -- 172.21.15.106:0/3484798824 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f6c0c0000 con 0x7f4f5c005180 2023-12-22T09:16:22.894 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4f5006a460 msgr2=0x7f4f5006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4f5006a460 0x7f4f5006c920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0bf740 tx=0x7f4f58008040 comp rx=0 tx=0).stop 2023-12-22T09:16:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 msgr2=0x7f4f6c150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f6c150f90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000e480 tx=0x7f4f6000e940 comp rx=0 tx=0).stop 2023-12-22T09:16:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 shutdown_connections 2023-12-22T09:16:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4f5006a460 0x7f4f5006c920 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4f6c151c20 0x7f4f6c1459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c1517a0 0x7f4f6c1454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 --2- 172.21.15.106:0/3484798824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f5c005180 0x7f4f6c150f90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.897+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 >> 172.21.15.106:0/3484798824 conn(0x7f4f6c06a220 msgr2=0x7f4f6c06c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.898+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 shutdown_connections 2023-12-22T09:16:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:22.898+0000 7f4f72f92640 1 -- 172.21.15.106:0/3484798824 wait complete. 2023-12-22T09:16:22.917 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:16:23.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.137+0000 7fd67759e640 1 Processor -- start 2023-12-22T09:16:23.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.138+0000 7fd67759e640 1 -- start start 2023-12-22T09:16:23.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.139+0000 7fd67759e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780a83c0 0x7fd678147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.139+0000 7fd67759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6780c2830 0x7fd6781484e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.139+0000 7fd67759e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd6780bfb00 0x7fd6780a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.139+0000 7fd67759e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6780a9a20 con 0x7fd6780bfb00 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.139+0000 7fd67759e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd678151970 con 0x7fd6780c2830 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.139+0000 7fd67759e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd678151bc0 con 0x7fd6780a83c0 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.139+0000 7fd676d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd6780bfb00 0x7fd6780a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd676d9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd6780bfb00 0x7fd6780a9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49796/0 (socket says 172.21.15.106:49796) 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd676d9d640 1 -- 172.21.15.106:0/3372212540 learned_addr learned my addr 172.21.15.106:0/3372212540 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd66ffff640 1 --2- 172.21.15.106:0/3372212540 >> v2:172.21.15.132:3300/0 conn(0x7fd6780c2830 0x7fd6781484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd67659c640 1 --2- 172.21.15.106:0/3372212540 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780a83c0 0x7fd678147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd676d9d640 1 -- 172.21.15.106:0/3372212540 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780a83c0 msgr2=0x7fd678147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd676d9d640 1 --2- 172.21.15.106:0/3372212540 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780a83c0 0x7fd678147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd676d9d640 1 -- 172.21.15.106:0/3372212540 >> v2:172.21.15.132:3300/0 conn(0x7fd6780c2830 msgr2=0x7fd6781484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd676d9d640 1 --2- 172.21.15.106:0/3372212540 >> v2:172.21.15.132:3300/0 conn(0x7fd6780c2830 0x7fd6781484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd676d9d640 1 -- 172.21.15.106:0/3372212540 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678151ea0 con 0x7fd6780bfb00 2023-12-22T09:16:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.140+0000 7fd66ffff640 1 --2- 172.21.15.106:0/3372212540 >> v2:172.21.15.132:3300/0 conn(0x7fd6780c2830 0x7fd6781484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.141+0000 7fd676d9d640 1 --2- 172.21.15.106:0/3372212540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780bfb00 0x7fd6780a9fa0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd67806dbf0 tx=0x7fd67002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600ee068e124027b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.141+0000 7fd675d9b640 1 -- 172.21.15.106:0/3372212540 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67002ca70 con 0x7fd6780bfb00 2023-12-22T09:16:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.141+0000 7fd675d9b640 1 -- 172.21.15.106:0/3372212540 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67002cbd0 con 0x7fd6780bfb00 2023-12-22T09:16:23.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd675d9b640 1 -- 172.21.15.106:0/3372212540 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6700343f0 con 0x7fd6780bfb00 2023-12-22T09:16:23.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd67759e640 1 -- 172.21.15.106:0/3372212540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780bfb00 msgr2=0x7fd6780a9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd67759e640 1 --2- 172.21.15.106:0/3372212540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780bfb00 0x7fd6780a9fa0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd67806dbf0 tx=0x7fd67002bed0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd67759e640 1 -- 172.21.15.106:0/3372212540 shutdown_connections 2023-12-22T09:16:23.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd67759e640 1 --2- 172.21.15.106:0/3372212540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780bfb00 0x7fd6780a9fa0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd67759e640 1 --2- 172.21.15.106:0/3372212540 >> v2:172.21.15.132:3300/0 conn(0x7fd6780c2830 0x7fd6781484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd67759e640 1 --2- 172.21.15.106:0/3372212540 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780a83c0 0x7fd678147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd67759e640 1 -- 172.21.15.106:0/3372212540 >> 172.21.15.106:0/3372212540 conn(0x7fd678069bf0 msgr2=0x7fd678069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:23.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd67759e640 1 -- 172.21.15.106:0/3372212540 shutdown_connections 2023-12-22T09:16:23.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.142+0000 7fd67759e640 1 -- 172.21.15.106:0/3372212540 wait complete. 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.144+0000 7fd67759e640 1 Processor -- start 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.144+0000 7fd67759e640 1 -- start start 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.145+0000 7fd67759e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780a83c0 0x7fd6781ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.145+0000 7fd67759e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780bfb00 0x7fd67814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.145+0000 7fd67759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6780c2830 0x7fd6781409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.145+0000 7fd67759e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67814af30 con 0x7fd6780a83c0 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.145+0000 7fd67759e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6780c12c0 con 0x7fd6780c2830 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.145+0000 7fd67759e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6781ed2a0 con 0x7fd6780bfb00 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.145+0000 7fd67659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780a83c0 0x7fd6781ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.145+0000 7fd67659c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780a83c0 0x7fd6781ecd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49808/0 (socket says 172.21.15.106:49808) 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.145+0000 7fd67659c640 1 -- 172.21.15.106:0/3823723401 learned_addr learned my addr 172.21.15.106:0/3823723401 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd66ffff640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780bfb00 0x7fd67814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd676d9d640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6780c2830 0x7fd6781409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd67659c640 1 -- 172.21.15.106:0/3823723401 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780bfb00 msgr2=0x7fd67814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd67659c640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780bfb00 0x7fd67814a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd67659c640 1 -- 172.21.15.106:0/3823723401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6780c2830 msgr2=0x7fd6781409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd67659c640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6780c2830 0x7fd6781409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd67659c640 1 -- 172.21.15.106:0/3823723401 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd670009b30 con 0x7fd6780a83c0 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd66ffff640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780bfb00 0x7fd67814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd67659c640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780a83c0 0x7fd6781ecd60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c7f0 tx=0x7fd66800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd66effd640 1 -- 172.21.15.106:0/3823723401 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668004220 con 0x7fd6780a83c0 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd66effd640 1 -- 172.21.15.106:0/3823723401 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668004380 con 0x7fd6780a83c0 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6780c1530 con 0x7fd6780a83c0 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.146+0000 7fd66effd640 1 -- 172.21.15.106:0/3823723401 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668007860 con 0x7fd6780a83c0 2023-12-22T09:16:23.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.147+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd678148c30 con 0x7fd6780a83c0 2023-12-22T09:16:23.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.148+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6780c1a50 con 0x7fd6780a83c0 2023-12-22T09:16:23.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.149+0000 7fd66effd640 1 -- 172.21.15.106:0/3823723401 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd668007bd0 con 0x7fd6780a83c0 2023-12-22T09:16:23.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.149+0000 7fd66effd640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd65806a430 0x7fd65806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.150+0000 7fd66effd640 1 -- 172.21.15.106:0/3823723401 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd668088e50 con 0x7fd6780a83c0 2023-12-22T09:16:23.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.150+0000 7fd66ffff640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd65806a430 0x7fd65806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.151+0000 7fd66ffff640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd65806a430 0x7fd65806c8f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd660006fd0 tx=0x7fd660008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:23.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.154+0000 7fd66effd640 1 -- 172.21.15.106:0/3823723401 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd6780c1a50 con 0x7fd6780a83c0 2023-12-22T09:16:23.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.344+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd678148a90 con 0x7fd6780a83c0 2023-12-22T09:16:23.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.346+0000 7fd66effd640 1 -- 172.21.15.106:0/3823723401 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd678148a90 con 0x7fd6780a83c0 2023-12-22T09:16:23.346 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:23.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd65806a430 msgr2=0x7fd65806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd65806a430 0x7fd65806c8f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd660006fd0 tx=0x7fd660008040 comp rx=0 tx=0).stop 2023-12-22T09:16:23.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780a83c0 msgr2=0x7fd6781ecd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780a83c0 0x7fd6781ecd60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c7f0 tx=0x7fd66800ccb0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 shutdown_connections 2023-12-22T09:16:23.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd65806a430 0x7fd65806c8f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6780c2830 0x7fd6781409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6780bfb00 0x7fd67814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 --2- 172.21.15.106:0/3823723401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6780a83c0 0x7fd6781ecd60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 >> 172.21.15.106:0/3823723401 conn(0x7fd678069bf0 msgr2=0x7fd678147500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:23.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 shutdown_connections 2023-12-22T09:16:23.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.349+0000 7fd67759e640 1 -- 172.21.15.106:0/3823723401 wait complete. 2023-12-22T09:16:23.366 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-22T09:16:23.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.575+0000 7f2539e77640 1 Processor -- start 2023-12-22T09:16:23.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.576+0000 7f2539e77640 1 -- start start 2023-12-22T09:16:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.577+0000 7f2539e77640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25340c1960 0x7f25341573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.577+0000 7f2539e77640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25340705a0 0x7f2534157920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.577+0000 7f2539e77640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25340ab040 con 0x7f2534151640 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.577+0000 7f2539e77640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253406bdc0 con 0x7f25340705a0 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.577+0000 7f2539e77640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253406caf0 con 0x7f25340c1960 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.577+0000 7f25337fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2534151640 0x7f25340c5a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51540/0 (socket says 172.21.15.106:51540) 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.577+0000 7f25337fe640 1 -- 172.21.15.106:0/2613876474 learned_addr learned my addr 172.21.15.106:0/2613876474 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.577+0000 7f2533fff640 1 --2- 172.21.15.106:0/2613876474 >> v2:172.21.15.106:3300/0 conn(0x7f25340705a0 0x7f2534157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.578+0000 7f252bfff640 1 --2- 172.21.15.106:0/2613876474 >> v2:172.21.15.132:3300/0 conn(0x7f25340c1960 0x7f25341573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.578+0000 7f2533fff640 1 -- 172.21.15.106:0/2613876474 >> v2:172.21.15.132:3300/0 conn(0x7f25340c1960 msgr2=0x7f25341573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.578+0000 7f2533fff640 1 --2- 172.21.15.106:0/2613876474 >> v2:172.21.15.132:3300/0 conn(0x7f25340c1960 0x7f25341573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.578+0000 7f2533fff640 1 -- 172.21.15.106:0/2613876474 >> v1:172.21.15.106:6789/0 conn(0x7f2534151640 legacy=0x7f25340c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.578+0000 7f2533fff640 1 -- 172.21.15.106:0/2613876474 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534157e60 con 0x7f25340705a0 2023-12-22T09:16:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.579+0000 7f2533fff640 1 --2- 172.21.15.106:0/2613876474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25340705a0 0x7f2534157920 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2534154fa0 tx=0x7f252c02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9ec86ee47a32f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.579+0000 7f2532ffd640 1 -- 172.21.15.106:0/2613876474 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c02cb50 con 0x7f25340705a0 2023-12-22T09:16:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.579+0000 7f2532ffd640 1 -- 172.21.15.106:0/2613876474 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c02ccb0 con 0x7f25340705a0 2023-12-22T09:16:23.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.579+0000 7f2532ffd640 1 -- 172.21.15.106:0/2613876474 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c034660 con 0x7f25340705a0 2023-12-22T09:16:23.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.580+0000 7f2539e77640 1 -- 172.21.15.106:0/2613876474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25340705a0 msgr2=0x7f2534157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.580+0000 7f2539e77640 1 --2- 172.21.15.106:0/2613876474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25340705a0 0x7f2534157920 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2534154fa0 tx=0x7f252c02bda0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.580+0000 7f2539e77640 1 -- 172.21.15.106:0/2613876474 shutdown_connections 2023-12-22T09:16:23.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.580+0000 7f2539e77640 1 --2- 172.21.15.106:0/2613876474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25340705a0 0x7f2534157920 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.580+0000 7f2539e77640 1 --2- 172.21.15.106:0/2613876474 >> v2:172.21.15.132:3300/0 conn(0x7f25340c1960 0x7f25341573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.580+0000 7f2539e77640 1 -- 172.21.15.106:0/2613876474 >> 172.21.15.106:0/2613876474 conn(0x7f253406a220 msgr2=0x7f25340c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:23.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.580+0000 7f2539e77640 1 -- 172.21.15.106:0/2613876474 shutdown_connections 2023-12-22T09:16:23.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.580+0000 7f2539e77640 1 -- 172.21.15.106:0/2613876474 wait complete. 2023-12-22T09:16:23.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.582+0000 7f2539e77640 1 Processor -- start 2023-12-22T09:16:23.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.582+0000 7f2539e77640 1 -- start start 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2539e77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25340705a0 0x7f25341e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2539e77640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25340c1960 0x7f2534152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2539e77640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534151640 0x7f2534152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2539e77640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340bb990 con 0x7f2534151640 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2539e77640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2534151dc0 con 0x7f25340705a0 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2539e77640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340c0240 con 0x7f25340c1960 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2533fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534151640 0x7f2534152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2533fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534151640 0x7f2534152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49812/0 (socket says 172.21.15.106:49812) 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2533fff640 1 -- 172.21.15.106:0/1725667928 learned_addr learned my addr 172.21.15.106:0/1725667928 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f25337fe640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25340705a0 0x7f25341e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2533fff640 1 -- 172.21.15.106:0/1725667928 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25340c1960 msgr2=0x7f2534152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2533fff640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25340c1960 0x7f2534152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2533fff640 1 -- 172.21.15.106:0/1725667928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25340705a0 msgr2=0x7f25341e8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2533fff640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25340705a0 0x7f25341e8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.583+0000 7f2533fff640 1 -- 172.21.15.106:0/1725667928 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c009a70 con 0x7f2534151640 2023-12-22T09:16:23.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.584+0000 7f2533fff640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534151640 0x7f2534152fc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f252c037040 tx=0x7f252c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:23.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.584+0000 7f2530ff9640 1 -- 172.21.15.106:0/1725667928 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c040650 con 0x7f2534151640 2023-12-22T09:16:23.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.584+0000 7f2530ff9640 1 -- 172.21.15.106:0/1725667928 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c0407d0 con 0x7f2534151640 2023-12-22T09:16:23.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.584+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2534153500 con 0x7f2534151640 2023-12-22T09:16:23.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.584+0000 7f2530ff9640 1 -- 172.21.15.106:0/1725667928 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c040b80 con 0x7f2534151640 2023-12-22T09:16:23.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.584+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25341e97c0 con 0x7f2534151640 2023-12-22T09:16:23.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.585+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253406c2d0 con 0x7f2534151640 2023-12-22T09:16:23.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.586+0000 7f2530ff9640 1 -- 172.21.15.106:0/1725667928 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f252c040ce0 con 0x7f2534151640 2023-12-22T09:16:23.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.588+0000 7f2530ff9640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f251406a430 0x7f251406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:23.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.588+0000 7f2530ff9640 1 -- 172.21.15.106:0/1725667928 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f252c0abc60 con 0x7f2534151640 2023-12-22T09:16:23.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.588+0000 7f25337fe640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f251406a430 0x7f251406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:23.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.588+0000 7f25337fe640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f251406a430 0x7f251406c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2524005880 tx=0x7f2524009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:23.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.592+0000 7f2530ff9640 1 -- 172.21.15.106:0/1725667928 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f253406c2d0 con 0x7f2534151640 2023-12-22T09:16:23.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.780+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f253406c2d0 con 0x7f2534151640 2023-12-22T09:16:23.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.781+0000 7f2530ff9640 1 -- 172.21.15.106:0/1725667928 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f253406c2d0 con 0x7f2534151640 2023-12-22T09:16:23.781 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:23.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.783+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f251406a430 msgr2=0x7f251406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.783+0000 7f2539e77640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f251406a430 0x7f251406c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2524005880 tx=0x7f2524009040 comp rx=0 tx=0).stop 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.783+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534151640 msgr2=0x7f2534152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.783+0000 7f2539e77640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534151640 0x7f2534152fc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f252c037040 tx=0x7f252c004a40 comp rx=0 tx=0).stop 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.784+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 shutdown_connections 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.784+0000 7f2539e77640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f251406a430 0x7f251406c8f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.784+0000 7f2539e77640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2534151640 0x7f2534152fc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.784+0000 7f2539e77640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25340c1960 0x7f2534152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.784+0000 7f2539e77640 1 --2- 172.21.15.106:0/1725667928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25340705a0 0x7f25341e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.784+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 >> 172.21.15.106:0/1725667928 conn(0x7f253406a220 msgr2=0x7f25340c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.784+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 shutdown_connections 2023-12-22T09:16:23.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:23.784+0000 7f2539e77640 1 -- 172.21.15.106:0/1725667928 wait complete. 2023-12-22T09:16:23.802 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-22T09:16:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.014+0000 7f9d73fff640 1 Processor -- start 2023-12-22T09:16:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.015+0000 7f9d73fff640 1 -- start start 2023-12-22T09:16:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.016+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740aead0 0x7f9d740ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.016+0000 7f9d73fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d740c5820 0x7f9d74157360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.016+0000 7f9d73fff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7406a400 con 0x7f9d740ab930 2023-12-22T09:16:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.016+0000 7f9d73fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7406aca0 con 0x7f9d740c5820 2023-12-22T09:16:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.016+0000 7f9d73fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740c5d00 con 0x7f9d740aead0 2023-12-22T09:16:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.017+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740aead0 0x7f9d740ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.017+0000 7f9d727fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d740c5820 0x7f9d74157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.017+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740aead0 0x7f9d740ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:53466/0 (socket says 172.21.15.106:53466) 2023-12-22T09:16:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.017+0000 7f9d72ffd640 1 -- 172.21.15.106:0/2242715208 learned_addr learned my addr 172.21.15.106:0/2242715208 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.018+0000 7f9d727fc640 1 -- 172.21.15.106:0/2242715208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740aead0 msgr2=0x7f9d740ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.018+0000 7f9d727fc640 1 --2- 172.21.15.106:0/2242715208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740aead0 0x7f9d740ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.018+0000 7f9d727fc640 1 -- 172.21.15.106:0/2242715208 >> v1:172.21.15.132:6789/0 conn(0x7f9d740ab930 legacy=0x7f9d740c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.018+0000 7f9d727fc640 1 -- 172.21.15.106:0/2242715208 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7406a650 con 0x7f9d740c5820 2023-12-22T09:16:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.018+0000 7f9d72ffd640 1 --2- 172.21.15.106:0/2242715208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740aead0 0x7f9d740ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:16:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.019+0000 7f9d727fc640 1 --2- 172.21.15.106:0/2242715208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d740c5820 0x7f9d74157360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0097a0 tx=0x7f9d5c02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1d8be16d1f081dc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.020+0000 7f9d71ffb640 1 -- 172.21.15.106:0/2242715208 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c02f050 con 0x7f9d740c5820 2023-12-22T09:16:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.020+0000 7f9d71ffb640 1 -- 172.21.15.106:0/2242715208 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c031700 con 0x7f9d740c5820 2023-12-22T09:16:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.020+0000 7f9d71ffb640 1 -- 172.21.15.106:0/2242715208 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c031a90 con 0x7f9d740c5820 2023-12-22T09:16:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.020+0000 7f9d73fff640 1 -- 172.21.15.106:0/2242715208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d740c5820 msgr2=0x7f9d74157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.020+0000 7f9d73fff640 1 --2- 172.21.15.106:0/2242715208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d740c5820 0x7f9d74157360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0097a0 tx=0x7f9d5c02b7a0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.021+0000 7f9d73fff640 1 -- 172.21.15.106:0/2242715208 shutdown_connections 2023-12-22T09:16:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.021+0000 7f9d73fff640 1 --2- 172.21.15.106:0/2242715208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d740c5820 0x7f9d74157360 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.021+0000 7f9d73fff640 1 --2- 172.21.15.106:0/2242715208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740aead0 0x7f9d740ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.021+0000 7f9d73fff640 1 -- 172.21.15.106:0/2242715208 >> 172.21.15.106:0/2242715208 conn(0x7f9d740c97d0 msgr2=0x7f9d740c9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.021+0000 7f9d73fff640 1 -- 172.21.15.106:0/2242715208 shutdown_connections 2023-12-22T09:16:24.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.021+0000 7f9d73fff640 1 -- 172.21.15.106:0/2242715208 wait complete. 2023-12-22T09:16:24.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.022+0000 7f9d73fff640 1 Processor -- start 2023-12-22T09:16:24.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.022+0000 7f9d73fff640 1 -- start start 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.023+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d740ab930 0x7f9d74154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.023+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d740aead0 0x7f9d74154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.023+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740c5820 0x7f9d740be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.023+0000 7f9d73fff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d741edbe0 con 0x7f9d740aead0 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.023+0000 7f9d73fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740bdf40 con 0x7f9d740ab930 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.023+0000 7f9d73fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d741550d0 con 0x7f9d740c5820 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d727fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d740aead0 0x7f9d74154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d727fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d740aead0 0x7f9d74154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49828/0 (socket says 172.21.15.106:49828) 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d727fc640 1 -- 172.21.15.106:0/1763793426 learned_addr learned my addr 172.21.15.106:0/1763793426 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d737fe640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740c5820 0x7f9d740be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d727fc640 1 -- 172.21.15.106:0/1763793426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740c5820 msgr2=0x7f9d740be3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d72ffd640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d740ab930 0x7f9d74154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d727fc640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740c5820 0x7f9d740be3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d727fc640 1 -- 172.21.15.106:0/1763793426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d740ab930 msgr2=0x7f9d74154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d727fc640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d740ab930 0x7f9d74154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d727fc640 1 -- 172.21.15.106:0/1763793426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d64009b30 con 0x7f9d740aead0 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.024+0000 7f9d727fc640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d740aead0 0x7f9d74154b90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c000c00 tx=0x7f9d5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.025+0000 7f9d6bfff640 1 -- 172.21.15.106:0/1763793426 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c0339b0 con 0x7f9d740aead0 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.025+0000 7f9d6bfff640 1 -- 172.21.15.106:0/1763793426 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c033b10 con 0x7f9d740aead0 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.025+0000 7f9d6bfff640 1 -- 172.21.15.106:0/1763793426 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c03d470 con 0x7f9d740aead0 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.025+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c009400 con 0x7f9d740aead0 2023-12-22T09:16:24.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.025+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d74152470 con 0x7f9d740aead0 2023-12-22T09:16:24.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.026+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d74157ae0 con 0x7f9d740aead0 2023-12-22T09:16:24.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.027+0000 7f9d6bfff640 1 -- 172.21.15.106:0/1763793426 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d5c03a040 con 0x7f9d740aead0 2023-12-22T09:16:24.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.028+0000 7f9d6bfff640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9d5406a430 0x7f9d5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.028+0000 7f9d6bfff640 1 -- 172.21.15.106:0/1763793426 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9d5c0aab30 con 0x7f9d740aead0 2023-12-22T09:16:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.028+0000 7f9d72ffd640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9d5406a430 0x7f9d5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.029+0000 7f9d72ffd640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9d5406a430 0x7f9d5406c8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009240 tx=0x7f9d6400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:24.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.032+0000 7f9d6bfff640 1 -- 172.21.15.106:0/1763793426 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9d5c075db0 con 0x7f9d740aead0 2023-12-22T09:16:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.207+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9d740bfd90 con 0x7f9d740aead0 2023-12-22T09:16:24.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.208+0000 7f9d6bfff640 1 -- 172.21.15.106:0/1763793426 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9d5c0380a0 con 0x7f9d740aead0 2023-12-22T09:16:24.208 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9d5406a430 msgr2=0x7f9d5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9d5406a430 0x7f9d5406c8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009240 tx=0x7f9d6400b040 comp rx=0 tx=0).stop 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d740aead0 msgr2=0x7f9d74154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d740aead0 0x7f9d74154b90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c000c00 tx=0x7f9d5c0046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 shutdown_connections 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9d5406a430 0x7f9d5406c8f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9d740c5820 0x7f9d740be3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d740aead0 0x7f9d74154b90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 --2- 172.21.15.106:0/1763793426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d740ab930 0x7f9d74154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 >> 172.21.15.106:0/1763793426 conn(0x7f9d740c97d0 msgr2=0x7f9d740aa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:24.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 shutdown_connections 2023-12-22T09:16:24.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.211+0000 7f9d73fff640 1 -- 172.21.15.106:0/1763793426 wait complete. 2023-12-22T09:16:24.229 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T09:16:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.440+0000 7fae7f88b640 1 Processor -- start 2023-12-22T09:16:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.440+0000 7fae7f88b640 1 -- start start 2023-12-22T09:16:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.442+0000 7fae7f88b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae78151300 0x7fae780c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.442+0000 7fae7f88b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fae7806bc70 0x7fae780be6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.442+0000 7fae7f88b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae781516e0 con 0x7fae781545d0 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.442+0000 7fae7f88b640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7806c7b0 con 0x7fae7806bc70 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.442+0000 7fae7f88b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7806ca90 con 0x7fae78151300 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.442+0000 7fae7ce26640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fae7806bc70 0x7fae780be6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.442+0000 7fae7ce26640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fae7806bc70 0x7fae780be6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49830/0 (socket says 172.21.15.106:49830) 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.442+0000 7fae7ce26640 1 -- 172.21.15.106:0/2791029290 learned_addr learned my addr 172.21.15.106:0/2791029290 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.442+0000 7fae7de28640 1 --1- 172.21.15.106:0/2791029290 >> v1:172.21.15.106:6789/0 conn(0x7fae781545d0 0x7fae78069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51556/0 (socket says 172.21.15.106:51556) 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.443+0000 7fae7d627640 1 --2- 172.21.15.106:0/2791029290 >> v2:172.21.15.132:3300/0 conn(0x7fae78151300 0x7fae780c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.443+0000 7fae7ce26640 1 -- 172.21.15.106:0/2791029290 >> v2:172.21.15.132:3300/0 conn(0x7fae78151300 msgr2=0x7fae780c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.443+0000 7fae7ce26640 1 --2- 172.21.15.106:0/2791029290 >> v2:172.21.15.132:3300/0 conn(0x7fae78151300 0x7fae780c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.443+0000 7fae7ce26640 1 -- 172.21.15.106:0/2791029290 >> v1:172.21.15.106:6789/0 conn(0x7fae781545d0 legacy=0x7fae78069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.443+0000 7fae7ce26640 1 -- 172.21.15.106:0/2791029290 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae78153dd0 con 0x7fae7806bc70 2023-12-22T09:16:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.443+0000 7fae6ffff640 1 -- 172.21.15.106:0/2791029290 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919922765 0 0) 0x7fae781516e0 con 0x7fae781545d0 2023-12-22T09:16:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.444+0000 7fae7ce26640 1 --2- 172.21.15.106:0/2791029290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae7806bc70 0x7fae780be6e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fae7806aa70 tx=0x7fae6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0eb68d0fad5553 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.444+0000 7fae6ffff640 1 -- 172.21.15.106:0/2791029290 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68031870 con 0x7fae7806bc70 2023-12-22T09:16:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.444+0000 7fae6ffff640 1 -- 172.21.15.106:0/2791029290 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae680319d0 con 0x7fae7806bc70 2023-12-22T09:16:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.444+0000 7fae6ffff640 1 -- 172.21.15.106:0/2791029290 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68031d60 con 0x7fae7806bc70 2023-12-22T09:16:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.445+0000 7fae7f88b640 1 -- 172.21.15.106:0/2791029290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae7806bc70 msgr2=0x7fae780be6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.445+0000 7fae7f88b640 1 --2- 172.21.15.106:0/2791029290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae7806bc70 0x7fae780be6e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fae7806aa70 tx=0x7fae6802b910 comp rx=0 tx=0).stop 2023-12-22T09:16:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.445+0000 7fae7f88b640 1 -- 172.21.15.106:0/2791029290 shutdown_connections 2023-12-22T09:16:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.445+0000 7fae7f88b640 1 --2- 172.21.15.106:0/2791029290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae7806bc70 0x7fae780be6e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.445+0000 7fae7f88b640 1 --2- 172.21.15.106:0/2791029290 >> v2:172.21.15.132:3300/0 conn(0x7fae78151300 0x7fae780c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.445+0000 7fae7f88b640 1 -- 172.21.15.106:0/2791029290 >> 172.21.15.106:0/2791029290 conn(0x7fae780c1db0 msgr2=0x7fae780c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.445+0000 7fae7f88b640 1 -- 172.21.15.106:0/2791029290 shutdown_connections 2023-12-22T09:16:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.445+0000 7fae7f88b640 1 -- 172.21.15.106:0/2791029290 wait complete. 2023-12-22T09:16:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.447+0000 7fae7f88b640 1 Processor -- start 2023-12-22T09:16:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.447+0000 7fae7f88b640 1 -- start start 2023-12-22T09:16:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7f88b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae7806bc70 0x7fae78154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7f88b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae78151300 0x7fae78157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7f88b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae781545d0 0x7fae781492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7f88b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae78155990 con 0x7fae78151300 2023-12-22T09:16:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7f88b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae78070300 con 0x7fae7806bc70 2023-12-22T09:16:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7f88b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7814a760 con 0x7fae781545d0 2023-12-22T09:16:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7ce26640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae78151300 0x7fae78157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7ce26640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae78151300 0x7fae78157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49846/0 (socket says 172.21.15.106:49846) 2023-12-22T09:16:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7ce26640 1 -- 172.21.15.106:0/653293793 learned_addr learned my addr 172.21.15.106:0/653293793 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7ce26640 1 -- 172.21.15.106:0/653293793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae781545d0 msgr2=0x7fae781492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7ce26640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae781545d0 0x7fae781492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7ce26640 1 -- 172.21.15.106:0/653293793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae7806bc70 msgr2=0x7fae78154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7ce26640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae7806bc70 0x7fae78154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.448+0000 7fae7ce26640 1 -- 172.21.15.106:0/653293793 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680094d0 con 0x7fae78151300 2023-12-22T09:16:24.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.449+0000 7fae7ce26640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae78151300 0x7fae78157b10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fae6802b950 tx=0x7fae680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:24.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.449+0000 7fae6dffb640 1 -- 172.21.15.106:0/653293793 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6803ad30 con 0x7fae78151300 2023-12-22T09:16:24.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.449+0000 7fae6dffb640 1 -- 172.21.15.106:0/653293793 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae680443f0 con 0x7fae78151300 2023-12-22T09:16:24.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.449+0000 7fae6dffb640 1 -- 172.21.15.106:0/653293793 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680447a0 con 0x7fae78151300 2023-12-22T09:16:24.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.449+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7814a480 con 0x7fae78151300 2023-12-22T09:16:24.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.449+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7806ff90 con 0x7fae78151300 2023-12-22T09:16:24.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.450+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae78073f10 con 0x7fae78151300 2023-12-22T09:16:24.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.451+0000 7fae6dffb640 1 -- 172.21.15.106:0/653293793 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae6804d450 con 0x7fae78151300 2023-12-22T09:16:24.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.452+0000 7fae6dffb640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a430 0x7fae5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:24.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.452+0000 7fae6dffb640 1 -- 172.21.15.106:0/653293793 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fae6802d040 con 0x7fae78151300 2023-12-22T09:16:24.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.452+0000 7fae7d627640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a430 0x7fae5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:24.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.453+0000 7fae7d627640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a430 0x7fae5c06c8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae74006e20 tx=0x7fae74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:24.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.457+0000 7fae6dffb640 1 -- 172.21.15.106:0/653293793 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae68076560 con 0x7fae78151300 2023-12-22T09:16:24.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.661+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae780704b0 con 0x7fae78151300 2023-12-22T09:16:24.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.662+0000 7fae6dffb640 1 -- 172.21.15.106:0/653293793 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7fae780704b0 con 0x7fae78151300 2023-12-22T09:16:24.662 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a430 msgr2=0x7fae5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a430 0x7fae5c06c8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae74006e20 tx=0x7fae74008040 comp rx=0 tx=0).stop 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae78151300 msgr2=0x7fae78157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae78151300 0x7fae78157b10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fae6802b950 tx=0x7fae680046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 shutdown_connections 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fae5c06a430 0x7fae5c06c8f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fae781545d0 0x7fae781492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae78151300 0x7fae78157b10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 --2- 172.21.15.106:0/653293793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae7806bc70 0x7fae78154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 >> 172.21.15.106:0/653293793 conn(0x7fae780c1db0 msgr2=0x7fae780c0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 shutdown_connections 2023-12-22T09:16:24.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:24.665+0000 7fae7f88b640 1 -- 172.21.15.106:0/653293793 wait complete. 2023-12-22T09:16:24.685 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T09:16:24.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:24.686 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T09:16:24.794 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2023-12-22T09:16:24.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:24.795 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T09:16:24.853 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:16:24.853 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:24.899 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-22T09:16:24.900 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:16:25.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.157+0000 7fa99c36e640 1 Processor -- start 2023-12-22T09:16:25.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.157+0000 7fa99c36e640 1 -- start start 2023-12-22T09:16:25.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.158+0000 7fa99c36e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa99414d980 0x7fa9941537e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:25.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa99c36e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa9940aaca0 0x7fa994070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:25.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa99c36e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9940c1720 con 0x7fa994071e60 2023-12-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa99c36e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9940c1a00 con 0x7fa9940aaca0 2023-12-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa99c36e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9940706d0 con 0x7fa99414d980 2023-12-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa999909640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa9940aaca0 0x7fa994070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa999909640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa9940aaca0 0x7fa994070bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49858/0 (socket says 172.21.15.106:49858) 2023-12-22T09:16:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa999909640 1 -- 172.21.15.106:0/1057252171 learned_addr learned my addr 172.21.15.106:0/1057252171 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa99a10a640 1 --2- 172.21.15.106:0/1057252171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa99414d980 0x7fa9941537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa999909640 1 -- 172.21.15.106:0/1057252171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa99414d980 msgr2=0x7fa9941537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa999909640 1 --2- 172.21.15.106:0/1057252171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa99414d980 0x7fa9941537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa999909640 1 -- 172.21.15.106:0/1057252171 >> v1:172.21.15.132:6789/0 conn(0x7fa994071e60 legacy=0x7fa99406fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.159+0000 7fa999909640 1 -- 172.21.15.106:0/1057252171 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa994153d20 con 0x7fa9940aaca0 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.160+0000 7fa999909640 1 --2- 172.21.15.106:0/1057252171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 0x7fa994070bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa984009870 tx=0x7fa98402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3015e63520fb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa999108640 1 -- 172.21.15.106:0/1057252171 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840317c0 con 0x7fa9940aaca0 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa999108640 1 -- 172.21.15.106:0/1057252171 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984031920 con 0x7fa9940aaca0 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa999108640 1 -- 172.21.15.106:0/1057252171 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984031cb0 con 0x7fa9940aaca0 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa99c36e640 1 -- 172.21.15.106:0/1057252171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 msgr2=0x7fa994070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa99c36e640 1 --2- 172.21.15.106:0/1057252171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 0x7fa994070bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa984009870 tx=0x7fa98402b860 comp rx=0 tx=0).stop 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa99c36e640 1 -- 172.21.15.106:0/1057252171 shutdown_connections 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa99c36e640 1 --2- 172.21.15.106:0/1057252171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 0x7fa994070bf0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa99c36e640 1 --2- 172.21.15.106:0/1057252171 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa99414d980 0x7fa9941537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa99c36e640 1 -- 172.21.15.106:0/1057252171 >> 172.21.15.106:0/1057252171 conn(0x7fa9940c5360 msgr2=0x7fa9940c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa99c36e640 1 -- 172.21.15.106:0/1057252171 shutdown_connections 2023-12-22T09:16:25.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.161+0000 7fa99c36e640 1 -- 172.21.15.106:0/1057252171 wait complete. 2023-12-22T09:16:25.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.163+0000 7fa99c36e640 1 Processor -- start 2023-12-22T09:16:25.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.163+0000 7fa99c36e640 1 -- start start 2023-12-22T09:16:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.164+0000 7fa99c36e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa994071e60 0x7fa9941eab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.164+0000 7fa99c36e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 0x7fa9940aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.164+0000 7fa99c36e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa99414d980 0x7fa9941e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.164+0000 7fa99c36e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99414ef50 con 0x7fa9940aaca0 2023-12-22T09:16:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.164+0000 7fa99c36e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9941e6c00 con 0x7fa99414d980 2023-12-22T09:16:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.164+0000 7fa99c36e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99414e990 con 0x7fa994071e60 2023-12-22T09:16:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.164+0000 7fa999909640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 0x7fa9940aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.164+0000 7fa999909640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 0x7fa9940aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49870/0 (socket says 172.21.15.106:49870) 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.164+0000 7fa999909640 1 -- 172.21.15.106:0/2239905759 learned_addr learned my addr 172.21.15.106:0/2239905759 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa99a10a640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa994071e60 0x7fa9941eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa99a90b640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa99414d980 0x7fa9941e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa999909640 1 -- 172.21.15.106:0/2239905759 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa994071e60 msgr2=0x7fa9941eab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa999909640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa994071e60 0x7fa9941eab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa999909640 1 -- 172.21.15.106:0/2239905759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa99414d980 msgr2=0x7fa9941e7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa999909640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa99414d980 0x7fa9941e7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa999909640 1 -- 172.21.15.106:0/2239905759 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9840094d0 con 0x7fa9940aaca0 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa99a10a640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa994071e60 0x7fa9941eab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa999909640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 0x7fa9940aa0f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa984000c00 tx=0x7fa9840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa98affd640 1 -- 172.21.15.106:0/2239905759 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840329a0 con 0x7fa9940aaca0 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa98affd640 1 -- 172.21.15.106:0/2239905759 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984032b20 con 0x7fa9940aaca0 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.165+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99414ec70 con 0x7fa9940aaca0 2023-12-22T09:16:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.166+0000 7fa98affd640 1 -- 172.21.15.106:0/2239905759 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840453f0 con 0x7fa9940aaca0 2023-12-22T09:16:25.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.166+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9940aa630 con 0x7fa9940aaca0 2023-12-22T09:16:25.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.167+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99414ead0 con 0x7fa9940aaca0 2023-12-22T09:16:25.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.168+0000 7fa98affd640 1 -- 172.21.15.106:0/2239905759 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa98404e450 con 0x7fa9940aaca0 2023-12-22T09:16:25.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.169+0000 7fa98affd640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa97806a460 0x7fa97806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:25.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.169+0000 7fa98affd640 1 -- 172.21.15.106:0/2239905759 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa9840ab130 con 0x7fa9940aaca0 2023-12-22T09:16:25.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.169+0000 7fa99a10a640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa97806a460 0x7fa97806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:25.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.170+0000 7fa99a10a640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa97806a460 0x7fa97806c920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa990006fd0 tx=0x7fa990008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:25.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.173+0000 7fa98affd640 1 -- 172.21.15.106:0/2239905759 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa99414ead0 con 0x7fa9940aaca0 2023-12-22T09:16:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.402+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa99414ead0 con 0x7fa9940aaca0 2023-12-22T09:16:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.403+0000 7fa98affd640 1 -- 172.21.15.106:0/2239905759 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7fa99414ead0 con 0x7fa9940aaca0 2023-12-22T09:16:25.403 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T09:16:25.403 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-22T09:16:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa97806a460 msgr2=0x7fa97806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa97806a460 0x7fa97806c920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa990006fd0 tx=0x7fa990008040 comp rx=0 tx=0).stop 2023-12-22T09:16:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 msgr2=0x7fa9940aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 0x7fa9940aa0f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa984000c00 tx=0x7fa9840046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 shutdown_connections 2023-12-22T09:16:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa97806a460 0x7fa97806c920 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa99414d980 0x7fa9941e7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9940aaca0 0x7fa9940aa0f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 --2- 172.21.15.106:0/2239905759 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa994071e60 0x7fa9941eab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 >> 172.21.15.106:0/2239905759 conn(0x7fa9940c5360 msgr2=0x7fa9940c0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 shutdown_connections 2023-12-22T09:16:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:25.406+0000 7fa99c36e640 1 -- 172.21.15.106:0/2239905759 wait complete. 2023-12-22T09:16:25.425 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-22T09:16:25.425 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:16:25.425 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2023-12-22T09:16:25.426 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-22T09:16:25.426 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T09:16:25.426 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-22T09:16:25.426 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T09:16:25.426 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.MRHPcSSACd 2023-12-22T09:16:25.426 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2023-12-22T09:16:25.478 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.wFqOMiKMR1 2023-12-22T09:16:25.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /tmp/tmp.MRHPcSSACd /tmp/tmp.wFqOMiKMR1 2023-12-22T09:16:25.574 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.wFqOMiKMR1 2023-12-22T09:16:25.726 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.wFqOMiKMR1 is 66B 2023-12-22T09:16:25.786 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.wFqOMiKMR1 2023-12-22T09:16:25.838 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDlU4Vl1ynpERAA6q6kdszVDJYSaGfqTWAiYw== 2023-12-22T09:16:25.838 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:16:25.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:25.839 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2023-12-22T09:16:25.890 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:25.891 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42249sec preferred_lft 42249sec 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 1a:08:33:e3:a0:21 brd ff:ff:ff:ff:ff:ff 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::b017:8aff:febf:6d1d/64 scope link 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 1a:08:33:e3:a0:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T09:16:25.892 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::1808:33ff:fee3:a021/64 scope link 2023-12-22T09:16:25.893 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:16:25.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:25.894 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:16:25.980 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-12-22T09:16:25.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:25.985 DEBUG:teuthology.orchestra.run.smithi106:> route 2023-12-22T09:16:26.038 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2023-12-22T09:16:26.039 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:16:26.039 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:16:26.039 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:16:26.039 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:16:26.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:26.039 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:16:26.039 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:16:26.039 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:16:26.040 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:16:26.040 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:16:26.040 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:16:26.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:26.219 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-12-22T09:16:26.270 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T09:16:26.271 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:16:26.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:26.271 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2023-12-22T09:16:26.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:16:26.359 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T09:16:26.410 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:16:26.410 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:16:26.410 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T09:16:26.459 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:16:26.459 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/tmp/tmp.MRHPcSSACd of=/dev/stdout 2023-12-22T09:16:26.509 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T09:16:26.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:26.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDlU4Vl1ynpERAA6q6kdszVDJYSaGfqTWAiYw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-12-22T09:16:26.698 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,secret=AQDlU4Vl1ynpERAA6q6kdszVDJYSaGfqTWAiYw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-12-22T09:16:26.699 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-12-22T09:16:26.699 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:16:26.699 INFO:teuthology.orchestra.run.smithi106.stdout:keyring.get_secret failed 2023-12-22T09:16:26.721 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,secret=AQDlU4Vl1ynpERAA6q6kdszVDJYSaGfqTWAiYw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-12-22T09:16:26.721 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-12-22T09:16:26.721 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:16:26.721 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:16:26.722 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:16:26.722 INFO:teuthology.orchestra.run.smithi106.stdout:keyring.get_secret failed 2023-12-22T09:16:26.748 INFO:teuthology.orchestra.run.smithi106.stderr:mount error: no mds server is up or the cluster is laggy 2023-12-22T09:16:26.749 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,secret=AQDlU4Vl1ynpERAA6q6kdszVDJYSaGfqTWAiYw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-12-22T09:16:26.750 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-12-22T09:16:26.750 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:16:26.750 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:16:26.750 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:16:26.750 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790" 2023-12-22T09:16:26.750 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2023-12-22T09:16:26.751 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=c9422aac-a1e3-428b-87d0-2dbf321c6b46" will pass to kernel 2023-12-22T09:16:26.754 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T09:16:26.755 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-22T09:16:26.755 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T09:16:26.755 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T09:16:26.864 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T09:16:26.982 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T09:16:26.982 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:16:26.982 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:27.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-22T09:16:27.043 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:16:27.043 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:27.103 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:16:27.103 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:27.160 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:27.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.379+0000 7f8cb9e77640 1 Processor -- start 2023-12-22T09:16:27.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.380+0000 7f8cb9e77640 1 -- start start 2023-12-22T09:16:27.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.381+0000 7f8cb9e77640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb413b060 0x7f8cb406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.381+0000 7f8cb9e77640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40bf770 con 0x7f8cb4151b30 2023-12-22T09:16:27.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.381+0000 7f8cb9e77640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb4155120 con 0x7f8cb40bfce0 2023-12-22T09:16:27.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.381+0000 7f8cb9e77640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4155400 con 0x7f8cb413b060 2023-12-22T09:16:27.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.381+0000 7f8cb3fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8cb4151b30 0x7f8cb4151fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51558/0 (socket says 172.21.15.106:51558) 2023-12-22T09:16:27.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.381+0000 7f8cb3fff640 1 -- 172.21.15.106:0/23163366 learned_addr learned my addr 172.21.15.106:0/23163366 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:27.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb37fe640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb413b060 0x7f8cb406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:27.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854629384 0 0) 0x7f8cb40bf770 con 0x7f8cb4151b30 2023-12-22T09:16:27.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca0003520 con 0x7f8cb4151b30 2023-12-22T09:16:27.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556225725 0 0) 0x7f8ca0003520 con 0x7f8cb4151b30 2023-12-22T09:16:27.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb413b060 msgr2=0x7f8cb406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:27.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb413b060 0x7f8cb406a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 >> v1:172.21.15.132:6789/0 conn(0x7f8cb40bfce0 legacy=0x7f8cb4069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb41556e0 con 0x7f8cb4151b30 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f8cac0019f0 con 0x7f8cb4151b30 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 >> v1:172.21.15.106:6789/0 conn(0x7f8cb4151b30 legacy=0x7f8cb4151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb413b060 0x7f8ca00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8ca00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ca0004d00 0x7f8ca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4155400 con 0x7f8ca0004020 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca000bc60 con 0x7f8ca0004d00 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.382+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca000be20 con 0x7f8cb413b060 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.383+0000 7f8caaffd640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8ca00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.383+0000 7f8cb37fe640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb413b060 0x7f8ca00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.383+0000 7f8caaffd640 1 -- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb413b060 msgr2=0x7f8ca00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:27.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.383+0000 7f8caaffd640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb413b060 0x7f8ca00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.383+0000 7f8caaffd640 1 -- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ca0004d00 msgr2=0x7f8ca0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:27.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.383+0000 7f8caaffd640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ca0004d00 0x7f8ca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.383+0000 7f8caaffd640 1 -- 172.21.15.106:0/23163366 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca0003520 con 0x7f8ca0004020 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.384+0000 7f8caaffd640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8ca00047c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c001750 tx=0x7f8ca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1781da31be310238 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.384+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0052d0 con 0x7f8ca0004020 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.384+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c02e050 con 0x7f8ca0004020 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.384+0000 7f8cb2ffd640 1 -- 172.21.15.106:0/23163366 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c003830 con 0x7f8ca0004020 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.385+0000 7f8cb9e77640 1 -- 172.21.15.106:0/23163366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 msgr2=0x7f8ca00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.385+0000 7f8cb9e77640 1 --2- 172.21.15.106:0/23163366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8ca00047c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c001750 tx=0x7f8ca00057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.385+0000 7f8cb3fff640 1 -- 172.21.15.106:0/23163366 reap_dead start 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.385+0000 7f8cb9e77640 1 -- 172.21.15.106:0/23163366 shutdown_connections 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.385+0000 7f8cb9e77640 1 -- 172.21.15.106:0/23163366 >> 172.21.15.106:0/23163366 conn(0x7f8cb40c5360 msgr2=0x7f8cb40c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.385+0000 7f8cb9e77640 1 -- 172.21.15.106:0/23163366 shutdown_connections 2023-12-22T09:16:27.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.385+0000 7f8cb9e77640 1 -- 172.21.15.106:0/23163366 wait complete. 2023-12-22T09:16:27.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.387+0000 7f8cb9e77640 1 Processor -- start 2023-12-22T09:16:27.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.387+0000 7f8cb9e77640 1 -- start start 2023-12-22T09:16:27.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.388+0000 7f8cb9e77640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8cb4150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb9e77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb40c4bb0 0x7f8cb41ea600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb9e77640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb41eab40 0x7f8cb4153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb9e77640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4132cb0 con 0x7f8ca0004020 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb9e77640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb41321a0 con 0x7f8cb40c4bb0 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb9e77640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40c2c30 con 0x7f8cb41eab40 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8cb4150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8cb4150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49892/0 (socket says 172.21.15.106:49892) 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb37fe640 1 -- 172.21.15.106:0/109686961 learned_addr learned my addr 172.21.15.106:0/109686961 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb37fe640 1 -- 172.21.15.106:0/109686961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb41eab40 msgr2=0x7f8cb4153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb37fe640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb41eab40 0x7f8cb4153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb37fe640 1 -- 172.21.15.106:0/109686961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb40c4bb0 msgr2=0x7f8cb41ea600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb37fe640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb40c4bb0 0x7f8cb41ea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb37fe640 1 -- 172.21.15.106:0/109686961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb4132710 con 0x7f8ca0004020 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.389+0000 7f8cb37fe640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8cb4150d90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400f590 tx=0x7f8ca400fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.390+0000 7f8cb0ff9640 1 -- 172.21.15.106:0/109686961 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4005da0 con 0x7f8ca0004020 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.390+0000 7f8cb0ff9640 1 -- 172.21.15.106:0/109686961 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4006050 con 0x7f8ca0004020 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.390+0000 7f8cb0ff9640 1 -- 172.21.15.106:0/109686961 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40063e0 con 0x7f8ca0004020 2023-12-22T09:16:27.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.390+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb4135690 con 0x7f8ca0004020 2023-12-22T09:16:27.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.390+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb41329d0 con 0x7f8ca0004020 2023-12-22T09:16:27.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.391+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb4155ee0 con 0x7f8ca0004020 2023-12-22T09:16:27.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.392+0000 7f8cb0ff9640 1 -- 172.21.15.106:0/109686961 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ca4006540 con 0x7f8ca0004020 2023-12-22T09:16:27.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.393+0000 7f8cb0ff9640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c9406a460 0x7f8c9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.393+0000 7f8cb0ff9640 1 -- 172.21.15.106:0/109686961 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8ca40892d0 con 0x7f8ca0004020 2023-12-22T09:16:27.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.393+0000 7f8caaffd640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c9406a460 0x7f8c9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:27.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.394+0000 7f8caaffd640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c9406a460 0x7f8c9406c920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c033000 tx=0x7f8c9c02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:27.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.397+0000 7f8cb0ff9640 1 -- 172.21.15.106:0/109686961 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8ca40544b0 con 0x7f8ca0004020 2023-12-22T09:16:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.588+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cb4155c70 con 0x7f8ca0004020 2023-12-22T09:16:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.590+0000 7f8cb0ff9640 1 -- 172.21.15.106:0/109686961 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20070 (secure 0 0 0) 0x7f8ca4057ad0 con 0x7f8ca0004020 2023-12-22T09:16:27.590 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:27.590 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:11.243405+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c9406a460 msgr2=0x7f8c9406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c9406a460 0x7f8c9406c920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c033000 tx=0x7f8c9c02f000 comp rx=0 tx=0).stop 2023-12-22T09:16:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 msgr2=0x7f8cb4150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8cb4150d90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400f590 tx=0x7f8ca400fa50 comp rx=0 tx=0).stop 2023-12-22T09:16:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 shutdown_connections 2023-12-22T09:16:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8c9406a460 0x7f8c9406c920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8cb41eab40 0x7f8cb4153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cb40c4bb0 0x7f8cb41ea600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 --2- 172.21.15.106:0/109686961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ca0004020 0x7f8cb4150d90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 >> 172.21.15.106:0/109686961 conn(0x7f8cb40c5360 msgr2=0x7f8cb4072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 shutdown_connections 2023-12-22T09:16:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.592+0000 7f8cb9e77640 1 -- 172.21.15.106:0/109686961 wait complete. 2023-12-22T09:16:27.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:15:52.874302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:15:54.136774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-22T09:16:08.066634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-22T09:16:09.242570+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:16:27.613 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:16:27.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.830+0000 7f69f3e77640 1 Processor -- start 2023-12-22T09:16:27.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.830+0000 7f69f3e77640 1 -- start start 2023-12-22T09:16:27.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.832+0000 7f69f3e77640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69ec06dec0 0x7f69ec0c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.832+0000 7f69f3e77640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69ec070470 0x7f69ec06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.832+0000 7f69f3e77640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec071db0 con 0x7f69ec06b140 2023-12-22T09:16:27.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.832+0000 7f69f3e77640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec071180 con 0x7f69ec06dec0 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.832+0000 7f69f3e77640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec0c5790 con 0x7f69ec070470 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.832+0000 7f69f1c13640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69ec06dec0 0x7f69ec0c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.832+0000 7f69f2414640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f69ec06b140 0x7f69ec153e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51572/0 (socket says 172.21.15.106:51572) 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.832+0000 7f69f1c13640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69ec06dec0 0x7f69ec0c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49908/0 (socket says 172.21.15.106:49908) 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.832+0000 7f69f2414640 1 -- 172.21.15.106:0/1694152520 learned_addr learned my addr 172.21.15.106:0/1694152520 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.833+0000 7f69f0c11640 1 -- 172.21.15.106:0/1694152520 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422290810 0 0) 0x7f69ec071db0 con 0x7f69ec06b140 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.833+0000 7f69f0c11640 1 -- 172.21.15.106:0/1694152520 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d8003520 con 0x7f69ec06b140 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.833+0000 7f69f1c13640 1 -- 172.21.15.106:0/1694152520 >> v2:172.21.15.132:3300/0 conn(0x7f69ec070470 msgr2=0x7f69ec06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.833+0000 7f69f1c13640 1 --2- 172.21.15.106:0/1694152520 >> v2:172.21.15.132:3300/0 conn(0x7f69ec070470 0x7f69ec06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.833+0000 7f69f1c13640 1 -- 172.21.15.106:0/1694152520 >> v1:172.21.15.106:6789/0 conn(0x7f69ec06b140 legacy=0x7f69ec153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.833+0000 7f69f1c13640 1 -- 172.21.15.106:0/1694152520 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec072090 con 0x7f69ec06dec0 2023-12-22T09:16:27.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.834+0000 7f69f1c13640 1 --2- 172.21.15.106:0/1694152520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec06dec0 0x7f69ec0c44e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0716c0 tx=0x7f69e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce9f325330defa8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.834+0000 7f69f0c11640 1 -- 172.21.15.106:0/1694152520 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e802e070 con 0x7f69ec06dec0 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.834+0000 7f69f0c11640 1 -- 172.21.15.106:0/1694152520 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e80315a0 con 0x7f69ec06dec0 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.834+0000 7f69f0c11640 1 -- 172.21.15.106:0/1694152520 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8031930 con 0x7f69ec06dec0 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.835+0000 7f69f3e77640 1 -- 172.21.15.106:0/1694152520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec06dec0 msgr2=0x7f69ec0c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.835+0000 7f69f3e77640 1 --2- 172.21.15.106:0/1694152520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec06dec0 0x7f69ec0c44e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0716c0 tx=0x7f69e802b840 comp rx=0 tx=0).stop 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.835+0000 7f69f3e77640 1 -- 172.21.15.106:0/1694152520 shutdown_connections 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.835+0000 7f69f3e77640 1 --2- 172.21.15.106:0/1694152520 >> v2:172.21.15.132:3300/0 conn(0x7f69ec070470 0x7f69ec06ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.835+0000 7f69f3e77640 1 --2- 172.21.15.106:0/1694152520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec06dec0 0x7f69ec0c44e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.835+0000 7f69f3e77640 1 -- 172.21.15.106:0/1694152520 >> 172.21.15.106:0/1694152520 conn(0x7f69ec0c2680 msgr2=0x7f69ec0c2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.835+0000 7f69f3e77640 1 -- 172.21.15.106:0/1694152520 shutdown_connections 2023-12-22T09:16:27.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.835+0000 7f69f3e77640 1 -- 172.21.15.106:0/1694152520 wait complete. 2023-12-22T09:16:27.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.837+0000 7f69f3e77640 1 Processor -- start 2023-12-22T09:16:27.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.837+0000 7f69f3e77640 1 -- start start 2023-12-22T09:16:27.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f3e77640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69ec06b140 0x7f69ec157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f3e77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69ec06dec0 0x7f69ec1df050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f3e77640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec070470 0x7f69ec1df590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f3e77640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec072370 con 0x7f69ec070470 2023-12-22T09:16:27.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f3e77640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0bbdd0 con 0x7f69ec06dec0 2023-12-22T09:16:27.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f3e77640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec156350 con 0x7f69ec06b140 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f2414640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec070470 0x7f69ec1df590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f2414640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec070470 0x7f69ec1df590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49922/0 (socket says 172.21.15.106:49922) 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f2414640 1 -- 172.21.15.106:0/2455976038 learned_addr learned my addr 172.21.15.106:0/2455976038 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f2414640 1 -- 172.21.15.106:0/2455976038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69ec06b140 msgr2=0x7f69ec157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f2414640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69ec06b140 0x7f69ec157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f2414640 1 -- 172.21.15.106:0/2455976038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69ec06dec0 msgr2=0x7f69ec1df050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f1412640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69ec06dec0 0x7f69ec1df050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f2414640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69ec06dec0 0x7f69ec1df050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.838+0000 7f69f2414640 1 -- 172.21.15.106:0/2455976038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8009400 con 0x7f69ec070470 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.839+0000 7f69f2414640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec070470 0x7f69ec1df590 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f69e400cb40 tx=0x7f69e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.839+0000 7f69e27fc640 1 -- 172.21.15.106:0/2455976038 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e400aca0 con 0x7f69ec070470 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.839+0000 7f69e27fc640 1 -- 172.21.15.106:0/2455976038 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e400ae00 con 0x7f69ec070470 2023-12-22T09:16:27.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.839+0000 7f69e27fc640 1 -- 172.21.15.106:0/2455976038 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4012620 con 0x7f69ec070470 2023-12-22T09:16:27.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.839+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec158140 con 0x7f69ec070470 2023-12-22T09:16:27.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.839+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec0be260 con 0x7f69ec070470 2023-12-22T09:16:27.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.840+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec073f10 con 0x7f69ec070470 2023-12-22T09:16:27.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.841+0000 7f69e27fc640 1 -- 172.21.15.106:0/2455976038 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f69e4007070 con 0x7f69ec070470 2023-12-22T09:16:27.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.842+0000 7f69e27fc640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f69d006a460 0x7f69d006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:27.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.842+0000 7f69e27fc640 1 -- 172.21.15.106:0/2455976038 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f69e4088e00 con 0x7f69ec070470 2023-12-22T09:16:27.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.842+0000 7f69f1c13640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f69d006a460 0x7f69d006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:27.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.843+0000 7f69f1c13640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f69d006a460 0x7f69d006c920 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f69e8036000 tx=0x7f69e8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:27.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:27.846+0000 7f69e27fc640 1 -- 172.21.15.106:0/2455976038 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f69e4053f40 con 0x7f69ec070470 2023-12-22T09:16:28.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.036+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69ec1ded70 con 0x7f69ec070470 2023-12-22T09:16:28.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.037+0000 7f69e27fc640 1 -- 172.21.15.106:0/2455976038 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69ec1ded70 con 0x7f69ec070470 2023-12-22T09:16:28.037 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f69d006a460 msgr2=0x7f69d006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f69d006a460 0x7f69d006c920 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f69e8036000 tx=0x7f69e8030000 comp rx=0 tx=0).stop 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec070470 msgr2=0x7f69ec1df590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec070470 0x7f69ec1df590 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f69e400cb40 tx=0x7f69e400a060 comp rx=0 tx=0).stop 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 shutdown_connections 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f69d006a460 0x7f69d006c920 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec070470 0x7f69ec1df590 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69ec06dec0 0x7f69ec1df050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 --2- 172.21.15.106:0/2455976038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69ec06b140 0x7f69ec157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 >> 172.21.15.106:0/2455976038 conn(0x7f69ec0c2680 msgr2=0x7f69ec151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 shutdown_connections 2023-12-22T09:16:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.040+0000 7f69f3e77640 1 -- 172.21.15.106:0/2455976038 wait complete. 2023-12-22T09:16:28.059 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:16:28.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.264+0000 7faa0efe0640 1 Processor -- start 2023-12-22T09:16:28.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.264+0000 7faa0efe0640 1 -- start start 2023-12-22T09:16:28.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.265+0000 7faa0efe0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faa080c12a0 0x7faa08071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.265+0000 7faa0efe0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa080c1b50 con 0x7faa080bfda0 2023-12-22T09:16:28.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.265+0000 7faa0efe0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa08158350 con 0x7faa08152420 2023-12-22T09:16:28.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.265+0000 7faa0efe0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa080709e0 con 0x7faa080c12a0 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.266+0000 7faa0d57d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faa080bfda0 0x7faa080c01d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51582/0 (socket says 172.21.15.106:51582) 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.266+0000 7faa0d57d640 1 -- 172.21.15.106:0/670577667 learned_addr learned my addr 172.21.15.106:0/670577667 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.266+0000 7faa07fff640 1 --2- 172.21.15.106:0/670577667 >> v2:172.21.15.132:3300/0 conn(0x7faa080c12a0 0x7faa08071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.266+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549083862 0 0) 0x7faa080c1b50 con 0x7faa080bfda0 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.266+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f0003520 con 0x7faa080bfda0 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148499658 0 0) 0x7fa9f0003520 con 0x7faa080bfda0 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 >> v2:172.21.15.132:3300/0 conn(0x7faa080c12a0 msgr2=0x7faa08071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 --2- 172.21.15.106:0/670577667 >> v2:172.21.15.132:3300/0 conn(0x7faa080c12a0 0x7faa08071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 >> v1:172.21.15.132:6789/0 conn(0x7faa08152420 legacy=0x7faa080c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa08158630 con 0x7faa080bfda0 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7faa000019f0 con 0x7faa080bfda0 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 >> v1:172.21.15.106:6789/0 conn(0x7faa080bfda0 legacy=0x7faa080c01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9f0003970 0x7fa9f0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9f0004370 0x7fa9f0004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7fa9f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f000bff0 con 0x7fa9f00050e0 2023-12-22T09:16:28.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f000c160 con 0x7fa9f0004370 2023-12-22T09:16:28.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f000c320 con 0x7fa9f0003970 2023-12-22T09:16:28.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa0d57d640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7fa9f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.267+0000 7faa07fff640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9f0004370 0x7fa9f0004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.268+0000 7faa0cd7c640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9f0003970 0x7fa9f0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.268+0000 7faa0d57d640 1 -- 172.21.15.106:0/670577667 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9f0003970 msgr2=0x7fa9f0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.268+0000 7faa0d57d640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9f0003970 0x7fa9f0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.268+0000 7faa0d57d640 1 -- 172.21.15.106:0/670577667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9f0004370 msgr2=0x7fa9f0004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.268+0000 7faa0d57d640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9f0004370 0x7fa9f0004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.268+0000 7faa0d57d640 1 -- 172.21.15.106:0/670577667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0003520 con 0x7fa9f00050e0 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.268+0000 7faa0cd7c640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9f0003970 0x7fa9f0003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.269+0000 7faa0d57d640 1 -- 172.21.15.106:0/670577667 reap_dead start 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.269+0000 7faa0d57d640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7fa9f000b980 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7faa0000a840 tx=0x7fa9f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ce6a25e1fd713d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.269+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0002cea0 con 0x7fa9f00050e0 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.269+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0002f070 con 0x7fa9f00050e0 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.269+0000 7faa077fe640 1 -- 172.21.15.106:0/670577667 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000348b0 con 0x7fa9f00050e0 2023-12-22T09:16:28.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.269+0000 7faa0efe0640 1 -- 172.21.15.106:0/670577667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 msgr2=0x7fa9f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.269+0000 7faa0efe0640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7fa9f000b980 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7faa0000a840 tx=0x7fa9f00057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.270+0000 7faa0efe0640 1 -- 172.21.15.106:0/670577667 shutdown_connections 2023-12-22T09:16:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.270+0000 7faa0efe0640 1 --2- 172.21.15.106:0/670577667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7fa9f000b980 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.270+0000 7faa0efe0640 1 -- 172.21.15.106:0/670577667 >> 172.21.15.106:0/670577667 conn(0x7faa0806a220 msgr2=0x7faa080c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.270+0000 7faa0efe0640 1 -- 172.21.15.106:0/670577667 shutdown_connections 2023-12-22T09:16:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.270+0000 7faa0efe0640 1 -- 172.21.15.106:0/670577667 wait complete. 2023-12-22T09:16:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.271+0000 7faa0efe0640 1 Processor -- start 2023-12-22T09:16:28.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.272+0000 7faa0efe0640 1 -- start start 2023-12-22T09:16:28.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0efe0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7faa080bb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0efe0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa08152990 0x7faa0815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0efe0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa08152ee0 0x7faa081ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0efe0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa081558c0 con 0x7fa9f00050e0 2023-12-22T09:16:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0efe0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa080bb910 con 0x7faa08152ee0 2023-12-22T09:16:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0efe0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa081555e0 con 0x7faa08152990 2023-12-22T09:16:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0cd7c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7faa080bb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0cd7c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7faa080bb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49930/0 (socket says 172.21.15.106:49930) 2023-12-22T09:16:28.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0cd7c640 1 -- 172.21.15.106:0/1256536311 learned_addr learned my addr 172.21.15.106:0/1256536311 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:28.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0cd7c640 1 -- 172.21.15.106:0/1256536311 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa08152990 msgr2=0x7faa0815b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0cd7c640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa08152990 0x7faa0815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0cd7c640 1 -- 172.21.15.106:0/1256536311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa08152ee0 msgr2=0x7faa081ecbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0cd7c640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa08152ee0 0x7faa081ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.273+0000 7faa0cd7c640 1 -- 172.21.15.106:0/1256536311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa080ba6b0 con 0x7fa9f00050e0 2023-12-22T09:16:28.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.274+0000 7faa0cd7c640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7faa080bb3d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00d820 tx=0x7fa9fc00dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:28.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.274+0000 7faa057fa640 1 -- 172.21.15.106:0/1256536311 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc017070 con 0x7fa9f00050e0 2023-12-22T09:16:28.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.274+0000 7faa057fa640 1 -- 172.21.15.106:0/1256536311 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc00de10 con 0x7fa9f00050e0 2023-12-22T09:16:28.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.274+0000 7faa057fa640 1 -- 172.21.15.106:0/1256536311 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0054a0 con 0x7fa9f00050e0 2023-12-22T09:16:28.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.274+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa080ba990 con 0x7fa9f00050e0 2023-12-22T09:16:28.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.274+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0815bf20 con 0x7fa9f00050e0 2023-12-22T09:16:28.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.275+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa080af970 con 0x7fa9f00050e0 2023-12-22T09:16:28.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.276+0000 7faa057fa640 1 -- 172.21.15.106:0/1256536311 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa9fc007030 con 0x7fa9f00050e0 2023-12-22T09:16:28.277 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.277+0000 7faa057fa640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa9f406a460 0x7fa9f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.277 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.277+0000 7faa057fa640 1 -- 172.21.15.106:0/1256536311 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa9fc088650 con 0x7fa9f00050e0 2023-12-22T09:16:28.277 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.278+0000 7faa07fff640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa9f406a460 0x7fa9f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.278+0000 7faa07fff640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa9f406a460 0x7fa9f406c920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa080bf740 tx=0x7fa9f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:28.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.282+0000 7faa057fa640 1 -- 172.21.15.106:0/1256536311 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa9fc053790 con 0x7fa9f00050e0 2023-12-22T09:16:28.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.470+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa080ba510 con 0x7fa9f00050e0 2023-12-22T09:16:28.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.472+0000 7faa057fa640 1 -- 172.21.15.106:0/1256536311 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa080ba510 con 0x7fa9f00050e0 2023-12-22T09:16:28.471 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa9f406a460 msgr2=0x7fa9f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa9f406a460 0x7fa9f406c920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa080bf740 tx=0x7fa9f8008040 comp rx=0 tx=0).stop 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 msgr2=0x7faa080bb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7faa080bb3d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00d820 tx=0x7fa9fc00dce0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 shutdown_connections 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa9f406a460 0x7fa9f406c920 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa08152ee0 0x7faa081ecbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa08152990 0x7faa0815b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 --2- 172.21.15.106:0/1256536311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9f00050e0 0x7faa080bb3d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 >> 172.21.15.106:0/1256536311 conn(0x7faa0806a220 msgr2=0x7faa08150a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:28.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 shutdown_connections 2023-12-22T09:16:28.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.474+0000 7faa0efe0640 1 -- 172.21.15.106:0/1256536311 wait complete. 2023-12-22T09:16:28.492 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:16:28.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.708+0000 7fb247057640 1 Processor -- start 2023-12-22T09:16:28.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.709+0000 7fb247057640 1 -- start start 2023-12-22T09:16:28.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.710+0000 7fb247057640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2400c7640 0x7fb2400c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.710+0000 7fb247057640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2400c4560 con 0x7fb2400c6150 2023-12-22T09:16:28.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.710+0000 7fb247057640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb240154720 con 0x7fb24006ca00 2023-12-22T09:16:28.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.710+0000 7fb247057640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2400c4f90 con 0x7fb2400c7640 2023-12-22T09:16:28.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.710+0000 7fb23ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2400c7640 0x7fb2400c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.710+0000 7fb23ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2400c7640 0x7fb2400c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49938/0 (socket says 172.21.15.106:49938) 2023-12-22T09:16:28.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.710+0000 7fb244df3640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb2400c6150 0x7fb24006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51596/0 (socket says 172.21.15.106:51596) 2023-12-22T09:16:28.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.710+0000 7fb23ffff640 1 -- 172.21.15.106:0/1245169528 learned_addr learned my addr 172.21.15.106:0/1245169528 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:28.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.711+0000 7fb23ffff640 1 -- 172.21.15.106:0/1245169528 >> v1:172.21.15.132:6789/0 conn(0x7fb24006ca00 legacy=0x7fb24006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:28.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.711+0000 7fb23ffff640 1 -- 172.21.15.106:0/1245169528 >> v1:172.21.15.106:6789/0 conn(0x7fb2400c6150 legacy=0x7fb24006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.711+0000 7fb23ffff640 1 -- 172.21.15.106:0/1245169528 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240154c50 con 0x7fb2400c7640 2023-12-22T09:16:28.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.712+0000 7fb23ffff640 1 --2- 172.21.15.106:0/1245169528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 0x7fb2400c6530 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb228009870 tx=0x7fb22802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5fe67b7aad98d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:28.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.712+0000 7fb23f7fe640 1 -- 172.21.15.106:0/1245169528 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2280317e0 con 0x7fb2400c7640 2023-12-22T09:16:28.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.712+0000 7fb23f7fe640 1 -- 172.21.15.106:0/1245169528 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb228031940 con 0x7fb2400c7640 2023-12-22T09:16:28.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.712+0000 7fb23f7fe640 1 -- 172.21.15.106:0/1245169528 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228031cd0 con 0x7fb2400c7640 2023-12-22T09:16:28.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.713+0000 7fb247057640 1 -- 172.21.15.106:0/1245169528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 msgr2=0x7fb2400c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.713+0000 7fb247057640 1 --2- 172.21.15.106:0/1245169528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 0x7fb2400c6530 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb228009870 tx=0x7fb22802b880 comp rx=0 tx=0).stop 2023-12-22T09:16:28.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.713+0000 7fb247057640 1 -- 172.21.15.106:0/1245169528 shutdown_connections 2023-12-22T09:16:28.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.713+0000 7fb247057640 1 --2- 172.21.15.106:0/1245169528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 0x7fb2400c6530 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.713+0000 7fb247057640 1 -- 172.21.15.106:0/1245169528 >> 172.21.15.106:0/1245169528 conn(0x7fb2400ab330 msgr2=0x7fb2400ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:28.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.713+0000 7fb247057640 1 -- 172.21.15.106:0/1245169528 shutdown_connections 2023-12-22T09:16:28.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.713+0000 7fb247057640 1 -- 172.21.15.106:0/1245169528 wait complete. 2023-12-22T09:16:28.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.715+0000 7fb247057640 1 Processor -- start 2023-12-22T09:16:28.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.715+0000 7fb247057640 1 -- start start 2023-12-22T09:16:28.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb247057640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb24006ca00 0x7fb240150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb247057640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c6150 0x7fb24014b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb247057640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 0x7fb24014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb247057640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400c21a0 con 0x7fb2400c7640 2023-12-22T09:16:28.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb247057640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400c0d00 con 0x7fb2400c6150 2023-12-22T09:16:28.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb247057640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400c3450 con 0x7fb24006ca00 2023-12-22T09:16:28.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb2455f4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 0x7fb24014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb2455f4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 0x7fb24014bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49950/0 (socket says 172.21.15.106:49950) 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb2455f4640 1 -- 172.21.15.106:0/3990551861 learned_addr learned my addr 172.21.15.106:0/3990551861 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.716+0000 7fb23ffff640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c6150 0x7fb24014b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb2455f4640 1 -- 172.21.15.106:0/3990551861 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb24006ca00 msgr2=0x7fb240150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb2455f4640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb24006ca00 0x7fb240150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb2455f4640 1 -- 172.21.15.106:0/3990551861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c6150 msgr2=0x7fb24014b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb2455f4640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c6150 0x7fb24014b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb2455f4640 1 -- 172.21.15.106:0/3990551861 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280094d0 con 0x7fb2400c7640 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb23ffff640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c6150 0x7fb24014b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb2455f4640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 0x7fb24014bed0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb23800b440 tx=0x7fb23800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb23d7fa640 1 -- 172.21.15.106:0/3990551861 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238011830 con 0x7fb2400c7640 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb23d7fa640 1 -- 172.21.15.106:0/3990551861 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238011990 con 0x7fb2400c7640 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb23d7fa640 1 -- 172.21.15.106:0/3990551861 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238011d40 con 0x7fb2400c7640 2023-12-22T09:16:28.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2400c3730 con 0x7fb2400c7640 2023-12-22T09:16:28.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.717+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2401505a0 con 0x7fb2400c7640 2023-12-22T09:16:28.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.718+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2400c3920 con 0x7fb2400c7640 2023-12-22T09:16:28.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.719+0000 7fb23d7fa640 1 -- 172.21.15.106:0/3990551861 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb238004020 con 0x7fb2400c7640 2023-12-22T09:16:28.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.721+0000 7fb23d7fa640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb22006a430 0x7fb22006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:28.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.721+0000 7fb23d7fa640 1 -- 172.21.15.106:0/3990551861 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb238088870 con 0x7fb2400c7640 2023-12-22T09:16:28.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.721+0000 7fb244df3640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb22006a430 0x7fb22006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.722+0000 7fb244df3640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb22006a430 0x7fb22006c8f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb230007fd0 tx=0x7fb230007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:28.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.725+0000 7fb23d7fa640 1 -- 172.21.15.106:0/3990551861 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb2380539c0 con 0x7fb2400c7640 2023-12-22T09:16:28.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.917+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb240073f10 con 0x7fb2400c7640 2023-12-22T09:16:28.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.917+0000 7fb23d7fa640 1 -- 172.21.15.106:0/3990551861 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb238056fe0 con 0x7fb2400c7640 2023-12-22T09:16:28.917 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:28.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb22006a430 msgr2=0x7fb22006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb22006a430 0x7fb22006c8f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb230007fd0 tx=0x7fb230007d80 comp rx=0 tx=0).stop 2023-12-22T09:16:28.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 msgr2=0x7fb24014bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:28.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 0x7fb24014bed0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb23800b440 tx=0x7fb23800b900 comp rx=0 tx=0).stop 2023-12-22T09:16:28.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 shutdown_connections 2023-12-22T09:16:28.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb22006a430 0x7fb22006c8f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2400c7640 0x7fb24014bed0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2400c6150 0x7fb24014b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 --2- 172.21.15.106:0/3990551861 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb24006ca00 0x7fb240150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:28.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 >> 172.21.15.106:0/3990551861 conn(0x7fb2400ab330 msgr2=0x7fb240153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:28.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 shutdown_connections 2023-12-22T09:16:28.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:28.920+0000 7fb247057640 1 -- 172.21.15.106:0/3990551861 wait complete. 2023-12-22T09:16:28.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-22T09:16:29.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.159+0000 7f4541c79640 1 Processor -- start 2023-12-22T09:16:29.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.159+0000 7f4541c79640 1 -- start start 2023-12-22T09:16:29.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.161+0000 7f4541c79640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f453c0bfb40 0x7f453c0a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.161+0000 7f4541c79640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c1550b0 con 0x7f453c0a8360 2023-12-22T09:16:29.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.161+0000 7f4541c79640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c155390 con 0x7f453c0c0050 2023-12-22T09:16:29.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.161+0000 7f4541c79640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c0a93d0 con 0x7f453c0bfb40 2023-12-22T09:16:29.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.161+0000 7f4540c77640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f453c0a8360 0x7f453c151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51602/0 (socket says 172.21.15.106:51602) 2023-12-22T09:16:29.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.161+0000 7f4540c77640 1 -- 172.21.15.106:0/3556669376 learned_addr learned my addr 172.21.15.106:0/3556669376 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453bfff640 1 --2- 172.21.15.106:0/3556669376 >> v2:172.21.15.132:3300/0 conn(0x7f453c0bfb40 0x7f453c0a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283935886 0 0) 0x7f453c1550b0 con 0x7f453c0a8360 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f452c003520 con 0x7f453c0a8360 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2733797190 0 0) 0x7f452c003520 con 0x7f453c0a8360 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 >> v2:172.21.15.132:3300/0 conn(0x7f453c0bfb40 msgr2=0x7f453c0a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 --2- 172.21.15.106:0/3556669376 >> v2:172.21.15.132:3300/0 conn(0x7f453c0bfb40 0x7f453c0a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 >> v1:172.21.15.132:6789/0 conn(0x7f453c0c0050 legacy=0x7f453c152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c155670 con 0x7f453c0a8360 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f4530001670 con 0x7f453c0a8360 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 >> v1:172.21.15.106:6789/0 conn(0x7f453c0a8360 legacy=0x7f453c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0039c0 0x7f452c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f452c0047c0 0x7f452c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f452c0052a0 0x7f452c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0a93d0 con 0x7f452c0047c0 2023-12-22T09:16:29.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c00c1a0 con 0x7f452c0039c0 2023-12-22T09:16:29.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.162+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c00c360 con 0x7f452c0052a0 2023-12-22T09:16:29.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.163+0000 7f453bfff640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f452c0047c0 0x7f452c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.163+0000 7f453bfff640 1 -- 172.21.15.106:0/3556669376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f452c0052a0 msgr2=0x7f452c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:29.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.163+0000 7f453bfff640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f452c0052a0 0x7f452c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.163+0000 7f453bfff640 1 -- 172.21.15.106:0/3556669376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0039c0 msgr2=0x7f452c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:29.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.163+0000 7f4540c77640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0039c0 0x7f452c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.163+0000 7f453bfff640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0039c0 0x7f452c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.163+0000 7f453bfff640 1 -- 172.21.15.106:0/3556669376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c003520 con 0x7f452c0047c0 2023-12-22T09:16:29.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.163+0000 7f4541478640 1 -- 172.21.15.106:0/3556669376 reap_dead start 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.163+0000 7f4540c77640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0039c0 0x7f452c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.164+0000 7f453bfff640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f452c0047c0 0x7f452c004c40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4528009ac0 tx=0x7f452c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eac74063d394ee8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452802c6d0 con 0x7f452c0047c0 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452802c830 con 0x7f452c0047c0 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f453b7fe640 1 -- 172.21.15.106:0/3556669376 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452802cbc0 con 0x7f452c0047c0 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f4541c79640 1 -- 172.21.15.106:0/3556669376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f452c0047c0 msgr2=0x7f452c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f4541c79640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f452c0047c0 0x7f452c004c40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4528009ac0 tx=0x7f452c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f4541c79640 1 -- 172.21.15.106:0/3556669376 shutdown_connections 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f4541c79640 1 --2- 172.21.15.106:0/3556669376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f452c0047c0 0x7f452c004c40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f4541c79640 1 -- 172.21.15.106:0/3556669376 >> 172.21.15.106:0/3556669376 conn(0x7f453c069bf0 msgr2=0x7f453c069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f4541c79640 1 -- 172.21.15.106:0/3556669376 shutdown_connections 2023-12-22T09:16:29.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.165+0000 7f4541c79640 1 -- 172.21.15.106:0/3556669376 wait complete. 2023-12-22T09:16:29.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.167+0000 7f4541c79640 1 Processor -- start 2023-12-22T09:16:29.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.167+0000 7f4541c79640 1 -- start start 2023-12-22T09:16:29.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.168+0000 7f4541c79640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0047c0 0x7f453c13fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.168+0000 7f4541c79640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c0c3f60 0x7f453c13f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.168+0000 7f4541c79640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f453c1e88c0 0x7f453c1e8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.168+0000 7f4541c79640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c1e9280 con 0x7f453c0c3f60 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.168+0000 7f4541c79640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c1403d0 con 0x7f452c0047c0 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.168+0000 7f4541c79640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c1406b0 con 0x7f453c1e88c0 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.168+0000 7f453bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c0c3f60 0x7f453c13f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.168+0000 7f453bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c0c3f60 0x7f453c13f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49968/0 (socket says 172.21.15.106:49968) 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.168+0000 7f453bfff640 1 -- 172.21.15.106:0/193416576 learned_addr learned my addr 172.21.15.106:0/193416576 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.169+0000 7f4540c77640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0047c0 0x7f453c13fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.169+0000 7f4541478640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f453c1e88c0 0x7f453c1e8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.169+0000 7f453bfff640 1 -- 172.21.15.106:0/193416576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f453c1e88c0 msgr2=0x7f453c1e8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.169+0000 7f453bfff640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f453c1e88c0 0x7f453c1e8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.169+0000 7f453bfff640 1 -- 172.21.15.106:0/193416576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0047c0 msgr2=0x7f453c13fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.169+0000 7f453bfff640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0047c0 0x7f453c13fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.169+0000 7f453bfff640 1 -- 172.21.15.106:0/193416576 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c140990 con 0x7f453c0c3f60 2023-12-22T09:16:29.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.169+0000 7f4540c77640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0047c0 0x7f453c13fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:29.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.169+0000 7f453bfff640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c0c3f60 0x7f453c13f440 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4528009ac0 tx=0x7f4528004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:29.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.170+0000 7f45397fa640 1 -- 172.21.15.106:0/193416576 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528003810 con 0x7f453c0c3f60 2023-12-22T09:16:29.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.170+0000 7f45397fa640 1 -- 172.21.15.106:0/193416576 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4528003970 con 0x7f453c0c3f60 2023-12-22T09:16:29.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.170+0000 7f45397fa640 1 -- 172.21.15.106:0/193416576 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528003d00 con 0x7f453c0c3f60 2023-12-22T09:16:29.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.170+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c140c70 con 0x7f453c0c3f60 2023-12-22T09:16:29.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.170+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c13f980 con 0x7f453c0c3f60 2023-12-22T09:16:29.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.171+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c04e8d0 con 0x7f453c0c3f60 2023-12-22T09:16:29.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.172+0000 7f45397fa640 1 -- 172.21.15.106:0/193416576 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4528040450 con 0x7f453c0c3f60 2023-12-22T09:16:29.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.173+0000 7f45397fa640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452006a460 0x7f452006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.173+0000 7f45397fa640 1 -- 172.21.15.106:0/193416576 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f45280aade0 con 0x7f453c0c3f60 2023-12-22T09:16:29.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.173+0000 7f4540c77640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452006a460 0x7f452006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.173+0000 7f4540c77640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452006a460 0x7f452006c920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4530001200 tx=0x7f4530009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:29.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.177+0000 7f45397fa640 1 -- 172.21.15.106:0/193416576 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4528075e90 con 0x7f453c0c3f60 2023-12-22T09:16:29.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.365+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f453c0c5cb0 con 0x7f453c0c3f60 2023-12-22T09:16:29.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.366+0000 7f45397fa640 1 -- 172.21.15.106:0/193416576 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f45280044e0 con 0x7f453c0c3f60 2023-12-22T09:16:29.365 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:29.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452006a460 msgr2=0x7f452006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452006a460 0x7f452006c920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4530001200 tx=0x7f4530009040 comp rx=0 tx=0).stop 2023-12-22T09:16:29.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c0c3f60 msgr2=0x7f453c13f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c0c3f60 0x7f453c13f440 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4528009ac0 tx=0x7f4528004730 comp rx=0 tx=0).stop 2023-12-22T09:16:29.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 shutdown_connections 2023-12-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f452006a460 0x7f452006c920 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f453c1e88c0 0x7f453c1e8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c0c3f60 0x7f453c13f440 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 --2- 172.21.15.106:0/193416576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452c0047c0 0x7f453c13fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 >> 172.21.15.106:0/193416576 conn(0x7f453c069bf0 msgr2=0x7f453c0c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 shutdown_connections 2023-12-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.368+0000 7f4541c79640 1 -- 172.21.15.106:0/193416576 wait complete. 2023-12-22T09:16:29.387 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-22T09:16:29.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.603+0000 7fb0aa041640 1 Processor -- start 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.603+0000 7fb0aa041640 1 -- start start 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.605+0000 7fb0aa041640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb0a414dfe0 0x7fb0a4154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.605+0000 7fb0aa041640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0a4151760 0x7fb0a40a8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.605+0000 7fb0aa041640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a4150cc0 con 0x7fb0a40a88a0 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.605+0000 7fb0aa041640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a4150ab0 con 0x7fb0a414dfe0 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.605+0000 7fb0aa041640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4072130 con 0x7fb0a4151760 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.605+0000 7fb0a3fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb0a40a88a0 0x7fb0a40c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51616/0 (socket says 172.21.15.106:51616) 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.605+0000 7fb0a3fff640 1 -- 172.21.15.106:0/4156737275 learned_addr learned my addr 172.21.15.106:0/4156737275 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a37fe640 1 --2- 172.21.15.106:0/4156737275 >> v2:172.21.15.132:3300/0 conn(0x7fb0a414dfe0 0x7fb0a4154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a2ffd640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0a4151760 0x7fb0a40a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596765671 0 0) 0x7fb0a4150cc0 con 0x7fb0a40a88a0 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb08c003520 con 0x7fb0a40a88a0 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1246441567 0 0) 0x7fb08c003520 con 0x7fb0a40a88a0 2023-12-22T09:16:29.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0a4151760 msgr2=0x7fb0a40a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0a4151760 0x7fb0a40a8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 >> v2:172.21.15.132:3300/0 conn(0x7fb0a414dfe0 msgr2=0x7fb0a4154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 --2- 172.21.15.106:0/4156737275 >> v2:172.21.15.132:3300/0 conn(0x7fb0a414dfe0 0x7fb0a4154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4154ff0 con 0x7fb0a40a88a0 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fb09c0019f0 con 0x7fb0a40a88a0 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 >> v1:172.21.15.106:6789/0 conn(0x7fb0a40a88a0 legacy=0x7fb0a40c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08c003970 0x7fb08c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c0047c0 0x7fb08c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08c005180 0x7fb08c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4150ab0 con 0x7fb08c0047c0 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4072130 con 0x7fb08c005180 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.606+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c00bf40 con 0x7fb08c003970 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.607+0000 7fb0a2ffd640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c0047c0 0x7fb08c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.607+0000 7fb0a2ffd640 1 -- 172.21.15.106:0/4156737275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08c003970 msgr2=0x7fb08c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:29.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.607+0000 7fb0a2ffd640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08c003970 0x7fb08c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.607+0000 7fb0a2ffd640 1 -- 172.21.15.106:0/4156737275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08c005180 msgr2=0x7fb08c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:29.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.607+0000 7fb0a2ffd640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08c005180 0x7fb08c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.607+0000 7fb0a2ffd640 1 -- 172.21.15.106:0/4156737275 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c003520 con 0x7fb08c0047c0 2023-12-22T09:16:29.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.608+0000 7fb0a2ffd640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c0047c0 0x7fb08c004c40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40c18e0 tx=0x7fb08c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a91ddbc52ca6f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.608+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09802c550 con 0x7fb08c0047c0 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.608+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09802c6b0 con 0x7fb08c0047c0 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.608+0000 7fb0a27fc640 1 -- 172.21.15.106:0/4156737275 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09802ca60 con 0x7fb08c0047c0 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.609+0000 7fb0aa041640 1 -- 172.21.15.106:0/4156737275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c0047c0 msgr2=0x7fb08c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.609+0000 7fb0aa041640 1 --2- 172.21.15.106:0/4156737275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c0047c0 0x7fb08c004c40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40c18e0 tx=0x7fb08c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.609+0000 7fb0a3fff640 1 -- 172.21.15.106:0/4156737275 reap_dead start 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.609+0000 7fb0aa041640 1 -- 172.21.15.106:0/4156737275 shutdown_connections 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.609+0000 7fb0aa041640 1 -- 172.21.15.106:0/4156737275 >> 172.21.15.106:0/4156737275 conn(0x7fb0a4069dd0 msgr2=0x7fb0a406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.609+0000 7fb0aa041640 1 -- 172.21.15.106:0/4156737275 shutdown_connections 2023-12-22T09:16:29.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.609+0000 7fb0aa041640 1 -- 172.21.15.106:0/4156737275 wait complete. 2023-12-22T09:16:29.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.611+0000 7fb0aa041640 1 Processor -- start 2023-12-22T09:16:29.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.611+0000 7fb0aa041640 1 -- start start 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0aa041640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08c0047c0 0x7fb0a414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0aa041640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0a4149480 0x7fb0a40c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0aa041640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0a40c5140 0x7fb0a4147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0aa041640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4149b00 con 0x7fb0a4149480 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0aa041640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c55f0 con 0x7fb08c0047c0 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0aa041640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c5dc0 con 0x7fb0a40c5140 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0a2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0a4149480 0x7fb0a40c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0a2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0a4149480 0x7fb0a40c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49988/0 (socket says 172.21.15.106:49988) 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0a2ffd640 1 -- 172.21.15.106:0/1861426548 learned_addr learned my addr 172.21.15.106:0/1861426548 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:29.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0a2ffd640 1 -- 172.21.15.106:0/1861426548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0a40c5140 msgr2=0x7fb0a4147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0a2ffd640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0a40c5140 0x7fb0a4147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.612+0000 7fb0a37fe640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08c0047c0 0x7fb0a414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.613+0000 7fb0a2ffd640 1 -- 172.21.15.106:0/1861426548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08c0047c0 msgr2=0x7fb0a414b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.613+0000 7fb0a2ffd640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08c0047c0 0x7fb0a414b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.613+0000 7fb0a2ffd640 1 -- 172.21.15.106:0/1861426548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a41e9a10 con 0x7fb0a4149480 2023-12-22T09:16:29.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.613+0000 7fb0a2ffd640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0a4149480 0x7fb0a40c4c00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb09802c0f0 tx=0x7fb098004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:29.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.613+0000 7fb08bfff640 1 -- 172.21.15.106:0/1861426548 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098034990 con 0x7fb0a4149480 2023-12-22T09:16:29.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.613+0000 7fb08bfff640 1 -- 172.21.15.106:0/1861426548 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb098034af0 con 0x7fb0a4149480 2023-12-22T09:16:29.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.613+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a414bd10 con 0x7fb0a4149480 2023-12-22T09:16:29.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.613+0000 7fb08bfff640 1 -- 172.21.15.106:0/1861426548 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098034ea0 con 0x7fb0a4149480 2023-12-22T09:16:29.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.613+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a40c60a0 con 0x7fb0a4149480 2023-12-22T09:16:29.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.614+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a4073f10 con 0x7fb0a4149480 2023-12-22T09:16:29.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.615+0000 7fb08bfff640 1 -- 172.21.15.106:0/1861426548 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb098040450 con 0x7fb0a4149480 2023-12-22T09:16:29.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.616+0000 7fb08bfff640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb09006a460 0x7fb09006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:29.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.616+0000 7fb08bfff640 1 -- 172.21.15.106:0/1861426548 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb0980aabb0 con 0x7fb0a4149480 2023-12-22T09:16:29.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.616+0000 7fb0a37fe640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb09006a460 0x7fb09006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:29.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.617+0000 7fb0a37fe640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb09006a460 0x7fb09006c920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb0a414a0c0 tx=0x7fb094008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.621+0000 7fb08bfff640 1 -- 172.21.15.106:0/1861426548 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb098075c70 con 0x7fb0a4149480 2023-12-22T09:16:29.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.810+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb0a4070c70 con 0x7fb0a4149480 2023-12-22T09:16:29.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.811+0000 7fb08bfff640 1 -- 172.21.15.106:0/1861426548 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb098079290 con 0x7fb0a4149480 2023-12-22T09:16:29.811 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:29.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.813+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb09006a460 msgr2=0x7fb09006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.813+0000 7fb0aa041640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb09006a460 0x7fb09006c920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb0a414a0c0 tx=0x7fb094008040 comp rx=0 tx=0).stop 2023-12-22T09:16:29.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.813+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0a4149480 msgr2=0x7fb0a40c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:29.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.813+0000 7fb0aa041640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0a4149480 0x7fb0a40c4c00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb09802c0f0 tx=0x7fb098004730 comp rx=0 tx=0).stop 2023-12-22T09:16:29.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.814+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 shutdown_connections 2023-12-22T09:16:29.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.814+0000 7fb0aa041640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb09006a460 0x7fb09006c920 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.814+0000 7fb0aa041640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb0a40c5140 0x7fb0a4147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.814+0000 7fb0aa041640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0a4149480 0x7fb0a40c4c00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.814+0000 7fb0aa041640 1 --2- 172.21.15.106:0/1861426548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08c0047c0 0x7fb0a414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:29.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.814+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 >> 172.21.15.106:0/1861426548 conn(0x7fb0a4069dd0 msgr2=0x7fb0a406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:29.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.814+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 shutdown_connections 2023-12-22T09:16:29.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:29.814+0000 7fb0aa041640 1 -- 172.21.15.106:0/1861426548 wait complete. 2023-12-22T09:16:29.833 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T09:16:30.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.043+0000 7f5c7359e640 1 Processor -- start 2023-12-22T09:16:30.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.044+0000 7f5c7359e640 1 -- start start 2023-12-22T09:16:30.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.045+0000 7f5c7359e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c740c16f0 0x7f5c7406c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.045+0000 7f5c7359e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c740bfdb0 0x7f5c74157760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.045+0000 7f5c7359e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c741572d0 con 0x7f5c74150f70 2023-12-22T09:16:30.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.045+0000 7f5c7359e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c74069bf0 con 0x7f5c740c16f0 2023-12-22T09:16:30.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.045+0000 7f5c7359e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74069e00 con 0x7f5c740bfdb0 2023-12-22T09:16:30.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.046+0000 7f5c6bfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c740c16f0 0x7f5c7406c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:30.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.046+0000 7f5c6bfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c740c16f0 0x7f5c7406c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50000/0 (socket says 172.21.15.106:50000) 2023-12-22T09:16:30.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.046+0000 7f5c6bfff640 1 -- 172.21.15.106:0/947315017 learned_addr learned my addr 172.21.15.106:0/947315017 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:30.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.046+0000 7f5c6bfff640 1 -- 172.21.15.106:0/947315017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c740bfdb0 msgr2=0x7f5c74157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:30.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.046+0000 7f5c72d9d640 1 --2- 172.21.15.106:0/947315017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c740bfdb0 0x7f5c74157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:30.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.046+0000 7f5c6bfff640 1 --2- 172.21.15.106:0/947315017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c740bfdb0 0x7f5c74157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.046+0000 7f5c6bfff640 1 -- 172.21.15.106:0/947315017 >> v1:172.21.15.132:6789/0 conn(0x7f5c74150f70 legacy=0x7f5c741544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.046+0000 7f5c6bfff640 1 -- 172.21.15.106:0/947315017 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7406a0e0 con 0x7f5c740c16f0 2023-12-22T09:16:30.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.046+0000 7f5c72d9d640 1 --2- 172.21.15.106:0/947315017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c740bfdb0 0x7f5c74157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:30.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.047+0000 7f5c6bfff640 1 --2- 172.21.15.106:0/947315017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740c16f0 0x7f5c7406c010 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009870 tx=0x7f5c5c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433c0c0ea9883341 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:30.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.048+0000 7f5c71d9b640 1 -- 172.21.15.106:0/947315017 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c031640 con 0x7f5c740c16f0 2023-12-22T09:16:30.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.048+0000 7f5c71d9b640 1 -- 172.21.15.106:0/947315017 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c0317a0 con 0x7f5c740c16f0 2023-12-22T09:16:30.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.048+0000 7f5c71d9b640 1 -- 172.21.15.106:0/947315017 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c031b30 con 0x7f5c740c16f0 2023-12-22T09:16:30.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.048+0000 7f5c7359e640 1 -- 172.21.15.106:0/947315017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740c16f0 msgr2=0x7f5c7406c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.048+0000 7f5c7359e640 1 --2- 172.21.15.106:0/947315017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740c16f0 0x7f5c7406c010 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009870 tx=0x7f5c5c02b8f0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.049+0000 7f5c7359e640 1 -- 172.21.15.106:0/947315017 shutdown_connections 2023-12-22T09:16:30.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.049+0000 7f5c7359e640 1 --2- 172.21.15.106:0/947315017 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c740bfdb0 0x7f5c74157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.049+0000 7f5c7359e640 1 --2- 172.21.15.106:0/947315017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740c16f0 0x7f5c7406c010 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.049+0000 7f5c7359e640 1 -- 172.21.15.106:0/947315017 >> 172.21.15.106:0/947315017 conn(0x7f5c740c5180 msgr2=0x7f5c740c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:30.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.049+0000 7f5c7359e640 1 -- 172.21.15.106:0/947315017 shutdown_connections 2023-12-22T09:16:30.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.049+0000 7f5c7359e640 1 -- 172.21.15.106:0/947315017 wait complete. 2023-12-22T09:16:30.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.050+0000 7f5c7359e640 1 Processor -- start 2023-12-22T09:16:30.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.050+0000 7f5c7359e640 1 -- start start 2023-12-22T09:16:30.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.051+0000 7f5c7359e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740bfdb0 0x7f5c741e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.051+0000 7f5c7359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c16f0 0x7f5c741e9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.051+0000 7f5c7359e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c74150f70 0x7f5c741537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.051+0000 7f5c7359e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74071990 con 0x7f5c740bfdb0 2023-12-22T09:16:30.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.051+0000 7f5c7359e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74153330 con 0x7f5c740c16f0 2023-12-22T09:16:30.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.051+0000 7f5c7359e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c741e9a80 con 0x7f5c74150f70 2023-12-22T09:16:30.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c7259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740bfdb0 0x7f5c741e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c7259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740bfdb0 0x7f5c741e8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50012/0 (socket says 172.21.15.106:50012) 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c7259c640 1 -- 172.21.15.106:0/3951435368 learned_addr learned my addr 172.21.15.106:0/3951435368 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c7259c640 1 -- 172.21.15.106:0/3951435368 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c74150f70 msgr2=0x7f5c741537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c7259c640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c74150f70 0x7f5c741537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c7259c640 1 -- 172.21.15.106:0/3951435368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c16f0 msgr2=0x7f5c741e9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c7259c640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c16f0 0x7f5c741e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c7259c640 1 -- 172.21.15.106:0/3951435368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c0094d0 con 0x7f5c740bfdb0 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c7259c640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740bfdb0 0x7f5c741e8f00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c400 tx=0x7f5c6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.052+0000 7f5c6affd640 1 -- 172.21.15.106:0/3951435368 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640052d0 con 0x7f5c740bfdb0 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.053+0000 7f5c6affd640 1 -- 172.21.15.106:0/3951435368 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c64005430 con 0x7f5c740bfdb0 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.053+0000 7f5c6affd640 1 -- 172.21.15.106:0/3951435368 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64003830 con 0x7f5c740bfdb0 2023-12-22T09:16:30.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.053+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7411e3f0 con 0x7f5c740bfdb0 2023-12-22T09:16:30.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.053+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c74151cf0 con 0x7f5c740bfdb0 2023-12-22T09:16:30.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.054+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c740c4830 con 0x7f5c740bfdb0 2023-12-22T09:16:30.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.055+0000 7f5c6affd640 1 -- 172.21.15.106:0/3951435368 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c64003990 con 0x7f5c740bfdb0 2023-12-22T09:16:30.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.056+0000 7f5c6affd640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c5406a430 0x7f5c5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.056+0000 7f5c6affd640 1 -- 172.21.15.106:0/3951435368 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f5c64088370 con 0x7f5c740bfdb0 2023-12-22T09:16:30.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.056+0000 7f5c6bfff640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c5406a430 0x7f5c5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:30.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.057+0000 7f5c6bfff640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c5406a430 0x7f5c5406c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c036000 tx=0x7f5c5c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:30.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.060+0000 7f5c6affd640 1 -- 172.21.15.106:0/3951435368 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5c640534b0 con 0x7f5c740bfdb0 2023-12-22T09:16:30.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.265+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5c7404e8d0 con 0x7f5c740bfdb0 2023-12-22T09:16:30.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.266+0000 7f5c6affd640 1 -- 172.21.15.106:0/3951435368 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5c64056ad0 con 0x7f5c740bfdb0 2023-12-22T09:16:30.266 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c5406a430 msgr2=0x7f5c5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c5406a430 0x7f5c5406c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c036000 tx=0x7f5c5c030000 comp rx=0 tx=0).stop 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740bfdb0 msgr2=0x7f5c741e8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740bfdb0 0x7f5c741e8f00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c400 tx=0x7f5c6400c8c0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 shutdown_connections 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f5c5406a430 0x7f5c5406c8f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5c74150f70 0x7f5c741537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c740c16f0 0x7f5c741e9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 --2- 172.21.15.106:0/3951435368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c740bfdb0 0x7f5c741e8f00 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 >> 172.21.15.106:0/3951435368 conn(0x7f5c740c5180 msgr2=0x7f5c740c5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:30.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 shutdown_connections 2023-12-22T09:16:30.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.269+0000 7f5c7359e640 1 -- 172.21.15.106:0/3951435368 wait complete. 2023-12-22T09:16:30.286 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T09:16:30.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:30.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T09:16:30.400 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T09:16:30.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:16:30.400 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T09:16:30.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:30.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.673+0000 7ff66f59e640 1 Processor -- start 2023-12-22T09:16:30.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.674+0000 7ff66f59e640 1 -- start start 2023-12-22T09:16:30.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.675+0000 7ff66f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6700c2090 0x7ff6700bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.675+0000 7ff66f59e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6701579e0 0x7ff670150de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.675+0000 7ff66f59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff670157550 con 0x7ff67006b760 2023-12-22T09:16:30.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.675+0000 7ff66f59e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6701544b0 con 0x7ff6701579e0 2023-12-22T09:16:30.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.675+0000 7ff66f59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff670154790 con 0x7ff6700c2090 2023-12-22T09:16:30.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.675+0000 7ff66ed9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6701579e0 0x7ff670150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:30.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.676+0000 7ff66ed9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6701579e0 0x7ff670150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50028/0 (socket says 172.21.15.106:50028) 2023-12-22T09:16:30.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.676+0000 7ff66ed9d640 1 -- 172.21.15.106:0/3149602957 learned_addr learned my addr 172.21.15.106:0/3149602957 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:30.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.676+0000 7ff66e59c640 1 --2- 172.21.15.106:0/3149602957 >> v2:172.21.15.132:3300/0 conn(0x7ff6700c2090 0x7ff6700bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:30.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.676+0000 7ff66ed9d640 1 -- 172.21.15.106:0/3149602957 >> v2:172.21.15.132:3300/0 conn(0x7ff6700c2090 msgr2=0x7ff6700bfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:30.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.676+0000 7ff66ed9d640 1 --2- 172.21.15.106:0/3149602957 >> v2:172.21.15.132:3300/0 conn(0x7ff6700c2090 0x7ff6700bfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.676+0000 7ff66ed9d640 1 -- 172.21.15.106:0/3149602957 >> v1:172.21.15.132:6789/0 conn(0x7ff67006b760 legacy=0x7ff670153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:30.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.676+0000 7ff66ed9d640 1 -- 172.21.15.106:0/3149602957 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff670154a70 con 0x7ff6701579e0 2023-12-22T09:16:30.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.676+0000 7ff66e59c640 1 --2- 172.21.15.106:0/3149602957 >> v2:172.21.15.132:3300/0 conn(0x7ff6700c2090 0x7ff6700bfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:30.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.678+0000 7ff66ed9d640 1 --2- 172.21.15.106:0/3149602957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 0x7ff670150de0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff67006dd40 tx=0x7ff66802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d14d41b308fd258 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:30.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.678+0000 7ff66dd9b640 1 -- 172.21.15.106:0/3149602957 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66802c9f0 con 0x7ff6701579e0 2023-12-22T09:16:30.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.678+0000 7ff66dd9b640 1 -- 172.21.15.106:0/3149602957 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66802cb50 con 0x7ff6701579e0 2023-12-22T09:16:30.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.678+0000 7ff66dd9b640 1 -- 172.21.15.106:0/3149602957 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680343f0 con 0x7ff6701579e0 2023-12-22T09:16:30.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.678+0000 7ff66f59e640 1 -- 172.21.15.106:0/3149602957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 msgr2=0x7ff670150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.678+0000 7ff66f59e640 1 --2- 172.21.15.106:0/3149602957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 0x7ff670150de0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff67006dd40 tx=0x7ff66802be50 comp rx=0 tx=0).stop 2023-12-22T09:16:30.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.679+0000 7ff66f59e640 1 -- 172.21.15.106:0/3149602957 shutdown_connections 2023-12-22T09:16:30.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.679+0000 7ff66f59e640 1 --2- 172.21.15.106:0/3149602957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 0x7ff670150de0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.679+0000 7ff66f59e640 1 --2- 172.21.15.106:0/3149602957 >> v2:172.21.15.132:3300/0 conn(0x7ff6700c2090 0x7ff6700bfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.679+0000 7ff66f59e640 1 -- 172.21.15.106:0/3149602957 >> 172.21.15.106:0/3149602957 conn(0x7ff670069dd0 msgr2=0x7ff67006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:30.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.679+0000 7ff66f59e640 1 -- 172.21.15.106:0/3149602957 shutdown_connections 2023-12-22T09:16:30.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.679+0000 7ff66f59e640 1 -- 172.21.15.106:0/3149602957 wait complete. 2023-12-22T09:16:30.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.680+0000 7ff66f59e640 1 Processor -- start 2023-12-22T09:16:30.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.681+0000 7ff66f59e640 1 -- start start 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.681+0000 7ff66f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff67006b760 0x7ff670152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.681+0000 7ff66f59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6700c2090 0x7ff6700c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.681+0000 7ff66f59e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 0x7ff67014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.681+0000 7ff66f59e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6701523e0 con 0x7ff6701579e0 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.681+0000 7ff66f59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff670152a80 con 0x7ff67006b760 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.681+0000 7ff66f59e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff670151e20 con 0x7ff6700c2090 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.682+0000 7ff66ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 0x7ff67014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.682+0000 7ff66ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 0x7ff67014f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50030/0 (socket says 172.21.15.106:50030) 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.682+0000 7ff66ed9d640 1 -- 172.21.15.106:0/3386114530 learned_addr learned my addr 172.21.15.106:0/3386114530 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:30.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.682+0000 7ff66e59c640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff67006b760 0x7ff670152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:30.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.682+0000 7ff66ed9d640 1 -- 172.21.15.106:0/3386114530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6700c2090 msgr2=0x7ff6700c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.682+0000 7ff66ed9d640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6700c2090 0x7ff6700c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.682+0000 7ff66ed9d640 1 -- 172.21.15.106:0/3386114530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff67006b760 msgr2=0x7ff670152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.682+0000 7ff66ed9d640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff67006b760 0x7ff670152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.682+0000 7ff66ed9d640 1 -- 172.21.15.106:0/3386114530 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff668009b30 con 0x7ff6701579e0 2023-12-22T09:16:30.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.683+0000 7ff66ed9d640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 0x7ff67014f730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff668009f40 tx=0x7ff668004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:30.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.683+0000 7ff6677fe640 1 -- 172.21.15.106:0/3386114530 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66803e450 con 0x7ff6701579e0 2023-12-22T09:16:30.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.683+0000 7ff6677fe640 1 -- 172.21.15.106:0/3386114530 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66803e5d0 con 0x7ff6701579e0 2023-12-22T09:16:30.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.683+0000 7ff6677fe640 1 -- 172.21.15.106:0/3386114530 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66803e980 con 0x7ff6701579e0 2023-12-22T09:16:30.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.683+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff670152100 con 0x7ff6701579e0 2023-12-22T09:16:30.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.683+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6700c4760 con 0x7ff6701579e0 2023-12-22T09:16:30.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.684+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67004e8d0 con 0x7ff6701579e0 2023-12-22T09:16:30.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.685+0000 7ff6677fe640 1 -- 172.21.15.106:0/3386114530 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff66803eae0 con 0x7ff6701579e0 2023-12-22T09:16:30.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.686+0000 7ff6677fe640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff65406a460 0x7ff65406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:30.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.686+0000 7ff6677fe640 1 -- 172.21.15.106:0/3386114530 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff6680aba60 con 0x7ff6701579e0 2023-12-22T09:16:30.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.686+0000 7ff66e59c640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff65406a460 0x7ff65406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:30.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.687+0000 7ff66e59c640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff65406a460 0x7ff65406c920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff66000a990 tx=0x7ff660008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:30.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.690+0000 7ff6677fe640 1 -- 172.21.15.106:0/3386114530 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff668076bc0 con 0x7ff6701579e0 2023-12-22T09:16:30.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.918+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff670152bc0 con 0x7ff6701579e0 2023-12-22T09:16:30.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.920+0000 7ff6677fe640 1 -- 172.21.15.106:0/3386114530 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5779 (secure 0 0 0) 0x7ff66807a1e0 con 0x7ff6701579e0 2023-12-22T09:16:30.919 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:30.919 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:15:55.115066+0000","modified":"2023-12-22T09:15:58.132101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6835/3435163215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3435163215},{"type":"v1","addr":"172.21.15.132:6835","nonce":3435163215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:10.238217+0000","modified":"2023-12-22T09:16:13.270608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4792":{"gid":4792,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T09:16:30.920 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 21 2023-12-22T09:16:30.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff65406a460 msgr2=0x7ff65406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff65406a460 0x7ff65406c920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff66000a990 tx=0x7ff660008040 comp rx=0 tx=0).stop 2023-12-22T09:16:30.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 msgr2=0x7ff67014f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:30.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 0x7ff67014f730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff668009f40 tx=0x7ff668004a40 comp rx=0 tx=0).stop 2023-12-22T09:16:30.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 shutdown_connections 2023-12-22T09:16:30.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff65406a460 0x7ff65406c920 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6701579e0 0x7ff67014f730 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6700c2090 0x7ff6700c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 --2- 172.21.15.106:0/3386114530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff67006b760 0x7ff670152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:30.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 >> 172.21.15.106:0/3386114530 conn(0x7ff670069dd0 msgr2=0x7ff6700be4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:30.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 shutdown_connections 2023-12-22T09:16:30.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:30.922+0000 7ff66f59e640 1 -- 172.21.15.106:0/3386114530 wait complete. 2023-12-22T09:16:30.941 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:31.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.156+0000 7f713b804640 1 Processor -- start 2023-12-22T09:16:31.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.156+0000 7f713b804640 1 -- start start 2023-12-22T09:16:31.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.157+0000 7f713b804640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f713413b060 0x7f713406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.157+0000 7f713b804640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71340bfce0 0x7f7134069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.157+0000 7f713b804640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71340bf770 con 0x7f713406a130 2023-12-22T09:16:31.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.157+0000 7f713b804640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7134155120 con 0x7f71340bfce0 2023-12-22T09:16:31.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.157+0000 7f713b804640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7134155400 con 0x7f713413b060 2023-12-22T09:16:31.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.158+0000 7f7138d9f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71340bfce0 0x7f7134069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.158+0000 7f7139da1640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f713406a130 0x7f7134151b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51622/0 (socket says 172.21.15.106:51622) 2023-12-22T09:16:31.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.158+0000 7f7139da1640 1 -- 172.21.15.106:0/706337795 learned_addr learned my addr 172.21.15.106:0/706337795 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:31.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.158+0000 7f71395a0640 1 --2- 172.21.15.106:0/706337795 >> v2:172.21.15.132:3300/0 conn(0x7f713413b060 0x7f713406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.158+0000 7f7138d9f640 1 -- 172.21.15.106:0/706337795 >> v2:172.21.15.132:3300/0 conn(0x7f713413b060 msgr2=0x7f713406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.158+0000 7f7138d9f640 1 --2- 172.21.15.106:0/706337795 >> v2:172.21.15.132:3300/0 conn(0x7f713413b060 0x7f713406a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.158+0000 7f7138d9f640 1 -- 172.21.15.106:0/706337795 >> v1:172.21.15.106:6789/0 conn(0x7f713406a130 legacy=0x7f7134151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.158+0000 7f7138d9f640 1 -- 172.21.15.106:0/706337795 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71341556e0 con 0x7f71340bfce0 2023-12-22T09:16:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.158+0000 7f712bfff640 1 -- 172.21.15.106:0/706337795 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894416618 0 0) 0x7f71340bf770 con 0x7f713406a130 2023-12-22T09:16:31.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.159+0000 7f7138d9f640 1 --2- 172.21.15.106:0/706337795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71340bfce0 0x7f7134069bf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f713406db40 tx=0x7f712402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7719918b82e0373c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.159+0000 7f712bfff640 1 -- 172.21.15.106:0/706337795 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712402e070 con 0x7f71340bfce0 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f712bfff640 1 -- 172.21.15.106:0/706337795 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71240315a0 con 0x7f71340bfce0 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f712bfff640 1 -- 172.21.15.106:0/706337795 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124031930 con 0x7f71340bfce0 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f713b804640 1 -- 172.21.15.106:0/706337795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71340bfce0 msgr2=0x7f7134069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f713b804640 1 --2- 172.21.15.106:0/706337795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71340bfce0 0x7f7134069bf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f713406db40 tx=0x7f712402b840 comp rx=0 tx=0).stop 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f713b804640 1 -- 172.21.15.106:0/706337795 shutdown_connections 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f713b804640 1 --2- 172.21.15.106:0/706337795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71340bfce0 0x7f7134069bf0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f713b804640 1 --2- 172.21.15.106:0/706337795 >> v2:172.21.15.132:3300/0 conn(0x7f713413b060 0x7f713406a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f713b804640 1 -- 172.21.15.106:0/706337795 >> 172.21.15.106:0/706337795 conn(0x7f71340c5360 msgr2=0x7f71340c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f713b804640 1 -- 172.21.15.106:0/706337795 shutdown_connections 2023-12-22T09:16:31.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.160+0000 7f713b804640 1 -- 172.21.15.106:0/706337795 wait complete. 2023-12-22T09:16:31.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.162+0000 7f713b804640 1 Processor -- start 2023-12-22T09:16:31.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.162+0000 7f713b804640 1 -- start start 2023-12-22T09:16:31.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.163+0000 7f713b804640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713406a130 0x7f71341ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.163+0000 7f713b804640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71340bfce0 0x7f71340c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.163+0000 7f713b804640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f713413b060 0x7f71340c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.163+0000 7f713b804640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71341ed340 con 0x7f713413b060 2023-12-22T09:16:31.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.163+0000 7f713b804640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71341e0460 con 0x7f713406a130 2023-12-22T09:16:31.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.163+0000 7f713b804640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71340c4d50 con 0x7f71340bfce0 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.163+0000 7f7139da1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f713413b060 0x7f71340c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.163+0000 7f7139da1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f713413b060 0x7f71340c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50046/0 (socket says 172.21.15.106:50046) 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.163+0000 7f7139da1640 1 -- 172.21.15.106:0/1365525580 learned_addr learned my addr 172.21.15.106:0/1365525580 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f71395a0640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713406a130 0x7f71341ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f7139da1640 1 -- 172.21.15.106:0/1365525580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71340bfce0 msgr2=0x7f71340c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f7139da1640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71340bfce0 0x7f71340c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f7139da1640 1 -- 172.21.15.106:0/1365525580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713406a130 msgr2=0x7f71341ec890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f7139da1640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713406a130 0x7f71341ec890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f7139da1640 1 -- 172.21.15.106:0/1365525580 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124009400 con 0x7f713413b060 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f71395a0640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713406a130 0x7f71341ec890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f7139da1640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f713413b060 0x7f71340c3660 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f712c00c780 tx=0x7f712c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f7129ffb640 1 -- 172.21.15.106:0/1365525580 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c00ce90 con 0x7f713413b060 2023-12-22T09:16:31.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f7129ffb640 1 -- 172.21.15.106:0/1365525580 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c00a640 con 0x7f713413b060 2023-12-22T09:16:31.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f7129ffb640 1 -- 172.21.15.106:0/1365525580 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c00a9d0 con 0x7f713413b060 2023-12-22T09:16:31.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71341e0650 con 0x7f713413b060 2023-12-22T09:16:31.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.164+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7134071920 con 0x7f713413b060 2023-12-22T09:16:31.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.166+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71341ed480 con 0x7f713413b060 2023-12-22T09:16:31.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.166+0000 7f7129ffb640 1 -- 172.21.15.106:0/1365525580 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f712c00ab30 con 0x7f713413b060 2023-12-22T09:16:31.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.167+0000 7f7129ffb640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f711806a430 0x7f711806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.167+0000 7f7129ffb640 1 -- 172.21.15.106:0/1365525580 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f712c0881c0 con 0x7f713413b060 2023-12-22T09:16:31.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.168+0000 7f71395a0640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f711806a430 0x7f711806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.168+0000 7f71395a0640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f711806a430 0x7f711806c8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f71340be6e0 tx=0x7f7130008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:31.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.172+0000 7f7129ffb640 1 -- 172.21.15.106:0/1365525580 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f71341ed480 con 0x7f713413b060 2023-12-22T09:16:31.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.362+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71341ed480 con 0x7f713413b060 2023-12-22T09:16:31.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.365+0000 7f7129ffb640 1 -- 172.21.15.106:0/1365525580 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20070 (secure 0 0 0) 0x7f71341ed480 con 0x7f713413b060 2023-12-22T09:16:31.365 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:31.365 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:11.243405+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:31.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f711806a430 msgr2=0x7f711806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f711806a430 0x7f711806c8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f71340be6e0 tx=0x7f7130008040 comp rx=0 tx=0).stop 2023-12-22T09:16:31.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f713413b060 msgr2=0x7f71340c3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f713413b060 0x7f71340c3660 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f712c00c780 tx=0x7f712c00cc40 comp rx=0 tx=0).stop 2023-12-22T09:16:31.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 shutdown_connections 2023-12-22T09:16:31.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f711806a430 0x7f711806c8f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f713413b060 0x7f71340c3660 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71340bfce0 0x7f71340c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 --2- 172.21.15.106:0/1365525580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713406a130 0x7f71341ec890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.367+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 >> 172.21.15.106:0/1365525580 conn(0x7f71340c5360 msgr2=0x7f71340aaab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:31.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.368+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 shutdown_connections 2023-12-22T09:16:31.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.368+0000 7f713b804640 1 -- 172.21.15.106:0/1365525580 wait complete. 2023-12-22T09:16:31.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:15:52.874302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:15:54.136774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-22T09:16:08.066634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-22T09:16:09.242570+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:16:31.388 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:16:31.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.608+0000 7fa899826640 1 Processor -- start 2023-12-22T09:16:31.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.609+0000 7fa899826640 1 -- start start 2023-12-22T09:16:31.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.610+0000 7fa899826640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8941514f0 0x7fa8940c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.610+0000 7fa899826640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8940c4380 0x7fa8940c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.610+0000 7fa899826640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940c5b40 con 0x7fa89406aca0 2023-12-22T09:16:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.610+0000 7fa899826640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8940c4e10 con 0x7fa8940c4380 2023-12-22T09:16:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.610+0000 7fa899826640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940c7b50 con 0x7fa8941514f0 2023-12-22T09:16:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.611+0000 7fa8937fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa89406aca0 0x7fa8940c4fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51626/0 (socket says 172.21.15.106:51626) 2023-12-22T09:16:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.611+0000 7fa8937fe640 1 -- 172.21.15.106:0/3408069412 learned_addr learned my addr 172.21.15.106:0/3408069412 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.611+0000 7fa88a7fc640 1 --2- 172.21.15.106:0/3408069412 >> v2:172.21.15.106:3300/0 conn(0x7fa8940c4380 0x7fa8940c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.611+0000 7fa892ffd640 1 --2- 172.21.15.106:0/3408069412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8941514f0 0x7fa8940c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.611+0000 7fa8927fc640 1 -- 172.21.15.106:0/3408069412 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009776826 0 0) 0x7fa8940c5b40 con 0x7fa89406aca0 2023-12-22T09:16:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.611+0000 7fa8927fc640 1 -- 172.21.15.106:0/3408069412 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa880003520 con 0x7fa89406aca0 2023-12-22T09:16:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.611+0000 7fa88a7fc640 1 -- 172.21.15.106:0/3408069412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8941514f0 msgr2=0x7fa8940c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.611+0000 7fa88a7fc640 1 --2- 172.21.15.106:0/3408069412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8941514f0 0x7fa8940c48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.611+0000 7fa88a7fc640 1 -- 172.21.15.106:0/3408069412 >> v1:172.21.15.106:6789/0 conn(0x7fa89406aca0 legacy=0x7fa8940c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.612+0000 7fa88a7fc640 1 -- 172.21.15.106:0/3408069412 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89406b390 con 0x7fa8940c4380 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.613+0000 7fa88a7fc640 1 --2- 172.21.15.106:0/3408069412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8940c4380 0x7fa8940c7610 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0097a0 tx=0x7fa87c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511d88c98f8a008c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.613+0000 7fa8927fc640 1 -- 172.21.15.106:0/3408069412 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c02f050 con 0x7fa8940c4380 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.613+0000 7fa8927fc640 1 -- 172.21.15.106:0/3408069412 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c031700 con 0x7fa8940c4380 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.613+0000 7fa8927fc640 1 -- 172.21.15.106:0/3408069412 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c031a90 con 0x7fa8940c4380 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.614+0000 7fa899826640 1 -- 172.21.15.106:0/3408069412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8940c4380 msgr2=0x7fa8940c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.614+0000 7fa899826640 1 --2- 172.21.15.106:0/3408069412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8940c4380 0x7fa8940c7610 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0097a0 tx=0x7fa87c02b7a0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.614+0000 7fa899826640 1 -- 172.21.15.106:0/3408069412 shutdown_connections 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.614+0000 7fa899826640 1 --2- 172.21.15.106:0/3408069412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8940c4380 0x7fa8940c7610 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.614+0000 7fa899826640 1 --2- 172.21.15.106:0/3408069412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8941514f0 0x7fa8940c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.614+0000 7fa899826640 1 -- 172.21.15.106:0/3408069412 >> 172.21.15.106:0/3408069412 conn(0x7fa8940c9710 msgr2=0x7fa8940c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.614+0000 7fa899826640 1 -- 172.21.15.106:0/3408069412 shutdown_connections 2023-12-22T09:16:31.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.614+0000 7fa899826640 1 -- 172.21.15.106:0/3408069412 wait complete. 2023-12-22T09:16:31.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.616+0000 7fa899826640 1 Processor -- start 2023-12-22T09:16:31.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.616+0000 7fa899826640 1 -- start start 2023-12-22T09:16:31.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa899826640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa89406aca0 0x7fa8941535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa899826640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8940c4380 0x7fa8941498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa899826640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8941514f0 0x7fa894149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa899826640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941ed5b0 con 0x7fa8941514f0 2023-12-22T09:16:31.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa899826640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941e90c0 con 0x7fa89406aca0 2023-12-22T09:16:31.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa899826640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941ea090 con 0x7fa8940c4380 2023-12-22T09:16:31.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa8937fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8941514f0 0x7fa894149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa8937fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8941514f0 0x7fa894149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50070/0 (socket says 172.21.15.106:50070) 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa8937fe640 1 -- 172.21.15.106:0/1730096367 learned_addr learned my addr 172.21.15.106:0/1730096367 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa892ffd640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa89406aca0 0x7fa8941535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.617+0000 7fa88a7fc640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8940c4380 0x7fa8941498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa8937fe640 1 -- 172.21.15.106:0/1730096367 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8940c4380 msgr2=0x7fa8941498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa8937fe640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8940c4380 0x7fa8941498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa8937fe640 1 -- 172.21.15.106:0/1730096367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa89406aca0 msgr2=0x7fa8941535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa8937fe640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa89406aca0 0x7fa8941535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa8937fe640 1 -- 172.21.15.106:0/1730096367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009400 con 0x7fa8941514f0 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa88a7fc640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8940c4380 0x7fa8941498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa8937fe640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8941514f0 0x7fa894149df0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00c390 tx=0x7fa88c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa890ff9640 1 -- 172.21.15.106:0/1730096367 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c005ce0 con 0x7fa8941514f0 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa890ff9640 1 -- 172.21.15.106:0/1730096367 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c005e40 con 0x7fa8941514f0 2023-12-22T09:16:31.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa890ff9640 1 -- 172.21.15.106:0/1730096367 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c007310 con 0x7fa8941514f0 2023-12-22T09:16:31.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8941e9c00 con 0x7fa8941514f0 2023-12-22T09:16:31.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.618+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8941e95b0 con 0x7fa8941514f0 2023-12-22T09:16:31.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.619+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89414a330 con 0x7fa8941514f0 2023-12-22T09:16:31.620 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.620+0000 7fa890ff9640 1 -- 172.21.15.106:0/1730096367 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa88c007470 con 0x7fa8941514f0 2023-12-22T09:16:31.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.621+0000 7fa890ff9640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa87406a460 0x7fa87406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:31.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.621+0000 7fa890ff9640 1 -- 172.21.15.106:0/1730096367 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa88c0883e0 con 0x7fa8941514f0 2023-12-22T09:16:31.621 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.622+0000 7fa892ffd640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa87406a460 0x7fa87406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:31.622 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.622+0000 7fa892ffd640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa87406a460 0x7fa87406c920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa8840073f0 tx=0x7fa88400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:31.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.625+0000 7fa890ff9640 1 -- 172.21.15.106:0/1730096367 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa88c053520 con 0x7fa8941514f0 2023-12-22T09:16:31.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.815+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8941e9d90 con 0x7fa8941514f0 2023-12-22T09:16:31.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.816+0000 7fa890ff9640 1 -- 172.21.15.106:0/1730096367 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa88c056b40 con 0x7fa8941514f0 2023-12-22T09:16:31.816 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:16:31.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa87406a460 msgr2=0x7fa87406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa87406a460 0x7fa87406c920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa8840073f0 tx=0x7fa88400b040 comp rx=0 tx=0).stop 2023-12-22T09:16:31.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8941514f0 msgr2=0x7fa894149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:31.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8941514f0 0x7fa894149df0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00c390 tx=0x7fa88c00c850 comp rx=0 tx=0).stop 2023-12-22T09:16:31.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 shutdown_connections 2023-12-22T09:16:31.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa87406a460 0x7fa87406c920 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8941514f0 0x7fa894149df0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8940c4380 0x7fa8941498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 --2- 172.21.15.106:0/1730096367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa89406aca0 0x7fa8941535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:31.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 >> 172.21.15.106:0/1730096367 conn(0x7fa8940c9710 msgr2=0x7fa8940aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:31.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 shutdown_connections 2023-12-22T09:16:31.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:31.819+0000 7fa899826640 1 -- 172.21.15.106:0/1730096367 wait complete. 2023-12-22T09:16:31.838 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:16:32.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.049+0000 7ff6abf73640 1 Processor -- start 2023-12-22T09:16:32.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.049+0000 7ff6abf73640 1 -- start start 2023-12-22T09:16:32.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.050+0000 7ff6abf73640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6a40c1960 0x7ff6a41573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.050+0000 7ff6abf73640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6a40705a0 0x7ff6a4157920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.050+0000 7ff6abf73640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a40ab040 con 0x7ff6a4151640 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6abf73640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a406bdc0 con 0x7ff6a40c1960 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6abf73640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a406caf0 con 0x7ff6a40705a0 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6a9d0f640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff6a4151640 0x7ff6a40c5a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51640/0 (socket says 172.21.15.106:51640) 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6a9d0f640 1 -- 172.21.15.106:0/4258949762 learned_addr learned my addr 172.21.15.106:0/4258949762 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6a950e640 1 --2- 172.21.15.106:0/4258949762 >> v2:172.21.15.106:3300/0 conn(0x7ff6a40c1960 0x7ff6a41573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6aa510640 1 --2- 172.21.15.106:0/4258949762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6a40705a0 0x7ff6a4157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6a8d0d640 1 -- 172.21.15.106:0/4258949762 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192209625 0 0) 0x7ff6a0001110 con 0x7ff6a4151640 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6a8d0d640 1 -- 172.21.15.106:0/4258949762 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff690003520 con 0x7ff6a4151640 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6a950e640 1 -- 172.21.15.106:0/4258949762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6a40705a0 msgr2=0x7ff6a4157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6a950e640 1 --2- 172.21.15.106:0/4258949762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6a40705a0 0x7ff6a4157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6a950e640 1 -- 172.21.15.106:0/4258949762 >> v1:172.21.15.106:6789/0 conn(0x7ff6a4151640 legacy=0x7ff6a40c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.052 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.051+0000 7ff6a950e640 1 -- 172.21.15.106:0/4258949762 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4157e60 con 0x7ff6a40c1960 2023-12-22T09:16:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6a950e640 1 --2- 172.21.15.106:0/4258949762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40c1960 0x7ff6a41573e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff6940097a0 tx=0x7ff69402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305b1beb19a007d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6a8d0d640 1 -- 172.21.15.106:0/4258949762 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69402f050 con 0x7ff6a40c1960 2023-12-22T09:16:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6a8d0d640 1 -- 172.21.15.106:0/4258949762 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694031700 con 0x7ff6a40c1960 2023-12-22T09:16:32.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6a8d0d640 1 -- 172.21.15.106:0/4258949762 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694031a90 con 0x7ff6a40c1960 2023-12-22T09:16:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6abf73640 1 -- 172.21.15.106:0/4258949762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40c1960 msgr2=0x7ff6a41573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6abf73640 1 --2- 172.21.15.106:0/4258949762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40c1960 0x7ff6a41573e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff6940097a0 tx=0x7ff69402b7a0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6abf73640 1 -- 172.21.15.106:0/4258949762 shutdown_connections 2023-12-22T09:16:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6abf73640 1 --2- 172.21.15.106:0/4258949762 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6a40705a0 0x7ff6a4157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6abf73640 1 --2- 172.21.15.106:0/4258949762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40c1960 0x7ff6a41573e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6abf73640 1 -- 172.21.15.106:0/4258949762 >> 172.21.15.106:0/4258949762 conn(0x7ff6a406a220 msgr2=0x7ff6a40c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:32.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6abf73640 1 -- 172.21.15.106:0/4258949762 shutdown_connections 2023-12-22T09:16:32.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.053+0000 7ff6abf73640 1 -- 172.21.15.106:0/4258949762 wait complete. 2023-12-22T09:16:32.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.055+0000 7ff6abf73640 1 Processor -- start 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.055+0000 7ff6abf73640 1 -- start start 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.056+0000 7ff6abf73640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40705a0 0x7ff6a4156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.056+0000 7ff6abf73640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6a40c1960 0x7ff6a4143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.056+0000 7ff6abf73640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6a4151640 0x7ff6a41438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.056+0000 7ff6abf73640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40bea60 con 0x7ff6a40705a0 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.056+0000 7ff6abf73640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4153eb0 con 0x7ff6a40c1960 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.056+0000 7ff6abf73640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4154710 con 0x7ff6a4151640 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.056+0000 7ff6a9d0f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40705a0 0x7ff6a4156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.056+0000 7ff6a9d0f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40705a0 0x7ff6a4156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50090/0 (socket says 172.21.15.106:50090) 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.056+0000 7ff6a9d0f640 1 -- 172.21.15.106:0/1802238774 learned_addr learned my addr 172.21.15.106:0/1802238774 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff6a9d0f640 1 -- 172.21.15.106:0/1802238774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6a4151640 msgr2=0x7ff6a41438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff6a9d0f640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6a4151640 0x7ff6a41438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff6a9d0f640 1 -- 172.21.15.106:0/1802238774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6a40c1960 msgr2=0x7ff6a4143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff6a9d0f640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6a40c1960 0x7ff6a4143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff6a9d0f640 1 -- 172.21.15.106:0/1802238774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009400 con 0x7ff6a40705a0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff6a9d0f640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40705a0 0x7ff6a4156560 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000c420 tx=0x7ff6a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff69a7fc640 1 -- 172.21.15.106:0/1802238774 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0005ce0 con 0x7ff6a40705a0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff69a7fc640 1 -- 172.21.15.106:0/1802238774 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0005e40 con 0x7ff6a40705a0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff69a7fc640 1 -- 172.21.15.106:0/1802238774 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a00072f0 con 0x7ff6a40705a0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.057+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a4143e00 con 0x7ff6a40705a0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.058+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a41540c0 con 0x7ff6a40705a0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.059+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a4073f10 con 0x7ff6a40705a0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.060+0000 7ff69a7fc640 1 -- 172.21.15.106:0/1802238774 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6a0007450 con 0x7ff6a40705a0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.060+0000 7ff69a7fc640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff68806a430 0x7ff68806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.061+0000 7ff69a7fc640 1 -- 172.21.15.106:0/1802238774 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff6a0088260 con 0x7ff6a40705a0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.061+0000 7ff6a950e640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff68806a430 0x7ff68806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.061+0000 7ff6a950e640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff68806a430 0x7ff68806c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff694035000 tx=0x7ff694030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:32.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.065+0000 7ff69a7fc640 1 -- 172.21.15.106:0/1802238774 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff6a00533a0 con 0x7ff6a40705a0 2023-12-22T09:16:32.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.248+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6a40ab020 con 0x7ff6a40705a0 2023-12-22T09:16:32.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.249+0000 7ff69a7fc640 1 -- 172.21.15.106:0/1802238774 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff6a00569c0 con 0x7ff6a40705a0 2023-12-22T09:16:32.248 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff68806a430 msgr2=0x7ff68806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff68806a430 0x7ff68806c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff694035000 tx=0x7ff694030000 comp rx=0 tx=0).stop 2023-12-22T09:16:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40705a0 msgr2=0x7ff6a4156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40705a0 0x7ff6a4156560 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000c420 tx=0x7ff6a000c8e0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 shutdown_connections 2023-12-22T09:16:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff68806a430 0x7ff68806c8f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6a4151640 0x7ff6a41438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6a40c1960 0x7ff6a4143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 --2- 172.21.15.106:0/1802238774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a40705a0 0x7ff6a4156560 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 >> 172.21.15.106:0/1802238774 conn(0x7ff6a406a220 msgr2=0x7ff6a40c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 shutdown_connections 2023-12-22T09:16:32.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.251+0000 7ff6abf73640 1 -- 172.21.15.106:0/1802238774 wait complete. 2023-12-22T09:16:32.270 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:16:32.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.473+0000 7f2c62441640 1 Processor -- start 2023-12-22T09:16:32.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.473+0000 7f2c62441640 1 -- start start 2023-12-22T09:16:32.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.474+0000 7f2c62441640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c5c14f090 0x7f2c5c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.474+0000 7f2c62441640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2c5c06b960 0x7f2c5c0c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.475+0000 7f2c62441640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5c155120 con 0x7f2c5c0c1910 2023-12-22T09:16:32.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.475+0000 7f2c62441640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5c06e080 con 0x7f2c5c06b960 2023-12-22T09:16:32.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.475+0000 7f2c62441640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5c155fa0 con 0x7f2c5c14f090 2023-12-22T09:16:32.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.475+0000 7f2c53fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2c5c0c1910 0x7f2c5c155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51654/0 (socket says 172.21.15.106:51654) 2023-12-22T09:16:32.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.475+0000 7f2c53fff640 1 -- 172.21.15.106:0/171388386 learned_addr learned my addr 172.21.15.106:0/171388386 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:32.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.475+0000 7f2c609de640 1 --2- 172.21.15.106:0/171388386 >> v2:172.21.15.106:3300/0 conn(0x7f2c5c06b960 0x7f2c5c0c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.475+0000 7f2c5bfff640 1 --2- 172.21.15.106:0/171388386 >> v2:172.21.15.132:3300/0 conn(0x7f2c5c14f090 0x7f2c5c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.475+0000 7f2c5b7fe640 1 -- 172.21.15.106:0/171388386 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351463278 0 0) 0x7f2c5c155120 con 0x7f2c5c0c1910 2023-12-22T09:16:32.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.475+0000 7f2c5b7fe640 1 -- 172.21.15.106:0/171388386 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c48003520 con 0x7f2c5c0c1910 2023-12-22T09:16:32.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.476+0000 7f2c609de640 1 -- 172.21.15.106:0/171388386 >> v2:172.21.15.132:3300/0 conn(0x7f2c5c14f090 msgr2=0x7f2c5c151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:32.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.476+0000 7f2c609de640 1 --2- 172.21.15.106:0/171388386 >> v2:172.21.15.132:3300/0 conn(0x7f2c5c14f090 0x7f2c5c151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.476+0000 7f2c609de640 1 -- 172.21.15.106:0/171388386 >> v1:172.21.15.106:6789/0 conn(0x7f2c5c0c1910 legacy=0x7f2c5c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.476+0000 7f2c609de640 1 -- 172.21.15.106:0/171388386 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0a8720 con 0x7f2c5c06b960 2023-12-22T09:16:32.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.477+0000 7f2c609de640 1 --2- 172.21.15.106:0/171388386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c06b960 0x7f2c5c0c2010 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0c6450 tx=0x7f2c5402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7091759179372c45 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:32.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.477+0000 7f2c5b7fe640 1 -- 172.21.15.106:0/171388386 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5402cbf0 con 0x7f2c5c06b960 2023-12-22T09:16:32.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.477+0000 7f2c5b7fe640 1 -- 172.21.15.106:0/171388386 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5402cd50 con 0x7f2c5c06b960 2023-12-22T09:16:32.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.477+0000 7f2c5b7fe640 1 -- 172.21.15.106:0/171388386 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54034660 con 0x7f2c5c06b960 2023-12-22T09:16:32.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.477+0000 7f2c62441640 1 -- 172.21.15.106:0/171388386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c06b960 msgr2=0x7f2c5c0c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.477+0000 7f2c62441640 1 --2- 172.21.15.106:0/171388386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c06b960 0x7f2c5c0c2010 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0c6450 tx=0x7f2c5402be40 comp rx=0 tx=0).stop 2023-12-22T09:16:32.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.478+0000 7f2c62441640 1 -- 172.21.15.106:0/171388386 shutdown_connections 2023-12-22T09:16:32.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.478+0000 7f2c62441640 1 --2- 172.21.15.106:0/171388386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c06b960 0x7f2c5c0c2010 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.478+0000 7f2c62441640 1 --2- 172.21.15.106:0/171388386 >> v2:172.21.15.132:3300/0 conn(0x7f2c5c14f090 0x7f2c5c151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.478+0000 7f2c62441640 1 -- 172.21.15.106:0/171388386 >> 172.21.15.106:0/171388386 conn(0x7f2c5c069dd0 msgr2=0x7f2c5c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:32.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.478+0000 7f2c62441640 1 -- 172.21.15.106:0/171388386 shutdown_connections 2023-12-22T09:16:32.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.478+0000 7f2c62441640 1 -- 172.21.15.106:0/171388386 wait complete. 2023-12-22T09:16:32.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.480+0000 7f2c62441640 1 Processor -- start 2023-12-22T09:16:32.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.480+0000 7f2c62441640 1 -- start start 2023-12-22T09:16:32.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.481+0000 7f2c62441640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c5c06b960 0x7f2c5c1e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.481+0000 7f2c62441640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c0c1910 0x7f2c5c0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.481+0000 7f2c62441640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c5c14f090 0x7f2c5c1494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.481+0000 7f2c62441640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c0c50a0 con 0x7f2c5c0c1910 2023-12-22T09:16:32.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.481+0000 7f2c62441640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c071770 con 0x7f2c5c06b960 2023-12-22T09:16:32.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.481+0000 7f2c62441640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c1ed0f0 con 0x7f2c5c14f090 2023-12-22T09:16:32.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.481+0000 7f2c53fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c0c1910 0x7f2c5c0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.481+0000 7f2c53fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c0c1910 0x7f2c5c0c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50116/0 (socket says 172.21.15.106:50116) 2023-12-22T09:16:32.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.481+0000 7f2c53fff640 1 -- 172.21.15.106:0/1768600592 learned_addr learned my addr 172.21.15.106:0/1768600592 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:32.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c53fff640 1 -- 172.21.15.106:0/1768600592 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c5c14f090 msgr2=0x7f2c5c1494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c53fff640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c5c14f090 0x7f2c5c1494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c53fff640 1 -- 172.21.15.106:0/1768600592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c5c06b960 msgr2=0x7f2c5c1e8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c53fff640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c5c06b960 0x7f2c5c1e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c53fff640 1 -- 172.21.15.106:0/1768600592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54009a70 con 0x7f2c5c0c1910 2023-12-22T09:16:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c53fff640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c0c1910 0x7f2c5c0c4740 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c4d0 tx=0x7f2c4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c597fa640 1 -- 172.21.15.106:0/1768600592 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44005ce0 con 0x7f2c5c0c1910 2023-12-22T09:16:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c597fa640 1 -- 172.21.15.106:0/1768600592 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44005e40 con 0x7f2c5c0c1910 2023-12-22T09:16:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c597fa640 1 -- 172.21.15.106:0/1768600592 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44007270 con 0x7f2c5c0c1910 2023-12-22T09:16:32.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.482+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5c151b30 con 0x7f2c5c0c1910 2023-12-22T09:16:32.489 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.483+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5c0c4c80 con 0x7f2c5c0c1910 2023-12-22T09:16:32.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.484+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5c152050 con 0x7f2c5c0c1910 2023-12-22T09:16:32.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.485+0000 7f2c597fa640 1 -- 172.21.15.106:0/1768600592 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2c440073d0 con 0x7f2c5c0c1910 2023-12-22T09:16:32.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.485+0000 7f2c597fa640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2c3c06a430 0x7f2c3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.486+0000 7f2c597fa640 1 -- 172.21.15.106:0/1768600592 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f2c440881e0 con 0x7f2c5c0c1910 2023-12-22T09:16:32.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.486+0000 7f2c5bfff640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2c3c06a430 0x7f2c3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.486+0000 7f2c5bfff640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2c3c06a430 0x7f2c3c06c8f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c006fd0 tx=0x7f2c4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:32.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.490+0000 7f2c597fa640 1 -- 172.21.15.106:0/1768600592 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2c44053470 con 0x7f2c5c0c1910 2023-12-22T09:16:32.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.664+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c5c073f10 con 0x7f2c5c0c1910 2023-12-22T09:16:32.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.665+0000 7f2c597fa640 1 -- 172.21.15.106:0/1768600592 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c44056a90 con 0x7f2c5c0c1910 2023-12-22T09:16:32.665 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:32.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2c3c06a430 msgr2=0x7f2c3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2c3c06a430 0x7f2c3c06c8f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c006fd0 tx=0x7f2c4c008040 comp rx=0 tx=0).stop 2023-12-22T09:16:32.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c0c1910 msgr2=0x7f2c5c0c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c0c1910 0x7f2c5c0c4740 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c4d0 tx=0x7f2c4400c990 comp rx=0 tx=0).stop 2023-12-22T09:16:32.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 shutdown_connections 2023-12-22T09:16:32.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2c3c06a430 0x7f2c3c06c8f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c5c14f090 0x7f2c5c1494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c5c0c1910 0x7f2c5c0c4740 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 --2- 172.21.15.106:0/1768600592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c5c06b960 0x7f2c5c1e8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 >> 172.21.15.106:0/1768600592 conn(0x7f2c5c069dd0 msgr2=0x7f2c5c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:32.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 shutdown_connections 2023-12-22T09:16:32.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.668+0000 7f2c62441640 1 -- 172.21.15.106:0/1768600592 wait complete. 2023-12-22T09:16:32.685 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-22T09:16:32.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.899+0000 7f1515900640 1 Processor -- start 2023-12-22T09:16:32.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.900+0000 7f1515900640 1 -- start start 2023-12-22T09:16:32.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.901+0000 7f1515900640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1510151400 0x7f15100c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.901+0000 7f1515900640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f151006ca20 0x7f151006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.901+0000 7f1515900640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15100bcc70 con 0x7f15100c7620 2023-12-22T09:16:32.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.901+0000 7f1515900640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15101517e0 con 0x7f1510151400 2023-12-22T09:16:32.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.901+0000 7f1515900640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15100c4c90 con 0x7f151006ca20 2023-12-22T09:16:32.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.901+0000 7f150effd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1510151400 0x7f15100c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.902+0000 7f150effd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1510151400 0x7f15100c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52918/0 (socket says 172.21.15.106:52918) 2023-12-22T09:16:32.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.902+0000 7f150effd640 1 -- 172.21.15.106:0/993618884 learned_addr learned my addr 172.21.15.106:0/993618884 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:32.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.902+0000 7f150effd640 1 -- 172.21.15.106:0/993618884 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f151006ca20 msgr2=0x7f151006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:32.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.902+0000 7f150effd640 1 --2- 172.21.15.106:0/993618884 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f151006ca20 0x7f151006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.902+0000 7f150effd640 1 -- 172.21.15.106:0/993618884 >> v1:172.21.15.132:6789/0 conn(0x7f15100c7620 legacy=0x7f151006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:32.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.902+0000 7f150effd640 1 -- 172.21.15.106:0/993618884 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15100c42d0 con 0x7f1510151400 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.903+0000 7f150effd640 1 --2- 172.21.15.106:0/993618884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1510151400 0x7f15100c6130 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1500009870 tx=0x7f150002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15bd5e8c304d378 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.903+0000 7f150e7fc640 1 -- 172.21.15.106:0/993618884 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500031740 con 0x7f1510151400 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.903+0000 7f150e7fc640 1 -- 172.21.15.106:0/993618884 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15000318a0 con 0x7f1510151400 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.903+0000 7f150e7fc640 1 -- 172.21.15.106:0/993618884 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500031c30 con 0x7f1510151400 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.904+0000 7f1515900640 1 -- 172.21.15.106:0/993618884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1510151400 msgr2=0x7f15100c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.904+0000 7f1515900640 1 --2- 172.21.15.106:0/993618884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1510151400 0x7f15100c6130 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1500009870 tx=0x7f150002b7e0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.904+0000 7f1515900640 1 -- 172.21.15.106:0/993618884 shutdown_connections 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.904+0000 7f1515900640 1 --2- 172.21.15.106:0/993618884 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f151006ca20 0x7f151006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.904+0000 7f1515900640 1 --2- 172.21.15.106:0/993618884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1510151400 0x7f15100c6130 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.904+0000 7f1515900640 1 -- 172.21.15.106:0/993618884 >> 172.21.15.106:0/993618884 conn(0x7f15100ab310 msgr2=0x7f15100ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.904+0000 7f1515900640 1 -- 172.21.15.106:0/993618884 shutdown_connections 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.904+0000 7f1515900640 1 -- 172.21.15.106:0/993618884 wait complete. 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.906+0000 7f1515900640 1 Processor -- start 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.906+0000 7f1515900640 1 -- start start 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f1515900640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f151006ca20 0x7f15101e9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f1515900640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15100c7620 0x7f1510157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f1515900640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1510151400 0x7f15100c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f1515900640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510157f70 con 0x7f151006ca20 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f1515900640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15101ea130 con 0x7f15100c7620 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f1515900640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1510155200 con 0x7f1510151400 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f150effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f151006ca20 0x7f15101e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f150effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f151006ca20 0x7f15101e9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52928/0 (socket says 172.21.15.106:52928) 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f150effd640 1 -- 172.21.15.106:0/2493271804 learned_addr learned my addr 172.21.15.106:0/2493271804 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:32.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f150effd640 1 -- 172.21.15.106:0/2493271804 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1510151400 msgr2=0x7f15100c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f150effd640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1510151400 0x7f15100c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f150effd640 1 -- 172.21.15.106:0/2493271804 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15100c7620 msgr2=0x7f1510157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:32.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f150effd640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15100c7620 0x7f1510157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:32.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.907+0000 7f150effd640 1 -- 172.21.15.106:0/2493271804 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15000094d0 con 0x7f151006ca20 2023-12-22T09:16:32.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.908+0000 7f150effd640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f151006ca20 0x7f15101e9180 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1500009870 tx=0x7f15000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:32.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.908+0000 7f150cff9640 1 -- 172.21.15.106:0/2493271804 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500033d60 con 0x7f151006ca20 2023-12-22T09:16:32.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.908+0000 7f150cff9640 1 -- 172.21.15.106:0/2493271804 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150003d470 con 0x7f151006ca20 2023-12-22T09:16:32.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.908+0000 7f150cff9640 1 -- 172.21.15.106:0/2493271804 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150003d820 con 0x7f151006ca20 2023-12-22T09:16:32.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.908+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15100c07f0 con 0x7f151006ca20 2023-12-22T09:16:32.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.908+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15101e9b70 con 0x7f151006ca20 2023-12-22T09:16:32.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.909+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1510073f10 con 0x7f151006ca20 2023-12-22T09:16:32.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.910+0000 7f150cff9640 1 -- 172.21.15.106:0/2493271804 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f150003a040 con 0x7f151006ca20 2023-12-22T09:16:32.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.911+0000 7f150cff9640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f14f006a430 0x7f14f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:32.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.911+0000 7f150cff9640 1 -- 172.21.15.106:0/2493271804 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f15000aae50 con 0x7f151006ca20 2023-12-22T09:16:32.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.911+0000 7f15067fc640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f14f006a430 0x7f14f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:32.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.912+0000 7f15067fc640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f14f006a430 0x7f14f006c8f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f15100ca320 tx=0x7f14f8006bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:32.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:32.915+0000 7f150cff9640 1 -- 172.21.15.106:0/2493271804 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1500075f90 con 0x7f151006ca20 2023-12-22T09:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.105+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15100c0440 con 0x7f151006ca20 2023-12-22T09:16:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.106+0000 7f150cff9640 1 -- 172.21.15.106:0/2493271804 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f150002f0b0 con 0x7f151006ca20 2023-12-22T09:16:33.106 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:33.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f14f006a430 msgr2=0x7f14f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f14f006a430 0x7f14f006c8f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f15100ca320 tx=0x7f14f8006bf0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f151006ca20 msgr2=0x7f15101e9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f151006ca20 0x7f15101e9180 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1500009870 tx=0x7f15000046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 shutdown_connections 2023-12-22T09:16:33.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f14f006a430 0x7f14f006c8f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1510151400 0x7f15100c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15100c7620 0x7f1510157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 --2- 172.21.15.106:0/2493271804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f151006ca20 0x7f15101e9180 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.108+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 >> 172.21.15.106:0/2493271804 conn(0x7f15100ab310 msgr2=0x7f15100aa520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.109+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 shutdown_connections 2023-12-22T09:16:33.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.109+0000 7f1515900640 1 -- 172.21.15.106:0/2493271804 wait complete. 2023-12-22T09:16:33.128 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-22T09:16:33.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.329+0000 7f77bef9f640 1 Processor -- start 2023-12-22T09:16:33.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.329+0000 7f77bef9f640 1 -- start start 2023-12-22T09:16:33.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.331+0000 7f77bef9f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f77b80c6150 0x7f77b80c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.331+0000 7f77bef9f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b80c7640 0x7f77b806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.331+0000 7f77bef9f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b80c4560 con 0x7f77b806ca00 2023-12-22T09:16:33.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.331+0000 7f77bef9f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b80c4f90 con 0x7f77b80c6150 2023-12-22T09:16:33.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.331+0000 7f77bef9f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b8154720 con 0x7f77b80c7640 2023-12-22T09:16:33.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.331+0000 7f77bcd3b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f77b80c6150 0x7f77b80c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.331+0000 7f77bcd3b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f77b80c6150 0x7f77b80c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52938/0 (socket says 172.21.15.106:52938) 2023-12-22T09:16:33.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.331+0000 7f77bcd3b640 1 -- 172.21.15.106:0/1722100020 learned_addr learned my addr 172.21.15.106:0/1722100020 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:33.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.332+0000 7f77affff640 1 --2- 172.21.15.106:0/1722100020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b80c7640 0x7f77b806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.332+0000 7f77bcd3b640 1 -- 172.21.15.106:0/1722100020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b80c7640 msgr2=0x7f77b806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:33.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.332+0000 7f77bcd3b640 1 --2- 172.21.15.106:0/1722100020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b80c7640 0x7f77b806b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.332+0000 7f77bcd3b640 1 -- 172.21.15.106:0/1722100020 >> v1:172.21.15.132:6789/0 conn(0x7f77b806ca00 legacy=0x7f77b806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:33.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.332+0000 7f77bcd3b640 1 -- 172.21.15.106:0/1722100020 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b8154c50 con 0x7f77b80c6150 2023-12-22T09:16:33.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.333+0000 7f77bcd3b640 1 --2- 172.21.15.106:0/1722100020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c6150 0x7f77b80c6530 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009870 tx=0x7f77b402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54a7bc664e1d690 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:33.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.333+0000 7f77af7fe640 1 -- 172.21.15.106:0/1722100020 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4031740 con 0x7f77b80c6150 2023-12-22T09:16:33.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.333+0000 7f77af7fe640 1 -- 172.21.15.106:0/1722100020 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b40318a0 con 0x7f77b80c6150 2023-12-22T09:16:33.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.333+0000 7f77af7fe640 1 -- 172.21.15.106:0/1722100020 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4031c30 con 0x7f77b80c6150 2023-12-22T09:16:33.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.334+0000 7f77bef9f640 1 -- 172.21.15.106:0/1722100020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c6150 msgr2=0x7f77b80c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.334+0000 7f77bef9f640 1 --2- 172.21.15.106:0/1722100020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c6150 0x7f77b80c6530 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009870 tx=0x7f77b402b7e0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.334+0000 7f77bef9f640 1 -- 172.21.15.106:0/1722100020 shutdown_connections 2023-12-22T09:16:33.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.334+0000 7f77bef9f640 1 --2- 172.21.15.106:0/1722100020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b80c7640 0x7f77b806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.334+0000 7f77bef9f640 1 --2- 172.21.15.106:0/1722100020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c6150 0x7f77b80c6530 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.334+0000 7f77bef9f640 1 -- 172.21.15.106:0/1722100020 >> 172.21.15.106:0/1722100020 conn(0x7f77b80ab330 msgr2=0x7f77b80ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:33.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.334+0000 7f77bef9f640 1 -- 172.21.15.106:0/1722100020 shutdown_connections 2023-12-22T09:16:33.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.334+0000 7f77bef9f640 1 -- 172.21.15.106:0/1722100020 wait complete. 2023-12-22T09:16:33.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.336+0000 7f77bef9f640 1 Processor -- start 2023-12-22T09:16:33.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.336+0000 7f77bef9f640 1 -- start start 2023-12-22T09:16:33.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bef9f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b806ca00 0x7f77b80c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bef9f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77b80c6150 0x7f77b81e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bef9f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c7640 0x7f77b80c0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bef9f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80af030 con 0x7f77b80c7640 2023-12-22T09:16:33.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bef9f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80c0ea0 con 0x7f77b80c6150 2023-12-22T09:16:33.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bef9f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80c1180 con 0x7f77b806ca00 2023-12-22T09:16:33.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bd53c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c7640 0x7f77b80c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bd53c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c7640 0x7f77b80c0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52948/0 (socket says 172.21.15.106:52948) 2023-12-22T09:16:33.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bd53c640 1 -- 172.21.15.106:0/3164254243 learned_addr learned my addr 172.21.15.106:0/3164254243 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:33.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bcd3b640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b806ca00 0x7f77b80c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bd53c640 1 -- 172.21.15.106:0/3164254243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b806ca00 msgr2=0x7f77b80c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bd53c640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b806ca00 0x7f77b80c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77affff640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77b80c6150 0x7f77b81e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bd53c640 1 -- 172.21.15.106:0/3164254243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77b80c6150 msgr2=0x7f77b81e8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bd53c640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77b80c6150 0x7f77b81e8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.337+0000 7f77bd53c640 1 -- 172.21.15.106:0/3164254243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b40094d0 con 0x7f77b80c7640 2023-12-22T09:16:33.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.338+0000 7f77bd53c640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c7640 0x7f77b80c0810 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f77b000b970 tx=0x7f77b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:33.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.338+0000 7f77ad7fa640 1 -- 172.21.15.106:0/3164254243 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b000cb40 con 0x7f77b80c7640 2023-12-22T09:16:33.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.338+0000 7f77ad7fa640 1 -- 172.21.15.106:0/3164254243 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b000cca0 con 0x7f77b80c7640 2023-12-22T09:16:33.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.338+0000 7f77ad7fa640 1 -- 172.21.15.106:0/3164254243 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b0014680 con 0x7f77b80c7640 2023-12-22T09:16:33.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.338+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b80c1460 con 0x7f77b80c7640 2023-12-22T09:16:33.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.338+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b80c1a20 con 0x7f77b80c7640 2023-12-22T09:16:33.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.339+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b80c1c40 con 0x7f77b80c7640 2023-12-22T09:16:33.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.340+0000 7f77ad7fa640 1 -- 172.21.15.106:0/3164254243 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f77b001d3b0 con 0x7f77b80c7640 2023-12-22T09:16:33.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.341+0000 7f77ad7fa640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f77a406a430 0x7f77a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.341+0000 7f77ad7fa640 1 -- 172.21.15.106:0/3164254243 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f77b0088b10 con 0x7f77b80c7640 2023-12-22T09:16:33.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.341+0000 7f77bcd3b640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f77a406a430 0x7f77a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.342+0000 7f77bcd3b640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f77a406a430 0x7f77a406c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f77b4035000 tx=0x7f77b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:33.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.345+0000 7f77ad7fa640 1 -- 172.21.15.106:0/3164254243 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f77b0053cf0 con 0x7f77b80c7640 2023-12-22T09:16:33.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.535+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f77b8073f10 con 0x7f77b80c7640 2023-12-22T09:16:33.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.536+0000 7f77ad7fa640 1 -- 172.21.15.106:0/3164254243 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f77b0057310 con 0x7f77b80c7640 2023-12-22T09:16:33.536 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:33.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f77a406a430 msgr2=0x7f77a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f77a406a430 0x7f77a406c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f77b4035000 tx=0x7f77b4008030 comp rx=0 tx=0).stop 2023-12-22T09:16:33.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c7640 msgr2=0x7f77b80c0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c7640 0x7f77b80c0810 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f77b000b970 tx=0x7f77b000be30 comp rx=0 tx=0).stop 2023-12-22T09:16:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 shutdown_connections 2023-12-22T09:16:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f77a406a430 0x7f77a406c8f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77b80c7640 0x7f77b80c0810 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77b80c6150 0x7f77b81e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 --2- 172.21.15.106:0/3164254243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77b806ca00 0x7f77b80c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 >> 172.21.15.106:0/3164254243 conn(0x7f77b80ab330 msgr2=0x7f77b8150950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.538+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 shutdown_connections 2023-12-22T09:16:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.539+0000 7f77bef9f640 1 -- 172.21.15.106:0/3164254243 wait complete. 2023-12-22T09:16:33.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:33.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.767+0000 7f4565e26640 1 Processor -- start 2023-12-22T09:16:33.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.767+0000 7f4565e26640 1 -- start start 2023-12-22T09:16:33.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.769+0000 7f4565e26640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f45600c4130 0x7f45600c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.769+0000 7f4565e26640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f456006aad0 0x7f45600c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.769+0000 7f4565e26640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45600c4660 con 0x7f45601514b0 2023-12-22T09:16:33.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.769+0000 7f4565e26640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4560153d60 con 0x7f45600c4130 2023-12-22T09:16:33.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.769+0000 7f4565e26640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4560154c50 con 0x7f456006aad0 2023-12-22T09:16:33.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.769+0000 7f4556ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f45600c4130 0x7f45600c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.769+0000 7f4556ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f45600c4130 0x7f45600c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52954/0 (socket says 172.21.15.106:52954) 2023-12-22T09:16:33.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.769+0000 7f4556ffd640 1 -- 172.21.15.106:0/2528654932 learned_addr learned my addr 172.21.15.106:0/2528654932 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:33.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.769+0000 7f455ffff640 1 --2- 172.21.15.106:0/2528654932 >> v2:172.21.15.132:3300/0 conn(0x7f456006aad0 0x7f45600c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.770+0000 7f4556ffd640 1 -- 172.21.15.106:0/2528654932 >> v2:172.21.15.132:3300/0 conn(0x7f456006aad0 msgr2=0x7f45600c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:33.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.770+0000 7f4556ffd640 1 --2- 172.21.15.106:0/2528654932 >> v2:172.21.15.132:3300/0 conn(0x7f456006aad0 0x7f45600c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.770+0000 7f4556ffd640 1 -- 172.21.15.106:0/2528654932 >> v1:172.21.15.132:6789/0 conn(0x7f45601514b0 legacy=0x7f4560154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:33.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.770+0000 7f4556ffd640 1 -- 172.21.15.106:0/2528654932 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456006b250 con 0x7f45600c4130 2023-12-22T09:16:33.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.771+0000 7f4556ffd640 1 --2- 172.21.15.106:0/2528654932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 0x7f45600c75b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4560066990 tx=0x7f454802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a55c676a176e5d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:33.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.771+0000 7f455effd640 1 -- 172.21.15.106:0/2528654932 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480317e0 con 0x7f45600c4130 2023-12-22T09:16:33.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.771+0000 7f455effd640 1 -- 172.21.15.106:0/2528654932 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4548031940 con 0x7f45600c4130 2023-12-22T09:16:33.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.771+0000 7f455effd640 1 -- 172.21.15.106:0/2528654932 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548031cd0 con 0x7f45600c4130 2023-12-22T09:16:33.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.772+0000 7f4565e26640 1 -- 172.21.15.106:0/2528654932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 msgr2=0x7f45600c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.772+0000 7f4565e26640 1 --2- 172.21.15.106:0/2528654932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 0x7f45600c75b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4560066990 tx=0x7f454802b880 comp rx=0 tx=0).stop 2023-12-22T09:16:33.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.772+0000 7f4565e26640 1 -- 172.21.15.106:0/2528654932 shutdown_connections 2023-12-22T09:16:33.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.772+0000 7f4565e26640 1 --2- 172.21.15.106:0/2528654932 >> v2:172.21.15.132:3300/0 conn(0x7f456006aad0 0x7f45600c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.772+0000 7f4565e26640 1 --2- 172.21.15.106:0/2528654932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 0x7f45600c75b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.772+0000 7f4565e26640 1 -- 172.21.15.106:0/2528654932 >> 172.21.15.106:0/2528654932 conn(0x7f45600ab1a0 msgr2=0x7f45600ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:33.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.772+0000 7f4565e26640 1 -- 172.21.15.106:0/2528654932 shutdown_connections 2023-12-22T09:16:33.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.772+0000 7f4565e26640 1 -- 172.21.15.106:0/2528654932 wait complete. 2023-12-22T09:16:33.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.773+0000 7f4565e26640 1 Processor -- start 2023-12-22T09:16:33.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.774+0000 7f4565e26640 1 -- start start 2023-12-22T09:16:33.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.774+0000 7f4565e26640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f456006aad0 0x7f45600aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.774+0000 7f4565e26640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 0x7f4560149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.774+0000 7f4565e26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45601514b0 0x7f45601499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.774+0000 7f4565e26640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45600c16b0 con 0x7f45600c4130 2023-12-22T09:16:33.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.774+0000 7f4565e26640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45601ece10 con 0x7f45601514b0 2023-12-22T09:16:33.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.774+0000 7f4565e26640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45600c0ff0 con 0x7f456006aad0 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f4556ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 0x7f4560149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f4556ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 0x7f4560149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52958/0 (socket says 172.21.15.106:52958) 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f4556ffd640 1 -- 172.21.15.106:0/1071139202 learned_addr learned my addr 172.21.15.106:0/1071139202 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f4556ffd640 1 -- 172.21.15.106:0/1071139202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f456006aad0 msgr2=0x7f45600aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f455f7fe640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f456006aad0 0x7f45600aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f455ffff640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45601514b0 0x7f45601499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f4556ffd640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f456006aad0 0x7f45600aa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f4556ffd640 1 -- 172.21.15.106:0/1071139202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45601514b0 msgr2=0x7f45601499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f4556ffd640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45601514b0 0x7f45601499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f4556ffd640 1 -- 172.21.15.106:0/1071139202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45480094d0 con 0x7f45600c4130 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.775+0000 7f455f7fe640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f456006aad0 0x7f45600aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:33.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.776+0000 7f4556ffd640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 0x7f4560149470 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4548000c00 tx=0x7f45480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.776+0000 7f455cff9640 1 -- 172.21.15.106:0/1071139202 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548032880 con 0x7f45600c4130 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.776+0000 7f455cff9640 1 -- 172.21.15.106:0/1071139202 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4548032a20 con 0x7f45600c4130 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.776+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45600c12d0 con 0x7f45600c4130 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.776+0000 7f455cff9640 1 -- 172.21.15.106:0/1071139202 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548032dd0 con 0x7f45600c4130 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.776+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45600aac80 con 0x7f45600c4130 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.777+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45600c1130 con 0x7f45600c4130 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.778+0000 7f455cff9640 1 -- 172.21.15.106:0/1071139202 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f454804e450 con 0x7f45600c4130 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.779+0000 7f455cff9640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f454006a460 0x7f454006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.779+0000 7f455cff9640 1 -- 172.21.15.106:0/1071139202 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f45480aae20 con 0x7f45600c4130 2023-12-22T09:16:33.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.779+0000 7f455f7fe640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f454006a460 0x7f454006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:33.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.780+0000 7f455f7fe640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f454006a460 0x7f454006c920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f455000a830 tx=0x7f4550008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:33.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:33.784+0000 7f455cff9640 1 -- 172.21.15.106:0/1071139202 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f45600c1130 con 0x7f45600c4130 2023-12-22T09:16:34.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.013+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45600c1130 con 0x7f45600c4130 2023-12-22T09:16:34.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.014+0000 7f455cff9640 1 -- 172.21.15.106:0/1071139202 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5779 (secure 0 0 0) 0x7f45600c1130 con 0x7f45600c4130 2023-12-22T09:16:34.014 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:34.014 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:15:55.115066+0000","modified":"2023-12-22T09:15:58.132101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6835/3435163215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3435163215},{"type":"v1","addr":"172.21.15.132:6835","nonce":3435163215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:10.238217+0000","modified":"2023-12-22T09:16:13.270608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4792":{"gid":4792,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T09:16:34.014 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 21 2023-12-22T09:16:34.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f454006a460 msgr2=0x7f454006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f454006a460 0x7f454006c920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f455000a830 tx=0x7f4550008040 comp rx=0 tx=0).stop 2023-12-22T09:16:34.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 msgr2=0x7f4560149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 0x7f4560149470 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4548000c00 tx=0x7f45480046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 shutdown_connections 2023-12-22T09:16:34.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f454006a460 0x7f454006c920 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45601514b0 0x7f45601499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45600c4130 0x7f4560149470 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 --2- 172.21.15.106:0/1071139202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f456006aad0 0x7f45600aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 >> 172.21.15.106:0/1071139202 conn(0x7f45600ab1a0 msgr2=0x7f45600ab810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:34.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 shutdown_connections 2023-12-22T09:16:34.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.017+0000 7f4565e26640 1 -- 172.21.15.106:0/1071139202 wait complete. 2023-12-22T09:16:34.035 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:34.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.250+0000 7f71ba567640 1 Processor -- start 2023-12-22T09:16:34.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.250+0000 7f71ba567640 1 -- start start 2023-12-22T09:16:34.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.251+0000 7f71ba567640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40a8150 0x7f71b4070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.251+0000 7f71ba567640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71b40c16f0 0x7f71b4071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.252+0000 7f71ba567640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b4152300 con 0x7f71b414f050 2023-12-22T09:16:34.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.252+0000 7f71ba567640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b414f430 con 0x7f71b40c16f0 2023-12-22T09:16:34.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.252+0000 7f71ba567640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b41519f0 con 0x7f71b40a8150 2023-12-22T09:16:34.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.252+0000 7f71b9d66640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71b40c16f0 0x7f71b4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.252+0000 7f71b8d64640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40a8150 0x7f71b4070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.252+0000 7f71b9d66640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71b40c16f0 0x7f71b4071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:51572/0 (socket says 172.21.15.106:51572) 2023-12-22T09:16:34.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.252+0000 7f71b8d64640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40a8150 0x7f71b4070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:59822/0 (socket says 172.21.15.106:59822) 2023-12-22T09:16:34.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.252+0000 7f71b9d66640 1 -- 172.21.15.106:0/2727168601 learned_addr learned my addr 172.21.15.106:0/2727168601 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:34.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.253+0000 7f71b9d66640 1 -- 172.21.15.106:0/2727168601 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40a8150 msgr2=0x7f71b4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:34.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.253+0000 7f71b9d66640 1 --2- 172.21.15.106:0/2727168601 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40a8150 0x7f71b4070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.253+0000 7f71b9d66640 1 -- 172.21.15.106:0/2727168601 >> v1:172.21.15.132:6789/0 conn(0x7f71b414f050 legacy=0x7f71b40c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.253+0000 7f71b9d66640 1 -- 172.21.15.106:0/2727168601 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b40c0860 con 0x7f71b40c16f0 2023-12-22T09:16:34.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.253+0000 7f71b8d64640 1 --2- 172.21.15.106:0/2727168601 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40a8150 0x7f71b4070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:16:34.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.254+0000 7f71b9d66640 1 --2- 172.21.15.106:0/2727168601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71b40c16f0 0x7f71b4071340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009e50 tx=0x7f71ac02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35a45f981e6f2442 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:34.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.255+0000 7f71abfff640 1 -- 172.21.15.106:0/2727168601 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac02ca80 con 0x7f71b40c16f0 2023-12-22T09:16:34.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.255+0000 7f71abfff640 1 -- 172.21.15.106:0/2727168601 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac02cbe0 con 0x7f71b40c16f0 2023-12-22T09:16:34.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.255+0000 7f71abfff640 1 -- 172.21.15.106:0/2727168601 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0343f0 con 0x7f71b40c16f0 2023-12-22T09:16:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.256+0000 7f71ba567640 1 -- 172.21.15.106:0/2727168601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71b40c16f0 msgr2=0x7f71b4071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.256+0000 7f71ba567640 1 --2- 172.21.15.106:0/2727168601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71b40c16f0 0x7f71b4071340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009e50 tx=0x7f71ac02bee0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.256+0000 7f71ba567640 1 -- 172.21.15.106:0/2727168601 shutdown_connections 2023-12-22T09:16:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.256+0000 7f71ba567640 1 --2- 172.21.15.106:0/2727168601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71b40c16f0 0x7f71b4071340 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.256+0000 7f71ba567640 1 --2- 172.21.15.106:0/2727168601 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40a8150 0x7f71b4070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.256+0000 7f71ba567640 1 -- 172.21.15.106:0/2727168601 >> 172.21.15.106:0/2727168601 conn(0x7f71b4069dd0 msgr2=0x7f71b406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.256+0000 7f71ba567640 1 -- 172.21.15.106:0/2727168601 shutdown_connections 2023-12-22T09:16:34.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.256+0000 7f71ba567640 1 -- 172.21.15.106:0/2727168601 wait complete. 2023-12-22T09:16:34.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.258+0000 7f71ba567640 1 Processor -- start 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.259+0000 7f71ba567640 1 -- start start 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71ba567640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71b40a8150 0x7f71b40be740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71ba567640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40c16f0 0x7f71b4144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71ba567640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71b414f050 0x7f71b41451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71ba567640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40c5970 con 0x7f71b40a8150 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71ba567640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40c4d60 con 0x7f71b414f050 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71ba567640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40c5040 con 0x7f71b40c16f0 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71b9565640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71b40a8150 0x7f71b40be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71b9565640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71b40a8150 0x7f71b40be740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52960/0 (socket says 172.21.15.106:52960) 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71b9565640 1 -- 172.21.15.106:0/2372332022 learned_addr learned my addr 172.21.15.106:0/2372332022 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71b9d66640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71b414f050 0x7f71b41451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.260+0000 7f71b8d64640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40c16f0 0x7f71b4144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71b9565640 1 -- 172.21.15.106:0/2372332022 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40c16f0 msgr2=0x7f71b4144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71b9565640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40c16f0 0x7f71b4144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71b9565640 1 -- 172.21.15.106:0/2372332022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71b414f050 msgr2=0x7f71b41451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71b9565640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71b414f050 0x7f71b41451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71b9565640 1 -- 172.21.15.106:0/2372332022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4009400 con 0x7f71b40a8150 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71b8d64640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40c16f0 0x7f71b4144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71b9565640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71b40a8150 0x7f71b40be740 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f71b000c400 tx=0x7f71b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71a9ffb640 1 -- 172.21.15.106:0/2372332022 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00052d0 con 0x7f71b40a8150 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71a9ffb640 1 -- 172.21.15.106:0/2372332022 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b0005430 con 0x7f71b40a8150 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71a9ffb640 1 -- 172.21.15.106:0/2372332022 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0003830 con 0x7f71b40a8150 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.261+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac009b30 con 0x7f71b40a8150 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.262+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b40c5600 con 0x7f71b40a8150 2023-12-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.263+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b4152790 con 0x7f71b40a8150 2023-12-22T09:16:34.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.264+0000 7f71a9ffb640 1 -- 172.21.15.106:0/2372332022 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f71b0003990 con 0x7f71b40a8150 2023-12-22T09:16:34.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.265+0000 7f71a9ffb640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f719806a430 0x7f719806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.265+0000 7f71a9ffb640 1 -- 172.21.15.106:0/2372332022 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f71b0088400 con 0x7f71b40a8150 2023-12-22T09:16:34.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.265+0000 7f71b8d64640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f719806a430 0x7f719806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.266+0000 7f71b8d64640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f719806a430 0x7f719806c8f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f71b40c4ae0 tx=0x7f71a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:34.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.270+0000 7f71a9ffb640 1 -- 172.21.15.106:0/2372332022 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f71b00534b0 con 0x7f71b40a8150 2023-12-22T09:16:34.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.464+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71b404e8d0 con 0x7f71b40a8150 2023-12-22T09:16:34.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.467+0000 7f71a9ffb640 1 -- 172.21.15.106:0/2372332022 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20070 (secure 0 0 0) 0x7f71b0056ad0 con 0x7f71b40a8150 2023-12-22T09:16:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:34.468 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:11.243405+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f719806a430 msgr2=0x7f719806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f719806a430 0x7f719806c8f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f71b40c4ae0 tx=0x7f71a4008040 comp rx=0 tx=0).stop 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71b40a8150 msgr2=0x7f71b40be740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71b40a8150 0x7f71b40be740 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f71b000c400 tx=0x7f71b000c8c0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 shutdown_connections 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f719806a430 0x7f719806c8f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71b414f050 0x7f71b41451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71b40c16f0 0x7f71b4144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 --2- 172.21.15.106:0/2372332022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71b40a8150 0x7f71b40be740 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 >> 172.21.15.106:0/2372332022 conn(0x7f71b4069dd0 msgr2=0x7f71b414a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:34.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 shutdown_connections 2023-12-22T09:16:34.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.470+0000 7f71ba567640 1 -- 172.21.15.106:0/2372332022 wait complete. 2023-12-22T09:16:34.495 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T09:16:34.495 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:34.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.709+0000 7f3d7f054640 1 Processor -- start 2023-12-22T09:16:34.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.709+0000 7f3d7f054640 1 -- start start 2023-12-22T09:16:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.711+0000 7f3d7f054640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78071510 0x7f3d7815d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.711+0000 7f3d7f054640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d78152300 con 0x7f3d7814f050 2023-12-22T09:16:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.711+0000 7f3d7f054640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7814f430 con 0x7f3d780a8150 2023-12-22T09:16:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.711+0000 7f3d7f054640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d781519f0 con 0x7f3d78071510 2023-12-22T09:16:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.711+0000 7f3d7e052640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3d7814f050 0x7f3d780c1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53884/0 (socket says 172.21.15.106:53884) 2023-12-22T09:16:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.711+0000 7f3d7e052640 1 -- 172.21.15.106:0/2026033460 learned_addr learned my addr 172.21.15.106:0/2026033460 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7e853640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78071510 0x7f3d7815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79720454 0 0) 0x7f3d78152300 con 0x7f3d7814f050 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d64003520 con 0x7f3d7814f050 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1816466989 0 0) 0x7f3d64003520 con 0x7f3d7814f050 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78071510 msgr2=0x7f3d7815d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78071510 0x7f3d7815d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 >> v1:172.21.15.132:6789/0 conn(0x7f3d780a8150 legacy=0x7f3d78070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d780c0860 con 0x7f3d7814f050 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f3d74001670 con 0x7f3d7814f050 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 >> v1:172.21.15.106:6789/0 conn(0x7f3d7814f050 legacy=0x7f3d780c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78071510 0x7f3d640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d64004d00 0x7f3d64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d781519f0 con 0x7f3d640039a0 2023-12-22T09:16:34.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6400bb10 con 0x7f3d64004d00 2023-12-22T09:16:34.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.712+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6400bcd0 con 0x7f3d78071510 2023-12-22T09:16:34.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.713+0000 7f3d7e052640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d64003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.713+0000 7f3d7e052640 1 -- 172.21.15.106:0/2026033460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78071510 msgr2=0x7f3d640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:34.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.713+0000 7f3d7e052640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78071510 0x7f3d640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.713+0000 7f3d7e052640 1 -- 172.21.15.106:0/2026033460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d64004d00 msgr2=0x7f3d64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:34.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.713+0000 7f3d7e052640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d64004d00 0x7f3d64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.713+0000 7f3d7e052640 1 -- 172.21.15.106:0/2026033460 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d64003520 con 0x7f3d640039a0 2023-12-22T09:16:34.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.714+0000 7f3d7e052640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d64003dc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c0e0 tx=0x7f3d640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3359e9e1dad6846 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:34.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.714+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74005ad0 con 0x7f3d640039a0 2023-12-22T09:16:34.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.714+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74005c30 con 0x7f3d640039a0 2023-12-22T09:16:34.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.714+0000 7f3d7d050640 1 -- 172.21.15.106:0/2026033460 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7402c810 con 0x7f3d640039a0 2023-12-22T09:16:34.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.715+0000 7f3d7f054640 1 -- 172.21.15.106:0/2026033460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 msgr2=0x7f3d64003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.715+0000 7f3d7f054640 1 --2- 172.21.15.106:0/2026033460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d64003dc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c0e0 tx=0x7f3d640057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.715+0000 7f3d7e853640 1 -- 172.21.15.106:0/2026033460 reap_dead start 2023-12-22T09:16:34.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.715+0000 7f3d7f054640 1 -- 172.21.15.106:0/2026033460 shutdown_connections 2023-12-22T09:16:34.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.715+0000 7f3d7f054640 1 -- 172.21.15.106:0/2026033460 >> 172.21.15.106:0/2026033460 conn(0x7f3d78069dd0 msgr2=0x7f3d7806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:34.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.715+0000 7f3d7f054640 1 -- 172.21.15.106:0/2026033460 shutdown_connections 2023-12-22T09:16:34.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.715+0000 7f3d7f054640 1 -- 172.21.15.106:0/2026033460 wait complete. 2023-12-22T09:16:34.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.717+0000 7f3d7f054640 1 Processor -- start 2023-12-22T09:16:34.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.717+0000 7f3d7f054640 1 -- start start 2023-12-22T09:16:34.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7f054640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d780c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7f054640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d7814b370 0x7f3d781ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7f054640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78144810 0x7f3d78155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7f054640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d78153720 con 0x7f3d640039a0 2023-12-22T09:16:34.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7f054640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d781ea5a0 con 0x7f3d7814b370 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7f054640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7814e400 con 0x7f3d78144810 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7e052640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d780c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7e052640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d780c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52976/0 (socket says 172.21.15.106:52976) 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7e052640 1 -- 172.21.15.106:0/1739477486 learned_addr learned my addr 172.21.15.106:0/1739477486 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7e052640 1 -- 172.21.15.106:0/1739477486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78144810 msgr2=0x7f3d78155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7e052640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78144810 0x7f3d78155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7e052640 1 -- 172.21.15.106:0/1739477486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d7814b370 msgr2=0x7f3d781ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7e052640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d7814b370 0x7f3d781ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.718+0000 7f3d7e052640 1 -- 172.21.15.106:0/1739477486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d78144f40 con 0x7f3d640039a0 2023-12-22T09:16:34.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.719+0000 7f3d7e052640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d780c4720 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c0e0 tx=0x7f3d74001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:34.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.719+0000 7f3d6effd640 1 -- 172.21.15.106:0/1739477486 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74039070 con 0x7f3d640039a0 2023-12-22T09:16:34.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.719+0000 7f3d6effd640 1 -- 172.21.15.106:0/1739477486 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7402cc20 con 0x7f3d640039a0 2023-12-22T09:16:34.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.719+0000 7f3d6effd640 1 -- 172.21.15.106:0/1739477486 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7403c040 con 0x7f3d640039a0 2023-12-22T09:16:34.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.719+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d78145200 con 0x7f3d640039a0 2023-12-22T09:16:34.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.719+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d78154f00 con 0x7f3d640039a0 2023-12-22T09:16:34.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.720+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d78151c90 con 0x7f3d640039a0 2023-12-22T09:16:34.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.721+0000 7f3d6effd640 1 -- 172.21.15.106:0/1739477486 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3d74032070 con 0x7f3d640039a0 2023-12-22T09:16:34.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.722+0000 7f3d6effd640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d5c06a460 0x7f3d5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:34.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.722+0000 7f3d6effd640 1 -- 172.21.15.106:0/1739477486 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f3d740aa090 con 0x7f3d640039a0 2023-12-22T09:16:34.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.722+0000 7f3d7d851640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d5c06a460 0x7f3d5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:34.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.723+0000 7f3d7d851640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d5c06a460 0x7f3d5c06c920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3d781560a0 tx=0x7f3d68007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:34.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.727+0000 7f3d6effd640 1 -- 172.21.15.106:0/1739477486 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3d78151c90 con 0x7f3d640039a0 2023-12-22T09:16:34.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.956+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d78151c90 con 0x7f3d640039a0 2023-12-22T09:16:34.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.957+0000 7f3d6effd640 1 -- 172.21.15.106:0/1739477486 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5779 (secure 0 0 0) 0x7f3d78151c90 con 0x7f3d640039a0 2023-12-22T09:16:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:34.957 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:15:55.115066+0000","modified":"2023-12-22T09:15:58.132101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6835/3435163215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3435163215},{"type":"v1","addr":"172.21.15.132:6835","nonce":3435163215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:10.238217+0000","modified":"2023-12-22T09:16:13.270608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4792":{"gid":4792,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T09:16:34.957 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 21 2023-12-22T09:16:34.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.959+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d5c06a460 msgr2=0x7f3d5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.959+0000 7f3d7f054640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d5c06a460 0x7f3d5c06c920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3d781560a0 tx=0x7f3d68007990 comp rx=0 tx=0).stop 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.959+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 msgr2=0x7f3d780c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.959+0000 7f3d7f054640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d780c4720 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c0e0 tx=0x7f3d74001930 comp rx=0 tx=0).stop 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.960+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 shutdown_connections 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.960+0000 7f3d7f054640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d5c06a460 0x7f3d5c06c920 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.960+0000 7f3d7f054640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d78144810 0x7f3d78155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.960+0000 7f3d7f054640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d7814b370 0x7f3d781ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.960+0000 7f3d7f054640 1 --2- 172.21.15.106:0/1739477486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d640039a0 0x7f3d780c4720 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.960+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 >> 172.21.15.106:0/1739477486 conn(0x7f3d78069dd0 msgr2=0x7f3d780bf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.960+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 shutdown_connections 2023-12-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:34.960+0000 7f3d7f054640 1 -- 172.21.15.106:0/1739477486 wait complete. 2023-12-22T09:16:34.977 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:35.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.194+0000 7fd8556a1640 1 Processor -- start 2023-12-22T09:16:35.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.195+0000 7fd8556a1640 1 -- start start 2023-12-22T09:16:35.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.196+0000 7fd8556a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850150a80 0x7fd850151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.196+0000 7fd8556a1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd850071ea0 0x7fd8501524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.196+0000 7fd8556a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8500bfce0 con 0x7fd850069e60 2023-12-22T09:16:35.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.196+0000 7fd8556a1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8500c0960 con 0x7fd850071ea0 2023-12-22T09:16:35.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.196+0000 7fd8556a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85006aba0 con 0x7fd850150a80 2023-12-22T09:16:35.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.197+0000 7fd84f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd850071ea0 0x7fd8501524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.197+0000 7fd8467fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850150a80 0x7fd850151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.197+0000 7fd84f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd850071ea0 0x7fd8501524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:51614/0 (socket says 172.21.15.106:51614) 2023-12-22T09:16:35.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.197+0000 7fd8467fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850150a80 0x7fd850151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:59880/0 (socket says 172.21.15.106:59880) 2023-12-22T09:16:35.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.197+0000 7fd84f7fe640 1 -- 172.21.15.106:0/3329555447 learned_addr learned my addr 172.21.15.106:0/3329555447 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:35.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.198+0000 7fd8467fc640 1 -- 172.21.15.106:0/3329555447 >> v2:172.21.15.132:3300/0 conn(0x7fd850071ea0 msgr2=0x7fd8501524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:35.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.198+0000 7fd8467fc640 1 --2- 172.21.15.106:0/3329555447 >> v2:172.21.15.132:3300/0 conn(0x7fd850071ea0 0x7fd8501524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.198+0000 7fd8467fc640 1 -- 172.21.15.106:0/3329555447 >> v1:172.21.15.132:6789/0 conn(0x7fd850069e60 legacy=0x7fd85014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.198+0000 7fd8467fc640 1 -- 172.21.15.106:0/3329555447 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500bffc0 con 0x7fd850150a80 2023-12-22T09:16:35.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.199+0000 7fd8467fc640 1 --2- 172.21.15.106:0/3329555447 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850150a80 0x7fd850151f70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd8380097a0 tx=0x7fd83802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5513956fa09b2f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:35.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.200+0000 7fd84e7fc640 1 -- 172.21.15.106:0/3329555447 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83802f050 con 0x7fd850150a80 2023-12-22T09:16:35.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.200+0000 7fd84e7fc640 1 -- 172.21.15.106:0/3329555447 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838031700 con 0x7fd850150a80 2023-12-22T09:16:35.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.200+0000 7fd84e7fc640 1 -- 172.21.15.106:0/3329555447 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838031a90 con 0x7fd850150a80 2023-12-22T09:16:35.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.200+0000 7fd8556a1640 1 -- 172.21.15.106:0/3329555447 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850150a80 msgr2=0x7fd850151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.201+0000 7fd8556a1640 1 --2- 172.21.15.106:0/3329555447 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850150a80 0x7fd850151f70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd8380097a0 tx=0x7fd83802b7a0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.201+0000 7fd8556a1640 1 -- 172.21.15.106:0/3329555447 shutdown_connections 2023-12-22T09:16:35.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.201+0000 7fd8556a1640 1 --2- 172.21.15.106:0/3329555447 >> v2:172.21.15.132:3300/0 conn(0x7fd850071ea0 0x7fd8501524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.201+0000 7fd8556a1640 1 --2- 172.21.15.106:0/3329555447 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850150a80 0x7fd850151f70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.201+0000 7fd8556a1640 1 -- 172.21.15.106:0/3329555447 >> 172.21.15.106:0/3329555447 conn(0x7fd8500c5360 msgr2=0x7fd8500c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:35.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.201+0000 7fd8556a1640 1 -- 172.21.15.106:0/3329555447 shutdown_connections 2023-12-22T09:16:35.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.201+0000 7fd8556a1640 1 -- 172.21.15.106:0/3329555447 wait complete. 2023-12-22T09:16:35.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.202+0000 7fd8556a1640 1 Processor -- start 2023-12-22T09:16:35.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.203+0000 7fd8556a1640 1 -- start start 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.203+0000 7fd8556a1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd850069e60 0x7fd850153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.203+0000 7fd8556a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850071ea0 0x7fd850140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.203+0000 7fd8556a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd850150a80 0x7fd85013ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.203+0000 7fd8556a1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85014e0b0 con 0x7fd850069e60 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.203+0000 7fd8556a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd850154210 con 0x7fd850150a80 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.203+0000 7fd8556a1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85014d780 con 0x7fd850071ea0 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.204+0000 7fd84effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd850069e60 0x7fd850153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.204+0000 7fd84effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd850069e60 0x7fd850153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52986/0 (socket says 172.21.15.106:52986) 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.204+0000 7fd84effd640 1 -- 172.21.15.106:0/3110395132 learned_addr learned my addr 172.21.15.106:0/3110395132 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.204+0000 7fd84effd640 1 -- 172.21.15.106:0/3110395132 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850071ea0 msgr2=0x7fd850140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.204+0000 7fd84effd640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850071ea0 0x7fd850140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.204+0000 7fd84effd640 1 -- 172.21.15.106:0/3110395132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd850150a80 msgr2=0x7fd85013ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.204+0000 7fd84f7fe640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd850150a80 0x7fd85013ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.204+0000 7fd84effd640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd850150a80 0x7fd85013ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.204+0000 7fd84effd640 1 -- 172.21.15.106:0/3110395132 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd838009400 con 0x7fd850069e60 2023-12-22T09:16:35.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.205+0000 7fd84effd640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd850069e60 0x7fd850153ba0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c3c0 tx=0x7fd84000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:35.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.205+0000 7fd847fff640 1 -- 172.21.15.106:0/3110395132 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400052d0 con 0x7fd850069e60 2023-12-22T09:16:35.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.205+0000 7fd847fff640 1 -- 172.21.15.106:0/3110395132 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840005450 con 0x7fd850069e60 2023-12-22T09:16:35.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.205+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85014da60 con 0x7fd850069e60 2023-12-22T09:16:35.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.205+0000 7fd847fff640 1 -- 172.21.15.106:0/3110395132 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840006a60 con 0x7fd850069e60 2023-12-22T09:16:35.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.205+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd850140c90 con 0x7fd850069e60 2023-12-22T09:16:35.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.206+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd850073f10 con 0x7fd850069e60 2023-12-22T09:16:35.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.207+0000 7fd847fff640 1 -- 172.21.15.106:0/3110395132 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd840003640 con 0x7fd850069e60 2023-12-22T09:16:35.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.208+0000 7fd847fff640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd83006a430 0x7fd83006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.208+0000 7fd847fff640 1 -- 172.21.15.106:0/3110395132 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd840088070 con 0x7fd850069e60 2023-12-22T09:16:35.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.208+0000 7fd8467fc640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd83006a430 0x7fd83006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.209+0000 7fd8467fc640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd83006a430 0x7fd83006c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd838035000 tx=0x7fd838030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:35.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.212+0000 7fd847fff640 1 -- 172.21.15.106:0/3110395132 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd840053250 con 0x7fd850069e60 2023-12-22T09:16:35.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.440+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd85014f070 con 0x7fd850069e60 2023-12-22T09:16:35.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.442+0000 7fd847fff640 1 -- 172.21.15.106:0/3110395132 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5779 (secure 0 0 0) 0x7fd840056870 con 0x7fd850069e60 2023-12-22T09:16:35.441 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:35.441 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:15:55.115066+0000","modified":"2023-12-22T09:15:58.132101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6835/3435163215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3435163215},{"type":"v1","addr":"172.21.15.132:6835","nonce":3435163215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:10.238217+0000","modified":"2023-12-22T09:16:13.270608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4792":{"gid":4792,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T09:16:35.442 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 21 2023-12-22T09:16:35.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd83006a430 msgr2=0x7fd83006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd83006a430 0x7fd83006c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd838035000 tx=0x7fd838030000 comp rx=0 tx=0).stop 2023-12-22T09:16:35.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd850069e60 msgr2=0x7fd850153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd850069e60 0x7fd850153ba0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c3c0 tx=0x7fd84000c880 comp rx=0 tx=0).stop 2023-12-22T09:16:35.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 shutdown_connections 2023-12-22T09:16:35.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd83006a430 0x7fd83006c8f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd850150a80 0x7fd85013ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd850071ea0 0x7fd850140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 --2- 172.21.15.106:0/3110395132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd850069e60 0x7fd850153ba0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 >> 172.21.15.106:0/3110395132 conn(0x7fd8500c5360 msgr2=0x7fd8500a92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:35.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 shutdown_connections 2023-12-22T09:16:35.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.444+0000 7fd8556a1640 1 -- 172.21.15.106:0/3110395132 wait complete. 2023-12-22T09:16:35.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:35.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.674+0000 7fcfd1441640 1 Processor -- start 2023-12-22T09:16:35.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.674+0000 7fcfd1441640 1 -- start start 2023-12-22T09:16:35.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.676+0000 7fcfd1441640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcfcc0bfce0 0x7fcfcc06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.676+0000 7fcfd1441640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc0bf770 con 0x7fcfcc13b060 2023-12-22T09:16:35.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.676+0000 7fcfd1441640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc155120 con 0x7fcfcc151b30 2023-12-22T09:16:35.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.676+0000 7fcfd1441640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc155400 con 0x7fcfcc0bfce0 2023-12-22T09:16:35.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.676+0000 7fcfcaffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcfcc13b060 0x7fcfcc069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53892/0 (socket says 172.21.15.106:53892) 2023-12-22T09:16:35.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.676+0000 7fcfc27fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcfcc0bfce0 0x7fcfcc06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.676+0000 7fcfcaffd640 1 -- 172.21.15.106:0/715311751 learned_addr learned my addr 172.21.15.106:0/715311751 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:35.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.677+0000 7fcfca7fc640 1 -- 172.21.15.106:0/715311751 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355327176 0 0) 0x7fcfcc0bf770 con 0x7fcfcc13b060 2023-12-22T09:16:35.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.677+0000 7fcfca7fc640 1 -- 172.21.15.106:0/715311751 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb8003520 con 0x7fcfcc13b060 2023-12-22T09:16:35.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.677+0000 7fcfc27fc640 1 -- 172.21.15.106:0/715311751 >> v1:172.21.15.132:6789/0 conn(0x7fcfcc151b30 legacy=0x7fcfcc151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:35.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.677+0000 7fcfc27fc640 1 -- 172.21.15.106:0/715311751 >> v1:172.21.15.106:6789/0 conn(0x7fcfcc13b060 legacy=0x7fcfcc069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.677+0000 7fcfc27fc640 1 -- 172.21.15.106:0/715311751 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc1556e0 con 0x7fcfcc0bfce0 2023-12-22T09:16:35.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.678+0000 7fcfc27fc640 1 --2- 172.21.15.106:0/715311751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc0bfce0 0x7fcfcc06a6b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40097a0 tx=0x7fcfb402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c898b6d7a1b87f0b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.678+0000 7fcfca7fc640 1 -- 172.21.15.106:0/715311751 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb402e070 con 0x7fcfcc0bfce0 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.678+0000 7fcfca7fc640 1 -- 172.21.15.106:0/715311751 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb40315a0 con 0x7fcfcc0bfce0 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.678+0000 7fcfca7fc640 1 -- 172.21.15.106:0/715311751 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4031910 con 0x7fcfcc0bfce0 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.679+0000 7fcfd1441640 1 -- 172.21.15.106:0/715311751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc0bfce0 msgr2=0x7fcfcc06a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.679+0000 7fcfd1441640 1 --2- 172.21.15.106:0/715311751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc0bfce0 0x7fcfcc06a6b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40097a0 tx=0x7fcfb402b840 comp rx=0 tx=0).stop 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.679+0000 7fcfd1441640 1 -- 172.21.15.106:0/715311751 shutdown_connections 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.679+0000 7fcfd1441640 1 --2- 172.21.15.106:0/715311751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc0bfce0 0x7fcfcc06a6b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.679+0000 7fcfd1441640 1 -- 172.21.15.106:0/715311751 >> 172.21.15.106:0/715311751 conn(0x7fcfcc0c5360 msgr2=0x7fcfcc0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.679+0000 7fcfd1441640 1 -- 172.21.15.106:0/715311751 shutdown_connections 2023-12-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.679+0000 7fcfd1441640 1 -- 172.21.15.106:0/715311751 wait complete. 2023-12-22T09:16:35.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.681+0000 7fcfd1441640 1 Processor -- start 2023-12-22T09:16:35.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.681+0000 7fcfd1441640 1 -- start start 2023-12-22T09:16:35.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.682+0000 7fcfd1441640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfcc0bfce0 0x7fcfcc139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.682+0000 7fcfd1441640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfcc13b060 0x7fcfcc1ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.682+0000 7fcfd1441640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc151b30 0x7fcfcc070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.682+0000 7fcfd1441640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc137950 con 0x7fcfcc151b30 2023-12-22T09:16:35.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.682+0000 7fcfd1441640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc1541e0 con 0x7fcfcc13b060 2023-12-22T09:16:35.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.682+0000 7fcfd1441640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc1ed050 con 0x7fcfcc0bfce0 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.682+0000 7fcfcb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc151b30 0x7fcfcc070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.682+0000 7fcfcb7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc151b30 0x7fcfcc070d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53000/0 (socket says 172.21.15.106:53000) 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.682+0000 7fcfcb7fe640 1 -- 172.21.15.106:0/2756940555 learned_addr learned my addr 172.21.15.106:0/2756940555 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfc27fc640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfcc13b060 0x7fcfcc1ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfcaffd640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfcc0bfce0 0x7fcfcc139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfcb7fe640 1 -- 172.21.15.106:0/2756940555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfcc0bfce0 msgr2=0x7fcfcc139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfcb7fe640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfcc0bfce0 0x7fcfcc139400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfcb7fe640 1 -- 172.21.15.106:0/2756940555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfcc13b060 msgr2=0x7fcfcc1ecb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfcb7fe640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfcc13b060 0x7fcfcc1ecb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfcb7fe640 1 -- 172.21.15.106:0/2756940555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4009400 con 0x7fcfcc151b30 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfc27fc640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfcc13b060 0x7fcfcc1ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfcb7fe640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc151b30 0x7fcfcc070d70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c780 tx=0x7fcfc400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfc3fff640 1 -- 172.21.15.106:0/2756940555 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4004b60 con 0x7fcfcc151b30 2023-12-22T09:16:35.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfc3fff640 1 -- 172.21.15.106:0/2756940555 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc400ce90 con 0x7fcfcc151b30 2023-12-22T09:16:35.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfc3fff640 1 -- 172.21.15.106:0/2756940555 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc400a850 con 0x7fcfcc151b30 2023-12-22T09:16:35.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.683+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc139a00 con 0x7fcfcc151b30 2023-12-22T09:16:35.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.684+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc139fc0 con 0x7fcfcc151b30 2023-12-22T09:16:35.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.685+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc154350 con 0x7fcfcc151b30 2023-12-22T09:16:35.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.686+0000 7fcfc3fff640 1 -- 172.21.15.106:0/2756940555 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcfc400a9b0 con 0x7fcfcc151b30 2023-12-22T09:16:35.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.687+0000 7fcfc3fff640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcfac06a430 0x7fcfac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:35.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.687+0000 7fcfc3fff640 1 -- 172.21.15.106:0/2756940555 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fcfc4088fe0 con 0x7fcfcc151b30 2023-12-22T09:16:35.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.687+0000 7fcfcaffd640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcfac06a430 0x7fcfac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:35.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.688+0000 7fcfcaffd640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcfac06a430 0x7fcfac06c8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc001360 tx=0x7fcfbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:35.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.691+0000 7fcfc3fff640 1 -- 172.21.15.106:0/2756940555 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcfc4054130 con 0x7fcfcc151b30 2023-12-22T09:16:35.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.883+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfcc073f10 con 0x7fcfcc151b30 2023-12-22T09:16:35.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.887+0000 7fcfc3fff640 1 -- 172.21.15.106:0/2756940555 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20070 (secure 0 0 0) 0x7fcfc4057750 con 0x7fcfcc151b30 2023-12-22T09:16:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:35.887 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":44,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:11.243405+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:15:52.874302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T09:15:54.136774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:35.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcfac06a430 msgr2=0x7fcfac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcfac06a430 0x7fcfac06c8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc001360 tx=0x7fcfbc009040 comp rx=0 tx=0).stop 2023-12-22T09:16:35.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc151b30 msgr2=0x7fcfcc070d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:35.889 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc151b30 0x7fcfcc070d70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c780 tx=0x7fcfc400cc40 comp rx=0 tx=0).stop 2023-12-22T09:16:35.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 shutdown_connections 2023-12-22T09:16:35.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fcfac06a430 0x7fcfac06c8f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfcc151b30 0x7fcfcc070d70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfcc13b060 0x7fcfcc1ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 --2- 172.21.15.106:0/2756940555 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcfcc0bfce0 0x7fcfcc139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:35.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.889+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 >> 172.21.15.106:0/2756940555 conn(0x7fcfcc0c5360 msgr2=0x7fcfcc0aa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:35.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.890+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 shutdown_connections 2023-12-22T09:16:35.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:35.890+0000 7fcfd1441640 1 -- 172.21.15.106:0/2756940555 wait complete. 2023-12-22T09:16:35.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T09:16:36.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.115+0000 7ff7931c4640 1 Processor -- start 2023-12-22T09:16:36.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.115+0000 7ff7931c4640 1 -- start start 2023-12-22T09:16:36.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.117+0000 7ff7931c4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff78c151300 0x7ff78c0c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.117+0000 7ff7931c4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c1516e0 con 0x7ff78c0be6e0 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.117+0000 7ff7931c4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c0beb10 con 0x7ff78c06bc70 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.117+0000 7ff7931c4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c154ce0 con 0x7ff78c151300 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.117+0000 7ff791761640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff78c0be6e0 0x7ff78c069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53898/0 (socket says 172.21.15.106:53898) 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.117+0000 7ff791761640 1 -- 172.21.15.106:0/3402338898 learned_addr learned my addr 172.21.15.106:0/3402338898 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.117+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681736787 0 0) 0x7ff78c1516e0 con 0x7ff78c0be6e0 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.117+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff774003520 con 0x7ff78c0be6e0 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff790f60640 1 --2- 172.21.15.106:0/3402338898 >> v2:172.21.15.132:3300/0 conn(0x7ff78c151300 0x7ff78c0c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 347255173 0 0) 0x7ff774003520 con 0x7ff78c0be6e0 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 >> v2:172.21.15.132:3300/0 conn(0x7ff78c151300 msgr2=0x7ff78c0c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:36.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 --2- 172.21.15.106:0/3402338898 >> v2:172.21.15.132:3300/0 conn(0x7ff78c151300 0x7ff78c0c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 >> v1:172.21.15.132:6789/0 conn(0x7ff78c06bc70 legacy=0x7ff78c1545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c06c7b0 con 0x7ff78c0be6e0 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7ff7840019f0 con 0x7ff78c0be6e0 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 >> v1:172.21.15.106:6789/0 conn(0x7ff78c0be6e0 legacy=0x7ff78c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff774003970 0x7ff774003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7740047c0 0x7ff774004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff77400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c154ce0 con 0x7ff7740052a0 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77400c170 con 0x7ff774003970 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77400c330 con 0x7ff7740047c0 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.118+0000 7ff791761640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff77400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.119+0000 7ff790f60640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff774003970 0x7ff774003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.119+0000 7ff783fff640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7740047c0 0x7ff774004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.119+0000 7ff791761640 1 -- 172.21.15.106:0/3402338898 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7740047c0 msgr2=0x7ff774004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.119+0000 7ff791761640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7740047c0 0x7ff774004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.119+0000 7ff791761640 1 -- 172.21.15.106:0/3402338898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff774003970 msgr2=0x7ff774003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.119+0000 7ff791761640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff774003970 0x7ff774003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.119+0000 7ff791761640 1 -- 172.21.15.106:0/3402338898 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff774003520 con 0x7ff7740052a0 2023-12-22T09:16:36.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.119+0000 7ff790f60640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff774003970 0x7ff774003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:36.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.120+0000 7ff791761640 1 -- 172.21.15.106:0/3402338898 reap_dead start 2023-12-22T09:16:36.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.120+0000 7ff791761640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff77400b980 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff78400a800 tx=0x7ff7740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148d0d871eb254c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:36.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.120+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840072d0 con 0x7ff7740052a0 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.120+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78402f070 con 0x7ff7740052a0 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.120+0000 7ff7837fe640 1 -- 172.21.15.106:0/3402338898 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784007670 con 0x7ff7740052a0 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.121+0000 7ff7931c4640 1 -- 172.21.15.106:0/3402338898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 msgr2=0x7ff77400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.121+0000 7ff7931c4640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff77400b980 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff78400a800 tx=0x7ff7740057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.121+0000 7ff7931c4640 1 -- 172.21.15.106:0/3402338898 shutdown_connections 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.121+0000 7ff7931c4640 1 --2- 172.21.15.106:0/3402338898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff77400b980 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.121+0000 7ff7931c4640 1 -- 172.21.15.106:0/3402338898 >> 172.21.15.106:0/3402338898 conn(0x7ff78c0c1db0 msgr2=0x7ff78c0c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.121+0000 7ff7931c4640 1 -- 172.21.15.106:0/3402338898 shutdown_connections 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.121+0000 7ff7931c4640 1 -- 172.21.15.106:0/3402338898 wait complete. 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.123+0000 7ff7931c4640 1 Processor -- start 2023-12-22T09:16:36.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.123+0000 7ff7931c4640 1 -- start start 2023-12-22T09:16:36.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff7931c4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff78c1e9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff7931c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c155320 0x7ff78c142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff7931c4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c142e80 0x7ff78c070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff7931c4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0c3160 con 0x7ff7740052a0 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff7931c4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1e9f40 con 0x7ff78c155320 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff7931c4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c158180 con 0x7ff78c142e80 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff790f60640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff78c1e9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff790f60640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff78c1e9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53014/0 (socket says 172.21.15.106:53014) 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff790f60640 1 -- 172.21.15.106:0/2518397941 learned_addr learned my addr 172.21.15.106:0/2518397941 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff790f60640 1 -- 172.21.15.106:0/2518397941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c142e80 msgr2=0x7ff78c070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff790f60640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c142e80 0x7ff78c070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff783fff640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c155320 0x7ff78c142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff790f60640 1 -- 172.21.15.106:0/2518397941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c155320 msgr2=0x7ff78c142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff790f60640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c155320 0x7ff78c142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.124+0000 7ff790f60640 1 -- 172.21.15.106:0/2518397941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c070300 con 0x7ff7740052a0 2023-12-22T09:16:36.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.125+0000 7ff790f60640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff78c1e9a00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff78800e840 tx=0x7ff78800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:36.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.125+0000 7ff7817fa640 1 -- 172.21.15.106:0/2518397941 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78800c670 con 0x7ff7740052a0 2023-12-22T09:16:36.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.125+0000 7ff7817fa640 1 -- 172.21.15.106:0/2518397941 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78800c7d0 con 0x7ff7740052a0 2023-12-22T09:16:36.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.125+0000 7ff7817fa640 1 -- 172.21.15.106:0/2518397941 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78800cb60 con 0x7ff7740052a0 2023-12-22T09:16:36.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.125+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c1560b0 con 0x7ff7740052a0 2023-12-22T09:16:36.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.125+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c06ff90 con 0x7ff7740052a0 2023-12-22T09:16:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.126+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c073f10 con 0x7ff7740052a0 2023-12-22T09:16:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.127+0000 7ff7817fa640 1 -- 172.21.15.106:0/2518397941 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff78800ccc0 con 0x7ff7740052a0 2023-12-22T09:16:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.128+0000 7ff7817fa640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff77806a430 0x7ff77806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.128+0000 7ff7817fa640 1 -- 172.21.15.106:0/2518397941 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff788088b90 con 0x7ff7740052a0 2023-12-22T09:16:36.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.128+0000 7ff783fff640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff77806a430 0x7ff77806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.129+0000 7ff783fff640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff77806a430 0x7ff77806c8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff77c007fd0 tx=0x7ff77c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:36.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.132+0000 7ff7817fa640 1 -- 172.21.15.106:0/2518397941 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff788053cd0 con 0x7ff7740052a0 2023-12-22T09:16:36.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.364+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff78c0bfed0 con 0x7ff7740052a0 2023-12-22T09:16:36.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2023-12-22T09:16:36.365+0000 7fe4c35b5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T09:16:36.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.382+0000 7ff7817fa640 1 -- 172.21.15.106:0/2518397941 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff7880572f0 con 0x7ff7740052a0 2023-12-22T09:16:36.383 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T09:16:36.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff77806a430 msgr2=0x7ff77806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff77806a430 0x7ff77806c8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff77c007fd0 tx=0x7ff77c009040 comp rx=0 tx=0).stop 2023-12-22T09:16:36.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 msgr2=0x7ff78c1e9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff78c1e9a00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff78800e840 tx=0x7ff78800ed00 comp rx=0 tx=0).stop 2023-12-22T09:16:36.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 shutdown_connections 2023-12-22T09:16:36.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff77806a430 0x7ff77806c8f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff78c142e80 0x7ff78c070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff78c155320 0x7ff78c142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 --2- 172.21.15.106:0/2518397941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7740052a0 0x7ff78c1e9a00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 >> 172.21.15.106:0/2518397941 conn(0x7ff78c0c1db0 msgr2=0x7ff78c069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:36.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 shutdown_connections 2023-12-22T09:16:36.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.385+0000 7ff7931c4640 1 -- 172.21.15.106:0/2518397941 wait complete. 2023-12-22T09:16:36.404 INFO:tasks.ceph.mds.b.smithi132.stderr: -2920> 2023-12-22T09:15:57.242+0000 7f8deaebf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T09:16:36.405 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T09:16:36.495 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-12-22T09:16:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.605+0000 7f7fdb8bd640 1 Processor -- start 2023-12-22T09:16:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.605+0000 7f7fdb8bd640 1 -- start start 2023-12-22T09:16:36.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.606+0000 7f7fdb8bd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fd40c1d40 0x7f7fd40c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.606+0000 7f7fdb8bd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7fd40c1140 0x7f7fd4154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.606+0000 7f7fdb8bd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd4154e50 con 0x7f7fd4151650 2023-12-22T09:16:36.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.606+0000 7f7fdb8bd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd4150960 con 0x7f7fd40c1d40 2023-12-22T09:16:36.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.606+0000 7f7fdb8bd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd414e3a0 con 0x7f7fd40c1140 2023-12-22T09:16:36.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.607+0000 7f7fd9e5a640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7fd4151650 0x7f7fd40a92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53914/0 (socket says 172.21.15.106:53914) 2023-12-22T09:16:36.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.607+0000 7f7fd9e5a640 1 -- 172.21.15.106:0/3009924143 learned_addr learned my addr 172.21.15.106:0/3009924143 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:36.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.607+0000 7f7fd9659640 1 --2- 172.21.15.106:0/3009924143 >> v2:172.21.15.132:3300/0 conn(0x7f7fd40c1d40 0x7f7fd40c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.607+0000 7f7fd8e58640 1 --2- 172.21.15.106:0/3009924143 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7fd40c1140 0x7f7fd4154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.607+0000 7f7fcbfff640 1 -- 172.21.15.106:0/3009924143 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602288625 0 0) 0x7f7fcc001490 con 0x7f7fd4151650 2023-12-22T09:16:36.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.607+0000 7f7fcbfff640 1 -- 172.21.15.106:0/3009924143 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc0005730 con 0x7f7fd4151650 2023-12-22T09:16:36.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.608+0000 7f7fd9659640 1 -- 172.21.15.106:0/3009924143 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7fd40c1140 msgr2=0x7f7fd4154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:36.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.608+0000 7f7fd9659640 1 --2- 172.21.15.106:0/3009924143 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7fd40c1140 0x7f7fd4154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.608+0000 7f7fd9659640 1 -- 172.21.15.106:0/3009924143 >> v1:172.21.15.106:6789/0 conn(0x7f7fd4151650 legacy=0x7f7fd40a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.609 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.608+0000 7f7fd9659640 1 -- 172.21.15.106:0/3009924143 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40c1640 con 0x7f7fd40c1d40 2023-12-22T09:16:36.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.609+0000 7f7fd9659640 1 --2- 172.21.15.106:0/3009924143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fd40c1d40 0x7f7fd40c2120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009790 tx=0x7f7fd002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a49e15ac7adc675 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:36.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.610+0000 7f7fcbfff640 1 -- 172.21.15.106:0/3009924143 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd002d040 con 0x7f7fd40c1d40 2023-12-22T09:16:36.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.610+0000 7f7fcbfff640 1 -- 172.21.15.106:0/3009924143 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0031810 con 0x7f7fd40c1d40 2023-12-22T09:16:36.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.610+0000 7f7fcbfff640 1 -- 172.21.15.106:0/3009924143 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031ba0 con 0x7f7fd40c1d40 2023-12-22T09:16:36.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.610+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/3009924143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fd40c1d40 msgr2=0x7f7fd40c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.610+0000 7f7fdb8bd640 1 --2- 172.21.15.106:0/3009924143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fd40c1d40 0x7f7fd40c2120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009790 tx=0x7f7fd002b8b0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.610+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/3009924143 shutdown_connections 2023-12-22T09:16:36.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.610+0000 7f7fdb8bd640 1 --2- 172.21.15.106:0/3009924143 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7fd40c1140 0x7f7fd4154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.610+0000 7f7fdb8bd640 1 --2- 172.21.15.106:0/3009924143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fd40c1d40 0x7f7fd40c2120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.610+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/3009924143 >> 172.21.15.106:0/3009924143 conn(0x7f7fd4069bf0 msgr2=0x7f7fd4069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:36.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.611+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/3009924143 shutdown_connections 2023-12-22T09:16:36.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.611+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/3009924143 wait complete. 2023-12-22T09:16:36.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.612+0000 7f7fdb8bd640 1 Processor -- start 2023-12-22T09:16:36.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.612+0000 7f7fdb8bd640 1 -- start start 2023-12-22T09:16:36.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.613+0000 7f7fdb8bd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd40c1140 0x7f7fd40c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.613+0000 7f7fdb8bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fd40c1d40 0x7f7fd4148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.613+0000 7f7fdb8bd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7fd4151650 0x7f7fd414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.613+0000 7f7fdb8bd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd41dcb60 con 0x7f7fd40c1140 2023-12-22T09:16:36.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.613+0000 7f7fdb8bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd4148bb0 con 0x7f7fd40c1d40 2023-12-22T09:16:36.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.613+0000 7f7fdb8bd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd414ab90 con 0x7f7fd4151650 2023-12-22T09:16:36.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.613+0000 7f7fd9659640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd40c1140 0x7f7fd40c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.614+0000 7f7fd9659640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd40c1140 0x7f7fd40c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53024/0 (socket says 172.21.15.106:53024) 2023-12-22T09:16:36.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.614+0000 7f7fd9659640 1 -- 172.21.15.106:0/2835735704 learned_addr learned my addr 172.21.15.106:0/2835735704 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.614+0000 7f7fd9659640 1 -- 172.21.15.106:0/2835735704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7fd4151650 msgr2=0x7f7fd414a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.614+0000 7f7fd9659640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7fd4151650 0x7f7fd414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.614+0000 7f7fd9659640 1 -- 172.21.15.106:0/2835735704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fd40c1d40 msgr2=0x7f7fd4148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.614+0000 7f7fd9659640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fd40c1d40 0x7f7fd4148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.614+0000 7f7fd9659640 1 -- 172.21.15.106:0/2835735704 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd00093a0 con 0x7f7fd40c1140 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.614+0000 7f7fd9659640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd40c1140 0x7f7fd40c4bd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7fd002bec0 tx=0x7f7fd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.614+0000 7f7fc9ffb640 1 -- 172.21.15.106:0/2835735704 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031610 con 0x7f7fd40c1140 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.615+0000 7f7fc9ffb640 1 -- 172.21.15.106:0/2835735704 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd003ad60 con 0x7f7fd40c1140 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.615+0000 7f7fc9ffb640 1 -- 172.21.15.106:0/2835735704 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0005bd0 con 0x7f7fd40c1140 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.615+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd414a1c0 con 0x7f7fd40c1140 2023-12-22T09:16:36.616 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.615+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd4071580 con 0x7f7fd40c1140 2023-12-22T09:16:36.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.616+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd40713e0 con 0x7f7fd40c1140 2023-12-22T09:16:36.617 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.617+0000 7f7fc9ffb640 1 -- 172.21.15.106:0/2835735704 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7fd00423f0 con 0x7f7fd40c1140 2023-12-22T09:16:36.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.618+0000 7f7fc9ffb640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fb806a460 0x7f7fb806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:36.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.618+0000 7f7fc9ffb640 1 -- 172.21.15.106:0/2835735704 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6971+0+0 (secure 0 0 0) 0x7f7fd00aabe0 con 0x7f7fd40c1140 2023-12-22T09:16:36.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.618+0000 7f7fd8e58640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fb806a460 0x7f7fb806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:36.619 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.618+0000 7f7fd8e58640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fb806a460 0x7f7fb806c920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40093d0 tx=0x7f7fc4009320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:36.622 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.622+0000 7f7fc9ffb640 1 -- 172.21.15.106:0/2835735704 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7fd40713e0 con 0x7f7fd40c1140 2023-12-22T09:16:36.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:36.849+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7fd40713e0 con 0x7f7fd40c1140 2023-12-22T09:16:37.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.436+0000 7f7fc9ffb640 1 -- 172.21.15.106:0/2835735704 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7fd40713e0 con 0x7f7fd40c1140 2023-12-22T09:16:37.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fb806a460 msgr2=0x7f7fb806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:37.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fb806a460 0x7f7fb806c920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40093d0 tx=0x7f7fc4009320 comp rx=0 tx=0).stop 2023-12-22T09:16:37.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd40c1140 msgr2=0x7f7fd40c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd40c1140 0x7f7fd40c4bd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7fd002bec0 tx=0x7f7fd00046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 shutdown_connections 2023-12-22T09:16:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7fb806a460 0x7f7fb806c920 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7fd4151650 0x7f7fd414a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fd40c1d40 0x7f7fd4148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 --2- 172.21.15.106:0/2835735704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fd40c1140 0x7f7fd40c4bd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 >> 172.21.15.106:0/2835735704 conn(0x7f7fd4069bf0 msgr2=0x7f7fd4069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.440+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 shutdown_connections 2023-12-22T09:16:37.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.441+0000 7f7fdb8bd640 1 -- 172.21.15.106:0/2835735704 wait complete. 2023-12-22T09:16:37.461 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T09:16:37.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.678+0000 7f3d16ba4640 1 Processor -- start 2023-12-22T09:16:37.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.678+0000 7f3d16ba4640 1 -- start start 2023-12-22T09:16:37.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.680+0000 7f3d16ba4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d100aa220 0x7f3d10155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:37.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.680+0000 7f3d16ba4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d100c2400 0x7f3d100c0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:37.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.680+0000 7f3d16ba4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d10152ac0 con 0x7f3d100c1f70 2023-12-22T09:16:37.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.680+0000 7f3d16ba4640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100c2830 con 0x7f3d100c2400 2023-12-22T09:16:37.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.680+0000 7f3d16ba4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d101560c0 con 0x7f3d100aa220 2023-12-22T09:16:37.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.680+0000 7f3d15141640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d100c2400 0x7f3d100c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:37.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.680+0000 7f3d15141640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d100c2400 0x7f3d100c0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53038/0 (socket says 172.21.15.106:53038) 2023-12-22T09:16:37.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.680+0000 7f3d15141640 1 -- 172.21.15.106:0/3444248214 learned_addr learned my addr 172.21.15.106:0/3444248214 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:37.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.681+0000 7f3d15141640 1 -- 172.21.15.106:0/3444248214 >> v2:172.21.15.132:3300/0 conn(0x7f3d100aa220 msgr2=0x7f3d10155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:37.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.681+0000 7f3d15141640 1 --2- 172.21.15.106:0/3444248214 >> v2:172.21.15.132:3300/0 conn(0x7f3d100aa220 0x7f3d10155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.681+0000 7f3d15141640 1 -- 172.21.15.106:0/3444248214 >> v1:172.21.15.132:6789/0 conn(0x7f3d100c1f70 legacy=0x7f3d100bff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:37.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.681+0000 7f3d15141640 1 -- 172.21.15.106:0/3444248214 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10151f40 con 0x7f3d100c2400 2023-12-22T09:16:37.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.682+0000 7f3d15141640 1 --2- 172.21.15.106:0/3444248214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c2400 0x7f3d100c0650 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3d100c6340 tx=0x7f3d0802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b824d26a162ea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:37.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.682+0000 7f3d0f7fe640 1 -- 172.21.15.106:0/3444248214 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0802c960 con 0x7f3d100c2400 2023-12-22T09:16:37.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.682+0000 7f3d0f7fe640 1 -- 172.21.15.106:0/3444248214 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0802cac0 con 0x7f3d100c2400 2023-12-22T09:16:37.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.682+0000 7f3d0f7fe640 1 -- 172.21.15.106:0/3444248214 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0802ce50 con 0x7f3d100c2400 2023-12-22T09:16:37.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.683+0000 7f3d16ba4640 1 -- 172.21.15.106:0/3444248214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c2400 msgr2=0x7f3d100c0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:37.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.683+0000 7f3d16ba4640 1 --2- 172.21.15.106:0/3444248214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c2400 0x7f3d100c0650 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3d100c6340 tx=0x7f3d0802bdc0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.683+0000 7f3d16ba4640 1 -- 172.21.15.106:0/3444248214 shutdown_connections 2023-12-22T09:16:37.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.683+0000 7f3d16ba4640 1 --2- 172.21.15.106:0/3444248214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c2400 0x7f3d100c0650 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.683+0000 7f3d16ba4640 1 --2- 172.21.15.106:0/3444248214 >> v2:172.21.15.132:3300/0 conn(0x7f3d100aa220 0x7f3d10155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.683+0000 7f3d16ba4640 1 -- 172.21.15.106:0/3444248214 >> 172.21.15.106:0/3444248214 conn(0x7f3d10069dd0 msgr2=0x7f3d1006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:37.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.683+0000 7f3d16ba4640 1 -- 172.21.15.106:0/3444248214 shutdown_connections 2023-12-22T09:16:37.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.683+0000 7f3d16ba4640 1 -- 172.21.15.106:0/3444248214 wait complete. 2023-12-22T09:16:37.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.685+0000 7f3d16ba4640 1 Processor -- start 2023-12-22T09:16:37.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.685+0000 7f3d16ba4640 1 -- start start 2023-12-22T09:16:37.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d16ba4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d100aa220 0x7f3d100711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:37.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d16ba4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c1f70 0x7f3d101e9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:37.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d16ba4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d100c2400 0x7f3d101411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:37.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d16ba4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10155590 con 0x7f3d100c1f70 2023-12-22T09:16:37.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d16ba4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101e8e40 con 0x7f3d100c2400 2023-12-22T09:16:37.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d16ba4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1006ce90 con 0x7f3d100aa220 2023-12-22T09:16:37.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d0ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c1f70 0x7f3d101e9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:37.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d0ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c1f70 0x7f3d101e9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53050/0 (socket says 172.21.15.106:53050) 2023-12-22T09:16:37.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d0ffff640 1 -- 172.21.15.106:0/2560491548 learned_addr learned my addr 172.21.15.106:0/2560491548 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d15141640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d100c2400 0x7f3d101411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d14940640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d100aa220 0x7f3d100711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.686+0000 7f3d0ffff640 1 -- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d100aa220 msgr2=0x7f3d100711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d0ffff640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d100aa220 0x7f3d100711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d0ffff640 1 -- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d100c2400 msgr2=0x7f3d101411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d0ffff640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d100c2400 0x7f3d101411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d0ffff640 1 -- 172.21.15.106:0/2560491548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08009b30 con 0x7f3d100c1f70 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d15141640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d100c2400 0x7f3d101411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d14940640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d100aa220 0x7f3d100711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d0ffff640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c1f70 0x7f3d101e9620 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c410 tx=0x7f3cfc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d0d7fa640 1 -- 172.21.15.106:0/2560491548 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0035f0 con 0x7f3d100c1f70 2023-12-22T09:16:37.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d0d7fa640 1 -- 172.21.15.106:0/2560491548 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc003750 con 0x7f3d100c1f70 2023-12-22T09:16:37.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d0d7fa640 1 -- 172.21.15.106:0/2560491548 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc003b40 con 0x7f3d100c1f70 2023-12-22T09:16:37.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1006d170 con 0x7f3d100c1f70 2023-12-22T09:16:37.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.687+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d10071710 con 0x7f3d100c1f70 2023-12-22T09:16:37.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.688+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d101e9340 con 0x7f3d100c1f70 2023-12-22T09:16:37.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.689+0000 7f3d0d7fa640 1 -- 172.21.15.106:0/2560491548 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3cfc003ca0 con 0x7f3d100c1f70 2023-12-22T09:16:37.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.690+0000 7f3d0d7fa640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3cf406a460 0x7f3cf406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:37.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.690+0000 7f3d0d7fa640 1 -- 172.21.15.106:0/2560491548 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6971+0+0 (secure 0 0 0) 0x7f3cfc087fe0 con 0x7f3d100c1f70 2023-12-22T09:16:37.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.691+0000 7f3d14940640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3cf406a460 0x7f3cf406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:37.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.691+0000 7f3d14940640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3cf406a460 0x7f3cf406c920 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400a870 tx=0x7f3d04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:37.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.695+0000 7f3d0d7fa640 1 -- 172.21.15.106:0/2560491548 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3d101e9340 con 0x7f3d100c1f70 2023-12-22T09:16:37.886 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:37.885+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d101e9340 con 0x7f3d100c1f70 2023-12-22T09:16:38.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.442+0000 7f3d0d7fa640 1 -- 172.21.15.106:0/2560491548 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3d101e9340 con 0x7f3d100c1f70 2023-12-22T09:16:38.444 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' removed 2023-12-22T09:16:38.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.447+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3cf406a460 msgr2=0x7f3cf406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:38.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.447+0000 7f3d16ba4640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3cf406a460 0x7f3cf406c920 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400a870 tx=0x7f3d04008040 comp rx=0 tx=0).stop 2023-12-22T09:16:38.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.447+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c1f70 msgr2=0x7f3d101e9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:38.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.447+0000 7f3d16ba4640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c1f70 0x7f3d101e9620 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c410 tx=0x7f3cfc00c8d0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.450+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 shutdown_connections 2023-12-22T09:16:38.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.450+0000 7f3d16ba4640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3cf406a460 0x7f3cf406c920 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.450+0000 7f3d16ba4640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d100c2400 0x7f3d101411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.450+0000 7f3d16ba4640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d100c1f70 0x7f3d101e9620 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.450+0000 7f3d16ba4640 1 --2- 172.21.15.106:0/2560491548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d100aa220 0x7f3d100711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.450+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 >> 172.21.15.106:0/2560491548 conn(0x7f3d10069dd0 msgr2=0x7f3d100c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:38.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.450+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 shutdown_connections 2023-12-22T09:16:38.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.450+0000 7f3d16ba4640 1 -- 172.21.15.106:0/2560491548 wait complete. 2023-12-22T09:16:38.473 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T09:16:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.674+0000 7f26b0096640 1 Processor -- start 2023-12-22T09:16:38.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.674+0000 7f26b0096640 1 -- start start 2023-12-22T09:16:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.675+0000 7f26b0096640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f26a80aa220 0x7f26a8155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:38.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.675+0000 7f26b0096640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26a80c1f70 0x7f26a80c2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:38.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.675+0000 7f26b0096640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a8152ac0 con 0x7f26a80bff40 2023-12-22T09:16:38.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.676+0000 7f26b0096640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a81560c0 con 0x7f26a80aa220 2023-12-22T09:16:38.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.676+0000 7f26b0096640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a8151f40 con 0x7f26a80c1f70 2023-12-22T09:16:38.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.676+0000 7f26ade32640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f26a80aa220 0x7f26a8155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:38.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.676+0000 7f26ade32640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f26a80aa220 0x7f26a8155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53052/0 (socket says 172.21.15.106:53052) 2023-12-22T09:16:38.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.676+0000 7f26ade32640 1 -- 172.21.15.106:0/1827988184 learned_addr learned my addr 172.21.15.106:0/1827988184 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:38.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.676+0000 7f26ade32640 1 -- 172.21.15.106:0/1827988184 >> v2:172.21.15.132:3300/0 conn(0x7f26a80c1f70 msgr2=0x7f26a80c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:38.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.676+0000 7f26ade32640 1 --2- 172.21.15.106:0/1827988184 >> v2:172.21.15.132:3300/0 conn(0x7f26a80c1f70 0x7f26a80c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.676+0000 7f26ade32640 1 -- 172.21.15.106:0/1827988184 >> v1:172.21.15.132:6789/0 conn(0x7f26a80bff40 legacy=0x7f26a80c0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:38.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.677+0000 7f26ade32640 1 -- 172.21.15.106:0/1827988184 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a8152220 con 0x7f26a80aa220 2023-12-22T09:16:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.678+0000 7f26ade32640 1 --2- 172.21.15.106:0/1827988184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 0x7f26a8155b80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f26a80722c0 tx=0x7f26a402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87168d97972f977 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.678+0000 7f26ace30640 1 -- 172.21.15.106:0/1827988184 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4031750 con 0x7f26a80aa220 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.678+0000 7f26ace30640 1 -- 172.21.15.106:0/1827988184 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a40318b0 con 0x7f26a80aa220 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.678+0000 7f26ace30640 1 -- 172.21.15.106:0/1827988184 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4031c40 con 0x7f26a80aa220 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.678+0000 7f26b0096640 1 -- 172.21.15.106:0/1827988184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 msgr2=0x7f26a8155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.679+0000 7f26b0096640 1 --2- 172.21.15.106:0/1827988184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 0x7f26a8155b80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f26a80722c0 tx=0x7f26a402b7f0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.679+0000 7f26b0096640 1 -- 172.21.15.106:0/1827988184 shutdown_connections 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.679+0000 7f26b0096640 1 --2- 172.21.15.106:0/1827988184 >> v2:172.21.15.132:3300/0 conn(0x7f26a80c1f70 0x7f26a80c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.679+0000 7f26b0096640 1 --2- 172.21.15.106:0/1827988184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 0x7f26a8155b80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.679+0000 7f26b0096640 1 -- 172.21.15.106:0/1827988184 >> 172.21.15.106:0/1827988184 conn(0x7f26a8069dd0 msgr2=0x7f26a806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.679+0000 7f26b0096640 1 -- 172.21.15.106:0/1827988184 shutdown_connections 2023-12-22T09:16:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.679+0000 7f26b0096640 1 -- 172.21.15.106:0/1827988184 wait complete. 2023-12-22T09:16:38.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.680+0000 7f26b0096640 1 Processor -- start 2023-12-22T09:16:38.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.681+0000 7f26b0096640 1 -- start start 2023-12-22T09:16:38.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.681+0000 7f26b0096640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 0x7f26a8147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:38.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.681+0000 7f26b0096640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26a80bff40 0x7f26a81e9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:38.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.681+0000 7f26b0096640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26a80c1f70 0x7f26a80bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:38.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.681+0000 7f26b0096640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a814a480 con 0x7f26a80aa220 2023-12-22T09:16:38.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.681+0000 7f26b0096640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a81ece20 con 0x7f26a80c1f70 2023-12-22T09:16:38.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.681+0000 7f26b0096640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8148c70 con 0x7f26a80bff40 2023-12-22T09:16:38.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.682+0000 7f26ade32640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 0x7f26a8147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:38.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.682+0000 7f26ade32640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 0x7f26a8147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53068/0 (socket says 172.21.15.106:53068) 2023-12-22T09:16:38.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.682+0000 7f26ade32640 1 -- 172.21.15.106:0/2638877395 learned_addr learned my addr 172.21.15.106:0/2638877395 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:38.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.682+0000 7f26ade32640 1 -- 172.21.15.106:0/2638877395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26a80bff40 msgr2=0x7f26a81e9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:38.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.682+0000 7f26ade32640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26a80bff40 0x7f26a81e9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.682+0000 7f26ade32640 1 -- 172.21.15.106:0/2638877395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26a80c1f70 msgr2=0x7f26a80bf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:38.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.682+0000 7f26ade32640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26a80c1f70 0x7f26a80bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:38.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.682+0000 7f26ade32640 1 -- 172.21.15.106:0/2638877395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a40094d0 con 0x7f26a80aa220 2023-12-22T09:16:38.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.682+0000 7f26ade32640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 0x7f26a8147ec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f26a402b830 tx=0x7f26a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:38.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.683+0000 7f269e7fc640 1 -- 172.21.15.106:0/2638877395 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4033c60 con 0x7f26a80aa220 2023-12-22T09:16:38.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.683+0000 7f269e7fc640 1 -- 172.21.15.106:0/2638877395 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4033de0 con 0x7f26a80aa220 2023-12-22T09:16:38.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.683+0000 7f269e7fc640 1 -- 172.21.15.106:0/2638877395 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a403d6b0 con 0x7f26a80aa220 2023-12-22T09:16:38.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.683+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a8148f50 con 0x7f26a80aa220 2023-12-22T09:16:38.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.683+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a80bf610 con 0x7f26a80aa220 2023-12-22T09:16:38.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.684+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a81490e0 con 0x7f26a80aa220 2023-12-22T09:16:38.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.685+0000 7f269e7fc640 1 -- 172.21.15.106:0/2638877395 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f26a403a040 con 0x7f26a80aa220 2023-12-22T09:16:38.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.686+0000 7f269e7fc640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f268c06a430 0x7f268c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:38.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.686+0000 7f269e7fc640 1 -- 172.21.15.106:0/2638877395 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6533+0+0 (secure 0 0 0) 0x7f26a40aad90 con 0x7f26a80aa220 2023-12-22T09:16:38.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.686+0000 7f26ad631640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f268c06a430 0x7f268c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:38.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.687+0000 7f26ad631640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f268c06a430 0x7f268c06c8f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f26a8151a30 tx=0x7f2698006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:38.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.690+0000 7f269e7fc640 1 -- 172.21.15.106:0/2638877395 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f26a4076030 con 0x7f26a80aa220 2023-12-22T09:16:38.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:38.869+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f26a8073f10 con 0x7f26a80aa220 2023-12-22T09:16:39.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.454+0000 7f269e7fc640 1 -- 172.21.15.106:0/2638877395 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7f26a40380d0 con 0x7f26a80aa220 2023-12-22T09:16:39.456 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' removed 2023-12-22T09:16:39.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.460+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f268c06a430 msgr2=0x7f268c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:39.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.460+0000 7f26b0096640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f268c06a430 0x7f268c06c8f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f26a8151a30 tx=0x7f2698006c90 comp rx=0 tx=0).stop 2023-12-22T09:16:39.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.460+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 msgr2=0x7f26a8147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:39.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.460+0000 7f26b0096640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 0x7f26a8147ec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f26a402b830 tx=0x7f26a40046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.461+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 shutdown_connections 2023-12-22T09:16:39.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.461+0000 7f26b0096640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f268c06a430 0x7f268c06c8f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.461+0000 7f26b0096640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26a80c1f70 0x7f26a80bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.461+0000 7f26b0096640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26a80bff40 0x7f26a81e9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.461+0000 7f26b0096640 1 --2- 172.21.15.106:0/2638877395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80aa220 0x7f26a8147ec0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.461+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 >> 172.21.15.106:0/2638877395 conn(0x7f26a8069dd0 msgr2=0x7f26a806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:39.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.461+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 shutdown_connections 2023-12-22T09:16:39.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.461+0000 7f26b0096640 1 -- 172.21.15.106:0/2638877395 wait complete. 2023-12-22T09:16:39.483 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:39.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.688+0000 7f60dc31b640 1 Processor -- start 2023-12-22T09:16:39.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.688+0000 7f60dc31b640 1 -- start start 2023-12-22T09:16:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.690+0000 7f60dc31b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60d4069e60 0x7f60d413cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.690+0000 7f60dc31b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d4153e90 con 0x7f60d4157c80 2023-12-22T09:16:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.690+0000 7f60dc31b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d4154c10 con 0x7f60d40be700 2023-12-22T09:16:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.690+0000 7f60dc31b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d4153c80 con 0x7f60d4069e60 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.690+0000 7f60d98b6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f60d4157c80 0x7f60d4070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53920/0 (socket says 172.21.15.106:53920) 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.690+0000 7f60d98b6640 1 -- 172.21.15.106:0/3800953148 learned_addr learned my addr 172.21.15.106:0/3800953148 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338406310 0 0) 0x7f60d4153e90 con 0x7f60d4157c80 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c0003520 con 0x7f60d4157c80 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60da0b7640 1 --2- 172.21.15.106:0/3800953148 >> v2:172.21.15.132:3300/0 conn(0x7f60d4069e60 0x7f60d413cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1118879043 0 0) 0x7f60c0003520 con 0x7f60d4157c80 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 >> v2:172.21.15.132:3300/0 conn(0x7f60d4069e60 msgr2=0x7f60d413cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 --2- 172.21.15.106:0/3800953148 >> v2:172.21.15.132:3300/0 conn(0x7f60d4069e60 0x7f60d413cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 >> v1:172.21.15.132:6789/0 conn(0x7f60d40be700 legacy=0x7f60d415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4154130 con 0x7f60d4157c80 2023-12-22T09:16:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f60c4001670 con 0x7f60d4157c80 2023-12-22T09:16:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 >> v1:172.21.15.106:6789/0 conn(0x7f60d4157c80 legacy=0x7f60d4070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 --2- 172.21.15.106:0/3800953148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c00039c0 0x7f60c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 --2- 172.21.15.106:0/3800953148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60c00047c0 0x7f60c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 --2- 172.21.15.106:0/3800953148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60c0005250 0x7f60c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d4153c80 con 0x7f60c00039c0 2023-12-22T09:16:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c000c1a0 con 0x7f60c00047c0 2023-12-22T09:16:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.691+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c000c360 con 0x7f60c0005250 2023-12-22T09:16:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.692+0000 7f60da0b7640 1 --2- 172.21.15.106:0/3800953148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c00039c0 0x7f60c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:39.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.692+0000 7f60da0b7640 1 -- 172.21.15.106:0/3800953148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60c0005250 msgr2=0x7f60c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:39.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.692+0000 7f60da0b7640 1 --2- 172.21.15.106:0/3800953148 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60c0005250 0x7f60c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.692+0000 7f60da0b7640 1 -- 172.21.15.106:0/3800953148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60c00047c0 msgr2=0x7f60c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:39.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.692+0000 7f60da0b7640 1 --2- 172.21.15.106:0/3800953148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60c00047c0 0x7f60c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.692+0000 7f60da0b7640 1 -- 172.21.15.106:0/3800953148 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0003520 con 0x7f60c00039c0 2023-12-22T09:16:39.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.692+0000 7f60da8b8640 1 -- 172.21.15.106:0/3800953148 reap_dead start 2023-12-22T09:16:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.693+0000 7f60da0b7640 1 --2- 172.21.15.106:0/3800953148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c00039c0 0x7f60c0003dc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f60d000ba10 tx=0x7f60c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235a83d189a1c8d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.693+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0005b90 con 0x7f60c00039c0 2023-12-22T09:16:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.693+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0005cf0 con 0x7f60c00039c0 2023-12-22T09:16:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.693+0000 7f60d90b5640 1 -- 172.21.15.106:0/3800953148 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0006270 con 0x7f60c00039c0 2023-12-22T09:16:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.694+0000 7f60dc31b640 1 -- 172.21.15.106:0/3800953148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c00039c0 msgr2=0x7f60c0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.694+0000 7f60dc31b640 1 --2- 172.21.15.106:0/3800953148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c00039c0 0x7f60c0003dc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f60d000ba10 tx=0x7f60c00057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.694+0000 7f60dc31b640 1 -- 172.21.15.106:0/3800953148 shutdown_connections 2023-12-22T09:16:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.694+0000 7f60dc31b640 1 --2- 172.21.15.106:0/3800953148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c00039c0 0x7f60c0003dc0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.694+0000 7f60dc31b640 1 -- 172.21.15.106:0/3800953148 >> 172.21.15.106:0/3800953148 conn(0x7f60d40c5360 msgr2=0x7f60d40c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:39.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.694+0000 7f60dc31b640 1 -- 172.21.15.106:0/3800953148 shutdown_connections 2023-12-22T09:16:39.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.694+0000 7f60dc31b640 1 -- 172.21.15.106:0/3800953148 wait complete. 2023-12-22T09:16:39.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.696+0000 7f60dc31b640 1 Processor -- start 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.696+0000 7f60dc31b640 1 -- start start 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.697+0000 7f60dc31b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60c00039c0 0x7f60d41ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.697+0000 7f60dc31b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d41ea100 0x7f60d4150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.697+0000 7f60dc31b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60d40a8360 0x7f60d4150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.697+0000 7f60dc31b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d41511d0 con 0x7f60d40a8360 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.697+0000 7f60dc31b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d41ec430 con 0x7f60c00039c0 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.697+0000 7f60dc31b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d4135560 con 0x7f60d41ea100 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.697+0000 7f60da8b8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60d40a8360 0x7f60d4150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.697+0000 7f60da8b8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60d40a8360 0x7f60d4150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53088/0 (socket says 172.21.15.106:53088) 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.697+0000 7f60da8b8640 1 -- 172.21.15.106:0/1666339615 learned_addr learned my addr 172.21.15.106:0/1666339615 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60da8b8640 1 -- 172.21.15.106:0/1666339615 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d41ea100 msgr2=0x7f60d4150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60da8b8640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d41ea100 0x7f60d4150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60da8b8640 1 -- 172.21.15.106:0/1666339615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60c00039c0 msgr2=0x7f60d41ec8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:39.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60da8b8640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60c00039c0 0x7f60d41ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60da8b8640 1 -- 172.21.15.106:0/1666339615 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d41e97b0 con 0x7f60d40a8360 2023-12-22T09:16:39.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60da8b8640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60d40a8360 0x7f60d4150c60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f60c00057a0 tx=0x7f60cc00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:39.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60caffd640 1 -- 172.21.15.106:0/1666339615 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0070d0 con 0x7f60d40a8360 2023-12-22T09:16:39.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60caffd640 1 -- 172.21.15.106:0/1666339615 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc007230 con 0x7f60d40a8360 2023-12-22T09:16:39.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60caffd640 1 -- 172.21.15.106:0/1666339615 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc007620 con 0x7f60d40a8360 2023-12-22T09:16:39.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d41e9a90 con 0x7f60d40a8360 2023-12-22T09:16:39.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.698+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d4151420 con 0x7f60d40a8360 2023-12-22T09:16:39.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.699+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d4073f10 con 0x7f60d40a8360 2023-12-22T09:16:39.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.700+0000 7f60caffd640 1 -- 172.21.15.106:0/1666339615 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f60cc007780 con 0x7f60d40a8360 2023-12-22T09:16:39.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.701+0000 7f60caffd640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f60b806a430 0x7f60b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:39.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.701+0000 7f60caffd640 1 -- 172.21.15.106:0/1666339615 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f60cc087f90 con 0x7f60d40a8360 2023-12-22T09:16:39.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.702+0000 7f60da0b7640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f60b806a430 0x7f60b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:39.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.702+0000 7f60da0b7640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f60b806a430 0x7f60b806c8f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f60d0036000 tx=0x7f60d0031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:39.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.706+0000 7f60caffd640 1 -- 172.21.15.106:0/1666339615 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f60cc0533d0 con 0x7f60d40a8360 2023-12-22T09:16:39.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.905+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60d41ec200 con 0x7f60d40a8360 2023-12-22T09:16:39.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.908+0000 7f60caffd640 1 -- 172.21.15.106:0/1666339615 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16489 (secure 0 0 0) 0x7f60cc0569f0 con 0x7f60d40a8360 2023-12-22T09:16:39.910 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:39.910 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":47,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:39.438722+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/3435163215":"2023-12-23T09:16:36.366375+0000","172.21.15.132:6833/3435163215":"2023-12-23T09:16:36.366375+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:39.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.910+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f60b806a430 msgr2=0x7f60b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.910+0000 7f60dc31b640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f60b806a430 0x7f60b806c8f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f60d0036000 tx=0x7f60d0031000 comp rx=0 tx=0).stop 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.910+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60d40a8360 msgr2=0x7f60d4150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.910+0000 7f60dc31b640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60d40a8360 0x7f60d4150c60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f60c00057a0 tx=0x7f60cc00c980 comp rx=0 tx=0).stop 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.911+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 shutdown_connections 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.911+0000 7f60dc31b640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f60b806a430 0x7f60b806c8f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.911+0000 7f60dc31b640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60d40a8360 0x7f60d4150c60 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.911+0000 7f60dc31b640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f60d41ea100 0x7f60d4150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.911+0000 7f60dc31b640 1 --2- 172.21.15.106:0/1666339615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60c00039c0 0x7f60d41ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.911+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 >> 172.21.15.106:0/1666339615 conn(0x7f60d40c5360 msgr2=0x7f60d4138630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.911+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 shutdown_connections 2023-12-22T09:16:39.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:39.911+0000 7f60dc31b640 1 -- 172.21.15.106:0/1666339615 wait complete. 2023-12-22T09:16:39.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-22T09:16:08.066634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-22T09:16:09.242570+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:16:39.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:16:40.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.137+0000 7f027f87a640 1 Processor -- start 2023-12-22T09:16:40.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.137+0000 7f027f87a640 1 -- start start 2023-12-22T09:16:40.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.138+0000 7f027f87a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f027806ca00 0x7f02780c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f027f87a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02780c4560 con 0x7f02780c7640 2023-12-22T09:16:40.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f027f87a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0278154720 con 0x7f02780c6150 2023-12-22T09:16:40.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f027f87a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02780c4f90 con 0x7f027806ca00 2023-12-22T09:16:40.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f027ce15640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f02780c7640 0x7f027806b8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53936/0 (socket says 172.21.15.106:53936) 2023-12-22T09:16:40.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f027ce15640 1 -- 172.21.15.106:0/2291268699 learned_addr learned my addr 172.21.15.106:0/2291268699 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:40.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f027de17640 1 --2- 172.21.15.106:0/2291268699 >> v2:172.21.15.106:3300/0 conn(0x7f027806ca00 0x7f02780c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f026ffff640 1 -- 172.21.15.106:0/2291268699 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439022856 0 0) 0x7f02780c4560 con 0x7f02780c7640 2023-12-22T09:16:40.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f026ffff640 1 -- 172.21.15.106:0/2291268699 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0264003520 con 0x7f02780c7640 2023-12-22T09:16:40.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f027de17640 1 -- 172.21.15.106:0/2291268699 >> v1:172.21.15.132:6789/0 conn(0x7f02780c6150 legacy=0x7f027806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:40.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f027de17640 1 -- 172.21.15.106:0/2291268699 >> v1:172.21.15.106:6789/0 conn(0x7f02780c7640 legacy=0x7f027806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.139+0000 7f027de17640 1 -- 172.21.15.106:0/2291268699 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278154c50 con 0x7f027806ca00 2023-12-22T09:16:40.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.140+0000 7f027de17640 1 --2- 172.21.15.106:0/2291268699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 0x7f02780c6530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0270009d90 tx=0x7f027002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5aaf4705eb6ffd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:40.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.141+0000 7f026ffff640 1 -- 172.21.15.106:0/2291268699 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027002cb40 con 0x7f027806ca00 2023-12-22T09:16:40.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.141+0000 7f026ffff640 1 -- 172.21.15.106:0/2291268699 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027002cca0 con 0x7f027806ca00 2023-12-22T09:16:40.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.141+0000 7f026ffff640 1 -- 172.21.15.106:0/2291268699 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270034660 con 0x7f027806ca00 2023-12-22T09:16:40.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.141+0000 7f027f87a640 1 -- 172.21.15.106:0/2291268699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 msgr2=0x7f02780c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.141+0000 7f027f87a640 1 --2- 172.21.15.106:0/2291268699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 0x7f02780c6530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0270009d90 tx=0x7f027002bd90 comp rx=0 tx=0).stop 2023-12-22T09:16:40.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.141+0000 7f027f87a640 1 -- 172.21.15.106:0/2291268699 shutdown_connections 2023-12-22T09:16:40.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.141+0000 7f027f87a640 1 --2- 172.21.15.106:0/2291268699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 0x7f02780c6530 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.141+0000 7f027f87a640 1 -- 172.21.15.106:0/2291268699 >> 172.21.15.106:0/2291268699 conn(0x7f02780ab330 msgr2=0x7f02780ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:40.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.141+0000 7f027f87a640 1 -- 172.21.15.106:0/2291268699 shutdown_connections 2023-12-22T09:16:40.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.142+0000 7f027f87a640 1 -- 172.21.15.106:0/2291268699 wait complete. 2023-12-22T09:16:40.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.143+0000 7f027f87a640 1 Processor -- start 2023-12-22T09:16:40.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.143+0000 7f027f87a640 1 -- start start 2023-12-22T09:16:40.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.144+0000 7f027f87a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 0x7f02781ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.144+0000 7f027f87a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02780c6150 0x7f02781479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.144+0000 7f027f87a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02780c7640 0x7f0278147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.144+0000 7f027f87a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02781ed670 con 0x7f027806ca00 2023-12-22T09:16:40.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.144+0000 7f027f87a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0278148420 con 0x7f02780c7640 2023-12-22T09:16:40.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.144+0000 7f027f87a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02781eb2c0 con 0x7f02780c6150 2023-12-22T09:16:40.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.144+0000 7f027d616640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 0x7f02781ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.144+0000 7f027d616640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 0x7f02781ecb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53102/0 (socket says 172.21.15.106:53102) 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.144+0000 7f027d616640 1 -- 172.21.15.106:0/545573283 learned_addr learned my addr 172.21.15.106:0/545573283 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f027d616640 1 -- 172.21.15.106:0/545573283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02780c6150 msgr2=0x7f02781479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f027d616640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02780c6150 0x7f02781479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f027d616640 1 -- 172.21.15.106:0/545573283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02780c7640 msgr2=0x7f0278147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f027de17640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02780c7640 0x7f0278147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f027d616640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02780c7640 0x7f0278147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f027d616640 1 -- 172.21.15.106:0/545573283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270009a70 con 0x7f027806ca00 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f027d616640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 0x7f02781ecb60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f027400b420 tx=0x7f027400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f026dffb640 1 -- 172.21.15.106:0/545573283 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274011830 con 0x7f027806ca00 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f026dffb640 1 -- 172.21.15.106:0/545573283 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0274011990 con 0x7f027806ca00 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f026dffb640 1 -- 172.21.15.106:0/545573283 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274011d40 con 0x7f027806ca00 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02781ea990 con 0x7f027806ca00 2023-12-22T09:16:40.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.145+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02781eaf50 con 0x7f027806ca00 2023-12-22T09:16:40.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.147+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0278073f10 con 0x7f027806ca00 2023-12-22T09:16:40.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.148+0000 7f026dffb640 1 -- 172.21.15.106:0/545573283 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f027401b460 con 0x7f027806ca00 2023-12-22T09:16:40.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.149+0000 7f026dffb640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f025c06a430 0x7f025c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.149+0000 7f026dffb640 1 -- 172.21.15.106:0/545573283 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f0274088590 con 0x7f027806ca00 2023-12-22T09:16:40.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.149+0000 7f027ce15640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f025c06a430 0x7f025c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.150+0000 7f027ce15640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f025c06a430 0x7f025c06c8f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f02780aaf90 tx=0x7f0268007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:40.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.153+0000 7f026dffb640 1 -- 172.21.15.106:0/545573283 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0274053a70 con 0x7f027806ca00 2023-12-22T09:16:40.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.342+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f027806c7e0 con 0x7f027806ca00 2023-12-22T09:16:40.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.343+0000 7f026dffb640 1 -- 172.21.15.106:0/545573283 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0274057090 con 0x7f027806ca00 2023-12-22T09:16:40.344 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:16:40.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.345+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f025c06a430 msgr2=0x7f025c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.345+0000 7f027f87a640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f025c06a430 0x7f025c06c8f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f02780aaf90 tx=0x7f0268007930 comp rx=0 tx=0).stop 2023-12-22T09:16:40.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 msgr2=0x7f02781ecb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 0x7f02781ecb60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f027400b420 tx=0x7f027400b8e0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 shutdown_connections 2023-12-22T09:16:40.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f025c06a430 0x7f025c06c8f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02780c7640 0x7f0278147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f02780c6150 0x7f02781479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 --2- 172.21.15.106:0/545573283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f027806ca00 0x7f02781ecb60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 >> 172.21.15.106:0/545573283 conn(0x7f02780ab330 msgr2=0x7f02780c6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:40.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 shutdown_connections 2023-12-22T09:16:40.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.346+0000 7f027f87a640 1 -- 172.21.15.106:0/545573283 wait complete. 2023-12-22T09:16:40.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-22T09:16:40.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.580+0000 7fa54b8ab640 1 Processor -- start 2023-12-22T09:16:40.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.580+0000 7fa54b8ab640 1 -- start start 2023-12-22T09:16:40.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.582+0000 7fa54b8ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa544152420 0x7fa544071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.582+0000 7fa54b8ab640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5440bfda0 0x7fa5440c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.582+0000 7fa54b8ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5440c1b50 con 0x7fa5440c12a0 2023-12-22T09:16:40.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.582+0000 7fa54b8ab640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5440709e0 con 0x7fa5440bfda0 2023-12-22T09:16:40.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.582+0000 7fa54b8ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54406dd40 con 0x7fa544152420 2023-12-22T09:16:40.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.582+0000 7fa549e48640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5440bfda0 0x7fa5440c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.582+0000 7fa549e48640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5440bfda0 0x7fa5440c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53110/0 (socket says 172.21.15.106:53110) 2023-12-22T09:16:40.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.582+0000 7fa549e48640 1 -- 172.21.15.106:0/1720330506 learned_addr learned my addr 172.21.15.106:0/1720330506 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:40.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.582+0000 7fa549647640 1 --2- 172.21.15.106:0/1720330506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa544152420 0x7fa544071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.583+0000 7fa549e48640 1 -- 172.21.15.106:0/1720330506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa544152420 msgr2=0x7fa544071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:40.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.583+0000 7fa549e48640 1 --2- 172.21.15.106:0/1720330506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa544152420 0x7fa544071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.583+0000 7fa549e48640 1 -- 172.21.15.106:0/1720330506 >> v1:172.21.15.132:6789/0 conn(0x7fa5440c12a0 legacy=0x7fa5440c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:40.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.583+0000 7fa549e48640 1 -- 172.21.15.106:0/1720330506 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544158350 con 0x7fa5440bfda0 2023-12-22T09:16:40.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.584+0000 7fa549e48640 1 --2- 172.21.15.106:0/1720330506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 0x7fa5440c01d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009e50 tx=0x7fa53c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109a0d3fa14fa589 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:40.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.584+0000 7fa53bfff640 1 -- 172.21.15.106:0/1720330506 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c02ca80 con 0x7fa5440bfda0 2023-12-22T09:16:40.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa53bfff640 1 -- 172.21.15.106:0/1720330506 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c02cbe0 con 0x7fa5440bfda0 2023-12-22T09:16:40.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa53bfff640 1 -- 172.21.15.106:0/1720330506 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0343f0 con 0x7fa5440bfda0 2023-12-22T09:16:40.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1720330506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 msgr2=0x7fa5440c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa54b8ab640 1 --2- 172.21.15.106:0/1720330506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 0x7fa5440c01d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009e50 tx=0x7fa53c02bee0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1720330506 shutdown_connections 2023-12-22T09:16:40.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa54b8ab640 1 --2- 172.21.15.106:0/1720330506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 0x7fa5440c01d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa54b8ab640 1 --2- 172.21.15.106:0/1720330506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa544152420 0x7fa544071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1720330506 >> 172.21.15.106:0/1720330506 conn(0x7fa54406a220 msgr2=0x7fa5440c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:40.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1720330506 shutdown_connections 2023-12-22T09:16:40.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.585+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1720330506 wait complete. 2023-12-22T09:16:40.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.587+0000 7fa54b8ab640 1 Processor -- start 2023-12-22T09:16:40.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.587+0000 7fa54b8ab640 1 -- start start 2023-12-22T09:16:40.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.588+0000 7fa54b8ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 0x7fa5440b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.588+0000 7fa54b8ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5440c12a0 0x7fa5440bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.588+0000 7fa54b8ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa544152420 0x7fa54414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.588+0000 7fa54b8ab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54415ba30 con 0x7fa5440bfda0 2023-12-22T09:16:40.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.588+0000 7fa54b8ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54415b470 con 0x7fa544152420 2023-12-22T09:16:40.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.588+0000 7fa54b8ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54415b750 con 0x7fa5440c12a0 2023-12-22T09:16:40.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.588+0000 7fa549647640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 0x7fa5440b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.588+0000 7fa549647640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 0x7fa5440b9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53124/0 (socket says 172.21.15.106:53124) 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.588+0000 7fa549647640 1 -- 172.21.15.106:0/1577203507 learned_addr learned my addr 172.21.15.106:0/1577203507 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa548e46640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5440c12a0 0x7fa5440bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa549e48640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa544152420 0x7fa54414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa549647640 1 -- 172.21.15.106:0/1577203507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5440c12a0 msgr2=0x7fa5440bc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa549647640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5440c12a0 0x7fa5440bc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa549647640 1 -- 172.21.15.106:0/1577203507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa544152420 msgr2=0x7fa54414d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa549647640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa544152420 0x7fa54414d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa549647640 1 -- 172.21.15.106:0/1577203507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c009b30 con 0x7fa5440bfda0 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa548e46640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5440c12a0 0x7fa5440bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa549647640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 0x7fa5440b9ea0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa54000d5f0 tx=0x7fa54000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa539ffb640 1 -- 172.21.15.106:0/1577203507 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5400125f0 con 0x7fa5440bfda0 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa539ffb640 1 -- 172.21.15.106:0/1577203507 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540012750 con 0x7fa5440bfda0 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54415bd60 con 0x7fa5440bfda0 2023-12-22T09:16:40.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa539ffb640 1 -- 172.21.15.106:0/1577203507 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540012b00 con 0x7fa5440bfda0 2023-12-22T09:16:40.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.589+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54415a2d0 con 0x7fa5440bfda0 2023-12-22T09:16:40.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.591+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa544073f10 con 0x7fa5440bfda0 2023-12-22T09:16:40.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.592+0000 7fa539ffb640 1 -- 172.21.15.106:0/1577203507 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa540012c60 con 0x7fa5440bfda0 2023-12-22T09:16:40.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.593+0000 7fa539ffb640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa52806a430 0x7fa52806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:40.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.593+0000 7fa539ffb640 1 -- 172.21.15.106:0/1577203507 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7fa540088ef0 con 0x7fa5440bfda0 2023-12-22T09:16:40.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.593+0000 7fa548e46640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa52806a430 0x7fa52806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:40.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.594+0000 7fa548e46640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa52806a430 0x7fa52806c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa5440bb9d0 tx=0x7fa534009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:40.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.597+0000 7fa539ffb640 1 -- 172.21.15.106:0/1577203507 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5400543d0 con 0x7fa5440bfda0 2023-12-22T09:16:40.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.788+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5440c1080 con 0x7fa5440bfda0 2023-12-22T09:16:40.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.789+0000 7fa539ffb640 1 -- 172.21.15.106:0/1577203507 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v47) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa5400579f0 con 0x7fa5440bfda0 2023-12-22T09:16:40.790 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:16:40.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa52806a430 msgr2=0x7fa52806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa52806a430 0x7fa52806c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa5440bb9d0 tx=0x7fa534009040 comp rx=0 tx=0).stop 2023-12-22T09:16:40.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 msgr2=0x7fa5440b9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:40.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 0x7fa5440b9ea0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa54000d5f0 tx=0x7fa54000dab0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 shutdown_connections 2023-12-22T09:16:40.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa52806a430 0x7fa52806c8f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa544152420 0x7fa54414d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5440c12a0 0x7fa5440bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 --2- 172.21.15.106:0/1577203507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5440bfda0 0x7fa5440b9ea0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:40.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 >> 172.21.15.106:0/1577203507 conn(0x7fa54406a220 msgr2=0x7fa5440c1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:40.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 shutdown_connections 2023-12-22T09:16:40.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:40.792+0000 7fa54b8ab640 1 -- 172.21.15.106:0/1577203507 wait complete. 2023-12-22T09:16:40.812 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-22T09:16:41.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.023+0000 7efd04ce2640 1 Processor -- start 2023-12-22T09:16:41.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.023+0000 7efd04ce2640 1 -- start start 2023-12-22T09:16:41.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.025+0000 7efd04ce2640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd00151760 0x7efd000a8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.025+0000 7efd04ce2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd00150cc0 con 0x7efd000a88a0 2023-12-22T09:16:41.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.025+0000 7efd04ce2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd00071e50 con 0x7efd0014dfe0 2023-12-22T09:16:41.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.025+0000 7efd04ce2640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd00150ab0 con 0x7efd00151760 2023-12-22T09:16:41.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.025+0000 7efcfed9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efd000a88a0 0x7efd000c2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53952/0 (socket says 172.21.15.106:53952) 2023-12-22T09:16:41.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.025+0000 7efcfed9d640 1 -- 172.21.15.106:0/1205718091 learned_addr learned my addr 172.21.15.106:0/1205718091 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:41.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.025+0000 7efcf5d9b640 1 --2- 172.21.15.106:0/1205718091 >> v2:172.21.15.106:3300/0 conn(0x7efd00151760 0x7efd000a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.026+0000 7efcfdd9b640 1 -- 172.21.15.106:0/1205718091 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663121624 0 0) 0x7efd00150cc0 con 0x7efd000a88a0 2023-12-22T09:16:41.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.026+0000 7efcfdd9b640 1 -- 172.21.15.106:0/1205718091 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcec003520 con 0x7efd000a88a0 2023-12-22T09:16:41.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.026+0000 7efcf5d9b640 1 -- 172.21.15.106:0/1205718091 >> v1:172.21.15.132:6789/0 conn(0x7efd0014dfe0 legacy=0x7efd00154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.026+0000 7efcf5d9b640 1 -- 172.21.15.106:0/1205718091 >> v1:172.21.15.106:6789/0 conn(0x7efd000a88a0 legacy=0x7efd000c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.026+0000 7efcf5d9b640 1 -- 172.21.15.106:0/1205718091 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd00150f60 con 0x7efd00151760 2023-12-22T09:16:41.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.027+0000 7efcf5d9b640 1 --2- 172.21.15.106:0/1205718091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd00151760 0x7efd000a8360 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efce80097a0 tx=0x7efce802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b205db997513caab server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:41.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.027+0000 7efcfdd9b640 1 -- 172.21.15.106:0/1205718091 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8031830 con 0x7efd00151760 2023-12-22T09:16:41.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.027+0000 7efcfdd9b640 1 -- 172.21.15.106:0/1205718091 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce8031990 con 0x7efd00151760 2023-12-22T09:16:41.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.027+0000 7efcfdd9b640 1 -- 172.21.15.106:0/1205718091 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8031d00 con 0x7efd00151760 2023-12-22T09:16:41.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.028+0000 7efd04ce2640 1 -- 172.21.15.106:0/1205718091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd00151760 msgr2=0x7efd000a8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.028+0000 7efd04ce2640 1 --2- 172.21.15.106:0/1205718091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd00151760 0x7efd000a8360 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efce80097a0 tx=0x7efce802b8d0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.028+0000 7efd04ce2640 1 -- 172.21.15.106:0/1205718091 shutdown_connections 2023-12-22T09:16:41.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.028+0000 7efd04ce2640 1 --2- 172.21.15.106:0/1205718091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd00151760 0x7efd000a8360 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.028+0000 7efd04ce2640 1 -- 172.21.15.106:0/1205718091 >> 172.21.15.106:0/1205718091 conn(0x7efd00069dd0 msgr2=0x7efd0006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:41.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.028+0000 7efd04ce2640 1 -- 172.21.15.106:0/1205718091 shutdown_connections 2023-12-22T09:16:41.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.028+0000 7efd04ce2640 1 -- 172.21.15.106:0/1205718091 wait complete. 2023-12-22T09:16:41.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.030+0000 7efd04ce2640 1 Processor -- start 2023-12-22T09:16:41.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.030+0000 7efd04ce2640 1 -- start start 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.031+0000 7efd04ce2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd000a88a0 0x7efd001ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.031+0000 7efd04ce2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0014dfe0 0x7efd000bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.031+0000 7efd04ce2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd00151760 0x7efd0013f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.031+0000 7efd04ce2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd001ed690 con 0x7efd0014dfe0 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.031+0000 7efd04ce2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0014b740 con 0x7efd00151760 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.031+0000 7efd04ce2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0014ba20 con 0x7efd000a88a0 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.031+0000 7efcf5d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0014dfe0 0x7efd000bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.031+0000 7efcf5d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0014dfe0 0x7efd000bfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53142/0 (socket says 172.21.15.106:53142) 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.031+0000 7efcf5d9b640 1 -- 172.21.15.106:0/199293912 learned_addr learned my addr 172.21.15.106:0/199293912 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcfe59c640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd000a88a0 0x7efd001ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcfed9d640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd00151760 0x7efd0013f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcf5d9b640 1 -- 172.21.15.106:0/199293912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd000a88a0 msgr2=0x7efd001ed150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcf5d9b640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd000a88a0 0x7efd001ed150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcf5d9b640 1 -- 172.21.15.106:0/199293912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd00151760 msgr2=0x7efd0013f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcf5d9b640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd00151760 0x7efd0013f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcf5d9b640 1 -- 172.21.15.106:0/199293912 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8009400 con 0x7efd0014dfe0 2023-12-22T09:16:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcfed9d640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd00151760 0x7efd0013f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcf5d9b640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0014dfe0 0x7efd000bfe40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efce8000c00 tx=0x7efce80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcf77fe640 1 -- 172.21.15.106:0/199293912 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8004230 con 0x7efd0014dfe0 2023-12-22T09:16:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcf77fe640 1 -- 172.21.15.106:0/199293912 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce8004390 con 0x7efd0014dfe0 2023-12-22T09:16:41.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.032+0000 7efcf77fe640 1 -- 172.21.15.106:0/199293912 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce803a860 con 0x7efd0014dfe0 2023-12-22T09:16:41.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.033+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd00153670 con 0x7efd0014dfe0 2023-12-22T09:16:41.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.033+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd00153c30 con 0x7efd0014dfe0 2023-12-22T09:16:41.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.034+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd001e9240 con 0x7efd0014dfe0 2023-12-22T09:16:41.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.035+0000 7efcf77fe640 1 -- 172.21.15.106:0/199293912 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efce803a9c0 con 0x7efd0014dfe0 2023-12-22T09:16:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.035+0000 7efcf77fe640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efce006a430 0x7efce006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.036+0000 7efcf77fe640 1 -- 172.21.15.106:0/199293912 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7efce80ab190 con 0x7efd0014dfe0 2023-12-22T09:16:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.036+0000 7efcfe59c640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efce006a430 0x7efce006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.036+0000 7efcfe59c640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efce006a430 0x7efce006c8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efcf0000f60 tx=0x7efcf0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:41.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.040+0000 7efcf77fe640 1 -- 172.21.15.106:0/199293912 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd001e9240 con 0x7efd0014dfe0 2023-12-22T09:16:41.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.229+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7efd001e9240 con 0x7efd0014dfe0 2023-12-22T09:16:41.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.230+0000 7efcf77fe640 1 -- 172.21.15.106:0/199293912 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v47) v1 ==== 101+0+11 (secure 0 0 0) 0x7efd001e9240 con 0x7efd0014dfe0 2023-12-22T09:16:41.231 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.232+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efce006a430 msgr2=0x7efce006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.232+0000 7efd04ce2640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efce006a430 0x7efce006c8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efcf0000f60 tx=0x7efcf0009040 comp rx=0 tx=0).stop 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0014dfe0 msgr2=0x7efd000bfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0014dfe0 0x7efd000bfe40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efce8000c00 tx=0x7efce80046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 shutdown_connections 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efce006a430 0x7efce006c8f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd00151760 0x7efd0013f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0014dfe0 0x7efd000bfe40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 --2- 172.21.15.106:0/199293912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd000a88a0 0x7efd001ed150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 >> 172.21.15.106:0/199293912 conn(0x7efd00069dd0 msgr2=0x7efd0006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 shutdown_connections 2023-12-22T09:16:41.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.233+0000 7efd04ce2640 1 -- 172.21.15.106:0/199293912 wait complete. 2023-12-22T09:16:41.252 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:41.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.457+0000 7f72220f7640 1 Processor -- start 2023-12-22T09:16:41.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.457+0000 7f72220f7640 1 -- start start 2023-12-22T09:16:41.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.459+0000 7f72220f7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c15ab30 0x7f721c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.459+0000 7f72220f7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0c0dd0 con 0x7f721c0c1f20 2023-12-22T09:16:41.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.459+0000 7f72220f7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0c23b0 con 0x7f721c0ab0b0 2023-12-22T09:16:41.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.459+0000 7f72220f7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c06b090 con 0x7f721c15ab30 2023-12-22T09:16:41.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.459+0000 7f7213fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f721c0c1f20 0x7f721c0c1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53962/0 (socket says 172.21.15.106:53962) 2023-12-22T09:16:41.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.459+0000 7f7213fff640 1 -- 172.21.15.106:0/2399958187 learned_addr learned my addr 172.21.15.106:0/2399958187 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:41.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.459+0000 7f721bfff640 1 --2- 172.21.15.106:0/2399958187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c15ab30 0x7f721c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.460+0000 7f721affd640 1 -- 172.21.15.106:0/2399958187 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801723460 0 0) 0x7f721c0c0dd0 con 0x7f721c0c1f20 2023-12-22T09:16:41.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.460+0000 7f721affd640 1 -- 172.21.15.106:0/2399958187 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7208003520 con 0x7f721c0c1f20 2023-12-22T09:16:41.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.460+0000 7f721bfff640 1 -- 172.21.15.106:0/2399958187 >> v1:172.21.15.132:6789/0 conn(0x7f721c0ab0b0 legacy=0x7f721c1555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.460+0000 7f721bfff640 1 -- 172.21.15.106:0/2399958187 >> v1:172.21.15.106:6789/0 conn(0x7f721c0c1f20 legacy=0x7f721c0c1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.460+0000 7f721bfff640 1 -- 172.21.15.106:0/2399958187 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c06aad0 con 0x7f721c15ab30 2023-12-22T09:16:41.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.461+0000 7f721bfff640 1 --2- 172.21.15.106:0/2399958187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c15ab30 0x7f721c15cf20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7214009dc0 tx=0x7f721402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4974b61674eb77f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:41.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.462+0000 7f721affd640 1 -- 172.21.15.106:0/2399958187 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721402cc40 con 0x7f721c15ab30 2023-12-22T09:16:41.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.462+0000 7f721affd640 1 -- 172.21.15.106:0/2399958187 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721402cda0 con 0x7f721c15ab30 2023-12-22T09:16:41.463 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.462+0000 7f721affd640 1 -- 172.21.15.106:0/2399958187 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214034640 con 0x7f721c15ab30 2023-12-22T09:16:41.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.463+0000 7f72220f7640 1 -- 172.21.15.106:0/2399958187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c15ab30 msgr2=0x7f721c15cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.463+0000 7f72220f7640 1 --2- 172.21.15.106:0/2399958187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c15ab30 0x7f721c15cf20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7214009dc0 tx=0x7f721402be90 comp rx=0 tx=0).stop 2023-12-22T09:16:41.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.463+0000 7f72220f7640 1 -- 172.21.15.106:0/2399958187 shutdown_connections 2023-12-22T09:16:41.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.463+0000 7f72220f7640 1 --2- 172.21.15.106:0/2399958187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c15ab30 0x7f721c15cf20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.463+0000 7f72220f7640 1 -- 172.21.15.106:0/2399958187 >> 172.21.15.106:0/2399958187 conn(0x7f721c0c5ce0 msgr2=0x7f721c0c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:41.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.463+0000 7f72220f7640 1 -- 172.21.15.106:0/2399958187 shutdown_connections 2023-12-22T09:16:41.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.463+0000 7f72220f7640 1 -- 172.21.15.106:0/2399958187 wait complete. 2023-12-22T09:16:41.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.465+0000 7f72220f7640 1 Processor -- start 2023-12-22T09:16:41.466 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.465+0000 7f72220f7640 1 -- start start 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.466+0000 7f72220f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721c0ab0b0 0x7f721c070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.466+0000 7f72220f7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c0c1f20 0x7f721c1eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.466+0000 7f72220f7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f721c15ab30 0x7f721c0a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.466+0000 7f72220f7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c071250 con 0x7f721c15ab30 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.466+0000 7f72220f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c1ec830 con 0x7f721c0ab0b0 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.466+0000 7f72220f7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c1ed200 con 0x7f721c0c1f20 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.466+0000 7f721bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f721c15ab30 0x7f721c0a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.466+0000 7f721bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f721c15ab30 0x7f721c0a8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53158/0 (socket says 172.21.15.106:53158) 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.466+0000 7f721bfff640 1 -- 172.21.15.106:0/1598027826 learned_addr learned my addr 172.21.15.106:0/1598027826 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.467+0000 7f721b7fe640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721c0ab0b0 0x7f721c070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.467+0000 7f7213fff640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c0c1f20 0x7f721c1eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.467+0000 7f721bfff640 1 -- 172.21.15.106:0/1598027826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c0c1f20 msgr2=0x7f721c1eccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.467+0000 7f721bfff640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c0c1f20 0x7f721c1eccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.467+0000 7f721bfff640 1 -- 172.21.15.106:0/1598027826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721c0ab0b0 msgr2=0x7f721c070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.467+0000 7f721bfff640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721c0ab0b0 0x7f721c070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.467+0000 7f721bfff640 1 -- 172.21.15.106:0/1598027826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214009a70 con 0x7f721c15ab30 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.467+0000 7f721bfff640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f721c15ab30 0x7f721c0a8c30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f721402c4a0 tx=0x7f7214004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.468+0000 7f7218ff9640 1 -- 172.21.15.106:0/1598027826 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214004880 con 0x7f721c15ab30 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.468+0000 7f7218ff9640 1 -- 172.21.15.106:0/1598027826 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7214009450 con 0x7f721c15ab30 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.468+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c0a9170 con 0x7f721c15ab30 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.468+0000 7f7218ff9640 1 -- 172.21.15.106:0/1598027826 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214034640 con 0x7f721c15ab30 2023-12-22T09:16:41.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.468+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c14f880 con 0x7f721c15ab30 2023-12-22T09:16:41.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.469+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c0c0fe0 con 0x7f721c15ab30 2023-12-22T09:16:41.471 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.470+0000 7f7218ff9640 1 -- 172.21.15.106:0/1598027826 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f721403b030 con 0x7f721c15ab30 2023-12-22T09:16:41.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.471+0000 7f7218ff9640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f71fc06a430 0x7f71fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.471+0000 7f7218ff9640 1 -- 172.21.15.106:0/1598027826 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f72140ab3b0 con 0x7f721c15ab30 2023-12-22T09:16:41.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.471+0000 7f721b7fe640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f71fc06a430 0x7f71fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.472+0000 7f721b7fe640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f71fc06a430 0x7f71fc06c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f720c000f60 tx=0x7f720c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:41.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.475+0000 7f7218ff9640 1 -- 172.21.15.106:0/1598027826 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f721c0c0fe0 con 0x7f721c15ab30 2023-12-22T09:16:41.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.699+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f721c0c0fe0 con 0x7f721c15ab30 2023-12-22T09:16:41.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.700+0000 7f7218ff9640 1 -- 172.21.15.106:0/1598027826 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4659 (secure 0 0 0) 0x7f721c0c0fe0 con 0x7f721c15ab30 2023-12-22T09:16:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:41.701 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2871781771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":2871781771},{"type":"v1","addr":"172.21.15.132:6835","nonce":2871781771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:10.238217+0000","modified":"2023-12-22T09:16:13.270608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4792":{"gid":4792,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T09:16:41.702 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 23 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f71fc06a430 msgr2=0x7f71fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f71fc06a430 0x7f71fc06c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f720c000f60 tx=0x7f720c009040 comp rx=0 tx=0).stop 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f721c15ab30 msgr2=0x7f721c0a8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f721c15ab30 0x7f721c0a8c30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f721402c4a0 tx=0x7f7214004a40 comp rx=0 tx=0).stop 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 shutdown_connections 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f71fc06a430 0x7f71fc06c8f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f721c15ab30 0x7f721c0a8c30 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f721c0c1f20 0x7f721c1eccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 --2- 172.21.15.106:0/1598027826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721c0ab0b0 0x7f721c070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 >> 172.21.15.106:0/1598027826 conn(0x7f721c0c5ce0 msgr2=0x7f721c0c2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 shutdown_connections 2023-12-22T09:16:41.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.703+0000 7f72220f7640 1 -- 172.21.15.106:0/1598027826 wait complete. 2023-12-22T09:16:41.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:41.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.929+0000 7f6551e38640 1 Processor -- start 2023-12-22T09:16:41.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.930+0000 7f6551e38640 1 -- start start 2023-12-22T09:16:41.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.931+0000 7f6551e38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f654c0c4130 0x7f654c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.931+0000 7f6551e38640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f654c06aad0 0x7f654c0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.931+0000 7f6551e38640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c0c4660 con 0x7f654c1514b0 2023-12-22T09:16:41.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.931+0000 7f6551e38640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c153d60 con 0x7f654c06aad0 2023-12-22T09:16:41.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.931+0000 7f6551e38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c154c50 con 0x7f654c0c4130 2023-12-22T09:16:41.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.931+0000 7f654b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f654c1514b0 0x7f654c154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53974/0 (socket says 172.21.15.106:53974) 2023-12-22T09:16:41.936 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.931+0000 7f654b7fe640 1 -- 172.21.15.106:0/15131692 learned_addr learned my addr 172.21.15.106:0/15131692 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654bfff640 1 --2- 172.21.15.106:0/15131692 >> v2:172.21.15.132:3300/0 conn(0x7f654c06aad0 0x7f654c0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f6542ffd640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f654c0c4130 0x7f654c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093516030 0 0) 0x7f654c0c4660 con 0x7f654c1514b0 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6538003520 con 0x7f654c1514b0 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2423286797 0 0) 0x7f6538003520 con 0x7f654c1514b0 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f654c0c4130 msgr2=0x7f654c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f654c0c4130 0x7f654c0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 >> v2:172.21.15.132:3300/0 conn(0x7f654c06aad0 msgr2=0x7f654c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 --2- 172.21.15.106:0/15131692 >> v2:172.21.15.132:3300/0 conn(0x7f654c06aad0 0x7f654c0c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c06b250 con 0x7f654c1514b0 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f653c001670 con 0x7f654c1514b0 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 >> v1:172.21.15.106:6789/0 conn(0x7f654c1514b0 legacy=0x7f654c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6538003970 0x7f6538003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f654c0c4130 0x7f65380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6538004d00 0x7f6538005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c153d60 con 0x7f6538004d00 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c154c50 con 0x7f6538003970 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653800bae0 con 0x7f654c0c4130 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.932+0000 7f654bfff640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6538004d00 0x7f6538005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.933+0000 7f654b7fe640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6538003970 0x7f6538003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.933+0000 7f6542ffd640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f654c0c4130 0x7f65380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.933+0000 7f654bfff640 1 -- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f654c0c4130 msgr2=0x7f65380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.933+0000 7f654bfff640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f654c0c4130 0x7f65380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.933+0000 7f654bfff640 1 -- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6538003970 msgr2=0x7f6538003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.933+0000 7f654bfff640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6538003970 0x7f6538003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.933+0000 7f654bfff640 1 -- 172.21.15.106:0/15131692 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6538003520 con 0x7f6538004d00 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.934+0000 7f654bfff640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6538004d00 0x7f6538005180 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6544007360 tx=0x7f65380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a38bfb9deaae server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.934+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654402ccf0 con 0x7f6538004d00 2023-12-22T09:16:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.934+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654402ce50 con 0x7f6538004d00 2023-12-22T09:16:41.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.934+0000 7f654affd640 1 -- 172.21.15.106:0/15131692 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544034660 con 0x7f6538004d00 2023-12-22T09:16:41.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.935+0000 7f6551e38640 1 -- 172.21.15.106:0/15131692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6538004d00 msgr2=0x7f6538005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.935+0000 7f6551e38640 1 --2- 172.21.15.106:0/15131692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6538004d00 0x7f6538005180 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6544007360 tx=0x7f65380057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.935+0000 7f654bfff640 1 -- 172.21.15.106:0/15131692 reap_dead start 2023-12-22T09:16:41.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.935+0000 7f6551e38640 1 -- 172.21.15.106:0/15131692 shutdown_connections 2023-12-22T09:16:41.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.935+0000 7f6551e38640 1 -- 172.21.15.106:0/15131692 >> 172.21.15.106:0/15131692 conn(0x7f654c0ab1a0 msgr2=0x7f654c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:41.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.935+0000 7f6551e38640 1 -- 172.21.15.106:0/15131692 shutdown_connections 2023-12-22T09:16:41.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.935+0000 7f6551e38640 1 -- 172.21.15.106:0/15131692 wait complete. 2023-12-22T09:16:41.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.937+0000 7f6551e38640 1 Processor -- start 2023-12-22T09:16:41.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.937+0000 7f6551e38640 1 -- start start 2023-12-22T09:16:41.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f6551e38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6538004d00 0x7f654c144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f6551e38640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0c17d0 0x7f654c0c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f6551e38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f654c0c2190 0x7f654c1ebf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f6551e38640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0c3820 con 0x7f654c0c17d0 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f6551e38640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c149750 con 0x7f654c0c2190 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f6551e38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0bd790 con 0x7f6538004d00 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f6542ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0c17d0 0x7f654c0c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f6542ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0c17d0 0x7f654c0c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53178/0 (socket says 172.21.15.106:53178) 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f6542ffd640 1 -- 172.21.15.106:0/2760526888 learned_addr learned my addr 172.21.15.106:0/2760526888 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f654bfff640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f654c0c2190 0x7f654c1ebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.938+0000 7f654b7fe640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6538004d00 0x7f654c144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6542ffd640 1 -- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6538004d00 msgr2=0x7f654c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6542ffd640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6538004d00 0x7f654c144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6542ffd640 1 -- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f654c0c2190 msgr2=0x7f654c1ebf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:41.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6542ffd640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f654c0c2190 0x7f654c1ebf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6542ffd640 1 -- 172.21.15.106:0/2760526888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0bda70 con 0x7f654c0c17d0 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f654bfff640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f654c0c2190 0x7f654c1ebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f654b7fe640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6538004d00 0x7f654c144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6542ffd640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0c17d0 0x7f654c0c1c50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f653400f550 tx=0x7f653400fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6548ff9640 1 -- 172.21.15.106:0/2760526888 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534014870 con 0x7f654c0c17d0 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6548ff9640 1 -- 172.21.15.106:0/2760526888 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65340149d0 con 0x7f654c0c17d0 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6548ff9640 1 -- 172.21.15.106:0/2760526888 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534014d80 con 0x7f654c0c17d0 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c149100 con 0x7f654c0c17d0 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.939+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c144e90 con 0x7f654c0c17d0 2023-12-22T09:16:41.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.940+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c04e080 con 0x7f654c0c17d0 2023-12-22T09:16:41.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.941+0000 7f6548ff9640 1 -- 172.21.15.106:0/2760526888 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6534015410 con 0x7f654c0c17d0 2023-12-22T09:16:41.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.942+0000 7f6548ff9640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f652c06a460 0x7f652c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:41.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.942+0000 7f6548ff9640 1 -- 172.21.15.106:0/2760526888 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f65340893f0 con 0x7f654c0c17d0 2023-12-22T09:16:41.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.942+0000 7f654b7fe640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f652c06a460 0x7f652c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:41.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.943+0000 7f654b7fe640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f652c06a460 0x7f652c06c920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f653c0017a0 tx=0x7f653c000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:41.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:41.946+0000 7f6548ff9640 1 -- 172.21.15.106:0/2760526888 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6534054830 con 0x7f654c0c17d0 2023-12-22T09:16:42.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.140+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f654c073f10 con 0x7f654c0c17d0 2023-12-22T09:16:42.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.143+0000 7f6548ff9640 1 -- 172.21.15.106:0/2760526888 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16489 (secure 0 0 0) 0x7f6534057e50 con 0x7f654c0c17d0 2023-12-22T09:16:42.144 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:42.145 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":47,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:39.438722+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/3435163215":"2023-12-23T09:16:36.366375+0000","172.21.15.132:6833/3435163215":"2023-12-23T09:16:36.366375+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:42.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.145+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f652c06a460 msgr2=0x7f652c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.145+0000 7f6551e38640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f652c06a460 0x7f652c06c920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f653c0017a0 tx=0x7f653c000ed0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.145+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0c17d0 msgr2=0x7f654c0c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.145+0000 7f6551e38640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0c17d0 0x7f654c0c1c50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f653400f550 tx=0x7f653400fa10 comp rx=0 tx=0).stop 2023-12-22T09:16:42.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.146+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 shutdown_connections 2023-12-22T09:16:42.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.146+0000 7f6551e38640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f652c06a460 0x7f652c06c920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.146+0000 7f6551e38640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f654c0c2190 0x7f654c1ebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.146+0000 7f6551e38640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0c17d0 0x7f654c0c1c50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.146+0000 7f6551e38640 1 --2- 172.21.15.106:0/2760526888 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6538004d00 0x7f654c144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.146+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 >> 172.21.15.106:0/2760526888 conn(0x7f654c0ab1a0 msgr2=0x7f654c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:42.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.146+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 shutdown_connections 2023-12-22T09:16:42.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.146+0000 7f6551e38640 1 -- 172.21.15.106:0/2760526888 wait complete. 2023-12-22T09:16:42.165 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-22T09:16:42.166 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:42.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.379+0000 7ff1fd877640 1 Processor -- start 2023-12-22T09:16:42.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.379+0000 7ff1fd877640 1 -- start start 2023-12-22T09:16:42.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.381+0000 7ff1fd877640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f8069e60 0x7ff1f813cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.381+0000 7ff1fd877640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1f8157c80 0x7ff1f813d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.381+0000 7ff1fd877640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f8153e90 con 0x7ff1f80be700 2023-12-22T09:16:42.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.381+0000 7ff1fd877640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f8153c80 con 0x7ff1f8157c80 2023-12-22T09:16:42.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.381+0000 7ff1fd877640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8158240 con 0x7ff1f8069e60 2023-12-22T09:16:42.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f77fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff1f80be700 0x7ff1f8070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53990/0 (socket says 172.21.15.106:53990) 2023-12-22T09:16:42.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f77fe640 1 -- 172.21.15.106:0/1479523841 learned_addr learned my addr 172.21.15.106:0/1479523841 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:42.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f6ffd640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f8069e60 0x7ff1f813cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1ee7fc640 1 --2- 172.21.15.106:0/1479523841 >> v2:172.21.15.132:3300/0 conn(0x7ff1f8157c80 0x7ff1f813d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930178952 0 0) 0x7ff1f8153e90 con 0x7ff1f80be700 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e4003520 con 0x7ff1f80be700 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014752033 0 0) 0x7ff1e4003520 con 0x7ff1f80be700 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f8069e60 msgr2=0x7ff1f813cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f67fc640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f8069e60 0x7ff1f813cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 >> v2:172.21.15.132:3300/0 conn(0x7ff1f8157c80 msgr2=0x7ff1f813d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f67fc640 1 --2- 172.21.15.106:0/1479523841 >> v2:172.21.15.132:3300/0 conn(0x7ff1f8157c80 0x7ff1f813d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8154c10 con 0x7ff1f80be700 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.382+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7ff1f00019f0 con 0x7ff1f80be700 2023-12-22T09:16:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 >> v1:172.21.15.106:6789/0 conn(0x7ff1f80be700 legacy=0x7ff1f8070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f67fc640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f8069e60 0x7ff1e4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f67fc640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1e4003ef0 0x7ff1e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f67fc640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8153c80 con 0x7ff1e4004d00 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8158240 con 0x7ff1e4003ef0 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e400b9d0 con 0x7ff1f8069e60 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f77fe640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f6ffd640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f8069e60 0x7ff1e4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f77fe640 1 -- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f8069e60 msgr2=0x7ff1e4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f77fe640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f8069e60 0x7ff1e4003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f77fe640 1 -- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1e4003ef0 msgr2=0x7ff1e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f77fe640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1e4003ef0 0x7ff1e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.383+0000 7ff1f77fe640 1 -- 172.21.15.106:0/1479523841 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4003520 con 0x7ff1e4004d00 2023-12-22T09:16:42.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.384+0000 7ff1f77fe640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1e4005180 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000a860 tx=0x7ff1e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaa0a507872836 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:42.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.384+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0034630 con 0x7ff1e4004d00 2023-12-22T09:16:42.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.385+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f002f070 con 0x7ff1e4004d00 2023-12-22T09:16:42.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.385+0000 7ff1f67fc640 1 -- 172.21.15.106:0/1479523841 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0034a30 con 0x7ff1e4004d00 2023-12-22T09:16:42.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.385+0000 7ff1fd877640 1 -- 172.21.15.106:0/1479523841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 msgr2=0x7ff1e4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.385+0000 7ff1fd877640 1 --2- 172.21.15.106:0/1479523841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1e4005180 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000a860 tx=0x7ff1e40057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.385+0000 7ff1f77fe640 1 -- 172.21.15.106:0/1479523841 reap_dead start 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.385+0000 7ff1fd877640 1 -- 172.21.15.106:0/1479523841 shutdown_connections 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.385+0000 7ff1fd877640 1 -- 172.21.15.106:0/1479523841 >> 172.21.15.106:0/1479523841 conn(0x7ff1f80c5360 msgr2=0x7ff1f80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.385+0000 7ff1fd877640 1 -- 172.21.15.106:0/1479523841 shutdown_connections 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.385+0000 7ff1fd877640 1 -- 172.21.15.106:0/1479523841 wait complete. 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.387+0000 7ff1fd877640 1 Processor -- start 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.387+0000 7ff1fd877640 1 -- start start 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.388+0000 7ff1fd877640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1f81552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.388+0000 7ff1fd877640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f80aaea0 0x7ff1f8136330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.388+0000 7ff1fd877640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f81e8b20 0x7ff1f81e8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.388+0000 7ff1fd877640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80a86d0 con 0x7ff1e4004d00 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.388+0000 7ff1fd877640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80aa710 con 0x7ff1f81e8b20 2023-12-22T09:16:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.388+0000 7ff1fd877640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f813c150 con 0x7ff1f80aaea0 2023-12-22T09:16:42.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.388+0000 7ff1f6ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1f81552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.388+0000 7ff1f6ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1f81552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53190/0 (socket says 172.21.15.106:53190) 2023-12-22T09:16:42.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.388+0000 7ff1f6ffd640 1 -- 172.21.15.106:0/515306492 learned_addr learned my addr 172.21.15.106:0/515306492 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:42.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1f6ffd640 1 -- 172.21.15.106:0/515306492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f80aaea0 msgr2=0x7ff1f8136330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1f6ffd640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f80aaea0 0x7ff1f8136330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1f6ffd640 1 -- 172.21.15.106:0/515306492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f81e8b20 msgr2=0x7ff1f81e8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1f6ffd640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f81e8b20 0x7ff1f81e8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1f6ffd640 1 -- 172.21.15.106:0/515306492 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8136870 con 0x7ff1e4004d00 2023-12-22T09:16:42.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1f6ffd640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1f81552b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800e840 tx=0x7ff1e800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:42.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1f4ff9640 1 -- 172.21.15.106:0/515306492 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800c7f0 con 0x7ff1e4004d00 2023-12-22T09:16:42.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1f4ff9640 1 -- 172.21.15.106:0/515306492 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e800c950 con 0x7ff1e4004d00 2023-12-22T09:16:42.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1f4ff9640 1 -- 172.21.15.106:0/515306492 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800cce0 con 0x7ff1e4004d00 2023-12-22T09:16:42.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f80aa900 con 0x7ff1e4004d00 2023-12-22T09:16:42.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.389+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f813c640 con 0x7ff1e4004d00 2023-12-22T09:16:42.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.390+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f8073f10 con 0x7ff1e4004d00 2023-12-22T09:16:42.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.391+0000 7ff1f4ff9640 1 -- 172.21.15.106:0/515306492 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff1e8013410 con 0x7ff1e4004d00 2023-12-22T09:16:42.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.392+0000 7ff1f4ff9640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff1d806a460 0x7ff1d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.392+0000 7ff1f4ff9640 1 -- 172.21.15.106:0/515306492 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7ff1e8088720 con 0x7ff1e4004d00 2023-12-22T09:16:42.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.393+0000 7ff1ee7fc640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff1d806a460 0x7ff1d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.393+0000 7ff1ee7fc640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff1d806a460 0x7ff1d806c920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0006a90 tx=0x7ff1e0006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:42.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.396+0000 7ff1f4ff9640 1 -- 172.21.15.106:0/515306492 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff1e8053b60 con 0x7ff1e4004d00 2023-12-22T09:16:42.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.623+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1f80aaaf0 con 0x7ff1e4004d00 2023-12-22T09:16:42.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.624+0000 7ff1f4ff9640 1 -- 172.21.15.106:0/515306492 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4659 (secure 0 0 0) 0x7ff1f80aaaf0 con 0x7ff1e4004d00 2023-12-22T09:16:42.625 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:42.625 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2871781771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":2871781771},{"type":"v1","addr":"172.21.15.132:6835","nonce":2871781771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:10.238217+0000","modified":"2023-12-22T09:16:13.270608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4792":{"gid":4792,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T09:16:42.625 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 23 2023-12-22T09:16:42.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.626+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff1d806a460 msgr2=0x7ff1d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.626+0000 7ff1fd877640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff1d806a460 0x7ff1d806c920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0006a90 tx=0x7ff1e0006a20 comp rx=0 tx=0).stop 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.626+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 msgr2=0x7ff1f81552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.626+0000 7ff1fd877640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1f81552b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800e840 tx=0x7ff1e800ed00 comp rx=0 tx=0).stop 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.627+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 shutdown_connections 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.627+0000 7ff1fd877640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff1d806a460 0x7ff1d806c920 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.627+0000 7ff1fd877640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f81e8b20 0x7ff1f81e8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.627+0000 7ff1fd877640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff1f80aaea0 0x7ff1f8136330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.627+0000 7ff1fd877640 1 --2- 172.21.15.106:0/515306492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4004d00 0x7ff1f81552b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.627+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 >> 172.21.15.106:0/515306492 conn(0x7ff1f80c5360 msgr2=0x7ff1f80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.627+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 shutdown_connections 2023-12-22T09:16:42.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.627+0000 7ff1fd877640 1 -- 172.21.15.106:0/515306492 wait complete. 2023-12-22T09:16:42.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:42.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.857+0000 7f51808ca640 1 Processor -- start 2023-12-22T09:16:42.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.857+0000 7f51808ca640 1 -- start start 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.858+0000 7f51808ca640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f517c0bfce0 0x7f517c06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.858+0000 7f51808ca640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f517c151b30 0x7f517c151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.858+0000 7f51808ca640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517c0bf770 con 0x7f517c13b060 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.858+0000 7f51808ca640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c155120 con 0x7f517c151b30 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.858+0000 7f51808ca640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c155400 con 0x7f517c0bfce0 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.859+0000 7f517a59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f517c13b060 0x7f517c069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46374/0 (socket says 172.21.15.106:46374) 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.859+0000 7f517a59c640 1 -- 172.21.15.106:0/854615047 learned_addr learned my addr 172.21.15.106:0/854615047 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.859+0000 7f5171d9b640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f517c0bfce0 0x7f517c06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.859+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533430836 0 0) 0x7f517c0bf770 con 0x7f517c13b060 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.859+0000 7f517ad9d640 1 --2- 172.21.15.106:0/854615047 >> v2:172.21.15.132:3300/0 conn(0x7f517c151b30 0x7f517c151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.859+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f515c003520 con 0x7f517c13b060 2023-12-22T09:16:42.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3983540528 0 0) 0x7f515c003520 con 0x7f517c13b060 2023-12-22T09:16:42.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f517c0bfce0 msgr2=0x7f517c06a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:42.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f517c0bfce0 0x7f517c06a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 >> v2:172.21.15.132:3300/0 conn(0x7f517c151b30 msgr2=0x7f517c151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:42.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 --2- 172.21.15.106:0/854615047 >> v2:172.21.15.132:3300/0 conn(0x7f517c151b30 0x7f517c151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c1556e0 con 0x7f517c13b060 2023-12-22T09:16:42.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f516c0017f0 con 0x7f517c13b060 2023-12-22T09:16:42.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 >> v1:172.21.15.106:6789/0 conn(0x7f517c13b060 legacy=0x7f517c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f515c003970 0x7f515c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f517c0bfce0 0x7f515c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f515c004d00 0x7f515c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c155120 con 0x7f515c003970 2023-12-22T09:16:42.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c155400 con 0x7f515c004d00 2023-12-22T09:16:42.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c00fe70 con 0x7f517c0bfce0 2023-12-22T09:16:42.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f517a59c640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f515c003970 0x7f515c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f517ad9d640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f515c004d00 0x7f515c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.860+0000 7f5171d9b640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f517c0bfce0 0x7f515c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.861+0000 7f517a59c640 1 -- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f517c0bfce0 msgr2=0x7f515c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:42.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.861+0000 7f517a59c640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f517c0bfce0 0x7f515c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.861+0000 7f517a59c640 1 -- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f515c004d00 msgr2=0x7f515c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:42.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.861+0000 7f517a59c640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f515c004d00 0x7f515c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.861+0000 7f517a59c640 1 -- 172.21.15.106:0/854615047 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c003520 con 0x7f515c003970 2023-12-22T09:16:42.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.862+0000 7f517a59c640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f515c003970 0x7f515c003d90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c160 tx=0x7f515c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8620cf6a0fa187c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:42.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.862+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c007270 con 0x7f515c003970 2023-12-22T09:16:42.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.862+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c0073d0 con 0x7f515c003970 2023-12-22T09:16:42.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.862+0000 7f5179d9b640 1 -- 172.21.15.106:0/854615047 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c02c830 con 0x7f515c003970 2023-12-22T09:16:42.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.863+0000 7f51808ca640 1 -- 172.21.15.106:0/854615047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f515c003970 msgr2=0x7f515c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.863+0000 7f51808ca640 1 --2- 172.21.15.106:0/854615047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f515c003970 0x7f515c003d90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c160 tx=0x7f515c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.863+0000 7f517ad9d640 1 -- 172.21.15.106:0/854615047 reap_dead start 2023-12-22T09:16:42.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.863+0000 7f51808ca640 1 -- 172.21.15.106:0/854615047 shutdown_connections 2023-12-22T09:16:42.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.863+0000 7f51808ca640 1 -- 172.21.15.106:0/854615047 >> 172.21.15.106:0/854615047 conn(0x7f517c0c5360 msgr2=0x7f517c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:42.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.863+0000 7f51808ca640 1 -- 172.21.15.106:0/854615047 shutdown_connections 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.863+0000 7f51808ca640 1 -- 172.21.15.106:0/854615047 wait complete. 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.865+0000 7f51808ca640 1 Processor -- start 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.865+0000 7f51808ca640 1 -- start start 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.866+0000 7f51808ca640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f515c003970 0x7f517c1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.866+0000 7f51808ca640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f517c0c2f30 0x7f517c150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.866+0000 7f51808ca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f517c0715c0 0x7f517c1e8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.866+0000 7f51808ca640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c071ac0 con 0x7f517c0c2f30 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.866+0000 7f51808ca640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c14fad0 con 0x7f517c0715c0 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f51808ca640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c14fd70 con 0x7f515c003970 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f5171d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f517c0c2f30 0x7f517c150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f5171d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f517c0c2f30 0x7f517c150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52836/0 (socket says 172.21.15.106:52836) 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f5171d9b640 1 -- 172.21.15.106:0/3964589878 learned_addr learned my addr 172.21.15.106:0/3964589878 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f5171d9b640 1 -- 172.21.15.106:0/3964589878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f515c003970 msgr2=0x7f517c1541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f5171d9b640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f515c003970 0x7f517c1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f5171d9b640 1 -- 172.21.15.106:0/3964589878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f517c0715c0 msgr2=0x7f517c1e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:42.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f5171d9b640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f517c0715c0 0x7f517c1e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:42.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f5171d9b640 1 -- 172.21.15.106:0/3964589878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c150050 con 0x7f517c0c2f30 2023-12-22T09:16:42.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.867+0000 7f5171d9b640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f517c0c2f30 0x7f517c150850 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5164011600 tx=0x7f5164011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:42.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.868+0000 7f51737fe640 1 -- 172.21.15.106:0/3964589878 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516400f920 con 0x7f517c0c2f30 2023-12-22T09:16:42.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.868+0000 7f51737fe640 1 -- 172.21.15.106:0/3964589878 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516400fa80 con 0x7f517c0c2f30 2023-12-22T09:16:42.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.868+0000 7f51737fe640 1 -- 172.21.15.106:0/3964589878 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516400fdf0 con 0x7f517c0c2f30 2023-12-22T09:16:42.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.868+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c150330 con 0x7f517c0c2f30 2023-12-22T09:16:42.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.868+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c154bc0 con 0x7f517c0c2f30 2023-12-22T09:16:42.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.869+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c073f10 con 0x7f517c0c2f30 2023-12-22T09:16:42.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.870+0000 7f51737fe640 1 -- 172.21.15.106:0/3964589878 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5164015460 con 0x7f517c0c2f30 2023-12-22T09:16:42.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.871+0000 7f51737fe640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f516006a460 0x7f516006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:42.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.871+0000 7f51737fe640 1 -- 172.21.15.106:0/3964589878 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f5164088f40 con 0x7f517c0c2f30 2023-12-22T09:16:42.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.871+0000 7f517a59c640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f516006a460 0x7f516006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:42.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.872+0000 7f517a59c640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f516006a460 0x7f516006c920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f516c034000 tx=0x7f516c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:42.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:42.875+0000 7f51737fe640 1 -- 172.21.15.106:0/3964589878 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5164054420 con 0x7f517c0c2f30 2023-12-22T09:16:43.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.103+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f517c13a540 con 0x7f517c0c2f30 2023-12-22T09:16:43.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.104+0000 7f51737fe640 1 -- 172.21.15.106:0/3964589878 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4659 (secure 0 0 0) 0x7f5164057a40 con 0x7f517c0c2f30 2023-12-22T09:16:43.105 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:43.105 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2871781771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":2871781771},{"type":"v1","addr":"172.21.15.132:6835","nonce":2871781771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:10.238217+0000","modified":"2023-12-22T09:16:13.270608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4792":{"gid":4792,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.132:6834/1352663863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1352663863},{"type":"v1","addr":"172.21.15.132:6834","nonce":1352663863}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T09:16:43.105 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 23 2023-12-22T09:16:43.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f516006a460 msgr2=0x7f516006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f516006a460 0x7f516006c920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f516c034000 tx=0x7f516c02e000 comp rx=0 tx=0).stop 2023-12-22T09:16:43.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f517c0c2f30 msgr2=0x7f517c150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f517c0c2f30 0x7f517c150850 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5164011600 tx=0x7f5164011ac0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 shutdown_connections 2023-12-22T09:16:43.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f516006a460 0x7f516006c920 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f517c0715c0 0x7f517c1e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f517c0c2f30 0x7f517c150850 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 --2- 172.21.15.106:0/3964589878 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f515c003970 0x7f517c1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 >> 172.21.15.106:0/3964589878 conn(0x7f517c0c5360 msgr2=0x7f517c069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:43.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 shutdown_connections 2023-12-22T09:16:43.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.107+0000 7f51808ca640 1 -- 172.21.15.106:0/3964589878 wait complete. 2023-12-22T09:16:43.127 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.339+0000 7f167ffff640 1 Processor -- start 2023-12-22T09:16:43.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.339+0000 7f167ffff640 1 -- start start 2023-12-22T09:16:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.341+0000 7f167ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f16800aa440 0x7f1680153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.341+0000 7f167ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16800a8c60 0x7f1680153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.341+0000 7f167ffff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1680071c60 con 0x7f168014d630 2023-12-22T09:16:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.341+0000 7f167ffff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1680151060 con 0x7f16800aa440 2023-12-22T09:16:43.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.341+0000 7f167ffff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1680071980 con 0x7f16800a8c60 2023-12-22T09:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.342+0000 7f167e7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f16800aa440 0x7f1680153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.342+0000 7f167f7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16800a8c60 0x7f1680153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.342+0000 7f167effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f168014d630 0x7f168006bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:40348/0 (socket says 172.21.15.106:40348) 2023-12-22T09:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.342+0000 7f167effd640 1 -- 172.21.15.106:0/1994368081 learned_addr learned my addr 172.21.15.106:0/1994368081 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.342+0000 7f167e7fc640 1 -- 172.21.15.106:0/1994368081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16800a8c60 msgr2=0x7f1680153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:43.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.342+0000 7f167e7fc640 1 --2- 172.21.15.106:0/1994368081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16800a8c60 0x7f1680153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.342+0000 7f167e7fc640 1 -- 172.21.15.106:0/1994368081 >> v1:172.21.15.132:6789/0 conn(0x7f168014d630 legacy=0x7f168006bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.342+0000 7f167e7fc640 1 -- 172.21.15.106:0/1994368081 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1680150c80 con 0x7f16800aa440 2023-12-22T09:16:43.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.344+0000 7f167e7fc640 1 --2- 172.21.15.106:0/1994368081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16800aa440 0x7f1680153880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1668009d90 tx=0x7f166802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dce96b434d70270 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:43.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.345+0000 7f167dffb640 1 -- 172.21.15.106:0/1994368081 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166802cbc0 con 0x7f16800aa440 2023-12-22T09:16:43.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.345+0000 7f167dffb640 1 -- 172.21.15.106:0/1994368081 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166802cd20 con 0x7f16800aa440 2023-12-22T09:16:43.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.345+0000 7f167dffb640 1 -- 172.21.15.106:0/1994368081 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668034660 con 0x7f16800aa440 2023-12-22T09:16:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.345+0000 7f167ffff640 1 -- 172.21.15.106:0/1994368081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16800aa440 msgr2=0x7f1680153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.345+0000 7f167ffff640 1 --2- 172.21.15.106:0/1994368081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16800aa440 0x7f1680153880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1668009d90 tx=0x7f166802be10 comp rx=0 tx=0).stop 2023-12-22T09:16:43.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.345+0000 7f167ffff640 1 -- 172.21.15.106:0/1994368081 shutdown_connections 2023-12-22T09:16:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.345+0000 7f167ffff640 1 --2- 172.21.15.106:0/1994368081 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f16800a8c60 0x7f1680153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.345+0000 7f167ffff640 1 --2- 172.21.15.106:0/1994368081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16800aa440 0x7f1680153880 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.345+0000 7f167ffff640 1 -- 172.21.15.106:0/1994368081 >> 172.21.15.106:0/1994368081 conn(0x7f1680069dd0 msgr2=0x7f168006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.346+0000 7f167ffff640 1 -- 172.21.15.106:0/1994368081 shutdown_connections 2023-12-22T09:16:43.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.346+0000 7f167ffff640 1 -- 172.21.15.106:0/1994368081 wait complete. 2023-12-22T09:16:43.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.347+0000 7f167ffff640 1 Processor -- start 2023-12-22T09:16:43.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.347+0000 7f167ffff640 1 -- start start 2023-12-22T09:16:43.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.348+0000 7f167ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16800a8c60 0x7f1680151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.348+0000 7f167ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16800aa440 0x7f1680147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.348+0000 7f167ffff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f168014d630 0x7f16800c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.348+0000 7f167ffff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800bf320 con 0x7f16800a8c60 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.348+0000 7f167ffff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800706d0 con 0x7f16800aa440 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.348+0000 7f167ffff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800702d0 con 0x7f168014d630 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16800a8c60 0x7f1680151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16800a8c60 0x7f1680151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52838/0 (socket says 172.21.15.106:52838) 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167effd640 1 -- 172.21.15.106:0/231577296 learned_addr learned my addr 172.21.15.106:0/231577296 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167e7fc640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16800aa440 0x7f1680147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167f7fe640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f168014d630 0x7f16800c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167effd640 1 -- 172.21.15.106:0/231577296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f168014d630 msgr2=0x7f16800c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167effd640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f168014d630 0x7f16800c2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167effd640 1 -- 172.21.15.106:0/231577296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16800aa440 msgr2=0x7f1680147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167effd640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16800aa440 0x7f1680147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167effd640 1 -- 172.21.15.106:0/231577296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668009a70 con 0x7f16800a8c60 2023-12-22T09:16:43.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.349+0000 7f167effd640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16800a8c60 0x7f1680151d20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f167000c4b0 tx=0x7f167000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:43.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.350+0000 7f1677fff640 1 -- 172.21.15.106:0/231577296 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670005ce0 con 0x7f16800a8c60 2023-12-22T09:16:43.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.350+0000 7f1677fff640 1 -- 172.21.15.106:0/231577296 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1670005e40 con 0x7f16800a8c60 2023-12-22T09:16:43.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.350+0000 7f1677fff640 1 -- 172.21.15.106:0/231577296 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670007270 con 0x7f16800a8c60 2023-12-22T09:16:43.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.350+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1680152730 con 0x7f16800a8c60 2023-12-22T09:16:43.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.350+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16800bf570 con 0x7f16800a8c60 2023-12-22T09:16:43.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.351+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16800bf8e0 con 0x7f16800a8c60 2023-12-22T09:16:43.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.352+0000 7f1677fff640 1 -- 172.21.15.106:0/231577296 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f16700073d0 con 0x7f16800a8c60 2023-12-22T09:16:43.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.353+0000 7f1677fff640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f166006a430 0x7f166006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.353+0000 7f1677fff640 1 -- 172.21.15.106:0/231577296 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f1670087f80 con 0x7f16800a8c60 2023-12-22T09:16:43.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.353+0000 7f167e7fc640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f166006a430 0x7f166006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.354+0000 7f167e7fc640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f166006a430 0x7f166006c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1668036000 tx=0x7f1668030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:43.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.357+0000 7f1677fff640 1 -- 172.21.15.106:0/231577296 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1670053470 con 0x7f16800a8c60 2023-12-22T09:16:43.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.549+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f168004e8d0 con 0x7f16800a8c60 2023-12-22T09:16:43.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.551+0000 7f1677fff640 1 -- 172.21.15.106:0/231577296 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16489 (secure 0 0 0) 0x7f1670017090 con 0x7f16800a8c60 2023-12-22T09:16:43.552 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:43.552 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":47,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:39.438722+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:16:08.066634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:16:09.242570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6835/3435163215":"2023-12-23T09:16:36.366375+0000","172.21.15.132:6833/3435163215":"2023-12-23T09:16:36.366375+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:43.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f166006a430 msgr2=0x7f166006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f166006a430 0x7f166006c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1668036000 tx=0x7f1668030000 comp rx=0 tx=0).stop 2023-12-22T09:16:43.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16800a8c60 msgr2=0x7f1680151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16800a8c60 0x7f1680151d20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f167000c4b0 tx=0x7f167000c970 comp rx=0 tx=0).stop 2023-12-22T09:16:43.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 shutdown_connections 2023-12-22T09:16:43.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f166006a430 0x7f166006c8f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f168014d630 0x7f16800c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16800aa440 0x7f1680147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 --2- 172.21.15.106:0/231577296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16800a8c60 0x7f1680151d20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 >> 172.21.15.106:0/231577296 conn(0x7f1680069dd0 msgr2=0x7f168006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:43.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 shutdown_connections 2023-12-22T09:16:43.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.554+0000 7f167ffff640 1 -- 172.21.15.106:0/231577296 wait complete. 2023-12-22T09:16:43.574 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-22T09:16:43.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.787+0000 7f05fe495640 1 Processor -- start 2023-12-22T09:16:43.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.787+0000 7f05fe495640 1 -- start start 2023-12-22T09:16:43.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.789+0000 7f05fe495640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f05f8069e60 0x7f05f8070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.789+0000 7f05fe495640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05f8154f10 0x7f05f813aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.789+0000 7f05fe495640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f806bc70 con 0x7f05f813afb0 2023-12-22T09:16:43.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.789+0000 7f05fe495640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f80713a0 con 0x7f05f8154f10 2023-12-22T09:16:43.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.789+0000 7f05fe495640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f8071660 con 0x7f05f8069e60 2023-12-22T09:16:43.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.789+0000 7f05fcc92640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05f8154f10 0x7f05f813aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.789+0000 7f05fcc92640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05f8154f10 0x7f05f813aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52854/0 (socket says 172.21.15.106:52854) 2023-12-22T09:16:43.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.789+0000 7f05fcc92640 1 -- 172.21.15.106:0/825780334 learned_addr learned my addr 172.21.15.106:0/825780334 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:43.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.789+0000 7f05fd493640 1 --2- 172.21.15.106:0/825780334 >> v2:172.21.15.132:3300/0 conn(0x7f05f8069e60 0x7f05f8070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.790+0000 7f05fcc92640 1 -- 172.21.15.106:0/825780334 >> v2:172.21.15.132:3300/0 conn(0x7f05f8069e60 msgr2=0x7f05f8070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:43.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.790+0000 7f05fcc92640 1 --2- 172.21.15.106:0/825780334 >> v2:172.21.15.132:3300/0 conn(0x7f05f8069e60 0x7f05f8070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.790+0000 7f05fcc92640 1 -- 172.21.15.106:0/825780334 >> v1:172.21.15.132:6789/0 conn(0x7f05f813afb0 legacy=0x7f05f80c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:43.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.790+0000 7f05fcc92640 1 -- 172.21.15.106:0/825780334 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8071940 con 0x7f05f8154f10 2023-12-22T09:16:43.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.790+0000 7f05fd493640 1 --2- 172.21.15.106:0/825780334 >> v2:172.21.15.132:3300/0 conn(0x7f05f8069e60 0x7f05f8070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:43.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.791+0000 7f05fcc92640 1 --2- 172.21.15.106:0/825780334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8154f10 0x7f05f813aa70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f05f80c2d20 tx=0x7f05e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca459fc498e51c45 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.791+0000 7f05effff640 1 -- 172.21.15.106:0/825780334 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8031640 con 0x7f05f8154f10 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.791+0000 7f05effff640 1 -- 172.21.15.106:0/825780334 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e80317a0 con 0x7f05f8154f10 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.791+0000 7f05effff640 1 -- 172.21.15.106:0/825780334 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8031b30 con 0x7f05f8154f10 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.792+0000 7f05fe495640 1 -- 172.21.15.106:0/825780334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8154f10 msgr2=0x7f05f813aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.792+0000 7f05fe495640 1 --2- 172.21.15.106:0/825780334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8154f10 0x7f05f813aa70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f05f80c2d20 tx=0x7f05e802b8f0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.792+0000 7f05fe495640 1 -- 172.21.15.106:0/825780334 shutdown_connections 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.792+0000 7f05fe495640 1 --2- 172.21.15.106:0/825780334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8154f10 0x7f05f813aa70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.792+0000 7f05fe495640 1 --2- 172.21.15.106:0/825780334 >> v2:172.21.15.132:3300/0 conn(0x7f05f8069e60 0x7f05f8070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.792+0000 7f05fe495640 1 -- 172.21.15.106:0/825780334 >> 172.21.15.106:0/825780334 conn(0x7f05f80c5180 msgr2=0x7f05f80c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.792+0000 7f05fe495640 1 -- 172.21.15.106:0/825780334 shutdown_connections 2023-12-22T09:16:43.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.792+0000 7f05fe495640 1 -- 172.21.15.106:0/825780334 wait complete. 2023-12-22T09:16:43.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.794+0000 7f05fe495640 1 Processor -- start 2023-12-22T09:16:43.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.794+0000 7f05fe495640 1 -- start start 2023-12-22T09:16:43.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fe495640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8069e60 0x7f05f8151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fe495640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f813afb0 0x7f05f80c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fe495640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f8154f10 0x7f05f8150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fe495640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f8154770 con 0x7f05f8069e60 2023-12-22T09:16:43.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fe495640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f8135890 con 0x7f05f8154f10 2023-12-22T09:16:43.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fe495640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f814f870 con 0x7f05f813afb0 2023-12-22T09:16:43.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fd493640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8069e60 0x7f05f8151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fd493640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8069e60 0x7f05f8151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52860/0 (socket says 172.21.15.106:52860) 2023-12-22T09:16:43.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fd493640 1 -- 172.21.15.106:0/3294120211 learned_addr learned my addr 172.21.15.106:0/3294120211 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:43.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fdc94640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f8154f10 0x7f05f8150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fcc92640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f813afb0 0x7f05f80c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fd493640 1 -- 172.21.15.106:0/3294120211 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f813afb0 msgr2=0x7f05f80c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fd493640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f813afb0 0x7f05f80c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fd493640 1 -- 172.21.15.106:0/3294120211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f8154f10 msgr2=0x7f05f8150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:43.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fd493640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f8154f10 0x7f05f8150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:43.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.795+0000 7f05fd493640 1 -- 172.21.15.106:0/3294120211 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e80094d0 con 0x7f05f8069e60 2023-12-22T09:16:43.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.796+0000 7f05fd493640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8069e60 0x7f05f8151a40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c7f0 tx=0x7f05f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:43.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.796+0000 7f05edffb640 1 -- 172.21.15.106:0/3294120211 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4007820 con 0x7f05f8069e60 2023-12-22T09:16:43.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.796+0000 7f05edffb640 1 -- 172.21.15.106:0/3294120211 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f4007980 con 0x7f05f8069e60 2023-12-22T09:16:43.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.796+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f81e9a90 con 0x7f05f8069e60 2023-12-22T09:16:43.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.796+0000 7f05edffb640 1 -- 172.21.15.106:0/3294120211 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4007cf0 con 0x7f05f8069e60 2023-12-22T09:16:43.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.796+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f80c4550 con 0x7f05f8069e60 2023-12-22T09:16:43.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.797+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f80701e0 con 0x7f05f8069e60 2023-12-22T09:16:43.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.798+0000 7f05edffb640 1 -- 172.21.15.106:0/3294120211 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f05f40113f0 con 0x7f05f8069e60 2023-12-22T09:16:43.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.799+0000 7f05edffb640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f05dc06a430 0x7f05dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:43.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.799+0000 7f05edffb640 1 -- 172.21.15.106:0/3294120211 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f05f4088d50 con 0x7f05f8069e60 2023-12-22T09:16:43.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.799+0000 7f05fcc92640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f05dc06a430 0x7f05dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:43.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.800+0000 7f05fcc92640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f05dc06a430 0x7f05dc06c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f05e8036000 tx=0x7f05e803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:43.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:43.804+0000 7f05edffb640 1 -- 172.21.15.106:0/3294120211 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f05f408c030 con 0x7f05f8069e60 2023-12-22T09:16:44.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.031+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f05f804e8d0 con 0x7f05f8069e60 2023-12-22T09:16:44.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2023-12-22T09:16:44.033+0000 7fe4c35b5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T09:16:44.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.052+0000 7f05edffb640 1 -- 172.21.15.106:0/3294120211 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 163+0+0 (secure 0 0 0) 0x7f05f4054230 con 0x7f05f8069e60 2023-12-22T09:16:44.053 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T09:16:44.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.054+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f05dc06a430 msgr2=0x7f05dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:44.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.054+0000 7f05fe495640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f05dc06a430 0x7f05dc06c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f05e8036000 tx=0x7f05e803c040 comp rx=0 tx=0).stop 2023-12-22T09:16:44.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.054+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8069e60 msgr2=0x7f05f8151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.054+0000 7f05fe495640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8069e60 0x7f05f8151a40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c7f0 tx=0x7f05f400ccb0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.055+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 shutdown_connections 2023-12-22T09:16:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.055+0000 7f05fe495640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f05dc06a430 0x7f05dc06c8f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.055+0000 7f05fe495640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f8154f10 0x7f05f8150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.055+0000 7f05fe495640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f813afb0 0x7f05f80c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.055+0000 7f05fe495640 1 --2- 172.21.15.106:0/3294120211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05f8069e60 0x7f05f8151a40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.055+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 >> 172.21.15.106:0/3294120211 conn(0x7f05f80c5180 msgr2=0x7f05f806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.055+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 shutdown_connections 2023-12-22T09:16:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.055+0000 7f05fe495640 1 -- 172.21.15.106:0/3294120211 wait complete. 2023-12-22T09:16:44.070 INFO:tasks.ceph.mds.d.smithi132.stderr: -2200> 2023-12-22T09:16:12.239+0000 7fc23d083640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T09:16:44.074 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-22T09:16:44.149 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-12-22T09:16:44.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.267+0000 7f34ebdf1640 1 Processor -- start 2023-12-22T09:16:44.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.268+0000 7f34ebdf1640 1 -- start start 2023-12-22T09:16:44.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.269+0000 7f34ebdf1640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f34e413a520 0x7f34e4151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:44.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.269+0000 7f34ebdf1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34e41559e0 0x7f34e413aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:44.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.269+0000 7f34ebdf1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34e4155e70 0x7f34e40bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:44.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.269+0000 7f34ebdf1640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e41555c0 con 0x7f34e413a520 2023-12-22T09:16:44.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.269+0000 7f34ebdf1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e4152090 con 0x7f34e41559e0 2023-12-22T09:16:44.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.269+0000 7f34ebdf1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40c26e0 con 0x7f34e4155e70 2023-12-22T09:16:44.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.270+0000 7f34e9b8d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f34e413a520 0x7f34e4151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:44.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.270+0000 7f34e9b8d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f34e413a520 0x7f34e4151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52868/0 (socket says 172.21.15.106:52868) 2023-12-22T09:16:44.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.270+0000 7f34e9b8d640 1 -- 172.21.15.106:0/1707886342 learned_addr learned my addr 172.21.15.106:0/1707886342 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:44.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.270+0000 7f34e9b8d640 1 -- 172.21.15.106:0/1707886342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34e4155e70 msgr2=0x7f34e40bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:44.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.270+0000 7f34e9b8d640 1 --2- 172.21.15.106:0/1707886342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34e4155e70 0x7f34e40bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.270+0000 7f34e9b8d640 1 -- 172.21.15.106:0/1707886342 >> v2:172.21.15.132:3300/0 conn(0x7f34e41559e0 msgr2=0x7f34e413aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:44.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.270+0000 7f34e9b8d640 1 --2- 172.21.15.106:0/1707886342 >> v2:172.21.15.132:3300/0 conn(0x7f34e41559e0 0x7f34e413aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.271 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.270+0000 7f34e9b8d640 1 -- 172.21.15.106:0/1707886342 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e40c2120 con 0x7f34e413a520 2023-12-22T09:16:44.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.271+0000 7f34e9b8d640 1 --2- 172.21.15.106:0/1707886342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 0x7f34e4151b50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f34e406fa60 tx=0x7f34e002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eddd4d0f006d8ba server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:44.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.271+0000 7f34e8b8b640 1 -- 172.21.15.106:0/1707886342 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0004230 con 0x7f34e413a520 2023-12-22T09:16:44.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.271+0000 7f34e8b8b640 1 -- 172.21.15.106:0/1707886342 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e0004390 con 0x7f34e413a520 2023-12-22T09:16:44.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.271+0000 7f34e8b8b640 1 -- 172.21.15.106:0/1707886342 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0003810 con 0x7f34e413a520 2023-12-22T09:16:44.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.272+0000 7f34ebdf1640 1 -- 172.21.15.106:0/1707886342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 msgr2=0x7f34e4151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:44.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.272+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/1707886342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 0x7f34e4151b50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f34e406fa60 tx=0x7f34e002b7e0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.272+0000 7f34ebdf1640 1 -- 172.21.15.106:0/1707886342 shutdown_connections 2023-12-22T09:16:44.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.272+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/1707886342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34e4155e70 0x7f34e40bfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.272+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/1707886342 >> v2:172.21.15.132:3300/0 conn(0x7f34e41559e0 0x7f34e413aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.272+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/1707886342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 0x7f34e4151b50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.272+0000 7f34ebdf1640 1 -- 172.21.15.106:0/1707886342 >> 172.21.15.106:0/1707886342 conn(0x7f34e4069bf0 msgr2=0x7f34e4069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:44.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.272+0000 7f34ebdf1640 1 -- 172.21.15.106:0/1707886342 shutdown_connections 2023-12-22T09:16:44.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.272+0000 7f34ebdf1640 1 -- 172.21.15.106:0/1707886342 wait complete. 2023-12-22T09:16:44.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.274+0000 7f34ebdf1640 1 Processor -- start 2023-12-22T09:16:44.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.274+0000 7f34ebdf1640 1 -- start start 2023-12-22T09:16:44.277 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34ebdf1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 0x7f34e4132e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34ebdf1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34e41559e0 0x7f34e4133370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34ebdf1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34e4155e70 0x7f34e41e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34ebdf1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41e7d20 con 0x7f34e413a520 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34ebdf1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41538f0 con 0x7f34e41559e0 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34ebdf1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4153bd0 con 0x7f34e4155e70 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34e9b8d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 0x7f34e4132e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34e9b8d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 0x7f34e4132e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52872/0 (socket says 172.21.15.106:52872) 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34e9b8d640 1 -- 172.21.15.106:0/350798947 learned_addr learned my addr 172.21.15.106:0/350798947 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34e9b8d640 1 -- 172.21.15.106:0/350798947 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34e4155e70 msgr2=0x7f34e41e70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:44.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34e9b8d640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34e4155e70 0x7f34e41e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34e9b8d640 1 -- 172.21.15.106:0/350798947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34e41559e0 msgr2=0x7f34e4133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:44.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34e9b8d640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34e41559e0 0x7f34e4133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:44.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.276+0000 7f34e9b8d640 1 -- 172.21.15.106:0/350798947 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0009460 con 0x7f34e413a520 2023-12-22T09:16:44.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.277+0000 7f34e9b8d640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 0x7f34e4132e30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f34e0036040 tx=0x7f34e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:44.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.277+0000 7f34da7fc640 1 -- 172.21.15.106:0/350798947 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0003e50 con 0x7f34e413a520 2023-12-22T09:16:44.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.277+0000 7f34da7fc640 1 -- 172.21.15.106:0/350798947 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e0004500 con 0x7f34e413a520 2023-12-22T09:16:44.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.277+0000 7f34da7fc640 1 -- 172.21.15.106:0/350798947 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0006240 con 0x7f34e413a520 2023-12-22T09:16:44.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.277+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e4153eb0 con 0x7f34e413a520 2023-12-22T09:16:44.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.277+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e41546b0 con 0x7f34e413a520 2023-12-22T09:16:44.280 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.278+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e41543d0 con 0x7f34e413a520 2023-12-22T09:16:44.280 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.279+0000 7f34da7fc640 1 -- 172.21.15.106:0/350798947 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f34e003a050 con 0x7f34e413a520 2023-12-22T09:16:44.280 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.280+0000 7f34da7fc640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f34c806a430 0x7f34c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:44.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.280+0000 7f34da7fc640 1 -- 172.21.15.106:0/350798947 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f34e00aa950 con 0x7f34e413a520 2023-12-22T09:16:44.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.280+0000 7f34e938c640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f34c806a430 0x7f34c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:44.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.281+0000 7f34e938c640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f34c806a430 0x7f34c806c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f34e40c1a50 tx=0x7f34d4006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:44.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.286+0000 7f34da7fc640 1 -- 172.21.15.106:0/350798947 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f34e41543d0 con 0x7f34e413a520 2023-12-22T09:16:44.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:44.514+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f34e41543d0 con 0x7f34e413a520 2023-12-22T09:16:45.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.054+0000 7f34da7fc640 1 -- 172.21.15.106:0/350798947 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 105+0+0 (secure 0 0 0) 0x7f34e41543d0 con 0x7f34e413a520 2023-12-22T09:16:45.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.057+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f34c806a430 msgr2=0x7f34c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f34c806a430 0x7f34c806c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f34e40c1a50 tx=0x7f34d4006c90 comp rx=0 tx=0).stop 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 msgr2=0x7f34e4132e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 0x7f34e4132e30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f34e0036040 tx=0x7f34e00046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 shutdown_connections 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f34c806a430 0x7f34c806c8f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34e4155e70 0x7f34e41e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34e41559e0 0x7f34e4133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 --2- 172.21.15.106:0/350798947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34e413a520 0x7f34e4132e30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 >> 172.21.15.106:0/350798947 conn(0x7f34e4069bf0 msgr2=0x7f34e40aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 shutdown_connections 2023-12-22T09:16:45.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.058+0000 7f34ebdf1640 1 -- 172.21.15.106:0/350798947 wait complete. 2023-12-22T09:16:45.079 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-22T09:16:45.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.293+0000 7fc348c5f640 1 Processor -- start 2023-12-22T09:16:45.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.294+0000 7fc348c5f640 1 -- start start 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.295+0000 7fc348c5f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3440c75b0 0x7fc3441540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.295+0000 7fc348c5f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc344157430 con 0x7fc344151540 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.295+0000 7fc348c5f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc344157710 con 0x7fc344154630 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.295+0000 7fc348c5f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc344151920 con 0x7fc3440c75b0 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.295+0000 7fc341d9b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3440c75b0 0x7fc3441540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.296+0000 7fc34259c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc344151540 0x7fc3440c6610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46390/0 (socket says 172.21.15.106:46390) 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.296+0000 7fc34259c640 1 -- 172.21.15.106:0/1456603133 learned_addr learned my addr 172.21.15.106:0/1456603133 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.296+0000 7fc341d9b640 1 -- 172.21.15.106:0/1456603133 >> v1:172.21.15.132:6789/0 conn(0x7fc344154630 legacy=0x7fc34415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.296+0000 7fc341d9b640 1 -- 172.21.15.106:0/1456603133 >> v1:172.21.15.106:6789/0 conn(0x7fc344151540 legacy=0x7fc3440c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:45.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.296+0000 7fc341d9b640 1 -- 172.21.15.106:0/1456603133 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3441579f0 con 0x7fc3440c75b0 2023-12-22T09:16:45.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.297+0000 7fc341d9b640 1 --2- 172.21.15.106:0/1456603133 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440c75b0 0x7fc3441540f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009d90 tx=0x7fc32c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b74b516a89e1aa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:45.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.298+0000 7fc34159a640 1 -- 172.21.15.106:0/1456603133 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c02cbd0 con 0x7fc3440c75b0 2023-12-22T09:16:45.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.298+0000 7fc34159a640 1 -- 172.21.15.106:0/1456603133 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c02cd30 con 0x7fc3440c75b0 2023-12-22T09:16:45.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.298+0000 7fc34159a640 1 -- 172.21.15.106:0/1456603133 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c02cea0 con 0x7fc3440c75b0 2023-12-22T09:16:45.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.298+0000 7fc348c5f640 1 -- 172.21.15.106:0/1456603133 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440c75b0 msgr2=0x7fc3441540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:45.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.298+0000 7fc348c5f640 1 --2- 172.21.15.106:0/1456603133 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440c75b0 0x7fc3441540f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009d90 tx=0x7fc32c02be20 comp rx=0 tx=0).stop 2023-12-22T09:16:45.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.298+0000 7fc348c5f640 1 -- 172.21.15.106:0/1456603133 shutdown_connections 2023-12-22T09:16:45.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.298+0000 7fc348c5f640 1 --2- 172.21.15.106:0/1456603133 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3440c75b0 0x7fc3441540f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:45.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.298+0000 7fc348c5f640 1 -- 172.21.15.106:0/1456603133 >> 172.21.15.106:0/1456603133 conn(0x7fc344071740 msgr2=0x7fc344071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:45.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.299+0000 7fc348c5f640 1 -- 172.21.15.106:0/1456603133 shutdown_connections 2023-12-22T09:16:45.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.299+0000 7fc348c5f640 1 -- 172.21.15.106:0/1456603133 wait complete. 2023-12-22T09:16:45.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.300+0000 7fc348c5f640 1 Processor -- start 2023-12-22T09:16:45.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.300+0000 7fc348c5f640 1 -- start start 2023-12-22T09:16:45.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.301+0000 7fc348c5f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3440c75b0 0x7fc3441e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.301+0000 7fc348c5f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344151540 0x7fc344156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.301+0000 7fc348c5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc344154630 0x7fc3441ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.301+0000 7fc348c5f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440ada40 con 0x7fc344151540 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.301+0000 7fc348c5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440aeb30 con 0x7fc344154630 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.301+0000 7fc348c5f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc344150070 con 0x7fc3440c75b0 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.301+0000 7fc341d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344151540 0x7fc344156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc341d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344151540 0x7fc344156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52896/0 (socket says 172.21.15.106:52896) 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc341d9b640 1 -- 172.21.15.106:0/2811273623 learned_addr learned my addr 172.21.15.106:0/2811273623 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc342d9d640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc344154630 0x7fc3441ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc34259c640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3440c75b0 0x7fc3441e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc341d9b640 1 -- 172.21.15.106:0/2811273623 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3440c75b0 msgr2=0x7fc3441e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc341d9b640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3440c75b0 0x7fc3441e96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc341d9b640 1 -- 172.21.15.106:0/2811273623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc344154630 msgr2=0x7fc3441ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc341d9b640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc344154630 0x7fc3441ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:45.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc341d9b640 1 -- 172.21.15.106:0/2811273623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c009a70 con 0x7fc344151540 2023-12-22T09:16:45.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc341d9b640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344151540 0x7fc344156620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009d90 tx=0x7fc32c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:45.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.302+0000 7fc33affd640 1 -- 172.21.15.106:0/2811273623 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c02cea0 con 0x7fc344151540 2023-12-22T09:16:45.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.303+0000 7fc33affd640 1 -- 172.21.15.106:0/2811273623 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c040650 con 0x7fc344151540 2023-12-22T09:16:45.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.303+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3441ecc40 con 0x7fc344151540 2023-12-22T09:16:45.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.303+0000 7fc33affd640 1 -- 172.21.15.106:0/2811273623 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c040a00 con 0x7fc344151540 2023-12-22T09:16:45.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.303+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3441ecf20 con 0x7fc344151540 2023-12-22T09:16:45.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.304+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3441ed0b0 con 0x7fc344151540 2023-12-22T09:16:45.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.305+0000 7fc33affd640 1 -- 172.21.15.106:0/2811273623 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc32c040b60 con 0x7fc344151540 2023-12-22T09:16:45.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.306+0000 7fc33affd640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc32406a430 0x7fc32406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:45.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.306+0000 7fc33affd640 1 -- 172.21.15.106:0/2811273623 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fc32c0ab8b0 con 0x7fc344151540 2023-12-22T09:16:45.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.306+0000 7fc34259c640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc32406a430 0x7fc32406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:45.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.307+0000 7fc34259c640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc32406a430 0x7fc32406c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc334005880 tx=0x7fc334009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:45.312 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.310+0000 7fc33affd640 1 -- 172.21.15.106:0/2811273623 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc32c076d40 con 0x7fc344151540 2023-12-22T09:16:45.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:45.503+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc344073f10 con 0x7fc344151540 2023-12-22T09:16:46.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.510+0000 7fc33affd640 1 -- 172.21.15.106:0/2811273623 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v49) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc32c07a360 con 0x7fc344151540 2023-12-22T09:16:46.512 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs2_metadata' removed 2023-12-22T09:16:46.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.515+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc32406a430 msgr2=0x7fc32406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:46.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.515+0000 7fc348c5f640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc32406a430 0x7fc32406c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc334005880 tx=0x7fc334009040 comp rx=0 tx=0).stop 2023-12-22T09:16:46.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.515+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344151540 msgr2=0x7fc344156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:46.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.515+0000 7fc348c5f640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344151540 0x7fc344156620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009d90 tx=0x7fc32c004a40 comp rx=0 tx=0).stop 2023-12-22T09:16:46.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.516+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 shutdown_connections 2023-12-22T09:16:46.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.516+0000 7fc348c5f640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc32406a430 0x7fc32406c8f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:46.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.516+0000 7fc348c5f640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc344154630 0x7fc3441ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:46.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.516+0000 7fc348c5f640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc344151540 0x7fc344156620 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:46.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.516+0000 7fc348c5f640 1 --2- 172.21.15.106:0/2811273623 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc3440c75b0 0x7fc3441e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:46.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.516+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 >> 172.21.15.106:0/2811273623 conn(0x7fc344071740 msgr2=0x7fc344152350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:46.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.516+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 shutdown_connections 2023-12-22T09:16:46.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.517+0000 7fc348c5f640 1 -- 172.21.15.106:0/2811273623 wait complete. 2023-12-22T09:16:46.543 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-22T09:16:46.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.750+0000 7f52044e7640 1 Processor -- start 2023-12-22T09:16:46.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.750+0000 7f52044e7640 1 -- start start 2023-12-22T09:16:46.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.752+0000 7f52044e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc06dc60 0x7f51fc150b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:46.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.752+0000 7f52044e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51fc071bf0 0x7f51fc151050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:46.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.752+0000 7f52044e7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51fc06bb70 con 0x7f51fc139ff0 2023-12-22T09:16:46.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.752+0000 7f52044e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51fc0c23f0 con 0x7f51fc071bf0 2023-12-22T09:16:46.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.752+0000 7f52044e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc1516c0 con 0x7f51fc06dc60 2023-12-22T09:16:46.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5201a82640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc06dc60 0x7f51fc150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:46.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5202a84640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51fc071bf0 0x7f51fc151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:46.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5201a82640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc06dc60 0x7f51fc150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.106:39816/0 (socket says 172.21.15.106:39816) 2023-12-22T09:16:46.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5201a82640 1 -- 172.21.15.106:0/3806553430 learned_addr learned my addr 172.21.15.106:0/3806553430 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:46.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5202283640 1 --1- 172.21.15.106:0/3806553430 >> v1:172.21.15.132:6789/0 conn(0x7f51fc139ff0 0x7f51fc0a8520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.106:40390/0 (socket says 172.21.15.106:40390) 2023-12-22T09:16:46.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5202a84640 1 -- 172.21.15.106:0/3806553430 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc06dc60 msgr2=0x7f51fc150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:46.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5202a84640 1 --2- 172.21.15.106:0/3806553430 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc06dc60 0x7f51fc150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:46.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5202a84640 1 -- 172.21.15.106:0/3806553430 >> v1:172.21.15.132:6789/0 conn(0x7f51fc139ff0 legacy=0x7f51fc0a8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:46.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5202a84640 1 -- 172.21.15.106:0/3806553430 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc1519a0 con 0x7f51fc071bf0 2023-12-22T09:16:46.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.753+0000 7f5201a82640 1 --2- 172.21.15.106:0/3806553430 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc06dc60 0x7f51fc150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:16:46.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.755+0000 7f5202a84640 1 --2- 172.21.15.106:0/3806553430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51fc071bf0 0x7f51fc151050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009d90 tx=0x7f51f402bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb69009167ae16e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.755+0000 7f5201281640 1 -- 172.21.15.106:0/3806553430 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f402cb40 con 0x7f51fc071bf0 2023-12-22T09:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.755+0000 7f5201281640 1 -- 172.21.15.106:0/3806553430 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f402cca0 con 0x7f51fc071bf0 2023-12-22T09:16:46.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.755+0000 7f5201281640 1 -- 172.21.15.106:0/3806553430 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4034660 con 0x7f51fc071bf0 2023-12-22T09:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.756+0000 7f52044e7640 1 -- 172.21.15.106:0/3806553430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51fc071bf0 msgr2=0x7f51fc151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.756+0000 7f52044e7640 1 --2- 172.21.15.106:0/3806553430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51fc071bf0 0x7f51fc151050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009d90 tx=0x7f51f402bd90 comp rx=0 tx=0).stop 2023-12-22T09:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.756+0000 7f52044e7640 1 -- 172.21.15.106:0/3806553430 shutdown_connections 2023-12-22T09:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.756+0000 7f52044e7640 1 --2- 172.21.15.106:0/3806553430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51fc071bf0 0x7f51fc151050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.756+0000 7f52044e7640 1 --2- 172.21.15.106:0/3806553430 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc06dc60 0x7f51fc150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.756+0000 7f52044e7640 1 -- 172.21.15.106:0/3806553430 >> 172.21.15.106:0/3806553430 conn(0x7f51fc06ad00 msgr2=0x7f51fc06b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.756+0000 7f52044e7640 1 -- 172.21.15.106:0/3806553430 shutdown_connections 2023-12-22T09:16:46.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.756+0000 7f52044e7640 1 -- 172.21.15.106:0/3806553430 wait complete. 2023-12-22T09:16:46.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.758+0000 7f52044e7640 1 Processor -- start 2023-12-22T09:16:46.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.758+0000 7f52044e7640 1 -- start start 2023-12-22T09:16:46.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.759+0000 7f52044e7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51fc06dc60 0x7f51fc1ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.759+0000 7f52044e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc071bf0 0x7f51fc150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.759+0000 7f52044e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51fc139ff0 0x7f51fc14cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.759+0000 7f52044e7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc134fb0 con 0x7f51fc06dc60 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.759+0000 7f52044e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc136c20 con 0x7f51fc139ff0 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.759+0000 7f52044e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc1ed4e0 con 0x7f51fc071bf0 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.759+0000 7f5202283640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51fc06dc60 0x7f51fc1ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5202283640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51fc06dc60 0x7f51fc1ecfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52900/0 (socket says 172.21.15.106:52900) 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5202283640 1 -- 172.21.15.106:0/1799749581 learned_addr learned my addr 172.21.15.106:0/1799749581 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5201a82640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc071bf0 0x7f51fc150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5202a84640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51fc139ff0 0x7f51fc14cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5202283640 1 -- 172.21.15.106:0/1799749581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc071bf0 msgr2=0x7f51fc150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5202283640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc071bf0 0x7f51fc150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5202283640 1 -- 172.21.15.106:0/1799749581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51fc139ff0 msgr2=0x7f51fc14cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5202283640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51fc139ff0 0x7f51fc14cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5202283640 1 -- 172.21.15.106:0/1799749581 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0094d0 con 0x7f51fc06dc60 2023-12-22T09:16:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f5202283640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51fc06dc60 0x7f51fc1ecfa0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c3c0 tx=0x7f51f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.760+0000 7f51f2ffd640 1 -- 172.21.15.106:0/1799749581 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80074e0 con 0x7f51fc06dc60 2023-12-22T09:16:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.761+0000 7f51f2ffd640 1 -- 172.21.15.106:0/1799749581 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f8007640 con 0x7f51fc06dc60 2023-12-22T09:16:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.761+0000 7f51f2ffd640 1 -- 172.21.15.106:0/1799749581 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8004a00 con 0x7f51fc06dc60 2023-12-22T09:16:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.761+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f4009a70 con 0x7f51fc06dc60 2023-12-22T09:16:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.761+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc1348f0 con 0x7f51fc06dc60 2023-12-22T09:16:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.762+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc134750 con 0x7f51fc06dc60 2023-12-22T09:16:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.763+0000 7f51f2ffd640 1 -- 172.21.15.106:0/1799749581 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f51f8004b60 con 0x7f51fc06dc60 2023-12-22T09:16:46.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.764+0000 7f51f2ffd640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f51e006a430 0x7f51e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.765+0000 7f51f2ffd640 1 -- 172.21.15.106:0/1799749581 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f51f8088260 con 0x7f51fc06dc60 2023-12-22T09:16:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.765+0000 7f5201a82640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f51e006a430 0x7f51e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.765+0000 7f5201a82640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f51e006a430 0x7f51e006c8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f51fc14e0f0 tx=0x7f51ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:46.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.769+0000 7f51f2ffd640 1 -- 172.21.15.106:0/1799749581 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f51fc134750 con 0x7f51fc06dc60 2023-12-22T09:16:46.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:46.967+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51fc134750 con 0x7f51fc06dc60 2023-12-22T09:16:47.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.527+0000 7f51f2ffd640 1 -- 172.21.15.106:0/1799749581 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v50) v1 ==== 172+0+0 (secure 0 0 0) 0x7f51fc134750 con 0x7f51fc06dc60 2023-12-22T09:16:47.529 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs2_data' removed 2023-12-22T09:16:47.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.533+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f51e006a430 msgr2=0x7f51e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:47.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.533+0000 7f52044e7640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f51e006a430 0x7f51e006c8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f51fc14e0f0 tx=0x7f51ec008040 comp rx=0 tx=0).stop 2023-12-22T09:16:47.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.533+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51fc06dc60 msgr2=0x7f51fc1ecfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:47.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.533+0000 7f52044e7640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51fc06dc60 0x7f51fc1ecfa0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c3c0 tx=0x7f51f800c880 comp rx=0 tx=0).stop 2023-12-22T09:16:47.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.534+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 shutdown_connections 2023-12-22T09:16:47.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.534+0000 7f52044e7640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f51e006a430 0x7f51e006c8f0 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f51fc14e0f0 tx=0x7f51ec008040 comp rx=0 tx=0).stop 2023-12-22T09:16:47.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.534+0000 7f52044e7640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51fc139ff0 0x7f51fc14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.534+0000 7f52044e7640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f51fc071bf0 0x7f51fc150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.534+0000 7f52044e7640 1 --2- 172.21.15.106:0/1799749581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51fc06dc60 0x7f51fc1ecfa0 secure :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c3c0 tx=0x7f51f800c880 comp rx=0 tx=0).stop 2023-12-22T09:16:47.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.534+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 >> 172.21.15.106:0/1799749581 conn(0x7f51fc06ad00 msgr2=0x7f51fc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:47.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.536+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 shutdown_connections 2023-12-22T09:16:47.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.538+0000 7f52044e7640 1 -- 172.21.15.106:0/1799749581 wait complete. 2023-12-22T09:16:47.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T09:16:47.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.752+0000 7fe720994640 1 Processor -- start 2023-12-22T09:16:47.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.752+0000 7fe720994640 1 -- start start 2023-12-22T09:16:47.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.753+0000 7fe720994640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe71c14a2b0 0x7fe71c14a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:47.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.753+0000 7fe720994640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c0c3e60 con 0x7fe71c06c410 2023-12-22T09:16:47.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.753+0000 7fe720994640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c1546a0 con 0x7fe71c0c73e0 2023-12-22T09:16:47.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.753+0000 7fe720994640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c154940 con 0x7fe71c14a2b0 2023-12-22T09:16:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.753+0000 7fe713fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe71c06c410 0x7fe71c0c5ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46402/0 (socket says 172.21.15.106:46402) 2023-12-22T09:16:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe713fff640 1 -- 172.21.15.106:0/3585308122 learned_addr learned my addr 172.21.15.106:0/3585308122 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe71ad9d640 1 --2- 172.21.15.106:0/3585308122 >> v2:172.21.15.132:3300/0 conn(0x7fe71c14a2b0 0x7fe71c14a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe71a59c640 1 -- 172.21.15.106:0/3585308122 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062321178 0 0) 0x7fe71c0c3e60 con 0x7fe71c06c410 2023-12-22T09:16:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe71a59c640 1 -- 172.21.15.106:0/3585308122 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe708003520 con 0x7fe71c06c410 2023-12-22T09:16:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe71a59c640 1 -- 172.21.15.106:0/3585308122 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310027331 0 0) 0x7fe71c1546a0 con 0x7fe71c0c73e0 2023-12-22T09:16:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe71a59c640 1 -- 172.21.15.106:0/3585308122 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe71c0c3e60 con 0x7fe71c0c73e0 2023-12-22T09:16:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe71ad9d640 1 -- 172.21.15.106:0/3585308122 >> v1:172.21.15.132:6789/0 conn(0x7fe71c0c73e0 legacy=0x7fe71c0ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe71a59c640 1 -- 172.21.15.106:0/3585308122 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684951094 0 0) 0x7fe708003520 con 0x7fe71c06c410 2023-12-22T09:16:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe71ad9d640 1 -- 172.21.15.106:0/3585308122 >> v1:172.21.15.106:6789/0 conn(0x7fe71c06c410 legacy=0x7fe71c0c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.754+0000 7fe71ad9d640 1 -- 172.21.15.106:0/3585308122 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c0c40b0 con 0x7fe71c14a2b0 2023-12-22T09:16:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.756+0000 7fe71ad9d640 1 --2- 172.21.15.106:0/3585308122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe71c14a2b0 0x7fe71c14a690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0097a0 tx=0x7fe70c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaafff4de688796a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.756+0000 7fe71a59c640 1 -- 172.21.15.106:0/3585308122 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704001670 con 0x7fe71c14a2b0 2023-12-22T09:16:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.756+0000 7fe71a59c640 1 -- 172.21.15.106:0/3585308122 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c02e050 con 0x7fe71c14a2b0 2023-12-22T09:16:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.756+0000 7fe71a59c640 1 -- 172.21.15.106:0/3585308122 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c030710 con 0x7fe71c14a2b0 2023-12-22T09:16:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.756+0000 7fe720994640 1 -- 172.21.15.106:0/3585308122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe71c14a2b0 msgr2=0x7fe71c14a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.756+0000 7fe720994640 1 --2- 172.21.15.106:0/3585308122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe71c14a2b0 0x7fe71c14a690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0097a0 tx=0x7fe70c02b710 comp rx=0 tx=0).stop 2023-12-22T09:16:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.757+0000 7fe720994640 1 -- 172.21.15.106:0/3585308122 shutdown_connections 2023-12-22T09:16:47.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.757+0000 7fe720994640 1 --2- 172.21.15.106:0/3585308122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe71c14a2b0 0x7fe71c14a690 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.757+0000 7fe720994640 1 -- 172.21.15.106:0/3585308122 >> 172.21.15.106:0/3585308122 conn(0x7fe71c071320 msgr2=0x7fe71c071730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:47.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.757+0000 7fe720994640 1 -- 172.21.15.106:0/3585308122 shutdown_connections 2023-12-22T09:16:47.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.757+0000 7fe720994640 1 -- 172.21.15.106:0/3585308122 wait complete. 2023-12-22T09:16:47.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.758+0000 7fe720994640 1 Processor -- start 2023-12-22T09:16:47.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.758+0000 7fe720994640 1 -- start start 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.759+0000 7fe720994640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe71c06c410 0x7fe71c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.759+0000 7fe720994640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe71c0c73e0 0x7fe71c149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.759+0000 7fe720994640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe71c14a2b0 0x7fe71c149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.759+0000 7fe720994640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0ad7d0 con 0x7fe71c06c410 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.759+0000 7fe720994640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0aeea0 con 0x7fe71c0c73e0 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.759+0000 7fe720994640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0af180 con 0x7fe71c14a2b0 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe71ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe71c06c410 0x7fe71c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe71ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe71c06c410 0x7fe71c156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52912/0 (socket says 172.21.15.106:52912) 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe71ad9d640 1 -- 172.21.15.106:0/3585993212 learned_addr learned my addr 172.21.15.106:0/3585993212 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe713fff640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe71c0c73e0 0x7fe71c149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe71ad9d640 1 -- 172.21.15.106:0/3585993212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe71c14a2b0 msgr2=0x7fe71c149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe71ad9d640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe71c14a2b0 0x7fe71c149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe71ad9d640 1 -- 172.21.15.106:0/3585993212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe71c0c73e0 msgr2=0x7fe71c149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe71ad9d640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe71c0c73e0 0x7fe71c149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe71ad9d640 1 -- 172.21.15.106:0/3585993212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c009400 con 0x7fe71c06c410 2023-12-22T09:16:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.760+0000 7fe71ad9d640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe71c06c410 0x7fe71c156b90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe70c000c00 tx=0x7fe70c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.761+0000 7fe7137fe640 1 -- 172.21.15.106:0/3585993212 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c03c620 con 0x7fe71c06c410 2023-12-22T09:16:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.761+0000 7fe7137fe640 1 -- 172.21.15.106:0/3585993212 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c03c7a0 con 0x7fe71c06c410 2023-12-22T09:16:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.761+0000 7fe7137fe640 1 -- 172.21.15.106:0/3585993212 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c03cb50 con 0x7fe71c06c410 2023-12-22T09:16:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.761+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c0ada20 con 0x7fe71c06c410 2023-12-22T09:16:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.761+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c157a20 con 0x7fe71c06c410 2023-12-22T09:16:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.762+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c0adc10 con 0x7fe71c06c410 2023-12-22T09:16:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.763+0000 7fe7137fe640 1 -- 172.21.15.106:0/3585993212 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe70c039070 con 0x7fe71c06c410 2023-12-22T09:16:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.764+0000 7fe7137fe640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6fc06a430 0x7fe6fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.764+0000 7fe7137fe640 1 -- 172.21.15.106:0/3585993212 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe70c0a9ff0 con 0x7fe71c06c410 2023-12-22T09:16:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.765+0000 7fe713fff640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6fc06a430 0x7fe6fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.765+0000 7fe713fff640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6fc06a430 0x7fe6fc06c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe71c1575b0 tx=0x7fe704009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:47.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.769+0000 7fe7137fe640 1 -- 172.21.15.106:0/3585993212 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe70c0dcc80 con 0x7fe71c06c410 2023-12-22T09:16:47.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.955+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe71c04e8d0 con 0x7fe71c06c410 2023-12-22T09:16:47.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.961+0000 7fe7137fe640 1 -- 172.21.15.106:0/3585993212 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe70c0400a0 con 0x7fe71c06c410 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.963+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6fc06a430 msgr2=0x7fe6fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.963+0000 7fe720994640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6fc06a430 0x7fe6fc06c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe71c1575b0 tx=0x7fe704009040 comp rx=0 tx=0).stop 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe71c06c410 msgr2=0x7fe71c156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe71c06c410 0x7fe71c156b90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe70c000c00 tx=0x7fe70c0046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 shutdown_connections 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe6fc06a430 0x7fe6fc06c8f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe71c14a2b0 0x7fe71c149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe71c0c73e0 0x7fe71c149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 --2- 172.21.15.106:0/3585993212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe71c06c410 0x7fe71c156b90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:47.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 >> 172.21.15.106:0/3585993212 conn(0x7fe71c071320 msgr2=0x7fe71c0c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:47.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 shutdown_connections 2023-12-22T09:16:47.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:47.964+0000 7fe720994640 1 -- 172.21.15.106:0/3585993212 wait complete. 2023-12-22T09:16:47.983 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-22T09:16:48.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.191+0000 7f003d9b9640 1 Processor -- start 2023-12-22T09:16:48.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.192+0000 7f003d9b9640 1 -- start start 2023-12-22T09:16:48.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.193+0000 7f003d9b9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00381514b0 0x7f00380c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.193+0000 7f003d9b9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f003806aad0 0x7f00380c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.193+0000 7f003d9b9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00380c4660 con 0x7f00380c4130 2023-12-22T09:16:48.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.193+0000 7f003d9b9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0038153d60 con 0x7f00381514b0 2023-12-22T09:16:48.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.193+0000 7f003d9b9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0038154c50 con 0x7f003806aad0 2023-12-22T09:16:48.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.194+0000 7f0036ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00381514b0 0x7f00380c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.194+0000 7f0036ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00381514b0 0x7f00380c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52924/0 (socket says 172.21.15.106:52924) 2023-12-22T09:16:48.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.194+0000 7f0036ffd640 1 -- 172.21.15.106:0/1913176214 learned_addr learned my addr 172.21.15.106:0/1913176214 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:48.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.194+0000 7f0036ffd640 1 -- 172.21.15.106:0/1913176214 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f003806aad0 msgr2=0x7f00380c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:48.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.194+0000 7f00377fe640 1 --2- 172.21.15.106:0/1913176214 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f003806aad0 0x7f00380c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.194+0000 7f0036ffd640 1 --2- 172.21.15.106:0/1913176214 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f003806aad0 0x7f00380c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.194+0000 7f0036ffd640 1 -- 172.21.15.106:0/1913176214 >> v1:172.21.15.132:6789/0 conn(0x7f00380c4130 legacy=0x7f0038154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:48.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.194+0000 7f0036ffd640 1 -- 172.21.15.106:0/1913176214 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003806b250 con 0x7f00381514b0 2023-12-22T09:16:48.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.195+0000 7f0036ffd640 1 --2- 172.21.15.106:0/1913176214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00381514b0 0x7f00380c75b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0028009e50 tx=0x7f002802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcabba31aa2be3a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:48.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.195+0000 7f0035ffb640 1 -- 172.21.15.106:0/1913176214 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002802c9e0 con 0x7f00381514b0 2023-12-22T09:16:48.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.195+0000 7f0035ffb640 1 -- 172.21.15.106:0/1913176214 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002802cb40 con 0x7f00381514b0 2023-12-22T09:16:48.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.195+0000 7f0035ffb640 1 -- 172.21.15.106:0/1913176214 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00280343f0 con 0x7f00381514b0 2023-12-22T09:16:48.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.196+0000 7f003d9b9640 1 -- 172.21.15.106:0/1913176214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00381514b0 msgr2=0x7f00380c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.196+0000 7f003d9b9640 1 --2- 172.21.15.106:0/1913176214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00381514b0 0x7f00380c75b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0028009e50 tx=0x7f002802be40 comp rx=0 tx=0).stop 2023-12-22T09:16:48.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.196+0000 7f003d9b9640 1 -- 172.21.15.106:0/1913176214 shutdown_connections 2023-12-22T09:16:48.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.196+0000 7f003d9b9640 1 --2- 172.21.15.106:0/1913176214 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f003806aad0 0x7f00380c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.196+0000 7f003d9b9640 1 --2- 172.21.15.106:0/1913176214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00381514b0 0x7f00380c75b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.196+0000 7f003d9b9640 1 -- 172.21.15.106:0/1913176214 >> 172.21.15.106:0/1913176214 conn(0x7f00380ab1a0 msgr2=0x7f00380ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:48.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.196+0000 7f003d9b9640 1 -- 172.21.15.106:0/1913176214 shutdown_connections 2023-12-22T09:16:48.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.196+0000 7f003d9b9640 1 -- 172.21.15.106:0/1913176214 wait complete. 2023-12-22T09:16:48.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.198+0000 7f003d9b9640 1 Processor -- start 2023-12-22T09:16:48.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.198+0000 7f003d9b9640 1 -- start start 2023-12-22T09:16:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f003d9b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f003806aad0 0x7f00380beb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f003d9b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00380c4130 0x7f003814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f003d9b9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00381514b0 0x7f00381e9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f003d9b9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380bddb0 con 0x7f00380c4130 2023-12-22T09:16:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f003d9b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00381ec960 con 0x7f003806aad0 2023-12-22T09:16:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f003d9b9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00381ecc40 con 0x7f00381514b0 2023-12-22T09:16:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f00367fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00380c4130 0x7f003814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f00367fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00380c4130 0x7f003814daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52934/0 (socket says 172.21.15.106:52934) 2023-12-22T09:16:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f00367fc640 1 -- 172.21.15.106:0/132525314 learned_addr learned my addr 172.21.15.106:0/132525314 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:48.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.199+0000 7f0036ffd640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f003806aad0 0x7f00380beb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f00367fc640 1 -- 172.21.15.106:0/132525314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00381514b0 msgr2=0x7f00381e9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f00377fe640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00381514b0 0x7f00381e9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f00367fc640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00381514b0 0x7f00381e9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f00367fc640 1 -- 172.21.15.106:0/132525314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f003806aad0 msgr2=0x7f00380beb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f00367fc640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f003806aad0 0x7f00380beb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f00367fc640 1 -- 172.21.15.106:0/132525314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0028009b30 con 0x7f00380c4130 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f00367fc640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00380c4130 0x7f003814daa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f002000b3f0 tx=0x7f002000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f002ffff640 1 -- 172.21.15.106:0/132525314 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020011830 con 0x7f00380c4130 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f002ffff640 1 -- 172.21.15.106:0/132525314 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020011990 con 0x7f00380c4130 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00381ecf20 con 0x7f00380c4130 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f002ffff640 1 -- 172.21.15.106:0/132525314 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020011d40 con 0x7f00380c4130 2023-12-22T09:16:48.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.200+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003814dfe0 con 0x7f00380c4130 2023-12-22T09:16:48.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.202+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00381ec7c0 con 0x7f00380c4130 2023-12-22T09:16:48.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.203+0000 7f002ffff640 1 -- 172.21.15.106:0/132525314 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f002001a400 con 0x7f00380c4130 2023-12-22T09:16:48.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.203+0000 7f002ffff640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f001806a430 0x7f001806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.204+0000 7f002ffff640 1 -- 172.21.15.106:0/132525314 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f00200885b0 con 0x7f00380c4130 2023-12-22T09:16:48.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.204+0000 7f0036ffd640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f001806a430 0x7f001806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.204+0000 7f0036ffd640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f001806a430 0x7f001806c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0028035000 tx=0x7f0028030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:48.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.208+0000 7f002ffff640 1 -- 172.21.15.106:0/132525314 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f00381ec7c0 con 0x7f00380c4130 2023-12-22T09:16:48.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.465+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f00381ec7c0 con 0x7f00380c4130 2023-12-22T09:16:48.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.526+0000 7f002ffff640 1 -- 172.21.15.106:0/132525314 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v153) v1 ==== 159+0+0 (secure 0 0 0) 0x7f00381ec7c0 con 0x7f00380c4130 2023-12-22T09:16:48.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.529+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f001806a430 msgr2=0x7f001806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.529+0000 7f003d9b9640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f001806a430 0x7f001806c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0028035000 tx=0x7f0028030000 comp rx=0 tx=0).stop 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.529+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00380c4130 msgr2=0x7f003814daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.529+0000 7f003d9b9640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00380c4130 0x7f003814daa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f002000b3f0 tx=0x7f002000b8b0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.530+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 shutdown_connections 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.530+0000 7f003d9b9640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f001806a430 0x7f001806c8f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.530+0000 7f003d9b9640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00381514b0 0x7f00381e9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.530+0000 7f003d9b9640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00380c4130 0x7f003814daa0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.530+0000 7f003d9b9640 1 --2- 172.21.15.106:0/132525314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f003806aad0 0x7f00380beb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.530+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 >> 172.21.15.106:0/132525314 conn(0x7f00380ab1a0 msgr2=0x7f0038152260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.530+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 shutdown_connections 2023-12-22T09:16:48.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.530+0000 7f003d9b9640 1 -- 172.21.15.106:0/132525314 wait complete. 2023-12-22T09:16:48.550 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-22T09:16:48.550 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-22T09:16:48.551 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:48.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.759+0000 7f8869115640 1 Processor -- start 2023-12-22T09:16:48.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.759+0000 7f8869115640 1 -- start start 2023-12-22T09:16:48.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.760+0000 7f8869115640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f88640c7500 0x7f886406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.760+0000 7f8869115640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886406c7e0 0x7f886406b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.760+0000 7f8869115640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88640c43b0 con 0x7f88640aeb90 2023-12-22T09:16:48.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.760+0000 7f8869115640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640aef70 con 0x7f88640c7500 2023-12-22T09:16:48.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.760+0000 7f8869115640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8864154650 con 0x7f886406c7e0 2023-12-22T09:16:48.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.760+0000 7f8863fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f88640aeb90 0x7f88640c5fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46408/0 (socket says 172.21.15.106:46408) 2023-12-22T09:16:48.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.760+0000 7f8863fff640 1 -- 172.21.15.106:0/769863251 learned_addr learned my addr 172.21.15.106:0/769863251 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:48.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8868914640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886406c7e0 0x7f886406b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392575017 0 0) 0x7f88640c43b0 con 0x7f88640aeb90 2023-12-22T09:16:48.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f88637fe640 1 --2- 172.21.15.106:0/769863251 >> v2:172.21.15.132:3300/0 conn(0x7f88640c7500 0x7f886406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8850003520 con 0x7f88640aeb90 2023-12-22T09:16:48.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424104835 0 0) 0x7f8850003520 con 0x7f88640aeb90 2023-12-22T09:16:48.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886406c7e0 msgr2=0x7f886406b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:48.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886406c7e0 0x7f886406b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 >> v2:172.21.15.132:3300/0 conn(0x7f88640c7500 msgr2=0x7f886406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 --2- 172.21.15.106:0/769863251 >> v2:172.21.15.132:3300/0 conn(0x7f88640c7500 0x7f886406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864154b80 con 0x7f88640aeb90 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f88540019f0 con 0x7f88640aeb90 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 >> v1:172.21.15.106:6789/0 conn(0x7f88640aeb90 legacy=0x7f88640c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886406c7e0 0x7f8850003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850003fa0 0x7f88500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8850004d00 0x7f8850005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640aef70 con 0x7f8850004d00 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8864154650 con 0x7f8850003fa0 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885000bbf0 con 0x7f886406c7e0 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.761+0000 7f8868914640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8850004d00 0x7f8850005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.762+0000 7f88637fe640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850003fa0 0x7f88500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.762+0000 7f8863fff640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886406c7e0 0x7f8850003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.762+0000 7f8868914640 1 -- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886406c7e0 msgr2=0x7f8850003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:48.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.762+0000 7f8868914640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886406c7e0 0x7f8850003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.762+0000 7f8868914640 1 -- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850003fa0 msgr2=0x7f88500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:48.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.762+0000 7f8868914640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850003fa0 0x7f88500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.762+0000 7f8868914640 1 -- 172.21.15.106:0/769863251 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850003520 con 0x7f8850004d00 2023-12-22T09:16:48.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.762+0000 7f8863fff640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886406c7e0 0x7f8850003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.763+0000 7f8868914640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8850004d00 0x7f8850005180 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f885c00ba30 tx=0x7f88500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35494965e7f6044 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.763+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c032630 con 0x7f8850004d00 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.763+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c032790 con 0x7f8850004d00 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.763+0000 7f8862ffd640 1 -- 172.21.15.106:0/769863251 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c032b20 con 0x7f8850004d00 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.764+0000 7f8869115640 1 -- 172.21.15.106:0/769863251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8850004d00 msgr2=0x7f8850005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.764+0000 7f8869115640 1 --2- 172.21.15.106:0/769863251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8850004d00 0x7f8850005180 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f885c00ba30 tx=0x7f88500057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.764+0000 7f8868914640 1 -- 172.21.15.106:0/769863251 reap_dead start 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.764+0000 7f8869115640 1 -- 172.21.15.106:0/769863251 shutdown_connections 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.764+0000 7f8869115640 1 -- 172.21.15.106:0/769863251 >> 172.21.15.106:0/769863251 conn(0x7f88640ab120 msgr2=0x7f88640ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.764+0000 7f8869115640 1 -- 172.21.15.106:0/769863251 shutdown_connections 2023-12-22T09:16:48.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.764+0000 7f8869115640 1 -- 172.21.15.106:0/769863251 wait complete. 2023-12-22T09:16:48.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.766+0000 7f8869115640 1 Processor -- start 2023-12-22T09:16:48.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.766+0000 7f8869115640 1 -- start start 2023-12-22T09:16:48.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f8869115640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850004d00 0x7f88641e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f8869115640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640c0660 0x7f886414b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f8869115640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886414bc00 0x7f88640c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f8869115640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c3110 con 0x7f88640c0660 2023-12-22T09:16:48.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f8869115640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c2b00 con 0x7f8850004d00 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f8869115640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88641e98f0 con 0x7f886414bc00 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f88637fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640c0660 0x7f886414b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f88637fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640c0660 0x7f886414b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52950/0 (socket says 172.21.15.106:52950) 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f88637fe640 1 -- 172.21.15.106:0/3282930162 learned_addr learned my addr 172.21.15.106:0/3282930162 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f8868914640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886414bc00 0x7f88640c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f8863fff640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850004d00 0x7f88641e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f88637fe640 1 -- 172.21.15.106:0/3282930162 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886414bc00 msgr2=0x7f88640c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f88637fe640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886414bc00 0x7f88640c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f88637fe640 1 -- 172.21.15.106:0/3282930162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850004d00 msgr2=0x7f88641e8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f88637fe640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850004d00 0x7f88641e8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f88637fe640 1 -- 172.21.15.106:0/3282930162 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640c2da0 con 0x7f88640c0660 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.767+0000 7f8863fff640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850004d00 0x7f88641e8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:48.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.768+0000 7f88637fe640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640c0660 0x7f886414b6c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f884c00f620 tx=0x7f884c00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:48.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.768+0000 7f8860ff9640 1 -- 172.21.15.106:0/3282930162 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c014870 con 0x7f88640c0660 2023-12-22T09:16:48.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.768+0000 7f8860ff9640 1 -- 172.21.15.106:0/3282930162 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c0149d0 con 0x7f88640c0660 2023-12-22T09:16:48.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.768+0000 7f8860ff9640 1 -- 172.21.15.106:0/3282930162 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c014d80 con 0x7f88640c0660 2023-12-22T09:16:48.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.768+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88641e9bd0 con 0x7f88640c0660 2023-12-22T09:16:48.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.768+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88640c9fe0 con 0x7f88640c0660 2023-12-22T09:16:48.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.769+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886404e8d0 con 0x7f88640c0660 2023-12-22T09:16:48.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.770+0000 7f8860ff9640 1 -- 172.21.15.106:0/3282930162 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f884c015410 con 0x7f88640c0660 2023-12-22T09:16:48.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.771+0000 7f8860ff9640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f884406a460 0x7f884406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:48.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.771+0000 7f8860ff9640 1 -- 172.21.15.106:0/3282930162 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f884c0891b0 con 0x7f88640c0660 2023-12-22T09:16:48.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.771+0000 7f8863fff640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f884406a460 0x7f884406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:48.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.772+0000 7f8863fff640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f884406a460 0x7f884406c920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8854001b20 tx=0x7f8854009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:48.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.775+0000 7f8860ff9640 1 -- 172.21.15.106:0/3282930162 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f884c0548f0 con 0x7f88640c0660 2023-12-22T09:16:48.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.966+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88640c3250 con 0x7f88640c0660 2023-12-22T09:16:48.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.970+0000 7f8860ff9640 1 -- 172.21.15.106:0/3282930162 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+12905 (secure 0 0 0) 0x7f88640c3250 con 0x7f88640c0660 2023-12-22T09:16:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:48.973 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":50,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:47.508813+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6834/1352663863":"2023-12-23T09:16:44.033884+0000","172.21.15.132:6832/1352663863":"2023-12-23T09:16:44.033884+0000","172.21.15.132:6835/3435163215":"2023-12-23T09:16:36.366375+0000","172.21.15.132:6833/3435163215":"2023-12-23T09:16:36.366375+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:48.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f884406a460 msgr2=0x7f884406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f884406a460 0x7f884406c920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8854001b20 tx=0x7f8854009040 comp rx=0 tx=0).stop 2023-12-22T09:16:48.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640c0660 msgr2=0x7f886414b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:48.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640c0660 0x7f886414b6c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f884c00f620 tx=0x7f884c00fae0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 shutdown_connections 2023-12-22T09:16:48.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f884406a460 0x7f884406c920 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f886414bc00 0x7f88640c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640c0660 0x7f886414b6c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 --2- 172.21.15.106:0/3282930162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8850004d00 0x7f88641e8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:48.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 >> 172.21.15.106:0/3282930162 conn(0x7f88640ab120 msgr2=0x7f88640adf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:48.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 shutdown_connections 2023-12-22T09:16:48.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:48.974+0000 7f8869115640 1 -- 172.21.15.106:0/3282930162 wait complete. 2023-12-22T09:16:48.995 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:16:48.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:16:49.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.211+0000 7efd0f59e640 1 Processor -- start 2023-12-22T09:16:49.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.211+0000 7efd0f59e640 1 -- start start 2023-12-22T09:16:49.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.213+0000 7efd0f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efd100a83c0 0x7efd10147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.213+0000 7efd0f59e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd100c2830 0x7efd101484e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.213+0000 7efd0f59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd10151970 con 0x7efd100bfb00 2023-12-22T09:16:49.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.213+0000 7efd0f59e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd100a9a20 con 0x7efd100c2830 2023-12-22T09:16:49.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.213+0000 7efd0f59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd10151bc0 con 0x7efd100a83c0 2023-12-22T09:16:49.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.213+0000 7efd07fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd100c2830 0x7efd101484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.213+0000 7efd07fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd100c2830 0x7efd101484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52962/0 (socket says 172.21.15.106:52962) 2023-12-22T09:16:49.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.213+0000 7efd07fff640 1 -- 172.21.15.106:0/3269834484 learned_addr learned my addr 172.21.15.106:0/3269834484 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:49.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.214+0000 7efd0e59c640 1 --2- 172.21.15.106:0/3269834484 >> v2:172.21.15.132:3300/0 conn(0x7efd100a83c0 0x7efd10147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.214+0000 7efd07fff640 1 -- 172.21.15.106:0/3269834484 >> v2:172.21.15.132:3300/0 conn(0x7efd100a83c0 msgr2=0x7efd10147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:49.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.214+0000 7efd07fff640 1 --2- 172.21.15.106:0/3269834484 >> v2:172.21.15.132:3300/0 conn(0x7efd100a83c0 0x7efd10147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.214+0000 7efd07fff640 1 -- 172.21.15.106:0/3269834484 >> v1:172.21.15.132:6789/0 conn(0x7efd100bfb00 legacy=0x7efd100a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:49.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.214+0000 7efd07fff640 1 -- 172.21.15.106:0/3269834484 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd10151ea0 con 0x7efd100c2830 2023-12-22T09:16:49.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.214+0000 7efd0e59c640 1 --2- 172.21.15.106:0/3269834484 >> v2:172.21.15.132:3300/0 conn(0x7efd100a83c0 0x7efd10147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:49.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.215+0000 7efd07fff640 1 --2- 172.21.15.106:0/3269834484 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 0x7efd101484e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efd10066a30 tx=0x7efcf802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a4f7407637e036 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:49.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.216+0000 7efd0dd9b640 1 -- 172.21.15.106:0/3269834484 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8031870 con 0x7efd100c2830 2023-12-22T09:16:49.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.216+0000 7efd0dd9b640 1 -- 172.21.15.106:0/3269834484 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf80319d0 con 0x7efd100c2830 2023-12-22T09:16:49.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.216+0000 7efd0dd9b640 1 -- 172.21.15.106:0/3269834484 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8031d60 con 0x7efd100c2830 2023-12-22T09:16:49.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.216+0000 7efd0f59e640 1 -- 172.21.15.106:0/3269834484 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 msgr2=0x7efd101484e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.216+0000 7efd0f59e640 1 --2- 172.21.15.106:0/3269834484 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 0x7efd101484e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efd10066a30 tx=0x7efcf802b910 comp rx=0 tx=0).stop 2023-12-22T09:16:49.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.216+0000 7efd0f59e640 1 -- 172.21.15.106:0/3269834484 shutdown_connections 2023-12-22T09:16:49.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.216+0000 7efd0f59e640 1 --2- 172.21.15.106:0/3269834484 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 0x7efd101484e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.216+0000 7efd0f59e640 1 --2- 172.21.15.106:0/3269834484 >> v2:172.21.15.132:3300/0 conn(0x7efd100a83c0 0x7efd10147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.216+0000 7efd0f59e640 1 -- 172.21.15.106:0/3269834484 >> 172.21.15.106:0/3269834484 conn(0x7efd10069bf0 msgr2=0x7efd10069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:49.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.217+0000 7efd0f59e640 1 -- 172.21.15.106:0/3269834484 shutdown_connections 2023-12-22T09:16:49.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.217+0000 7efd0f59e640 1 -- 172.21.15.106:0/3269834484 wait complete. 2023-12-22T09:16:49.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.218+0000 7efd0f59e640 1 Processor -- start 2023-12-22T09:16:49.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.218+0000 7efd0f59e640 1 -- start start 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.219+0000 7efd0f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd100a83c0 0x7efd10154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.219+0000 7efd0f59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd100bfb00 0x7efd100c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.219+0000 7efd0f59e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 0x7efd100c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.219+0000 7efd0f59e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd100c57a0 con 0x7efd100c2830 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.219+0000 7efd0f59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd101e9d60 con 0x7efd100a83c0 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.219+0000 7efd0f59e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd10141720 con 0x7efd100bfb00 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 0x7efd100c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0ed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 0x7efd100c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52964/0 (socket says 172.21.15.106:52964) 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0ed9d640 1 -- 172.21.15.106:0/3519988591 learned_addr learned my addr 172.21.15.106:0/3519988591 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0e59c640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd100a83c0 0x7efd10154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd07fff640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd100bfb00 0x7efd100c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0ed9d640 1 -- 172.21.15.106:0/3519988591 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd100bfb00 msgr2=0x7efd100c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0ed9d640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd100bfb00 0x7efd100c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0ed9d640 1 -- 172.21.15.106:0/3519988591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd100a83c0 msgr2=0x7efd10154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0ed9d640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd100a83c0 0x7efd10154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0ed9d640 1 -- 172.21.15.106:0/3519988591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80094d0 con 0x7efd100c2830 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd07fff640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd100bfb00 0x7efd100c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.220+0000 7efd0ed9d640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 0x7efd100c5000 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efd0800c700 tx=0x7efd0800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.221+0000 7efd06ffd640 1 -- 172.21.15.106:0/3519988591 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0800aa50 con 0x7efd100c2830 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.221+0000 7efd06ffd640 1 -- 172.21.15.106:0/3519988591 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0800abb0 con 0x7efd100c2830 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.221+0000 7efd06ffd640 1 -- 172.21.15.106:0/3519988591 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0800ce10 con 0x7efd100c2830 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.221+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd101e9150 con 0x7efd100c2830 2023-12-22T09:16:49.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.221+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd101e9710 con 0x7efd100c2830 2023-12-22T09:16:49.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.222+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1004e8d0 con 0x7efd100c2830 2023-12-22T09:16:49.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.223+0000 7efd06ffd640 1 -- 172.21.15.106:0/3519988591 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd08012420 con 0x7efd100c2830 2023-12-22T09:16:49.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.224+0000 7efd06ffd640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efcf006a430 0x7efcf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.224+0000 7efd06ffd640 1 -- 172.21.15.106:0/3519988591 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7efd08088bc0 con 0x7efd100c2830 2023-12-22T09:16:49.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.224+0000 7efd0e59c640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efcf006a430 0x7efcf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.225+0000 7efd0e59c640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efcf006a430 0x7efcf006c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efd0000a950 tx=0x7efd00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:49.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.229+0000 7efd06ffd640 1 -- 172.21.15.106:0/3519988591 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd080543a0 con 0x7efd100c2830 2023-12-22T09:16:49.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.416+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd100c0330 con 0x7efd100c2830 2023-12-22T09:16:49.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.417+0000 7efd06ffd640 1 -- 172.21.15.106:0/3519988591 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd080160a0 con 0x7efd100c2830 2023-12-22T09:16:49.419 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:16:49.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efcf006a430 msgr2=0x7efcf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efcf006a430 0x7efcf006c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efd0000a950 tx=0x7efd00008040 comp rx=0 tx=0).stop 2023-12-22T09:16:49.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 msgr2=0x7efd100c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 0x7efd100c5000 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efd0800c700 tx=0x7efd0800cbc0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 shutdown_connections 2023-12-22T09:16:49.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7efcf006a430 0x7efcf006c8f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd100c2830 0x7efd100c5000 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efd100bfb00 0x7efd100c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 --2- 172.21.15.106:0/3519988591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd100a83c0 0x7efd10154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 >> 172.21.15.106:0/3519988591 conn(0x7efd10069bf0 msgr2=0x7efd100beb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:49.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 shutdown_connections 2023-12-22T09:16:49.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.420+0000 7efd0f59e640 1 -- 172.21.15.106:0/3519988591 wait complete. 2023-12-22T09:16:49.441 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-22T09:16:49.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.653+0000 7fa1cb85f640 1 Processor -- start 2023-12-22T09:16:49.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.654+0000 7fa1cb85f640 1 -- start start 2023-12-22T09:16:49.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.655+0000 7fa1cb85f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c41514b0 0x7fa1c40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.655+0000 7fa1cb85f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c40c4660 con 0x7fa1c40c4130 2023-12-22T09:16:49.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.655+0000 7fa1cb85f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c4153d60 con 0x7fa1c406aad0 2023-12-22T09:16:49.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.655+0000 7fa1cb85f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c4154c50 con 0x7fa1c41514b0 2023-12-22T09:16:49.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.655+0000 7fa1c8dfa640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa1c40c4130 0x7fa1c4154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46422/0 (socket says 172.21.15.106:46422) 2023-12-22T09:16:49.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.655+0000 7fa1c8dfa640 1 -- 172.21.15.106:0/1129479837 learned_addr learned my addr 172.21.15.106:0/1129479837 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1c95fb640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c41514b0 0x7fa1c40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417449771 0 0) 0x7fa1c40c4660 con 0x7fa1c40c4130 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1b0003520 con 0x7fa1c40c4130 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720516101 0 0) 0x7fa1b0003520 con 0x7fa1c40c4130 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c41514b0 msgr2=0x7fa1c40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c41514b0 0x7fa1c40c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 >> v1:172.21.15.132:6789/0 conn(0x7fa1c406aad0 legacy=0x7fa1c40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c406b250 con 0x7fa1c40c4130 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fa1b8001670 con 0x7fa1c40c4130 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 >> v1:172.21.15.106:6789/0 conn(0x7fa1c40c4130 legacy=0x7fa1c4154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1b00039a0 0x7fa1b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c41514b0 0x7fa1b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c4154c50 con 0x7fa1b0004d00 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b000bb60 con 0x7fa1b00039a0 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b000bd20 con 0x7fa1c41514b0 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.656+0000 7fa1c9dfc640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.657+0000 7fa1c8dfa640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c41514b0 0x7fa1b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.657+0000 7fa1c95fb640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1b00039a0 0x7fa1b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.657+0000 7fa1c9dfc640 1 -- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c41514b0 msgr2=0x7fa1b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.657+0000 7fa1c9dfc640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c41514b0 0x7fa1b00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.657+0000 7fa1c9dfc640 1 -- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1b00039a0 msgr2=0x7fa1b0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.657+0000 7fa1c9dfc640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1b00039a0 0x7fa1b0003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.657+0000 7fa1c9dfc640 1 -- 172.21.15.106:0/1129479837 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0003520 con 0x7fa1b0004d00 2023-12-22T09:16:49.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.658+0000 7fa1c9dfc640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1b0005180 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc001e50 tx=0x7fa1b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d9f7c0d0ca1a4d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:49.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.658+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc003b70 con 0x7fa1b0004d00 2023-12-22T09:16:49.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.658+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1bc003cd0 con 0x7fa1b0004d00 2023-12-22T09:16:49.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.658+0000 7fa1b7fff640 1 -- 172.21.15.106:0/1129479837 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc005310 con 0x7fa1b0004d00 2023-12-22T09:16:49.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.658+0000 7fa1cb85f640 1 -- 172.21.15.106:0/1129479837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 msgr2=0x7fa1b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.658+0000 7fa1cb85f640 1 --2- 172.21.15.106:0/1129479837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1b0005180 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc001e50 tx=0x7fa1b00057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.658+0000 7fa1c9dfc640 1 -- 172.21.15.106:0/1129479837 reap_dead start 2023-12-22T09:16:49.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.659+0000 7fa1cb85f640 1 -- 172.21.15.106:0/1129479837 shutdown_connections 2023-12-22T09:16:49.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.659+0000 7fa1cb85f640 1 -- 172.21.15.106:0/1129479837 >> 172.21.15.106:0/1129479837 conn(0x7fa1c40ab1a0 msgr2=0x7fa1c40ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:49.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.659+0000 7fa1cb85f640 1 -- 172.21.15.106:0/1129479837 shutdown_connections 2023-12-22T09:16:49.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.659+0000 7fa1cb85f640 1 -- 172.21.15.106:0/1129479837 wait complete. 2023-12-22T09:16:49.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.660+0000 7fa1cb85f640 1 Processor -- start 2023-12-22T09:16:49.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.660+0000 7fa1cb85f640 1 -- start start 2023-12-22T09:16:49.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.661+0000 7fa1cb85f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1c40c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.661+0000 7fa1cb85f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c40aa470 0x7fa1c40c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.661+0000 7fa1cb85f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1c4148b50 0x7fa1c4148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.661+0000 7fa1cb85f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c40a9a20 con 0x7fa1b0004d00 2023-12-22T09:16:49.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.661+0000 7fa1cb85f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c40c15b0 con 0x7fa1c4148b50 2023-12-22T09:16:49.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.661+0000 7fa1cb85f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c40bd900 con 0x7fa1c40aa470 2023-12-22T09:16:49.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.661+0000 7fa1c95fb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1c40c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.661+0000 7fa1c95fb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1c40c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52992/0 (socket says 172.21.15.106:52992) 2023-12-22T09:16:49.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.661+0000 7fa1c95fb640 1 -- 172.21.15.106:0/2944526506 learned_addr learned my addr 172.21.15.106:0/2944526506 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:49.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1c95fb640 1 -- 172.21.15.106:0/2944526506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c40aa470 msgr2=0x7fa1c40c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1c95fb640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c40aa470 0x7fa1c40c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1c95fb640 1 -- 172.21.15.106:0/2944526506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1c4148b50 msgr2=0x7fa1c4148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1c95fb640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1c4148b50 0x7fa1c4148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1c95fb640 1 -- 172.21.15.106:0/2944526506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c40bdbe0 con 0x7fa1b0004d00 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1c95fb640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1c40c1070 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000e7e0 tx=0x7fa1c000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1b5ffb640 1 -- 172.21.15.106:0/2944526506 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000c650 con 0x7fa1b0004d00 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1b5ffb640 1 -- 172.21.15.106:0/2944526506 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c000c7b0 con 0x7fa1b0004d00 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1b5ffb640 1 -- 172.21.15.106:0/2944526506 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000cb20 con 0x7fa1b0004d00 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c40a9c70 con 0x7fa1b0004d00 2023-12-22T09:16:49.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.662+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c4149510 con 0x7fa1b0004d00 2023-12-22T09:16:49.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.664+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c408a2e0 con 0x7fa1b0004d00 2023-12-22T09:16:49.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.664+0000 7fa1b5ffb640 1 -- 172.21.15.106:0/2944526506 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1c000cc80 con 0x7fa1b0004d00 2023-12-22T09:16:49.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.665+0000 7fa1b5ffb640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa1a806a430 0x7fa1a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:49.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.665+0000 7fa1b5ffb640 1 -- 172.21.15.106:0/2944526506 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa1c00884e0 con 0x7fa1b0004d00 2023-12-22T09:16:49.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.666+0000 7fa1c8dfa640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa1a806a430 0x7fa1a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:49.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.666+0000 7fa1c8dfa640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa1a806a430 0x7fa1a806c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80017a0 tx=0x7fa1b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:49.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.670+0000 7fa1b5ffb640 1 -- 172.21.15.106:0/2944526506 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa1c0053cc0 con 0x7fa1b0004d00 2023-12-22T09:16:49.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:49.928+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fa1c41508b0 con 0x7fa1b0004d00 2023-12-22T09:16:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.539+0000 7fa1b5ffb640 1 -- 172.21.15.106:0/2944526506 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v155) v1 ==== 187+0+0 (secure 0 0 0) 0x7fa1c00572e0 con 0x7fa1b0004d00 2023-12-22T09:16:50.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa1a806a430 msgr2=0x7fa1a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:50.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa1a806a430 0x7fa1a806c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80017a0 tx=0x7fa1b8009040 comp rx=0 tx=0).stop 2023-12-22T09:16:50.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 msgr2=0x7fa1c40c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:50.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1c40c1070 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000e7e0 tx=0x7fa1c000eca0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 shutdown_connections 2023-12-22T09:16:50.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa1a806a430 0x7fa1a806c8f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1c4148b50 0x7fa1c4148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa1c40aa470 0x7fa1c40c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 --2- 172.21.15.106:0/2944526506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b0004d00 0x7fa1c40c1070 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 >> 172.21.15.106:0/2944526506 conn(0x7fa1c40ab1a0 msgr2=0x7fa1c40c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:50.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 shutdown_connections 2023-12-22T09:16:50.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.543+0000 7fa1cb85f640 1 -- 172.21.15.106:0/2944526506 wait complete. 2023-12-22T09:16:50.553 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:16:50.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:16:50.565 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T09:16:50.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.804+0000 7f365ea26640 1 Processor -- start 2023-12-22T09:16:50.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.804+0000 7f365ea26640 1 -- start start 2023-12-22T09:16:50.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.805+0000 7f365ea26640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f36581514f0 0x7f36580c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:50.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.805+0000 7f365ea26640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36580c4380 0x7f36580c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:50.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.805+0000 7f365ea26640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f365806aca0 0x7f36580c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:50.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.805+0000 7f365ea26640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36580c4e10 con 0x7f36581514f0 2023-12-22T09:16:50.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.805+0000 7f365ea26640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36580c5b40 con 0x7f365806aca0 2023-12-22T09:16:50.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.805+0000 7f365ea26640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36580c7b50 con 0x7f36580c4380 2023-12-22T09:16:50.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.806+0000 7f3657fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f36581514f0 0x7f36580c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:50.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.806+0000 7f3657fff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f36581514f0 0x7f36580c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52996/0 (socket says 172.21.15.106:52996) 2023-12-22T09:16:50.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.806+0000 7f3657fff640 1 -- 172.21.15.106:0/1725621701 learned_addr learned my addr 172.21.15.106:0/1725621701 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:50.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.806+0000 7f3657fff640 1 -- 172.21.15.106:0/1725621701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36580c4380 msgr2=0x7f36580c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:50.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.806+0000 7f3657fff640 1 --2- 172.21.15.106:0/1725621701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36580c4380 0x7f36580c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.806+0000 7f3657fff640 1 -- 172.21.15.106:0/1725621701 >> v2:172.21.15.132:3300/0 conn(0x7f365806aca0 msgr2=0x7f36580c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:50.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.806+0000 7f3657fff640 1 --2- 172.21.15.106:0/1725621701 >> v2:172.21.15.132:3300/0 conn(0x7f365806aca0 0x7f36580c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.806+0000 7f3657fff640 1 -- 172.21.15.106:0/1725621701 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365806b390 con 0x7f36581514f0 2023-12-22T09:16:50.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.807+0000 7f3657fff640 1 --2- 172.21.15.106:0/1725621701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36581514f0 0x7f36580c48d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f365808b1d0 tx=0x7f364802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70081f068a3b068a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.807+0000 7f3656ffd640 1 -- 172.21.15.106:0/1725621701 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364802c950 con 0x7f36581514f0 2023-12-22T09:16:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f3656ffd640 1 -- 172.21.15.106:0/1725621701 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364802cab0 con 0x7f36581514f0 2023-12-22T09:16:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f3656ffd640 1 -- 172.21.15.106:0/1725621701 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364802ce40 con 0x7f36581514f0 2023-12-22T09:16:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f365ea26640 1 -- 172.21.15.106:0/1725621701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36581514f0 msgr2=0x7f36580c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f365ea26640 1 --2- 172.21.15.106:0/1725621701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36581514f0 0x7f36580c48d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f365808b1d0 tx=0x7f364802bdb0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f365ea26640 1 -- 172.21.15.106:0/1725621701 shutdown_connections 2023-12-22T09:16:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f365ea26640 1 --2- 172.21.15.106:0/1725621701 >> v2:172.21.15.132:3300/0 conn(0x7f365806aca0 0x7f36580c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f365ea26640 1 --2- 172.21.15.106:0/1725621701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36580c4380 0x7f36580c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f365ea26640 1 --2- 172.21.15.106:0/1725621701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36581514f0 0x7f36580c48d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f365ea26640 1 -- 172.21.15.106:0/1725621701 >> 172.21.15.106:0/1725621701 conn(0x7f36580c9710 msgr2=0x7f36580c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.808+0000 7f365ea26640 1 -- 172.21.15.106:0/1725621701 shutdown_connections 2023-12-22T09:16:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.809+0000 7f365ea26640 1 -- 172.21.15.106:0/1725621701 wait complete. 2023-12-22T09:16:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.810+0000 7f365ea26640 1 Processor -- start 2023-12-22T09:16:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.810+0000 7f365ea26640 1 -- start start 2023-12-22T09:16:50.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.811+0000 7f365ea26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f365806aca0 0x7f3658153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:50.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.811+0000 7f365ea26640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580c4380 0x7f3658147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:50.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.811+0000 7f365ea26640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36581514f0 0x7f3658147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:50.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.811+0000 7f365ea26640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3658157240 con 0x7f36580c4380 2023-12-22T09:16:50.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.811+0000 7f365ea26640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36581ed1a0 con 0x7f365806aca0 2023-12-22T09:16:50.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.811+0000 7f365ea26640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36581574e0 con 0x7f36581514f0 2023-12-22T09:16:50.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.811+0000 7f36577fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580c4380 0x7f3658147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:50.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.812+0000 7f36577fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580c4380 0x7f3658147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53012/0 (socket says 172.21.15.106:53012) 2023-12-22T09:16:50.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.812+0000 7f36577fe640 1 -- 172.21.15.106:0/396184041 learned_addr learned my addr 172.21.15.106:0/396184041 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.812+0000 7f36577fe640 1 -- 172.21.15.106:0/396184041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36581514f0 msgr2=0x7f3658147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.812+0000 7f36577fe640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36581514f0 0x7f3658147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.812+0000 7f36577fe640 1 -- 172.21.15.106:0/396184041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f365806aca0 msgr2=0x7f3658153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.812+0000 7f36577fe640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f365806aca0 0x7f3658153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.812+0000 7f36577fe640 1 -- 172.21.15.106:0/396184041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3648009b30 con 0x7f36580c4380 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.812+0000 7f36577fe640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580c4380 0x7f3658147870 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f364000b410 tx=0x7f364000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.812+0000 7f3654ff9640 1 -- 172.21.15.106:0/396184041 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640011830 con 0x7f36580c4380 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.813+0000 7f3654ff9640 1 -- 172.21.15.106:0/396184041 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400119b0 con 0x7f36580c4380 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.813+0000 7f3654ff9640 1 -- 172.21.15.106:0/396184041 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640011d60 con 0x7f36580c4380 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.813+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3658153850 con 0x7f36580c4380 2023-12-22T09:16:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.813+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36581482f0 con 0x7f36580c4380 2023-12-22T09:16:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.814+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3658073f10 con 0x7f36580c4380 2023-12-22T09:16:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.815+0000 7f3654ff9640 1 -- 172.21.15.106:0/396184041 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f364001a400 con 0x7f36580c4380 2023-12-22T09:16:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.816+0000 7f3654ff9640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f363806a430 0x7f363806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.816+0000 7f3654ff9640 1 -- 172.21.15.106:0/396184041 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3640088950 con 0x7f36580c4380 2023-12-22T09:16:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.816+0000 7f3657fff640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f363806a430 0x7f363806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:50.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.817+0000 7f3657fff640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f363806a430 0x7f363806c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3648035000 tx=0x7f364802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:50.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:50.820+0000 7f3654ff9640 1 -- 172.21.15.106:0/396184041 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3640054130 con 0x7f36580c4380 2023-12-22T09:16:51.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.009+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f36580c4160 con 0x7f36580c4380 2023-12-22T09:16:51.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.017+0000 7f3654ff9640 1 -- 172.21.15.106:0/396184041 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3640015020 con 0x7f36580c4380 2023-12-22T09:16:51.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f363806a430 msgr2=0x7f363806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:51.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f363806a430 0x7f363806c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3648035000 tx=0x7f364802e000 comp rx=0 tx=0).stop 2023-12-22T09:16:51.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580c4380 msgr2=0x7f3658147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:51.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580c4380 0x7f3658147870 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f364000b410 tx=0x7f364000b8d0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 shutdown_connections 2023-12-22T09:16:51.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f363806a430 0x7f363806c8f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36581514f0 0x7f3658147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36580c4380 0x7f3658147870 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 --2- 172.21.15.106:0/396184041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f365806aca0 0x7f3658153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 >> 172.21.15.106:0/396184041 conn(0x7f36580c9710 msgr2=0x7f36580c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:51.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 shutdown_connections 2023-12-22T09:16:51.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.020+0000 7f365ea26640 1 -- 172.21.15.106:0/396184041 wait complete. 2023-12-22T09:16:51.040 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T09:16:51.040 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T09:16:51.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T09:16:51.267 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T09:16:51.268 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:16:51.268 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:51.327 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-22T09:16:51.327 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:16:51.327 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:16:51.384 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-22T09:16:51.385 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-22T09:16:51.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:16:51.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.601+0000 7f27b79c9640 1 Processor -- start 2023-12-22T09:16:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.601+0000 7f27b79c9640 1 -- start start 2023-12-22T09:16:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.602+0000 7f27b79c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f27b0069e60 0x7f27b014a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.602+0000 7f27b79c9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f27b0150a80 0x7f27b014abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.602+0000 7f27b79c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27b0071ea0 0x7f27b0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.602+0000 7f27b79c9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b00c0960 con 0x7f27b0150a80 2023-12-22T09:16:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.602+0000 7f27b79c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b006aba0 con 0x7f27b0069e60 2023-12-22T09:16:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.602+0000 7f27b79c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00bfce0 con 0x7f27b0071ea0 2023-12-22T09:16:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.603+0000 7f27b4f64640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f27b0150a80 0x7f27b014abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.603+0000 7f27b4f64640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f27b0150a80 0x7f27b014abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53016/0 (socket says 172.21.15.106:53016) 2023-12-22T09:16:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.603+0000 7f27b4f64640 1 -- 172.21.15.106:0/417080987 learned_addr learned my addr 172.21.15.106:0/417080987 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.603+0000 7f27b5765640 1 --2- 172.21.15.106:0/417080987 >> v2:172.21.15.132:3300/0 conn(0x7f27b0069e60 0x7f27b014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.603+0000 7f27b4f64640 1 -- 172.21.15.106:0/417080987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27b0071ea0 msgr2=0x7f27b0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.603+0000 7f27b4f64640 1 --2- 172.21.15.106:0/417080987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27b0071ea0 0x7f27b0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.603+0000 7f27b4f64640 1 -- 172.21.15.106:0/417080987 >> v2:172.21.15.132:3300/0 conn(0x7f27b0069e60 msgr2=0x7f27b014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.603+0000 7f27b4f64640 1 --2- 172.21.15.106:0/417080987 >> v2:172.21.15.132:3300/0 conn(0x7f27b0069e60 0x7f27b014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.603+0000 7f27b4f64640 1 -- 172.21.15.106:0/417080987 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b00bffc0 con 0x7f27b0150a80 2023-12-22T09:16:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.605+0000 7f27b4f64640 1 --2- 172.21.15.106:0/417080987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 0x7f27b014abb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f27b00c1120 tx=0x7f27a002dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b96fd80fd5f0ab6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.605+0000 7f27a7fff640 1 -- 172.21.15.106:0/417080987 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a002ed50 con 0x7f27b0150a80 2023-12-22T09:16:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.605+0000 7f27a7fff640 1 -- 172.21.15.106:0/417080987 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a0036440 con 0x7f27b0150a80 2023-12-22T09:16:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.605+0000 7f27a7fff640 1 -- 172.21.15.106:0/417080987 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a00367d0 con 0x7f27b0150a80 2023-12-22T09:16:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.605+0000 7f27b79c9640 1 -- 172.21.15.106:0/417080987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 msgr2=0x7f27b014abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.605+0000 7f27b79c9640 1 --2- 172.21.15.106:0/417080987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 0x7f27b014abb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f27b00c1120 tx=0x7f27a002dfa0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.606+0000 7f27b79c9640 1 -- 172.21.15.106:0/417080987 shutdown_connections 2023-12-22T09:16:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.606+0000 7f27b79c9640 1 --2- 172.21.15.106:0/417080987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27b0071ea0 0x7f27b0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.606+0000 7f27b79c9640 1 --2- 172.21.15.106:0/417080987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 0x7f27b014abb0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.606+0000 7f27b79c9640 1 --2- 172.21.15.106:0/417080987 >> v2:172.21.15.132:3300/0 conn(0x7f27b0069e60 0x7f27b014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.606+0000 7f27b79c9640 1 -- 172.21.15.106:0/417080987 >> 172.21.15.106:0/417080987 conn(0x7f27b00c5360 msgr2=0x7f27b00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.606+0000 7f27b79c9640 1 -- 172.21.15.106:0/417080987 shutdown_connections 2023-12-22T09:16:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.606+0000 7f27b79c9640 1 -- 172.21.15.106:0/417080987 wait complete. 2023-12-22T09:16:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.607+0000 7f27b79c9640 1 Processor -- start 2023-12-22T09:16:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.608+0000 7f27b79c9640 1 -- start start 2023-12-22T09:16:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.608+0000 7f27b79c9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27b0069e60 0x7f27b00be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.608+0000 7f27b79c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27b0071ea0 0x7f27b0149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b79c9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 0x7f27b0149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b79c9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b014a1c0 con 0x7f27b0150a80 2023-12-22T09:16:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b79c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0149160 con 0x7f27b0071ea0 2023-12-22T09:16:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b79c9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0148dd0 con 0x7f27b0069e60 2023-12-22T09:16:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b5f66640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 0x7f27b0149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b5f66640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 0x7f27b0149c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53026/0 (socket says 172.21.15.106:53026) 2023-12-22T09:16:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b5f66640 1 -- 172.21.15.106:0/2115449541 learned_addr learned my addr 172.21.15.106:0/2115449541 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b5f66640 1 -- 172.21.15.106:0/2115449541 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27b0069e60 msgr2=0x7f27b00be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b5f66640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27b0069e60 0x7f27b00be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b5f66640 1 -- 172.21.15.106:0/2115449541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27b0071ea0 msgr2=0x7f27b0149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b5f66640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27b0071ea0 0x7f27b0149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.609+0000 7f27b5f66640 1 -- 172.21.15.106:0/2115449541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a000b770 con 0x7f27b0150a80 2023-12-22T09:16:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.610+0000 7f27b5f66640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 0x7f27b0149c80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f27a800b970 tx=0x7f27a800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:51.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.610+0000 7f27a5ffb640 1 -- 172.21.15.106:0/2115449541 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a800cb40 con 0x7f27b0150a80 2023-12-22T09:16:51.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.610+0000 7f27a5ffb640 1 -- 172.21.15.106:0/2115449541 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a800ccc0 con 0x7f27b0150a80 2023-12-22T09:16:51.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.610+0000 7f27a5ffb640 1 -- 172.21.15.106:0/2115449541 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a8014680 con 0x7f27b0150a80 2023-12-22T09:16:51.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.610+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b01e91c0 con 0x7f27b0150a80 2023-12-22T09:16:51.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.610+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b0148480 con 0x7f27b0150a80 2023-12-22T09:16:51.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.611+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b0073f10 con 0x7f27b0150a80 2023-12-22T09:16:51.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.612+0000 7f27a5ffb640 1 -- 172.21.15.106:0/2115449541 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f27a801d3b0 con 0x7f27b0150a80 2023-12-22T09:16:51.613 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.613+0000 7f27a5ffb640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f279406a430 0x7f279406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:51.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.613+0000 7f27a5ffb640 1 -- 172.21.15.106:0/2115449541 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f27a80887e0 con 0x7f27b0150a80 2023-12-22T09:16:51.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.613+0000 7f27b5765640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f279406a430 0x7f279406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:51.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.614+0000 7f27b5765640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f279406a430 0x7f279406c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f27ac006e20 tx=0x7f27ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:51.618 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.617+0000 7f27a5ffb640 1 -- 172.21.15.106:0/2115449541 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f27a8053e90 con 0x7f27b0150a80 2023-12-22T09:16:51.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.844+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27b0151320 con 0x7f27b0150a80 2023-12-22T09:16:51.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.845+0000 7f27a5ffb640 1 -- 172.21.15.106:0/2115449541 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f27a8019090 con 0x7f27b0150a80 2023-12-22T09:16:51.847 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:51.847 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/452298890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":452298890},{"type":"v1","addr":"172.21.15.106:6835","nonce":452298890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1001958969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1001958969},{"type":"v1","addr":"172.21.15.106:6837","nonce":1001958969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2871781771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":2871781771},{"type":"v1","addr":"172.21.15.132:6835","nonce":2871781771}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/4059654392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":4059654392},{"type":"v1","addr":"172.21.15.132:6834","nonce":4059654392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-12-22T09:16:51.847 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 25 2023-12-22T09:16:51.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f279406a430 msgr2=0x7f279406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:51.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f279406a430 0x7f279406c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f27ac006e20 tx=0x7f27ac008040 comp rx=0 tx=0).stop 2023-12-22T09:16:51.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 msgr2=0x7f27b0149c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:51.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 0x7f27b0149c80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f27a800b970 tx=0x7f27a800be30 comp rx=0 tx=0).stop 2023-12-22T09:16:51.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 shutdown_connections 2023-12-22T09:16:51.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f279406a430 0x7f279406c8f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b0150a80 0x7f27b0149c80 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27b0071ea0 0x7f27b0149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 --2- 172.21.15.106:0/2115449541 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27b0069e60 0x7f27b00be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:51.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 >> 172.21.15.106:0/2115449541 conn(0x7f27b00c5360 msgr2=0x7f27b014ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:51.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 shutdown_connections 2023-12-22T09:16:51.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:51.848+0000 7f27b79c9640 1 -- 172.21.15.106:0/2115449541 wait complete. 2023-12-22T09:16:51.868 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T09:16:51.868 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T09:16:51.868 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T09:16:51.868 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T09:16:51.869 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T09:16:51.869 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T09:16:51.869 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T09:16:51.869 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T09:16:51.870 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T09:16:51.870 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T09:16:51.870 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T09:16:51.870 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T09:16:51.871 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T09:16:51.871 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T09:16:51.871 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T09:16:51.871 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T09:16:51.885 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T09:16:51.886 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T09:16:51.890 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T09:16:51.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T09:16:51.892 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T09:16:51.892 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T09:16:51.894 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T09:16:51.894 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T09:16:51.941 INFO:tasks.ceph.mds.c:Started 2023-12-22T09:16:51.942 DEBUG:teuthology.parallel:result is None 2023-12-22T09:16:51.943 INFO:tasks.ceph.mds.d:Started 2023-12-22T09:16:51.944 DEBUG:teuthology.parallel:result is None 2023-12-22T09:16:51.950 INFO:tasks.ceph.mds.a:Started 2023-12-22T09:16:51.951 DEBUG:teuthology.parallel:result is None 2023-12-22T09:16:51.951 INFO:tasks.ceph.mds.b:Started 2023-12-22T09:16:51.952 DEBUG:teuthology.parallel:result is None 2023-12-22T09:16:51.952 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T09:16:52.101 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2023-12-22T09:16:52.102 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2023-12-22T09:16:52.108 INFO:tasks.ceph.mds.d.smithi132.stdout:starting mds.d at 2023-12-22T09:16:52.108 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-12-22T09:16:52.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.146+0000 7f0646938640 1 Processor -- start 2023-12-22T09:16:52.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.146+0000 7f0646938640 1 -- start start 2023-12-22T09:16:52.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.147+0000 7f0646938640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06400c0dc0 0x7f064006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.147+0000 7f0646938640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f064006c670 0x7f06400a8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.147+0000 7f0646938640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0640154f30 con 0x7f06400c11a0 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.147+0000 7f0646938640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06400c15f0 con 0x7f06400c0dc0 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.147+0000 7f0646938640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064006d7f0 con 0x7f064006c670 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f063ffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06400c0dc0 0x7f064006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f0644ed5640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f06400c11a0 0x7f0640154820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46436/0 (socket says 172.21.15.106:46436) 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f0644ed5640 1 -- 172.21.15.106:0/2279268553 learned_addr learned my addr 172.21.15.106:0/2279268553 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f063f7fe640 1 --2- 172.21.15.106:0/2279268553 >> v2:172.21.15.132:3300/0 conn(0x7f064006c670 0x7f06400a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f063f7fe640 1 -- 172.21.15.106:0/2279268553 >> v2:172.21.15.106:3300/0 conn(0x7f06400c0dc0 msgr2=0x7f064006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f063f7fe640 1 --2- 172.21.15.106:0/2279268553 >> v2:172.21.15.106:3300/0 conn(0x7f06400c0dc0 0x7f064006ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f063effd640 1 -- 172.21.15.106:0/2279268553 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090403714 0 0) 0x7f0640154f30 con 0x7f06400c11a0 2023-12-22T09:16:52.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f063f7fe640 1 -- 172.21.15.106:0/2279268553 >> v1:172.21.15.106:6789/0 conn(0x7f06400c11a0 legacy=0x7f0640154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:52.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f063f7fe640 1 -- 172.21.15.106:0/2279268553 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064006dad0 con 0x7f064006c670 2023-12-22T09:16:52.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.148+0000 7f063ffff640 1 --2- 172.21.15.106:0/2279268553 >> v2:172.21.15.106:3300/0 conn(0x7f06400c0dc0 0x7f064006ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:16:52.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.149+0000 7f063f7fe640 1 --2- 172.21.15.106:0/2279268553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064006c670 0x7f06400a8360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f064006e0b0 tx=0x7f063402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89741222a0d73e02 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:52.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.150+0000 7f063effd640 1 -- 172.21.15.106:0/2279268553 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634031830 con 0x7f064006c670 2023-12-22T09:16:52.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.150+0000 7f063effd640 1 -- 172.21.15.106:0/2279268553 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634031990 con 0x7f064006c670 2023-12-22T09:16:52.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.150+0000 7f063effd640 1 -- 172.21.15.106:0/2279268553 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634031d20 con 0x7f064006c670 2023-12-22T09:16:52.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.151+0000 7f0646938640 1 -- 172.21.15.106:0/2279268553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064006c670 msgr2=0x7f06400a8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:52.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.151+0000 7f0646938640 1 --2- 172.21.15.106:0/2279268553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064006c670 0x7f06400a8360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f064006e0b0 tx=0x7f063402b8d0 comp rx=0 tx=0).stop 2023-12-22T09:16:52.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.151+0000 7f0646938640 1 -- 172.21.15.106:0/2279268553 shutdown_connections 2023-12-22T09:16:52.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.151+0000 7f0646938640 1 --2- 172.21.15.106:0/2279268553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064006c670 0x7f06400a8360 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:52.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.151+0000 7f0646938640 1 --2- 172.21.15.106:0/2279268553 >> v2:172.21.15.106:3300/0 conn(0x7f06400c0dc0 0x7f064006ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:52.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.151+0000 7f0646938640 1 -- 172.21.15.106:0/2279268553 >> 172.21.15.106:0/2279268553 conn(0x7f06400c1db0 msgr2=0x7f06400c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:52.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.151+0000 7f0646938640 1 -- 172.21.15.106:0/2279268553 shutdown_connections 2023-12-22T09:16:52.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.151+0000 7f0646938640 1 -- 172.21.15.106:0/2279268553 wait complete. 2023-12-22T09:16:52.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.152+0000 7f0646938640 1 Processor -- start 2023-12-22T09:16:52.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.153+0000 7f0646938640 1 -- start start 2023-12-22T09:16:52.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.153+0000 7f0646938640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064006c670 0x7f0640142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:52.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f0646938640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06400c0dc0 0x7f06400c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:52.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f0646938640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400c11a0 0x7f0640140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:52.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f0646938640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06401ed7b0 con 0x7f06400c0dc0 2023-12-22T09:16:52.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f0646938640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06401ecba0 con 0x7f06400c11a0 2023-12-22T09:16:52.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f0646938640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06401ece80 con 0x7f064006c670 2023-12-22T09:16:52.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f063f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06400c0dc0 0x7f06400c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:52.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f063f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06400c0dc0 0x7f06400c2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53078/0 (socket says 172.21.15.106:53078) 2023-12-22T09:16:52.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f063f7fe640 1 -- 172.21.15.106:0/2296379244 learned_addr learned my addr 172.21.15.106:0/2296379244 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:52.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f0644ed5640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400c11a0 0x7f0640140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:52.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f063f7fe640 1 -- 172.21.15.106:0/2296379244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064006c670 msgr2=0x7f0640142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:52.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f063ffff640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064006c670 0x7f0640142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:52.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f063f7fe640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064006c670 0x7f0640142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:52.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f063f7fe640 1 -- 172.21.15.106:0/2296379244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400c11a0 msgr2=0x7f0640140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:52.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f063f7fe640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400c11a0 0x7f0640140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:52.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.154+0000 7f063f7fe640 1 -- 172.21.15.106:0/2296379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063000b640 con 0x7f06400c0dc0 2023-12-22T09:16:52.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.155+0000 7f063f7fe640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06400c0dc0 0x7f06400c2ec0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0634000c00 tx=0x7f06340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:52.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.155+0000 7f063cff9640 1 -- 172.21.15.106:0/2296379244 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063403a8f0 con 0x7f06400c0dc0 2023-12-22T09:16:52.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.155+0000 7f063cff9640 1 -- 172.21.15.106:0/2296379244 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063403aa70 con 0x7f06400c0dc0 2023-12-22T09:16:52.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.155+0000 7f063cff9640 1 -- 172.21.15.106:0/2296379244 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063403ae20 con 0x7f06400c0dc0 2023-12-22T09:16:52.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.155+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0634009400 con 0x7f06400c0dc0 2023-12-22T09:16:52.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.155+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06401ed440 con 0x7f06400c0dc0 2023-12-22T09:16:52.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.157+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06401ed5d0 con 0x7f06400c0dc0 2023-12-22T09:16:52.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.157+0000 7f063cff9640 1 -- 172.21.15.106:0/2296379244 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f063404d450 con 0x7f06400c0dc0 2023-12-22T09:16:52.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.158+0000 7f063cff9640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f062c06a430 0x7f062c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:52.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.158+0000 7f063cff9640 1 -- 172.21.15.106:0/2296379244 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f06340aa840 con 0x7f06400c0dc0 2023-12-22T09:16:52.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.158+0000 7f063ffff640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f062c06a430 0x7f062c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:52.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.159+0000 7f063ffff640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f062c06a430 0x7f062c06c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f063000bc50 tx=0x7f0630008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:52.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.163+0000 7f063cff9640 1 -- 172.21.15.106:0/2296379244 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0634075f80 con 0x7f06400c0dc0 2023-12-22T09:16:52.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:52.362+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0640153fe0 con 0x7f06400c0dc0 2023-12-22T09:16:53.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.153+0000 7f063cff9640 1 -- 172.21.15.106:0/2296379244 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0634035020 con 0x7f06400c0dc0 2023-12-22T09:16:53.154 INFO:teuthology.orchestra.run.smithi106.stderr: removed all blocklist entries 2023-12-22T09:16:53.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f062c06a430 msgr2=0x7f062c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f062c06a430 0x7f062c06c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f063000bc50 tx=0x7f0630008040 comp rx=0 tx=0).stop 2023-12-22T09:16:53.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06400c0dc0 msgr2=0x7f06400c2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06400c0dc0 0x7f06400c2ec0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0634000c00 tx=0x7f06340046c0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 shutdown_connections 2023-12-22T09:16:53.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f062c06a430 0x7f062c06c8f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06400c11a0 0x7f0640140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06400c0dc0 0x7f06400c2ec0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 --2- 172.21.15.106:0/2296379244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f064006c670 0x7f0640142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 >> 172.21.15.106:0/2296379244 conn(0x7f06400c1db0 msgr2=0x7f06400be6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:53.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 shutdown_connections 2023-12-22T09:16:53.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.157+0000 7f0646938640 1 -- 172.21.15.106:0/2296379244 wait complete. 2023-12-22T09:16:53.181 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T09:16:53.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.394+0000 7ff352a19640 1 Processor -- start 2023-12-22T09:16:53.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.394+0000 7ff352a19640 1 -- start start 2023-12-22T09:16:53.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.395+0000 7ff352a19640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff34c13b060 0x7ff34c06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.396+0000 7ff352a19640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c0bf770 con 0x7ff34c151b30 2023-12-22T09:16:53.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.396+0000 7ff352a19640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c155120 con 0x7ff34c0bfce0 2023-12-22T09:16:53.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.396+0000 7ff352a19640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34c155400 con 0x7ff34c13b060 2023-12-22T09:16:53.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.396+0000 7ff350fb6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff34c151b30 0x7ff34c151f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59638/0 (socket says 172.21.15.106:59638) 2023-12-22T09:16:53.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.396+0000 7ff350fb6640 1 -- 172.21.15.106:0/2353851977 learned_addr learned my addr 172.21.15.106:0/2353851977 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:53.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.396+0000 7ff34bfff640 1 --2- 172.21.15.106:0/2353851977 >> v2:172.21.15.132:3300/0 conn(0x7ff34c13b060 0x7ff34c06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.396+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866483917 0 0) 0x7ff34c0bf770 con 0x7ff34c151b30 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff334003520 con 0x7ff34c151b30 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438249639 0 0) 0x7ff334003520 con 0x7ff34c151b30 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 >> v2:172.21.15.132:3300/0 conn(0x7ff34c13b060 msgr2=0x7ff34c06a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 --2- 172.21.15.106:0/2353851977 >> v2:172.21.15.132:3300/0 conn(0x7ff34c13b060 0x7ff34c06a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 >> v1:172.21.15.132:6789/0 conn(0x7ff34c0bfce0 legacy=0x7ff34c069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c1556e0 con 0x7ff34c151b30 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7ff3440019f0 con 0x7ff34c151b30 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 >> v1:172.21.15.106:6789/0 conn(0x7ff34c151b30 legacy=0x7ff34c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff334003970 0x7ff334003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff334004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff334005180 0x7ff33400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c155400 con 0x7ff3340047c0 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33400c120 con 0x7ff334005180 2023-12-22T09:16:53.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33400c2e0 con 0x7ff334003970 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.397+0000 7ff34b7fe640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff334004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.398+0000 7ff34bfff640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff334003970 0x7ff334003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.398+0000 7ff350fb6640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff334005180 0x7ff33400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.398+0000 7ff34b7fe640 1 -- 172.21.15.106:0/2353851977 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff334003970 msgr2=0x7ff334003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.398+0000 7ff34b7fe640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff334003970 0x7ff334003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.398+0000 7ff34b7fe640 1 -- 172.21.15.106:0/2353851977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff334005180 msgr2=0x7ff33400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.398+0000 7ff34b7fe640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff334005180 0x7ff33400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.398+0000 7ff34b7fe640 1 -- 172.21.15.106:0/2353851977 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff334003520 con 0x7ff3340047c0 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.398+0000 7ff350fb6640 1 -- 172.21.15.106:0/2353851977 reap_dead start 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.399+0000 7ff34b7fe640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff334004c40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff340001750 tx=0x7ff3340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19496441ddba31f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.399+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3400052d0 con 0x7ff3340047c0 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.399+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34002e050 con 0x7ff3340047c0 2023-12-22T09:16:53.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.399+0000 7ff34affd640 1 -- 172.21.15.106:0/2353851977 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340003830 con 0x7ff3340047c0 2023-12-22T09:16:53.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.400+0000 7ff352a19640 1 -- 172.21.15.106:0/2353851977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 msgr2=0x7ff334004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.400+0000 7ff352a19640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff334004c40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff340001750 tx=0x7ff3340057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.400+0000 7ff352a19640 1 -- 172.21.15.106:0/2353851977 shutdown_connections 2023-12-22T09:16:53.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.400+0000 7ff352a19640 1 --2- 172.21.15.106:0/2353851977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff334004c40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.400+0000 7ff352a19640 1 -- 172.21.15.106:0/2353851977 >> 172.21.15.106:0/2353851977 conn(0x7ff34c0c5360 msgr2=0x7ff34c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:53.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.400+0000 7ff352a19640 1 -- 172.21.15.106:0/2353851977 shutdown_connections 2023-12-22T09:16:53.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.400+0000 7ff352a19640 1 -- 172.21.15.106:0/2353851977 wait complete. 2023-12-22T09:16:53.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.401+0000 7ff352a19640 1 Processor -- start 2023-12-22T09:16:53.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.402+0000 7ff352a19640 1 -- start start 2023-12-22T09:16:53.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.402+0000 7ff352a19640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff34c0c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.402+0000 7ff352a19640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c1e8760 0x7ff34c1e8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.402+0000 7ff352a19640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff34c1346a0 0x7ff34c134b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.402+0000 7ff352a19640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c154bd0 con 0x7ff3340047c0 2023-12-22T09:16:53.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.402+0000 7ff352a19640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c070750 con 0x7ff34c1e8760 2023-12-22T09:16:53.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.402+0000 7ff352a19640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c154de0 con 0x7ff34c1346a0 2023-12-22T09:16:53.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff34c0c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff34c0c1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43500/0 (socket says 172.21.15.106:43500) 2023-12-22T09:16:53.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34bfff640 1 -- 172.21.15.106:0/4132720014 learned_addr learned my addr 172.21.15.106:0/4132720014 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34bfff640 1 -- 172.21.15.106:0/4132720014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff34c1346a0 msgr2=0x7ff34c134b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34b7fe640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c1e8760 0x7ff34c1e8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34bfff640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff34c1346a0 0x7ff34c134b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34bfff640 1 -- 172.21.15.106:0/4132720014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c1e8760 msgr2=0x7ff34c1e8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34bfff640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c1e8760 0x7ff34c1e8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34bfff640 1 -- 172.21.15.106:0/4132720014 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c070470 con 0x7ff3340047c0 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.403+0000 7ff34bfff640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff34c0c1fe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0116d0 tx=0x7ff33c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.404+0000 7ff348ff9640 1 -- 172.21.15.106:0/4132720014 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00f9c0 con 0x7ff3340047c0 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.404+0000 7ff348ff9640 1 -- 172.21.15.106:0/4132720014 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c00fb20 con 0x7ff3340047c0 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.404+0000 7ff348ff9640 1 -- 172.21.15.106:0/4132720014 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00fe90 con 0x7ff3340047c0 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.404+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c1e8240 con 0x7ff3340047c0 2023-12-22T09:16:53.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.404+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c06fdf0 con 0x7ff3340047c0 2023-12-22T09:16:53.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.405+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c154f20 con 0x7ff3340047c0 2023-12-22T09:16:53.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.406+0000 7ff348ff9640 1 -- 172.21.15.106:0/4132720014 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff33c015460 con 0x7ff3340047c0 2023-12-22T09:16:53.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.407+0000 7ff348ff9640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff33806a430 0x7ff33806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.407+0000 7ff348ff9640 1 -- 172.21.15.106:0/4132720014 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff33c089070 con 0x7ff3340047c0 2023-12-22T09:16:53.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.407+0000 7ff34b7fe640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff33806a430 0x7ff33806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.408+0000 7ff34b7fe640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff33806a430 0x7ff33806c8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff340033000 tx=0x7ff340009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:53.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.411+0000 7ff348ff9640 1 -- 172.21.15.106:0/4132720014 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff33c0bbc80 con 0x7ff3340047c0 2023-12-22T09:16:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.671+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff34c073f10 con 0x7ff3340047c0 2023-12-22T09:16:53.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.672+0000 7ff348ff9640 1 -- 172.21.15.106:0/4132720014 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5021 (secure 0 0 0) 0x7ff33c022020 con 0x7ff3340047c0 2023-12-22T09:16:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:53.673 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-12-22T09:16:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_dump": [ 2023-12-22T09:16:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.a", 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQAzU4VlwWkqLxAApz1giF6+ha0K7ztx/4TxuA==", 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.b", 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA0U4VlZGlkFRAAlhOp8GuimPn+NUbxP7ZllQ==", 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.c", 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA0U4VlNW78AxAAtjjvQMtyKLXjO553rvgbzg==", 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.d", 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA0U4VlUtEPJhAA3bcdbWblGawtQSyE26PH9A==", 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.0", 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA5U4VlZj6+ChAAgUGYECmhf7VMz7jptVK6kg==", 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.1", 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA8U4VlC5/yFRAAOCUCyRLUmz+2agqeuZvQmQ==", 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.2", 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA/U4Vln1YGLxAA8/8yn/FrMvPmQjohk/Yuag==", 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.3", 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBCU4Vl0m1gORAA4j0GIYcQmoWPOiWeDXme+w==", 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:16:53.678 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.4", 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBKU4VlC/kABxAAXafE0YIVbfH0+PwzNYZ6cA==", 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.5", 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBNU4VlrO2bERAAvVCV9iET01m3JXQ71+IO+w==", 2023-12-22T09:16:53.679 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.6", 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBQU4Vl1qE9GxAANLGc1YGoglBh6qkE6vCFCA==", 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.7", 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBTU4Vl5YYMJBAAoxMjGGh5W1Ov5y4ZkvmoGg==", 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.0", 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA0U4Vl+O39MxAAKadHlnvSTbHMtmqYe65N8w==", 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.681 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:16:53.682 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow r", 2023-12-22T09:16:53.682 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T09:16:53.682 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.682 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.1", 2023-12-22T09:16:53.682 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQA1U4VlrsGyAxAAMbxdEGSzUNtfZVI5FP8Llw==", 2023-12-22T09:16:53.682 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.682 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow r", 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.admin", 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQAyU4VleSnvHBAAImfeNYxKIbmkFRJYEkBBxQ==", 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.683 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.testuser", 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDlU4Vl1ynpERAA6q6kdszVDJYSaGfqTWAiYw==", 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow rw fsname=cephfs", 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow r fsname=cephfs", 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.x", 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQAzU4Vl9kj8IhAA0uOah8x3KUQ+6skT+MpbwQ==", 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.684 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.y", 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQAzU4VlNjb0ExAAVGE9vTIVcmlv6k9ayU0aWA==", 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:53.685 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-12-22T09:16:53.686 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-12-22T09:16:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff33806a430 msgr2=0x7ff33806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff33806a430 0x7ff33806c8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff340033000 tx=0x7ff340009030 comp rx=0 tx=0).stop 2023-12-22T09:16:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 msgr2=0x7ff34c0c1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff34c0c1fe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0116d0 tx=0x7ff33c011b90 comp rx=0 tx=0).stop 2023-12-22T09:16:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 shutdown_connections 2023-12-22T09:16:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff33806a430 0x7ff33806c8f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff34c1346a0 0x7ff34c134b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c1e8760 0x7ff34c1e8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 --2- 172.21.15.106:0/4132720014 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3340047c0 0x7ff34c0c1fe0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 >> 172.21.15.106:0/4132720014 conn(0x7ff34c0c5360 msgr2=0x7ff34c0c1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 shutdown_connections 2023-12-22T09:16:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.675+0000 7ff352a19640 1 -- 172.21.15.106:0/4132720014 wait complete. 2023-12-22T09:16:53.694 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-22T09:16:53.893 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.893+0000 7f4a340d5640 1 Processor -- start 2023-12-22T09:16:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.893+0000 7f4a340d5640 1 -- start start 2023-12-22T09:16:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.894+0000 7f4a340d5640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4a2c0c4250 0x7f4a2c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.894+0000 7f4a340d5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0a6cd0 0x7f4a2c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.894+0000 7f4a340d5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c0c7430 con 0x7f4a2c0705f0 2023-12-22T09:16:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.894+0000 7f4a340d5640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c154830 con 0x7f4a2c0c4250 2023-12-22T09:16:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.894+0000 7f4a340d5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0c39d0 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.894+0000 7f4a31e71640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4a2c0c4250 0x7f4a2c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.894+0000 7f4a32672640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4a2c0705f0 0x7f4a2c06eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59654/0 (socket says 172.21.15.106:59654) 2023-12-22T09:16:53.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.894+0000 7f4a32672640 1 -- 172.21.15.106:0/2801378204 learned_addr learned my addr 172.21.15.106:0/2801378204 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:53.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.895+0000 7f4a31670640 1 --2- 172.21.15.106:0/2801378204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0a6cd0 0x7f4a2c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.895+0000 7f4a31e71640 1 -- 172.21.15.106:0/2801378204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0a6cd0 msgr2=0x7f4a2c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:53.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.895+0000 7f4a30e6f640 1 -- 172.21.15.106:0/2801378204 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817627675 0 0) 0x7f4a24001490 con 0x7f4a2c0705f0 2023-12-22T09:16:53.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.895+0000 7f4a31e71640 1 --2- 172.21.15.106:0/2801378204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0a6cd0 0x7f4a2c150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.895+0000 7f4a31e71640 1 -- 172.21.15.106:0/2801378204 >> v1:172.21.15.106:6789/0 conn(0x7f4a2c0705f0 legacy=0x7f4a2c06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.895+0000 7f4a31e71640 1 -- 172.21.15.106:0/2801378204 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c154d20 con 0x7f4a2c0c4250 2023-12-22T09:16:53.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.895+0000 7f4a31670640 1 --2- 172.21.15.106:0/2801378204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0a6cd0 0x7f4a2c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:53.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.896+0000 7f4a31e71640 1 --2- 172.21.15.106:0/2801378204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0c4250 0x7f4a2c0700b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4a280097a0 tx=0x7f4a2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ad9c766942a02c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:53.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.896+0000 7f4a30e6f640 1 -- 172.21.15.106:0/2801378204 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28031830 con 0x7f4a2c0c4250 2023-12-22T09:16:53.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.896+0000 7f4a30e6f640 1 -- 172.21.15.106:0/2801378204 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28031990 con 0x7f4a2c0c4250 2023-12-22T09:16:53.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.896+0000 7f4a30e6f640 1 -- 172.21.15.106:0/2801378204 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28031d20 con 0x7f4a2c0c4250 2023-12-22T09:16:53.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.897+0000 7f4a340d5640 1 -- 172.21.15.106:0/2801378204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0c4250 msgr2=0x7f4a2c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.897+0000 7f4a340d5640 1 --2- 172.21.15.106:0/2801378204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0c4250 0x7f4a2c0700b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4a280097a0 tx=0x7f4a2802b8d0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.897+0000 7f4a340d5640 1 -- 172.21.15.106:0/2801378204 shutdown_connections 2023-12-22T09:16:53.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.897+0000 7f4a340d5640 1 --2- 172.21.15.106:0/2801378204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0a6cd0 0x7f4a2c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.897+0000 7f4a340d5640 1 --2- 172.21.15.106:0/2801378204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0c4250 0x7f4a2c0700b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.897+0000 7f4a340d5640 1 -- 172.21.15.106:0/2801378204 >> 172.21.15.106:0/2801378204 conn(0x7f4a2c0a9160 msgr2=0x7f4a2c0a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:53.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.897+0000 7f4a340d5640 1 -- 172.21.15.106:0/2801378204 shutdown_connections 2023-12-22T09:16:53.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.897+0000 7f4a340d5640 1 -- 172.21.15.106:0/2801378204 wait complete. 2023-12-22T09:16:53.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.899+0000 7f4a340d5640 1 Processor -- start 2023-12-22T09:16:53.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.899+0000 7f4a340d5640 1 -- start start 2023-12-22T09:16:53.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.900+0000 7f4a340d5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0705f0 0x7f4a2c1ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.900+0000 7f4a340d5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0a6cd0 0x7f4a2c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.900+0000 7f4a340d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c0c4250 0x7f4a2c1e8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.900+0000 7f4a340d5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0bc3e0 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.900+0000 7f4a340d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c1ecaf0 con 0x7f4a2c0c4250 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.900+0000 7f4a340d5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0bd6e0 con 0x7f4a2c0705f0 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.900+0000 7f4a31670640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0a6cd0 0x7f4a2c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.900+0000 7f4a31670640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0a6cd0 0x7f4a2c1534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43518/0 (socket says 172.21.15.106:43518) 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.900+0000 7f4a31670640 1 -- 172.21.15.106:0/4058597191 learned_addr learned my addr 172.21.15.106:0/4058597191 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a31e71640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0705f0 0x7f4a2c1ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a32672640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c0c4250 0x7f4a2c1e8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a31670640 1 -- 172.21.15.106:0/4058597191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0705f0 msgr2=0x7f4a2c1ecf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a31670640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0705f0 0x7f4a2c1ecf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a31670640 1 -- 172.21.15.106:0/4058597191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c0c4250 msgr2=0x7f4a2c1e8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a31670640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c0c4250 0x7f4a2c1e8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a31670640 1 -- 172.21.15.106:0/4058597191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a28009400 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a32672640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c0c4250 0x7f4a2c1e8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a31670640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0a6cd0 0x7f4a2c1534b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c7f0 tx=0x7f4a2000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a1e7fc640 1 -- 172.21.15.106:0/4058597191 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20007a30 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a1e7fc640 1 -- 172.21.15.106:0/4058597191 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a20007b90 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a1e7fc640 1 -- 172.21.15.106:0/4058597191 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000ce40 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.901+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c1ec4e0 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.902+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c1ec780 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.903+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c1ecc60 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.904+0000 7f4a1e7fc640 1 -- 172.21.15.106:0/4058597191 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4a200113f0 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.905+0000 7f4a1e7fc640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a1006a480 0x7f4a1006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:53.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.905+0000 7f4a1e7fc640 1 -- 172.21.15.106:0/4058597191 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4a20088800 con 0x7f4a2c0a6cd0 2023-12-22T09:16:53.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.905+0000 7f4a31e71640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a1006a480 0x7f4a1006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.906+0000 7f4a31e71640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a1006a480 0x7f4a1006c940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a28036000 tx=0x7f4a2803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:53.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:53.909+0000 7f4a1e7fc640 1 -- 172.21.15.106:0/4058597191 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4a20054070 con 0x7f4a2c0a6cd0 2023-12-22T09:16:54.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.163+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f4a2c073f10 con 0x7f4a2c0a6cd0 2023-12-22T09:16:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.172+0000 7f4a1e7fc640 1 -- 172.21.15.106:0/4058597191 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v15) v1 ==== 85+0+0 (secure 0 0 0) 0x7f4a20057690 con 0x7f4a2c0a6cd0 2023-12-22T09:16:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.174+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a1006a480 msgr2=0x7f4a1006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.174+0000 7f4a340d5640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a1006a480 0x7f4a1006c940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a28036000 tx=0x7f4a2803c040 comp rx=0 tx=0).stop 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.174+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0a6cd0 msgr2=0x7f4a2c1534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.174+0000 7f4a340d5640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0a6cd0 0x7f4a2c1534b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c7f0 tx=0x7f4a2000cbf0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.175+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 shutdown_connections 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.175+0000 7f4a340d5640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4a1006a480 0x7f4a1006c940 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.175+0000 7f4a340d5640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a2c0c4250 0x7f4a2c1e8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.175+0000 7f4a340d5640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a2c0a6cd0 0x7f4a2c1534b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.175+0000 7f4a340d5640 1 --2- 172.21.15.106:0/4058597191 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a2c0705f0 0x7f4a2c1ecf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.175+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 >> 172.21.15.106:0/4058597191 conn(0x7f4a2c0a9160 msgr2=0x7f4a2c153e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.175+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 shutdown_connections 2023-12-22T09:16:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.175+0000 7f4a340d5640 1 -- 172.21.15.106:0/4058597191 wait complete. 2023-12-22T09:16:54.192 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:54.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.398+0000 7f0a2e53a640 1 Processor -- start 2023-12-22T09:16:54.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.398+0000 7f0a2e53a640 1 -- start start 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.400+0000 7f0a2e53a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a2814d630 0x7f0a2806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.400+0000 7f0a2e53a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a280aa440 0x7f0a2806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.400+0000 7f0a2e53a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0a280a8c60 0x7f0a28153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.400+0000 7f0a2e53a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a28151060 con 0x7f0a280a8c60 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.400+0000 7f0a2e53a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2806c640 con 0x7f0a2814d630 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.400+0000 7f0a2e53a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a28071c60 con 0x7f0a280aa440 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.400+0000 7f0a2dd39640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0a280a8c60 0x7f0a28153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.400+0000 7f0a2dd39640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0a280a8c60 0x7f0a28153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43524/0 (socket says 172.21.15.106:43524) 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.401+0000 7f0a2dd39640 1 -- 172.21.15.106:0/2666887303 learned_addr learned my addr 172.21.15.106:0/2666887303 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.401+0000 7f0a2d538640 1 --2- 172.21.15.106:0/2666887303 >> v2:172.21.15.132:3300/0 conn(0x7f0a2814d630 0x7f0a2806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.401+0000 7f0a2cd37640 1 --2- 172.21.15.106:0/2666887303 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a280aa440 0x7f0a2806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.401+0000 7f0a2dd39640 1 -- 172.21.15.106:0/2666887303 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a280aa440 msgr2=0x7f0a2806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:54.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.401+0000 7f0a2dd39640 1 --2- 172.21.15.106:0/2666887303 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a280aa440 0x7f0a2806c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.401+0000 7f0a2dd39640 1 -- 172.21.15.106:0/2666887303 >> v2:172.21.15.132:3300/0 conn(0x7f0a2814d630 msgr2=0x7f0a2806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:54.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.401+0000 7f0a2dd39640 1 --2- 172.21.15.106:0/2666887303 >> v2:172.21.15.132:3300/0 conn(0x7f0a2814d630 0x7f0a2806bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.401+0000 7f0a2dd39640 1 -- 172.21.15.106:0/2666887303 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2806d930 con 0x7f0a280a8c60 2023-12-22T09:16:54.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.402+0000 7f0a2dd39640 1 --2- 172.21.15.106:0/2666887303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280a8c60 0x7f0a28153880 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0a2806ab30 tx=0x7f0a2002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa13f547607588d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:54.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.403+0000 7f0a1ffff640 1 -- 172.21.15.106:0/2666887303 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2002c9e0 con 0x7f0a280a8c60 2023-12-22T09:16:54.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.403+0000 7f0a1ffff640 1 -- 172.21.15.106:0/2666887303 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2002cb40 con 0x7f0a280a8c60 2023-12-22T09:16:54.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.403+0000 7f0a1ffff640 1 -- 172.21.15.106:0/2666887303 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200343f0 con 0x7f0a280a8c60 2023-12-22T09:16:54.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.403+0000 7f0a2e53a640 1 -- 172.21.15.106:0/2666887303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280a8c60 msgr2=0x7f0a28153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.403+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/2666887303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280a8c60 0x7f0a28153880 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0a2806ab30 tx=0x7f0a2002be40 comp rx=0 tx=0).stop 2023-12-22T09:16:54.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.404+0000 7f0a2e53a640 1 -- 172.21.15.106:0/2666887303 shutdown_connections 2023-12-22T09:16:54.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.404+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/2666887303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280a8c60 0x7f0a28153880 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.404+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/2666887303 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a280aa440 0x7f0a2806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.404+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/2666887303 >> v2:172.21.15.132:3300/0 conn(0x7f0a2814d630 0x7f0a2806bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.404+0000 7f0a2e53a640 1 -- 172.21.15.106:0/2666887303 >> 172.21.15.106:0/2666887303 conn(0x7f0a28069dd0 msgr2=0x7f0a2806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:54.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.404+0000 7f0a2e53a640 1 -- 172.21.15.106:0/2666887303 shutdown_connections 2023-12-22T09:16:54.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.404+0000 7f0a2e53a640 1 -- 172.21.15.106:0/2666887303 wait complete. 2023-12-22T09:16:54.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.405+0000 7f0a2e53a640 1 Processor -- start 2023-12-22T09:16:54.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.405+0000 7f0a2e53a640 1 -- start start 2023-12-22T09:16:54.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.406+0000 7f0a2e53a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a280a8c60 0x7f0a280be740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.406+0000 7f0a2e53a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280aa440 0x7f0a281497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.406+0000 7f0a2e53a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2814d630 0x7f0a28149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.406+0000 7f0a2e53a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a28152900 con 0x7f0a280aa440 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.406+0000 7f0a2e53a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a28152260 con 0x7f0a2814d630 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.406+0000 7f0a2e53a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a28151f80 con 0x7f0a280a8c60 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.406+0000 7f0a2cd37640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280aa440 0x7f0a281497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.407+0000 7f0a2cd37640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280aa440 0x7f0a281497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43534/0 (socket says 172.21.15.106:43534) 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.407+0000 7f0a2cd37640 1 -- 172.21.15.106:0/1088942515 learned_addr learned my addr 172.21.15.106:0/1088942515 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.407+0000 7f0a2cd37640 1 -- 172.21.15.106:0/1088942515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a280a8c60 msgr2=0x7f0a280be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.407+0000 7f0a2cd37640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a280a8c60 0x7f0a280be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.407+0000 7f0a2cd37640 1 -- 172.21.15.106:0/1088942515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2814d630 msgr2=0x7f0a28149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.407+0000 7f0a2cd37640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2814d630 0x7f0a28149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.407+0000 7f0a2cd37640 1 -- 172.21.15.106:0/1088942515 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20009b30 con 0x7f0a280aa440 2023-12-22T09:16:54.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.407+0000 7f0a2cd37640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280aa440 0x7f0a281497d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800d800 tx=0x7f0a1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:54.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.407+0000 7f0a1dffb640 1 -- 172.21.15.106:0/1088942515 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a180096a0 con 0x7f0a280aa440 2023-12-22T09:16:54.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.408+0000 7f0a1dffb640 1 -- 172.21.15.106:0/1088942515 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a18009800 con 0x7f0a280aa440 2023-12-22T09:16:54.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.408+0000 7f0a1dffb640 1 -- 172.21.15.106:0/1088942515 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18009b90 con 0x7f0a280aa440 2023-12-22T09:16:54.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.408+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a281e9b90 con 0x7f0a280aa440 2023-12-22T09:16:54.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.408+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a280bec80 con 0x7f0a280aa440 2023-12-22T09:16:54.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.409+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2804e8d0 con 0x7f0a280aa440 2023-12-22T09:16:54.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.410+0000 7f0a1dffb640 1 -- 172.21.15.106:0/1088942515 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a18009cf0 con 0x7f0a280aa440 2023-12-22T09:16:54.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.411+0000 7f0a1dffb640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.411+0000 7f0a1dffb640 1 -- 172.21.15.106:0/1088942515 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0a18088be0 con 0x7f0a280aa440 2023-12-22T09:16:54.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.411+0000 7f0a2d538640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.412+0000 7f0a2d538640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0a24006fd0 tx=0x7f0a24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:54.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.416+0000 7f0a1dffb640 1 -- 172.21.15.106:0/1088942515 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a180543d0 con 0x7f0a280aa440 2023-12-22T09:16:54.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.595+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a2806b9a0 con 0x7f0a280aa440 2023-12-22T09:16:54.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.596+0000 7f0a1dffb640 1 -- 172.21.15.106:0/1088942515 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+12642 (secure 0 0 0) 0x7f0a180579f0 con 0x7f0a280aa440 2023-12-22T09:16:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:54.597 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":55,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:53.146478+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0a0c06a430 msgr2=0x7f0a0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0a24006fd0 tx=0x7f0a24008040 comp rx=0 tx=0).stop 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280aa440 msgr2=0x7f0a281497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280aa440 0x7f0a281497d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800d800 tx=0x7f0a1800dcc0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 shutdown_connections 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2814d630 0x7f0a28149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a280aa440 0x7f0a281497d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 --2- 172.21.15.106:0/1088942515 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a280a8c60 0x7f0a280be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 >> 172.21.15.106:0/1088942515 conn(0x7f0a28069dd0 msgr2=0x7f0a2806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:54.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 shutdown_connections 2023-12-22T09:16:54.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.599+0000 7f0a2e53a640 1 -- 172.21.15.106:0/1088942515 wait complete. 2023-12-22T09:16:54.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:16:54.616 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:16:54.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.822+0000 7fd40d631640 1 Processor -- start 2023-12-22T09:16:54.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.822+0000 7fd40d631640 1 -- start start 2023-12-22T09:16:54.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.824+0000 7fd40d631640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd408070cf0 0x7fd408071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.824+0000 7fd40d631640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4080716a0 0x7fd40813c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.824+0000 7fd40d631640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd408157480 con 0x7fd408151570 2023-12-22T09:16:54.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.824+0000 7fd40d631640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd408158100 con 0x7fd4080716a0 2023-12-22T09:16:54.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.824+0000 7fd40d631640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd408157760 con 0x7fd408070cf0 2023-12-22T09:16:54.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.824+0000 7fd4077fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4080716a0 0x7fd40813c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.824+0000 7fd4067fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd408070cf0 0x7fd408071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.824+0000 7fd4077fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4080716a0 0x7fd40813c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:45794/0 (socket says 172.21.15.106:45794) 2023-12-22T09:16:54.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.824+0000 7fd4077fe640 1 -- 172.21.15.106:0/2886101822 learned_addr learned my addr 172.21.15.106:0/2886101822 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:54.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.825+0000 7fd4077fe640 1 -- 172.21.15.106:0/2886101822 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd408070cf0 msgr2=0x7fd408071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:54.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.825+0000 7fd4077fe640 1 --2- 172.21.15.106:0/2886101822 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd408070cf0 0x7fd408071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.825+0000 7fd4077fe640 1 -- 172.21.15.106:0/2886101822 >> v1:172.21.15.132:6789/0 conn(0x7fd408151570 legacy=0x7fd408154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.825+0000 7fd4077fe640 1 -- 172.21.15.106:0/2886101822 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd408157a40 con 0x7fd4080716a0 2023-12-22T09:16:54.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.826+0000 7fd4077fe640 1 --2- 172.21.15.106:0/2886101822 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4080716a0 0x7fd40813c6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd400009e50 tx=0x7fd40002be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e0d883c5ca119f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:54.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.827+0000 7fd405ffb640 1 -- 172.21.15.106:0/2886101822 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40002c9f0 con 0x7fd4080716a0 2023-12-22T09:16:54.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.827+0000 7fd405ffb640 1 -- 172.21.15.106:0/2886101822 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40002cb50 con 0x7fd4080716a0 2023-12-22T09:16:54.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.827+0000 7fd405ffb640 1 -- 172.21.15.106:0/2886101822 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4000343f0 con 0x7fd4080716a0 2023-12-22T09:16:54.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.828+0000 7fd40d631640 1 -- 172.21.15.106:0/2886101822 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4080716a0 msgr2=0x7fd40813c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.828+0000 7fd40d631640 1 --2- 172.21.15.106:0/2886101822 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4080716a0 0x7fd40813c6a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd400009e50 tx=0x7fd40002be50 comp rx=0 tx=0).stop 2023-12-22T09:16:54.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.828+0000 7fd40d631640 1 -- 172.21.15.106:0/2886101822 shutdown_connections 2023-12-22T09:16:54.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.828+0000 7fd40d631640 1 --2- 172.21.15.106:0/2886101822 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4080716a0 0x7fd40813c6a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.828+0000 7fd40d631640 1 --2- 172.21.15.106:0/2886101822 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd408070cf0 0x7fd408071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.828+0000 7fd40d631640 1 -- 172.21.15.106:0/2886101822 >> 172.21.15.106:0/2886101822 conn(0x7fd408069bf0 msgr2=0x7fd408069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:54.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.828+0000 7fd40d631640 1 -- 172.21.15.106:0/2886101822 shutdown_connections 2023-12-22T09:16:54.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.828+0000 7fd40d631640 1 -- 172.21.15.106:0/2886101822 wait complete. 2023-12-22T09:16:54.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.829+0000 7fd40d631640 1 Processor -- start 2023-12-22T09:16:54.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.830+0000 7fd40d631640 1 -- start start 2023-12-22T09:16:54.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.830+0000 7fd40d631640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd408070cf0 0x7fd4081eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.830+0000 7fd40d631640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4080716a0 0x7fd4081dee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd40d631640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd408151570 0x7fd4081df3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd40d631640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408152530 con 0x7fd408070cf0 2023-12-22T09:16:54.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd40d631640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408153b20 con 0x7fd408151570 2023-12-22T09:16:54.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd40d631640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4081ed980 con 0x7fd4080716a0 2023-12-22T09:16:54.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd406ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd408070cf0 0x7fd4081eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd406ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd408070cf0 0x7fd4081eccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43544/0 (socket says 172.21.15.106:43544) 2023-12-22T09:16:54.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd406ffd640 1 -- 172.21.15.106:0/4292533001 learned_addr learned my addr 172.21.15.106:0/4292533001 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:54.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd4077fe640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd408151570 0x7fd4081df3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd406ffd640 1 -- 172.21.15.106:0/4292533001 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4080716a0 msgr2=0x7fd4081dee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd406ffd640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4080716a0 0x7fd4081dee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd406ffd640 1 -- 172.21.15.106:0/4292533001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd408151570 msgr2=0x7fd4081df3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:54.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd406ffd640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd408151570 0x7fd4081df3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:54.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.831+0000 7fd406ffd640 1 -- 172.21.15.106:0/4292533001 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009b30 con 0x7fd408070cf0 2023-12-22T09:16:54.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.832+0000 7fd406ffd640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd408070cf0 0x7fd4081eccf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800c400 tx=0x7fd3f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:54.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.832+0000 7fd3ef7fe640 1 -- 172.21.15.106:0/4292533001 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80052d0 con 0x7fd408070cf0 2023-12-22T09:16:54.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.832+0000 7fd3ef7fe640 1 -- 172.21.15.106:0/4292533001 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f8005430 con 0x7fd408070cf0 2023-12-22T09:16:54.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.832+0000 7fd3ef7fe640 1 -- 172.21.15.106:0/4292533001 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8003830 con 0x7fd408070cf0 2023-12-22T09:16:54.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.832+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4081df8f0 con 0x7fd408070cf0 2023-12-22T09:16:54.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.832+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4081ed6a0 con 0x7fd408070cf0 2023-12-22T09:16:54.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.833+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40804e080 con 0x7fd408070cf0 2023-12-22T09:16:54.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.834+0000 7fd3ef7fe640 1 -- 172.21.15.106:0/4292533001 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd3f8003990 con 0x7fd408070cf0 2023-12-22T09:16:54.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.835+0000 7fd3ef7fe640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd3f406a430 0x7fd3f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:54.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.835+0000 7fd3ef7fe640 1 -- 172.21.15.106:0/4292533001 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd3f8087c20 con 0x7fd408070cf0 2023-12-22T09:16:54.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.835+0000 7fd4067fc640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd3f406a430 0x7fd3f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:54.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.836+0000 7fd4067fc640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd3f406a430 0x7fd3f406c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc006a90 tx=0x7fd3fc006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:54.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:54.839+0000 7fd3ef7fe640 1 -- 172.21.15.106:0/4292533001 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd3f80534b0 con 0x7fd408070cf0 2023-12-22T09:16:55.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.028+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd408157cf0 con 0x7fd408070cf0 2023-12-22T09:16:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.029+0000 7fd3ef7fe640 1 -- 172.21.15.106:0/4292533001 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3f8017020 con 0x7fd408070cf0 2023-12-22T09:16:55.030 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:16:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd3f406a430 msgr2=0x7fd3f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd3f406a430 0x7fd3f406c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc006a90 tx=0x7fd3fc006a20 comp rx=0 tx=0).stop 2023-12-22T09:16:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd408070cf0 msgr2=0x7fd4081eccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd408070cf0 0x7fd4081eccf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800c400 tx=0x7fd3f800c8c0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 shutdown_connections 2023-12-22T09:16:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd3f406a430 0x7fd3f406c8f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd408151570 0x7fd4081df3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4080716a0 0x7fd4081dee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 --2- 172.21.15.106:0/4292533001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd408070cf0 0x7fd4081eccf0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 >> 172.21.15.106:0/4292533001 conn(0x7fd408069bf0 msgr2=0x7fd408072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 shutdown_connections 2023-12-22T09:16:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.032+0000 7fd40d631640 1 -- 172.21.15.106:0/4292533001 wait complete. 2023-12-22T09:16:55.052 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T09:16:55.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.262+0000 7f3d5cc95640 1 Processor -- start 2023-12-22T09:16:55.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.262+0000 7f3d5cc95640 1 -- start start 2023-12-22T09:16:55.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d5cc95640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d58069e60 0x7f3d58070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d5cc95640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d580c00c0 0x7f3d580c0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d5cc95640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5806bc70 con 0x7f3d58154f10 2023-12-22T09:16:55.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d5cc95640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d580713a0 con 0x7f3d580c00c0 2023-12-22T09:16:55.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d5cc95640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d58071660 con 0x7f3d58069e60 2023-12-22T09:16:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d56ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3d58154f10 0x7f3d5813aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59670/0 (socket says 172.21.15.106:59670) 2023-12-22T09:16:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d56ffd640 1 -- 172.21.15.106:0/3743533810 learned_addr learned my addr 172.21.15.106:0/3743533810 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d57fff640 1 --2- 172.21.15.106:0/3743533810 >> v2:172.21.15.106:3300/0 conn(0x7f3d580c00c0 0x7f3d580c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d577fe640 1 --2- 172.21.15.106:0/3743533810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d58069e60 0x7f3d58070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d57fff640 1 -- 172.21.15.106:0/3743533810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d58069e60 msgr2=0x7f3d58070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:55.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d57fff640 1 --2- 172.21.15.106:0/3743533810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d58069e60 0x7f3d58070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.264+0000 7f3d57fff640 1 -- 172.21.15.106:0/3743533810 >> v1:172.21.15.106:6789/0 conn(0x7f3d58154f10 legacy=0x7f3d5813aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.265+0000 7f3d57fff640 1 -- 172.21.15.106:0/3743533810 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d58071940 con 0x7f3d580c00c0 2023-12-22T09:16:55.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.265+0000 7f3d567fc640 1 -- 172.21.15.106:0/3743533810 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775509086 0 0) 0x7f3d5806bc70 con 0x7f3d58154f10 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.266+0000 7f3d57fff640 1 --2- 172.21.15.106:0/3743533810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d580c00c0 0x7f3d580c0550 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3d5806be00 tx=0x7f3d5002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c757b55e012ce423 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.266+0000 7f3d567fc640 1 -- 172.21.15.106:0/3743533810 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5002cc40 con 0x7f3d580c00c0 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.266+0000 7f3d567fc640 1 -- 172.21.15.106:0/3743533810 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5002cda0 con 0x7f3d580c00c0 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.266+0000 7f3d567fc640 1 -- 172.21.15.106:0/3743533810 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50034660 con 0x7f3d580c00c0 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.266+0000 7f3d5cc95640 1 -- 172.21.15.106:0/3743533810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d580c00c0 msgr2=0x7f3d580c0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.266+0000 7f3d5cc95640 1 --2- 172.21.15.106:0/3743533810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d580c00c0 0x7f3d580c0550 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3d5806be00 tx=0x7f3d5002be90 comp rx=0 tx=0).stop 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.267+0000 7f3d5cc95640 1 -- 172.21.15.106:0/3743533810 shutdown_connections 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.267+0000 7f3d5cc95640 1 --2- 172.21.15.106:0/3743533810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d580c00c0 0x7f3d580c0550 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.267+0000 7f3d5cc95640 1 --2- 172.21.15.106:0/3743533810 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d58069e60 0x7f3d58070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.267+0000 7f3d5cc95640 1 -- 172.21.15.106:0/3743533810 >> 172.21.15.106:0/3743533810 conn(0x7f3d580c5180 msgr2=0x7f3d580c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:55.272 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.267+0000 7f3d5cc95640 1 -- 172.21.15.106:0/3743533810 shutdown_connections 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.267+0000 7f3d5cc95640 1 -- 172.21.15.106:0/3743533810 wait complete. 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.269+0000 7f3d5cc95640 1 Processor -- start 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.269+0000 7f3d5cc95640 1 -- start start 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d5cc95640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d58069e60 0x7f3d580bece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d5cc95640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d580c00c0 0x7f3d581ec310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d5cc95640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d58154f10 0x7f3d581ec850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d5cc95640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d58153b10 con 0x7f3d58154f10 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d5cc95640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581ebe80 con 0x7f3d58069e60 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d5cc95640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d58154640 con 0x7f3d580c00c0 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d57fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d58154f10 0x7f3d581ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d57fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d58154f10 0x7f3d581ec850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43572/0 (socket says 172.21.15.106:43572) 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d57fff640 1 -- 172.21.15.106:0/1263743843 learned_addr learned my addr 172.21.15.106:0/1263743843 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:55.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d56ffd640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d580c00c0 0x7f3d581ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d57fff640 1 -- 172.21.15.106:0/1263743843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d580c00c0 msgr2=0x7f3d581ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d577fe640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d58069e60 0x7f3d580bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d57fff640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d580c00c0 0x7f3d581ec310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d57fff640 1 -- 172.21.15.106:0/1263743843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d58069e60 msgr2=0x7f3d580bece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d57fff640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d58069e60 0x7f3d580bece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.270+0000 7f3d57fff640 1 -- 172.21.15.106:0/1263743843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d50009a70 con 0x7f3d58154f10 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.271+0000 7f3d57fff640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d58154f10 0x7f3d581ec850 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3d5002c4a0 tx=0x7f3d50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.271+0000 7f3d4ffff640 1 -- 172.21.15.106:0/1263743843 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50040650 con 0x7f3d58154f10 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.271+0000 7f3d4ffff640 1 -- 172.21.15.106:0/1263743843 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d500407d0 con 0x7f3d58154f10 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.271+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d581ecd90 con 0x7f3d58154f10 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.271+0000 7f3d4ffff640 1 -- 172.21.15.106:0/1263743843 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50040b80 con 0x7f3d58154f10 2023-12-22T09:16:55.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.271+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5814e6e0 con 0x7f3d58154f10 2023-12-22T09:16:55.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.272+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d580701e0 con 0x7f3d58154f10 2023-12-22T09:16:55.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.273+0000 7f3d4ffff640 1 -- 172.21.15.106:0/1263743843 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3d50040ce0 con 0x7f3d58154f10 2023-12-22T09:16:55.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.274+0000 7f3d4ffff640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d3806a430 0x7f3d3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.274+0000 7f3d4ffff640 1 -- 172.21.15.106:0/1263743843 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3d500ab540 con 0x7f3d58154f10 2023-12-22T09:16:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.274+0000 7f3d577fe640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d3806a430 0x7f3d3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.276 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.275+0000 7f3d577fe640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d3806a430 0x7f3d3806c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3d48006fd0 tx=0x7f3d48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:55.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.281+0000 7f3d4ffff640 1 -- 172.21.15.106:0/1263743843 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3d50076d30 con 0x7f3d58154f10 2023-12-22T09:16:55.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.472+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3d581ec010 con 0x7f3d58154f10 2023-12-22T09:16:55.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.473+0000 7f3d4ffff640 1 -- 172.21.15.106:0/1263743843 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3d5007a350 con 0x7f3d58154f10 2023-12-22T09:16:55.474 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:55.474 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2023-12-22T09:16:55.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:16:55.474 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2023-12-22T09:16:55.474 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2023-12-22T09:16:55.474 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:16:55.474 INFO:teuthology.orchestra.run.smithi106.stdout:] 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.475+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d3806a430 msgr2=0x7f3d3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d3806a430 0x7f3d3806c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3d48006fd0 tx=0x7f3d48008040 comp rx=0 tx=0).stop 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d58154f10 msgr2=0x7f3d581ec850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d58154f10 0x7f3d581ec850 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3d5002c4a0 tx=0x7f3d50004a40 comp rx=0 tx=0).stop 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 shutdown_connections 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f3d3806a430 0x7f3d3806c8f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d58154f10 0x7f3d581ec850 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3d580c00c0 0x7f3d581ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 --2- 172.21.15.106:0/1263743843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d58069e60 0x7f3d580bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 >> 172.21.15.106:0/1263743843 conn(0x7f3d580c5180 msgr2=0x7f3d58139f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 shutdown_connections 2023-12-22T09:16:55.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.476+0000 7f3d5cc95640 1 -- 172.21.15.106:0/1263743843 wait complete. 2023-12-22T09:16:55.495 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T09:16:55.496 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T09:16:55.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.715+0000 7f2a28d33640 1 Processor -- start 2023-12-22T09:16:55.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.716+0000 7f2a28d33640 1 -- start start 2023-12-22T09:16:55.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.717+0000 7f2a28d33640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2a240aebb0 0x7f2a240ab040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.717+0000 7f2a28d33640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a240c7420 0x7f2a241543a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.717+0000 7f2a28d33640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a240c3ea0 con 0x7f2a240bcbe0 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.717+0000 7f2a28d33640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a240aef90 con 0x7f2a240aebb0 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.717+0000 7f2a28d33640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24157c30 con 0x7f2a240c7420 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.717+0000 7f2a22ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2a240bcbe0 0x7f2a24153c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59674/0 (socket says 172.21.15.106:59674) 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.717+0000 7f2a22ffd640 1 -- 172.21.15.106:0/424130355 learned_addr learned my addr 172.21.15.106:0/424130355 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a23fff640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a240c7420 0x7f2a241543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a237fe640 1 --2- 172.21.15.106:0/424130355 >> v2:172.21.15.132:3300/0 conn(0x7f2a240aebb0 0x7f2a240ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014997219 0 0) 0x7f2a240c3ea0 con 0x7f2a240bcbe0 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a10003520 con 0x7f2a240bcbe0 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048795042 0 0) 0x7f2a10003520 con 0x7f2a240bcbe0 2023-12-22T09:16:55.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a240c7420 msgr2=0x7f2a241543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:55.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a240c7420 0x7f2a241543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 >> v2:172.21.15.132:3300/0 conn(0x7f2a240aebb0 msgr2=0x7f2a240ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:55.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 --2- 172.21.15.106:0/424130355 >> v2:172.21.15.132:3300/0 conn(0x7f2a240aebb0 0x7f2a240ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a24157f10 con 0x7f2a240bcbe0 2023-12-22T09:16:55.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f2a140019f0 con 0x7f2a240bcbe0 2023-12-22T09:16:55.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 >> v1:172.21.15.106:6789/0 conn(0x7f2a240bcbe0 legacy=0x7f2a24153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a240c7420 0x7f2a10003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.718+0000 7f2a227fc640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a10004d00 0x7f2a10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24157c30 con 0x7f2a10003ef0 2023-12-22T09:16:55.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1000b9e0 con 0x7f2a10004d00 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1000bba0 con 0x7f2a240c7420 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a22ffd640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a237fe640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a240c7420 0x7f2a10003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a23fff640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a10004d00 0x7f2a10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a22ffd640 1 -- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a240c7420 msgr2=0x7f2a10003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a22ffd640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a240c7420 0x7f2a10003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a22ffd640 1 -- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a10004d00 msgr2=0x7f2a10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a22ffd640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a10004d00 0x7f2a10005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a22ffd640 1 -- 172.21.15.106:0/424130355 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10003520 con 0x7f2a10003ef0 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.719+0000 7f2a23fff640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a10004d00 0x7f2a10005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.720+0000 7f2a22ffd640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a100047c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400a860 tx=0x7f2a100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e116d387befd91a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:55.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14034630 con 0x7f2a10003ef0 2023-12-22T09:16:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1402f070 con 0x7f2a10003ef0 2023-12-22T09:16:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a227fc640 1 -- 172.21.15.106:0/424130355 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14034a30 con 0x7f2a10003ef0 2023-12-22T09:16:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a28d33640 1 -- 172.21.15.106:0/424130355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 msgr2=0x7f2a100047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a28d33640 1 --2- 172.21.15.106:0/424130355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a100047c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400a860 tx=0x7f2a100057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a23fff640 1 -- 172.21.15.106:0/424130355 reap_dead start 2023-12-22T09:16:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a28d33640 1 -- 172.21.15.106:0/424130355 shutdown_connections 2023-12-22T09:16:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a28d33640 1 -- 172.21.15.106:0/424130355 >> 172.21.15.106:0/424130355 conn(0x7f2a240c9520 msgr2=0x7f2a240c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a28d33640 1 -- 172.21.15.106:0/424130355 shutdown_connections 2023-12-22T09:16:55.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.721+0000 7f2a28d33640 1 -- 172.21.15.106:0/424130355 wait complete. 2023-12-22T09:16:55.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.723+0000 7f2a28d33640 1 Processor -- start 2023-12-22T09:16:55.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.723+0000 7f2a28d33640 1 -- start start 2023-12-22T09:16:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.724+0000 7f2a28d33640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a240c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.724+0000 7f2a28d33640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a24152300 0x7f2a2414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.724+0000 7f2a28d33640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a240c2180 0x7f2a241e8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.724+0000 7f2a28d33640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24151a00 con 0x7f2a10003ef0 2023-12-22T09:16:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.724+0000 7f2a28d33640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240c1550 con 0x7f2a240c2180 2023-12-22T09:16:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.724+0000 7f2a28d33640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240c1220 con 0x7f2a24152300 2023-12-22T09:16:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.724+0000 7f2a237fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a240c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.724+0000 7f2a237fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a240c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43592/0 (socket says 172.21.15.106:43592) 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.724+0000 7f2a237fe640 1 -- 172.21.15.106:0/2214610075 learned_addr learned my addr 172.21.15.106:0/2214610075 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.725+0000 7f2a237fe640 1 -- 172.21.15.106:0/2214610075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a24152300 msgr2=0x7f2a2414cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.725+0000 7f2a237fe640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a24152300 0x7f2a2414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.725+0000 7f2a237fe640 1 -- 172.21.15.106:0/2214610075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a240c2180 msgr2=0x7f2a241e8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.725+0000 7f2a237fe640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a240c2180 0x7f2a241e8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.725+0000 7f2a237fe640 1 -- 172.21.15.106:0/2214610075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a24151c50 con 0x7f2a10003ef0 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.725+0000 7f2a237fe640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a240c19e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0116d0 tx=0x7f2a0c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.725+0000 7f2a1bfff640 1 -- 172.21.15.106:0/2214610075 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00f940 con 0x7f2a10003ef0 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.725+0000 7f2a1bfff640 1 -- 172.21.15.106:0/2214610075 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c00faa0 con 0x7f2a10003ef0 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.725+0000 7f2a1bfff640 1 -- 172.21.15.106:0/2214610075 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00fe10 con 0x7f2a10003ef0 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.726+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a24151f30 con 0x7f2a10003ef0 2023-12-22T09:16:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.726+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2414d140 con 0x7f2a10003ef0 2023-12-22T09:16:55.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.727+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2404e8d0 con 0x7f2a10003ef0 2023-12-22T09:16:55.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.728+0000 7f2a1bfff640 1 -- 172.21.15.106:0/2214610075 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a0c015460 con 0x7f2a10003ef0 2023-12-22T09:16:55.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.728+0000 7f2a1bfff640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2a0406a460 0x7f2a0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:55.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.729+0000 7f2a1bfff640 1 -- 172.21.15.106:0/2214610075 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2a0c088bd0 con 0x7f2a10003ef0 2023-12-22T09:16:55.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.729+0000 7f2a22ffd640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2a0406a460 0x7f2a0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:55.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.729+0000 7f2a22ffd640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2a0406a460 0x7f2a0406c920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a14034000 tx=0x7f2a14007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:55.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.733+0000 7f2a1bfff640 1 -- 172.21.15.106:0/2214610075 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2a0c054470 con 0x7f2a10003ef0 2023-12-22T09:16:55.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:55.922+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2a2406c620 con 0x7f2a10003ef0 2023-12-22T09:16:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.605+0000 7f2a1bfff640 1 -- 172.21.15.106:0/2214610075 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2a0c057a90 con 0x7f2a10003ef0 2023-12-22T09:16:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2a0406a460 msgr2=0x7f2a0406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2a0406a460 0x7f2a0406c920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a14034000 tx=0x7f2a14007000 comp rx=0 tx=0).stop 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 msgr2=0x7f2a240c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a240c19e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0116d0 tx=0x7f2a0c011b90 comp rx=0 tx=0).stop 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 shutdown_connections 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2a0406a460 0x7f2a0406c920 secure :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a14034000 tx=0x7f2a14007000 comp rx=0 tx=0).stop 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a240c2180 0x7f2a241e8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2a24152300 0x7f2a2414cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 --2- 172.21.15.106:0/2214610075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a10003ef0 0x7f2a240c19e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.611+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 >> 172.21.15.106:0/2214610075 conn(0x7f2a240c9520 msgr2=0x7f2a240a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.613+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 shutdown_connections 2023-12-22T09:16:56.615 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.614+0000 7f2a28d33640 1 -- 172.21.15.106:0/2214610075 wait complete. 2023-12-22T09:16:56.636 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T09:16:56.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.844+0000 7ffa04147640 1 Processor -- start 2023-12-22T09:16:56.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.844+0000 7ffa04147640 1 -- start start 2023-12-22T09:16:56.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.845+0000 7ffa04147640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff9fc14da50 0x7ff9fc0bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:56.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.845+0000 7ffa04147640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff9fc06c300 0x7ff9fc070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:56.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.845+0000 7ffa04147640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9fc0705a0 con 0x7ff9fc070f70 2023-12-22T09:16:56.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa04147640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc154820 con 0x7ff9fc14da50 2023-12-22T09:16:56.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa04147640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc06cf10 con 0x7ff9fc06c300 2023-12-22T09:16:56.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa01ee3640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff9fc14da50 0x7ff9fc0bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:56.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa026e4640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff9fc070f70 0x7ff9fc153980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59684/0 (socket says 172.21.15.106:59684) 2023-12-22T09:16:56.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa026e4640 1 -- 172.21.15.106:0/2749199983 learned_addr learned my addr 172.21.15.106:0/2749199983 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:56.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa01ee3640 1 -- 172.21.15.106:0/2749199983 >> v2:172.21.15.132:3300/0 conn(0x7ff9fc06c300 msgr2=0x7ff9fc070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:56.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa016e2640 1 --2- 172.21.15.106:0/2749199983 >> v2:172.21.15.132:3300/0 conn(0x7ff9fc06c300 0x7ff9fc070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:56.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa01ee3640 1 --2- 172.21.15.106:0/2749199983 >> v2:172.21.15.132:3300/0 conn(0x7ff9fc06c300 0x7ff9fc070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:56.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa00ee1640 1 -- 172.21.15.106:0/2749199983 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594534550 0 0) 0x7ff9fc0705a0 con 0x7ff9fc070f70 2023-12-22T09:16:56.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa01ee3640 1 -- 172.21.15.106:0/2749199983 >> v1:172.21.15.106:6789/0 conn(0x7ff9fc070f70 legacy=0x7ff9fc153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:56.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa01ee3640 1 -- 172.21.15.106:0/2749199983 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc06d1f0 con 0x7ff9fc14da50 2023-12-22T09:16:56.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.846+0000 7ffa016e2640 1 --2- 172.21.15.106:0/2749199983 >> v2:172.21.15.132:3300/0 conn(0x7ff9fc06c300 0x7ff9fc070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:56.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.847+0000 7ffa01ee3640 1 --2- 172.21.15.106:0/2749199983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 0x7ff9fc0bfca0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc06ba30 tx=0x7ff9f802cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751eb457912aa82c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:56.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.848+0000 7ffa00ee1640 1 -- 172.21.15.106:0/2749199983 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f802db50 con 0x7ff9fc14da50 2023-12-22T09:16:56.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.848+0000 7ffa00ee1640 1 -- 172.21.15.106:0/2749199983 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f802dcb0 con 0x7ff9fc14da50 2023-12-22T09:16:56.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.848+0000 7ffa00ee1640 1 -- 172.21.15.106:0/2749199983 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8035660 con 0x7ff9fc14da50 2023-12-22T09:16:56.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.848+0000 7ffa04147640 1 -- 172.21.15.106:0/2749199983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 msgr2=0x7ff9fc0bfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.848+0000 7ffa04147640 1 --2- 172.21.15.106:0/2749199983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 0x7ff9fc0bfca0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc06ba30 tx=0x7ff9f802cda0 comp rx=0 tx=0).stop 2023-12-22T09:16:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.848+0000 7ffa04147640 1 -- 172.21.15.106:0/2749199983 shutdown_connections 2023-12-22T09:16:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.848+0000 7ffa04147640 1 --2- 172.21.15.106:0/2749199983 >> v2:172.21.15.132:3300/0 conn(0x7ff9fc06c300 0x7ff9fc070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.848+0000 7ffa04147640 1 --2- 172.21.15.106:0/2749199983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 0x7ff9fc0bfca0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.848+0000 7ffa04147640 1 -- 172.21.15.106:0/2749199983 >> 172.21.15.106:0/2749199983 conn(0x7ff9fc06a220 msgr2=0x7ff9fc0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.849+0000 7ffa04147640 1 -- 172.21.15.106:0/2749199983 shutdown_connections 2023-12-22T09:16:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.849+0000 7ffa04147640 1 -- 172.21.15.106:0/2749199983 wait complete. 2023-12-22T09:16:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.850+0000 7ffa04147640 1 Processor -- start 2023-12-22T09:16:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.850+0000 7ffa04147640 1 -- start start 2023-12-22T09:16:56.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.851+0000 7ffa04147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9fc06c300 0x7ff9fc1ea040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:56.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.851+0000 7ffa04147640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff9fc070f70 0x7ff9fc1ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:56.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.851+0000 7ffa04147640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 0x7ff9fc1dca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:56.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.851+0000 7ffa04147640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc1ed080 con 0x7ff9fc14da50 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.851+0000 7ffa04147640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0bd850 con 0x7ff9fc06c300 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.851+0000 7ffa04147640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc1ecda0 con 0x7ff9fc070f70 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa026e4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 0x7ff9fc1dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa026e4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 0x7ff9fc1dca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43622/0 (socket says 172.21.15.106:43622) 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa026e4640 1 -- 172.21.15.106:0/761970927 learned_addr learned my addr 172.21.15.106:0/761970927 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa01ee3640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9fc06c300 0x7ff9fc1ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa016e2640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff9fc070f70 0x7ff9fc1ec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa026e4640 1 -- 172.21.15.106:0/761970927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff9fc070f70 msgr2=0x7ff9fc1ec2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa026e4640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff9fc070f70 0x7ff9fc1ec2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa026e4640 1 -- 172.21.15.106:0/761970927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9fc06c300 msgr2=0x7ff9fc1ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa026e4640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9fc06c300 0x7ff9fc1ea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.852+0000 7ffa026e4640 1 -- 172.21.15.106:0/761970927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f800a5a0 con 0x7ff9fc14da50 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.853+0000 7ffa026e4640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 0x7ff9fc1dca10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4002230 tx=0x7ff9f400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.853+0000 7ff9f27fc640 1 -- 172.21.15.106:0/761970927 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f400ce30 con 0x7ff9fc14da50 2023-12-22T09:16:56.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.853+0000 7ff9f27fc640 1 -- 172.21.15.106:0/761970927 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f400a640 con 0x7ff9fc14da50 2023-12-22T09:16:56.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.853+0000 7ff9f27fc640 1 -- 172.21.15.106:0/761970927 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f400a9f0 con 0x7ff9fc14da50 2023-12-22T09:16:56.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.853+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc0bd200 con 0x7ff9fc14da50 2023-12-22T09:16:56.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.853+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc0be620 con 0x7ff9fc14da50 2023-12-22T09:16:56.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.854+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc0bd9c0 con 0x7ff9fc14da50 2023-12-22T09:16:56.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.855+0000 7ff9f27fc640 1 -- 172.21.15.106:0/761970927 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff9f400ab50 con 0x7ff9fc14da50 2023-12-22T09:16:56.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.856+0000 7ff9f27fc640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff9e006a460 0x7ff9e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:56.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.856+0000 7ff9f27fc640 1 -- 172.21.15.106:0/761970927 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5547+0+0 (secure 0 0 0) 0x7ff9f4087cc0 con 0x7ff9fc14da50 2023-12-22T09:16:56.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.856+0000 7ffa01ee3640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff9e006a460 0x7ff9e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:56.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.857+0000 7ffa01ee3640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff9e006a460 0x7ff9e006c920 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8037000 tx=0x7ff9f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:56.861+0000 7ff9f27fc640 1 -- 172.21.15.106:0/761970927 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff9f408e080 con 0x7ff9fc14da50 2023-12-22T09:16:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.050+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff9fc073f10 con 0x7ff9fc14da50 2023-12-22T09:16:57.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.622+0000 7ff9f27fc640 1 -- 172.21.15.106:0/761970927 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff9f4018020 con 0x7ff9fc14da50 2023-12-22T09:16:57.625 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2023-12-22T09:16:57.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.632+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff9e006a460 msgr2=0x7ff9e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:57.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.632+0000 7ffa04147640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff9e006a460 0x7ff9e006c920 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8037000 tx=0x7ff9f8008040 comp rx=0 tx=0).stop 2023-12-22T09:16:57.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.632+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 msgr2=0x7ff9fc1dca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:57.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.632+0000 7ffa04147640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 0x7ff9fc1dca10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4002230 tx=0x7ff9f400cbe0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.633+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 shutdown_connections 2023-12-22T09:16:57.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.633+0000 7ffa04147640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff9e006a460 0x7ff9e006c920 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.633+0000 7ffa04147640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9fc14da50 0x7ff9fc1dca10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.633+0000 7ffa04147640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff9fc070f70 0x7ff9fc1ec2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.633+0000 7ffa04147640 1 --2- 172.21.15.106:0/761970927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9fc06c300 0x7ff9fc1ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.633+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 >> 172.21.15.106:0/761970927 conn(0x7ff9fc06a220 msgr2=0x7ff9fc06d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:57.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.634+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 shutdown_connections 2023-12-22T09:16:57.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.635+0000 7ffa04147640 1 -- 172.21.15.106:0/761970927 wait complete. 2023-12-22T09:16:57.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T09:16:57.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.847+0000 7fba1365f640 1 Processor -- start 2023-12-22T09:16:57.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.847+0000 7fba1365f640 1 -- start start 2023-12-22T09:16:57.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.849+0000 7fba1365f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c14f090 0x7fba0c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:57.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.849+0000 7fba1365f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fba0c06b960 0x7fba0c0c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:57.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.849+0000 7fba1365f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c155120 con 0x7fba0c0c1910 2023-12-22T09:16:57.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.849+0000 7fba1365f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c06e080 con 0x7fba0c06b960 2023-12-22T09:16:57.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.849+0000 7fba1365f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c155fa0 con 0x7fba0c14f090 2023-12-22T09:16:57.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.849+0000 7fba11bfc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fba0c06b960 0x7fba0c0c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:57.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.849+0000 7fba10bfa640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fba0c0c1910 0x7fba0c155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59698/0 (socket says 172.21.15.106:59698) 2023-12-22T09:16:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.849+0000 7fba10bfa640 1 -- 172.21.15.106:0/2636995795 learned_addr learned my addr 172.21.15.106:0/2636995795 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.850+0000 7fba113fb640 1 --2- 172.21.15.106:0/2636995795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c14f090 0x7fba0c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.850+0000 7fba11bfc640 1 -- 172.21.15.106:0/2636995795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c14f090 msgr2=0x7fba0c151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.850+0000 7fba11bfc640 1 --2- 172.21.15.106:0/2636995795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c14f090 0x7fba0c151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.850+0000 7fba11bfc640 1 -- 172.21.15.106:0/2636995795 >> v1:172.21.15.106:6789/0 conn(0x7fba0c0c1910 legacy=0x7fba0c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.850+0000 7fba11bfc640 1 -- 172.21.15.106:0/2636995795 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0a8720 con 0x7fba0c06b960 2023-12-22T09:16:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.850+0000 7fba03fff640 1 -- 172.21.15.106:0/2636995795 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137212452 0 0) 0x7fba0c155120 con 0x7fba0c0c1910 2023-12-22T09:16:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.851+0000 7fba11bfc640 1 --2- 172.21.15.106:0/2636995795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c06b960 0x7fba0c0c2010 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fba04009d90 tx=0x7fba0402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40c57665c4e8399 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.851+0000 7fba03fff640 1 -- 172.21.15.106:0/2636995795 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0402cbc0 con 0x7fba0c06b960 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.851+0000 7fba03fff640 1 -- 172.21.15.106:0/2636995795 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0402cd20 con 0x7fba0c06b960 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.851+0000 7fba03fff640 1 -- 172.21.15.106:0/2636995795 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04034660 con 0x7fba0c06b960 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.852+0000 7fba1365f640 1 -- 172.21.15.106:0/2636995795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c06b960 msgr2=0x7fba0c0c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.852+0000 7fba1365f640 1 --2- 172.21.15.106:0/2636995795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c06b960 0x7fba0c0c2010 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fba04009d90 tx=0x7fba0402be10 comp rx=0 tx=0).stop 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.852+0000 7fba1365f640 1 -- 172.21.15.106:0/2636995795 shutdown_connections 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.852+0000 7fba1365f640 1 --2- 172.21.15.106:0/2636995795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c06b960 0x7fba0c0c2010 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.852+0000 7fba1365f640 1 --2- 172.21.15.106:0/2636995795 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c14f090 0x7fba0c151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.852+0000 7fba1365f640 1 -- 172.21.15.106:0/2636995795 >> 172.21.15.106:0/2636995795 conn(0x7fba0c069dd0 msgr2=0x7fba0c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.852+0000 7fba1365f640 1 -- 172.21.15.106:0/2636995795 shutdown_connections 2023-12-22T09:16:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.852+0000 7fba1365f640 1 -- 172.21.15.106:0/2636995795 wait complete. 2023-12-22T09:16:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.854+0000 7fba1365f640 1 Processor -- start 2023-12-22T09:16:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.854+0000 7fba1365f640 1 -- start start 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba1365f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c06b960 0x7fba0c0bee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba1365f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c0c1910 0x7fba0c0bac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba1365f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba0c14f090 0x7fba0c1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba1365f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c154f50 con 0x7fba0c0c1910 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba1365f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c147b80 con 0x7fba0c14f090 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba1365f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0bf340 con 0x7fba0c06b960 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba10bfa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c0c1910 0x7fba0c0bac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba10bfa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c0c1910 0x7fba0c0bac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43630/0 (socket says 172.21.15.106:43630) 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba10bfa640 1 -- 172.21.15.106:0/4100012945 learned_addr learned my addr 172.21.15.106:0/4100012945 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.855+0000 7fba113fb640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c06b960 0x7fba0c0bee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba10bfa640 1 -- 172.21.15.106:0/4100012945 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c06b960 msgr2=0x7fba0c0bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba10bfa640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c06b960 0x7fba0c0bee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba11bfc640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba0c14f090 0x7fba0c1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba10bfa640 1 -- 172.21.15.106:0/4100012945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba0c14f090 msgr2=0x7fba0c1491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba10bfa640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba0c14f090 0x7fba0c1491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba10bfa640 1 -- 172.21.15.106:0/4100012945 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04009a70 con 0x7fba0c0c1910 2023-12-22T09:16:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba10bfa640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c0c1910 0x7fba0c0bac30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00c4d0 tx=0x7fb9fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba01ffb640 1 -- 172.21.15.106:0/4100012945 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0074e0 con 0x7fba0c0c1910 2023-12-22T09:16:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba01ffb640 1 -- 172.21.15.106:0/4100012945 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc007660 con 0x7fba0c0c1910 2023-12-22T09:16:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba01ffb640 1 -- 172.21.15.106:0/4100012945 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc004a20 con 0x7fba0c0c1910 2023-12-22T09:16:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c0bb170 con 0x7fba0c0c1910 2023-12-22T09:16:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.856+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c1ea730 con 0x7fba0c0c1910 2023-12-22T09:16:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.858+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c1ea8c0 con 0x7fba0c0c1910 2023-12-22T09:16:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.859+0000 7fba01ffb640 1 -- 172.21.15.106:0/4100012945 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9fc004b80 con 0x7fba0c0c1910 2023-12-22T09:16:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.860+0000 7fba01ffb640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f006a460 0x7fb9f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.860+0000 7fba01ffb640 1 -- 172.21.15.106:0/4100012945 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fb9fc087a10 con 0x7fba0c0c1910 2023-12-22T09:16:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.860+0000 7fba113fb640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f006a460 0x7fb9f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.860+0000 7fba113fb640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f006a460 0x7fb9f006c920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fba08006fd0 tx=0x7fba08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:57.865+0000 7fba01ffb640 1 -- 172.21.15.106:0/4100012945 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb9fc052f10 con 0x7fba0c0c1910 2023-12-22T09:16:58.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.093+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fba0c0bb170 con 0x7fba0c0c1910 2023-12-22T09:16:58.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.106+0000 7fba01ffb640 1 -- 172.21.15.106:0/4100012945 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7fba0c0bb170 con 0x7fba0c0c1910 2023-12-22T09:16:58.107 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 9 and data pool 10 2023-12-22T09:16:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f006a460 msgr2=0x7fb9f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f006a460 0x7fb9f006c920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fba08006fd0 tx=0x7fba08008040 comp rx=0 tx=0).stop 2023-12-22T09:16:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c0c1910 msgr2=0x7fba0c0bac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c0c1910 0x7fba0c0bac30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00c4d0 tx=0x7fb9fc00c990 comp rx=0 tx=0).stop 2023-12-22T09:16:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 shutdown_connections 2023-12-22T09:16:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f006a460 0x7fb9f006c920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba0c14f090 0x7fba0c1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c0c1910 0x7fba0c0bac30 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 --2- 172.21.15.106:0/4100012945 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba0c06b960 0x7fba0c0bee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.111+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 >> 172.21.15.106:0/4100012945 conn(0x7fba0c069dd0 msgr2=0x7fba0c0a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.113+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 shutdown_connections 2023-12-22T09:16:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.113+0000 7fba1365f640 1 -- 172.21.15.106:0/4100012945 wait complete. 2023-12-22T09:16:58.143 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:58.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.327+0000 7f33bb19c640 1 Processor -- start 2023-12-22T09:16:58.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.327+0000 7f33bb19c640 1 -- start start 2023-12-22T09:16:58.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.329+0000 7f33bb19c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33b41514b0 0x7f33b40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.329+0000 7f33bb19c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33b406aad0 0x7f33b40c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.329+0000 7f33bb19c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b40c4660 con 0x7f33b40c4130 2023-12-22T09:16:58.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.329+0000 7f33bb19c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b4153d60 con 0x7f33b41514b0 2023-12-22T09:16:58.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.329+0000 7f33bb19c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4154c50 con 0x7f33b406aad0 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.329+0000 7f33b3fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f33b40c4130 0x7f33b4154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59712/0 (socket says 172.21.15.106:59712) 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.329+0000 7f33b3fff640 1 -- 172.21.15.106:0/1894857018 learned_addr learned my addr 172.21.15.106:0/1894857018 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020922979 0 0) 0x7f33b40c4660 con 0x7f33b40c4130 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b9739640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33b406aad0 0x7f33b40c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3394003520 con 0x7f33b40c4130 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b8f38640 1 --2- 172.21.15.106:0/1894857018 >> v2:172.21.15.132:3300/0 conn(0x7f33b41514b0 0x7f33b40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476628991 0 0) 0x7f3394003520 con 0x7f33b40c4130 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33b406aad0 msgr2=0x7f33b40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33b406aad0 0x7f33b40c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 >> v2:172.21.15.132:3300/0 conn(0x7f33b41514b0 msgr2=0x7f33b40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:58.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 --2- 172.21.15.106:0/1894857018 >> v2:172.21.15.132:3300/0 conn(0x7f33b41514b0 0x7f33b40c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b406b250 con 0x7f33b40c4130 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f339c0019f0 con 0x7f33b40c4130 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 >> v1:172.21.15.106:6789/0 conn(0x7f33b40c4130 legacy=0x7f33b4154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33b406aad0 0x7f3394003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3394003fa0 0x7f33940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3394004d00 0x7f3394005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4153d60 con 0x7f3394003fa0 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4154c50 con 0x7f3394004d00 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339400bc10 con 0x7f33b406aad0 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.330+0000 7f33b3fff640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3394003fa0 0x7f33940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.331+0000 7f33b8f38640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33b406aad0 0x7f3394003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.331+0000 7f33b9739640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3394004d00 0x7f3394005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.331+0000 7f33b3fff640 1 -- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33b406aad0 msgr2=0x7f3394003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.331+0000 7f33b3fff640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33b406aad0 0x7f3394003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.331+0000 7f33b3fff640 1 -- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3394004d00 msgr2=0x7f3394005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:58.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.331+0000 7f33b3fff640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3394004d00 0x7f3394005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.331+0000 7f33b3fff640 1 -- 172.21.15.106:0/1894857018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394003520 con 0x7f3394003fa0 2023-12-22T09:16:58.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.331+0000 7f33b9739640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3394004d00 0x7f3394005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:58.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.332+0000 7f33b3fff640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3394003fa0 0x7f33940047c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f339c00a860 tx=0x7f33940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60d4dc9cea95043 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:58.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.332+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c034630 con 0x7f3394003fa0 2023-12-22T09:16:58.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.332+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c02f070 con 0x7f3394003fa0 2023-12-22T09:16:58.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.332+0000 7f33b37fe640 1 -- 172.21.15.106:0/1894857018 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c034a30 con 0x7f3394003fa0 2023-12-22T09:16:58.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.333+0000 7f33bb19c640 1 -- 172.21.15.106:0/1894857018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3394003fa0 msgr2=0x7f33940047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.333+0000 7f33bb19c640 1 --2- 172.21.15.106:0/1894857018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3394003fa0 0x7f33940047c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f339c00a860 tx=0x7f33940057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.333+0000 7f33b9739640 1 -- 172.21.15.106:0/1894857018 reap_dead start 2023-12-22T09:16:58.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.333+0000 7f33bb19c640 1 -- 172.21.15.106:0/1894857018 shutdown_connections 2023-12-22T09:16:58.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.333+0000 7f33bb19c640 1 -- 172.21.15.106:0/1894857018 >> 172.21.15.106:0/1894857018 conn(0x7f33b40ab1a0 msgr2=0x7f33b40ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:58.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.333+0000 7f33bb19c640 1 -- 172.21.15.106:0/1894857018 shutdown_connections 2023-12-22T09:16:58.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.333+0000 7f33bb19c640 1 -- 172.21.15.106:0/1894857018 wait complete. 2023-12-22T09:16:58.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.335+0000 7f33bb19c640 1 Processor -- start 2023-12-22T09:16:58.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.335+0000 7f33bb19c640 1 -- start start 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33bb19c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3394003fa0 0x7f33b414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33bb19c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b40bfea0 0x7f33b40aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33bb19c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33b40bd700 0x7f33b40bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33bb19c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b414fd40 con 0x7f33b40bd700 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33bb19c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40bd270 con 0x7f33b40bfea0 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33bb19c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b41502c0 con 0x7f3394003fa0 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b9739640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33b40bd700 0x7f33b40bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b9739640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33b40bd700 0x7f33b40bdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43646/0 (socket says 172.21.15.106:43646) 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b9739640 1 -- 172.21.15.106:0/2240591354 learned_addr learned my addr 172.21.15.106:0/2240591354 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b8f38640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3394003fa0 0x7f33b414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b3fff640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b40bfea0 0x7f33b40aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b9739640 1 -- 172.21.15.106:0/2240591354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3394003fa0 msgr2=0x7f33b414ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b9739640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3394003fa0 0x7f33b414ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b9739640 1 -- 172.21.15.106:0/2240591354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b40bfea0 msgr2=0x7f33b40aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b9739640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b40bfea0 0x7f33b40aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b9739640 1 -- 172.21.15.106:0/2240591354 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b41505a0 con 0x7f33b40bd700 2023-12-22T09:16:58.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.336+0000 7f33b3fff640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b40bfea0 0x7f33b40aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:58.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.337+0000 7f33b9739640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33b40bd700 0x7f33b40bdb90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f33ac006fd0 tx=0x7f33ac00e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:58.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.337+0000 7f33b17fa640 1 -- 172.21.15.106:0/2240591354 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00c070 con 0x7f33b40bd700 2023-12-22T09:16:58.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.337+0000 7f33b17fa640 1 -- 172.21.15.106:0/2240591354 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac013610 con 0x7f33b40bd700 2023-12-22T09:16:58.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.337+0000 7f33b17fa640 1 -- 172.21.15.106:0/2240591354 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0139c0 con 0x7f33b40bd700 2023-12-22T09:16:58.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.337+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b4150880 con 0x7f33b40bd700 2023-12-22T09:16:58.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.337+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b41523f0 con 0x7f33b40bd700 2023-12-22T09:16:58.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.339+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b406b510 con 0x7f33b40bd700 2023-12-22T09:16:58.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.339+0000 7f33b17fa640 1 -- 172.21.15.106:0/2240591354 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f33ac013b20 con 0x7f33b40bd700 2023-12-22T09:16:58.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.340+0000 7f33b17fa640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f339806a460 0x7f339806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.340+0000 7f33b17fa640 1 -- 172.21.15.106:0/2240591354 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f33ac088270 con 0x7f33b40bd700 2023-12-22T09:16:58.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.340+0000 7f33b8f38640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f339806a460 0x7f339806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.341+0000 7f33b8f38640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f339806a460 0x7f339806c920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f33a4006fd0 tx=0x7f33a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:58.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.344+0000 7f33b17fa640 1 -- 172.21.15.106:0/2240591354 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f33b406b510 con 0x7f33b40bd700 2023-12-22T09:16:58.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.524+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33b40bd420 con 0x7f33b40bd700 2023-12-22T09:16:58.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.527+0000 7f33b17fa640 1 -- 172.21.15.106:0/2240591354 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16309 (secure 0 0 0) 0x7f33b40bd420 con 0x7f33b40bd700 2023-12-22T09:16:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:58.528 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":58,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:58.095444+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:16:55.972567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-22T09:16:57.103965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:58.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f339806a460 msgr2=0x7f339806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f339806a460 0x7f339806c920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f33a4006fd0 tx=0x7f33a4008040 comp rx=0 tx=0).stop 2023-12-22T09:16:58.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33b40bd700 msgr2=0x7f33b40bdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33b40bd700 0x7f33b40bdb90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f33ac006fd0 tx=0x7f33ac00e770 comp rx=0 tx=0).stop 2023-12-22T09:16:58.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 shutdown_connections 2023-12-22T09:16:58.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f339806a460 0x7f339806c920 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33b40bd700 0x7f33b40bdb90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b40bfea0 0x7f33b40aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 --2- 172.21.15.106:0/2240591354 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3394003fa0 0x7f33b414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 >> 172.21.15.106:0/2240591354 conn(0x7f33b40ab1a0 msgr2=0x7f33b40ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:58.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 shutdown_connections 2023-12-22T09:16:58.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.529+0000 7f33bb19c640 1 -- 172.21.15.106:0/2240591354 wait complete. 2023-12-22T09:16:58.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:16:58.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.755+0000 7f2d5afc9640 1 Processor -- start 2023-12-22T09:16:58.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.755+0000 7f2d5afc9640 1 -- start start 2023-12-22T09:16:58.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.756+0000 7f2d5afc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d540bfce0 0x7f2d5406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.756+0000 7f2d5afc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d54151b30 0x7f2d54151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.756+0000 7f2d5afc9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d540bf770 con 0x7f2d5413b060 2023-12-22T09:16:58.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.756+0000 7f2d5afc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d54155120 con 0x7f2d54151b30 2023-12-22T09:16:58.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.756+0000 7f2d5afc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54155400 con 0x7f2d540bfce0 2023-12-22T09:16:58.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d58d65640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2d5413b060 0x7f2d54069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59714/0 (socket says 172.21.15.106:59714) 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d58d65640 1 -- 172.21.15.106:0/2877816297 learned_addr learned my addr 172.21.15.106:0/2877816297 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337842631 0 0) 0x7f2d540bf770 con 0x7f2d5413b060 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d3c003520 con 0x7f2d5413b060 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4bfff640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d540bfce0 0x7f2d5406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d59566640 1 --2- 172.21.15.106:0/2877816297 >> v2:172.21.15.132:3300/0 conn(0x7f2d54151b30 0x7f2d54151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1354355066 0 0) 0x7f2d3c003520 con 0x7f2d5413b060 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d540bfce0 msgr2=0x7f2d5406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d540bfce0 0x7f2d5406a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 >> v2:172.21.15.132:3300/0 conn(0x7f2d54151b30 msgr2=0x7f2d54151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:58.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 --2- 172.21.15.106:0/2877816297 >> v2:172.21.15.132:3300/0 conn(0x7f2d54151b30 0x7f2d54151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d541556e0 con 0x7f2d5413b060 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f2d50001b70 con 0x7f2d5413b060 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 >> v1:172.21.15.106:6789/0 conn(0x7f2d5413b060 legacy=0x7f2d54069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c003970 0x7f2d3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d3c0047c0 0x7f2d3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d3c005180 0x7f2d3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.757+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54155120 con 0x7f2d3c005180 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54155400 con 0x7f2d3c0047c0 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c00c050 con 0x7f2d3c003970 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d59566640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d3c005180 0x7f2d3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d4bfff640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d3c0047c0 0x7f2d3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d58d65640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c003970 0x7f2d3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d59566640 1 -- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c003970 msgr2=0x7f2d3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:58.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d59566640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c003970 0x7f2d3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d59566640 1 -- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d3c0047c0 msgr2=0x7f2d3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:58.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d59566640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d3c0047c0 0x7f2d3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d59566640 1 -- 172.21.15.106:0/2877816297 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c003520 con 0x7f2d3c005180 2023-12-22T09:16:58.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d58d65640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c003970 0x7f2d3c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:58.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.758+0000 7f2d4bfff640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d3c0047c0 0x7f2d3c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:16:58.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.759+0000 7f2d59566640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d3c005180 0x7f2d3c00b980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00ba30 tx=0x7f2d3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d1484f0e7faff8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:58.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.759+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c032680 con 0x7f2d3c005180 2023-12-22T09:16:58.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.759+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0327e0 con 0x7f2d3c005180 2023-12-22T09:16:58.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.759+0000 7f2d4b7fe640 1 -- 172.21.15.106:0/2877816297 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c032b70 con 0x7f2d3c005180 2023-12-22T09:16:58.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.760+0000 7f2d5afc9640 1 -- 172.21.15.106:0/2877816297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d3c005180 msgr2=0x7f2d3c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.760+0000 7f2d5afc9640 1 --2- 172.21.15.106:0/2877816297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d3c005180 0x7f2d3c00b980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00ba30 tx=0x7f2d3c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.760+0000 7f2d59566640 1 -- 172.21.15.106:0/2877816297 reap_dead start 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.760+0000 7f2d5afc9640 1 -- 172.21.15.106:0/2877816297 shutdown_connections 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.760+0000 7f2d5afc9640 1 -- 172.21.15.106:0/2877816297 >> 172.21.15.106:0/2877816297 conn(0x7f2d540c5360 msgr2=0x7f2d540c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.760+0000 7f2d5afc9640 1 -- 172.21.15.106:0/2877816297 shutdown_connections 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.760+0000 7f2d5afc9640 1 -- 172.21.15.106:0/2877816297 wait complete. 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.762+0000 7f2d5afc9640 1 Processor -- start 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.762+0000 7f2d5afc9640 1 -- start start 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d5afc9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c005180 0x7f2d541ea240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d5afc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d540bf1e0 0x7f2d540be040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d5afc9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d540be580 0x7f2d54152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d5afc9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d540becb0 con 0x7f2d540be580 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d5afc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54151400 con 0x7f2d540bf1e0 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d5afc9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d541eaa80 con 0x7f2d3c005180 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d59566640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d540be580 0x7f2d54152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d59566640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d540be580 0x7f2d54152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43676/0 (socket says 172.21.15.106:43676) 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d59566640 1 -- 172.21.15.106:0/3882935821 learned_addr learned my addr 172.21.15.106:0/3882935821 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d58d65640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c005180 0x7f2d541ea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.763+0000 7f2d4bfff640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d540bf1e0 0x7f2d540be040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d59566640 1 -- 172.21.15.106:0/3882935821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c005180 msgr2=0x7f2d541ea240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d59566640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c005180 0x7f2d541ea240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d59566640 1 -- 172.21.15.106:0/3882935821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d540bf1e0 msgr2=0x7f2d540be040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d59566640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d540bf1e0 0x7f2d540be040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d59566640 1 -- 172.21.15.106:0/3882935821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d541ead60 con 0x7f2d540be580 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d59566640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d540be580 0x7f2d54152fb0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c02bfd0 tx=0x7f2d4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:58.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d497fa640 1 -- 172.21.15.106:0/3882935821 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c004020 con 0x7f2d540be580 2023-12-22T09:16:58.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d497fa640 1 -- 172.21.15.106:0/3882935821 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c004180 con 0x7f2d540be580 2023-12-22T09:16:58.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d497fa640 1 -- 172.21.15.106:0/3882935821 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0044f0 con 0x7f2d540be580 2023-12-22T09:16:58.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d54151650 con 0x7f2d540be580 2023-12-22T09:16:58.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.764+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d54154bf0 con 0x7f2d540be580 2023-12-22T09:16:58.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.765+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d54155ee0 con 0x7f2d540be580 2023-12-22T09:16:58.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.766+0000 7f2d497fa640 1 -- 172.21.15.106:0/3882935821 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d4c03b630 con 0x7f2d540be580 2023-12-22T09:16:58.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.767+0000 7f2d497fa640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2d4006a460 0x7f2d4006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:58.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.767+0000 7f2d497fa640 1 -- 172.21.15.106:0/3882935821 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2d4c0aabb0 con 0x7f2d540be580 2023-12-22T09:16:58.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.767+0000 7f2d58d65640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2d4006a460 0x7f2d4006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:58.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.768+0000 7f2d58d65640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2d4006a460 0x7f2d4006c920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2d50001550 tx=0x7f2d50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:58.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.771+0000 7f2d497fa640 1 -- 172.21.15.106:0/3882935821 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d4c076050 con 0x7f2d540be580 2023-12-22T09:16:58.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.960+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d54073f10 con 0x7f2d540be580 2023-12-22T09:16:58.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.963+0000 7f2d497fa640 1 -- 172.21.15.106:0/3882935821 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16309 (secure 0 0 0) 0x7f2d4c079670 con 0x7f2d540be580 2023-12-22T09:16:58.964 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:16:58.964 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":58,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:58.095444+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:16:55.972567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-22T09:16:57.103965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2d4006a460 msgr2=0x7f2d4006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2d4006a460 0x7f2d4006c920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2d50001550 tx=0x7f2d50009040 comp rx=0 tx=0).stop 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d540be580 msgr2=0x7f2d54152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d540be580 0x7f2d54152fb0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c02bfd0 tx=0x7f2d4c004730 comp rx=0 tx=0).stop 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 shutdown_connections 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2d4006a460 0x7f2d4006c920 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d540be580 0x7f2d54152fb0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d540bf1e0 0x7f2d540be040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 --2- 172.21.15.106:0/3882935821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d3c005180 0x7f2d541ea240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:58.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 >> 172.21.15.106:0/3882935821 conn(0x7f2d540c5360 msgr2=0x7f2d540aa720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:58.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 shutdown_connections 2023-12-22T09:16:58.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:58.966+0000 7f2d5afc9640 1 -- 172.21.15.106:0/3882935821 wait complete. 2023-12-22T09:16:58.985 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T09:16:59.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.199+0000 7f7728c84640 1 Processor -- start 2023-12-22T09:16:59.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.199+0000 7f7728c84640 1 -- start start 2023-12-22T09:16:59.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.200+0000 7f7728c84640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f77240c5ca0 0x7f7724150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:59.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.201+0000 7f7728c84640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7724070000 con 0x7f7724071e30 2023-12-22T09:16:59.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.201+0000 7f7728c84640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240702e0 con 0x7f772406bdc0 2023-12-22T09:16:59.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.201+0000 7f7728c84640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77240705c0 con 0x7f77240c5ca0 2023-12-22T09:16:59.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.201+0000 7f772259c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f77240c5ca0 0x7f7724150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:59.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.201+0000 7f7721d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7724071e30 0x7f77240710a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59726/0 (socket says 172.21.15.106:59726) 2023-12-22T09:16:59.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.201+0000 7f7721d9b640 1 -- 172.21.15.106:0/3906872623 learned_addr learned my addr 172.21.15.106:0/3906872623 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:16:59.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.201+0000 7f772259c640 1 -- 172.21.15.106:0/3906872623 >> v1:172.21.15.132:6789/0 conn(0x7f772406bdc0 legacy=0x7f772414a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:16:59.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.201+0000 7f772259c640 1 -- 172.21.15.106:0/3906872623 >> v1:172.21.15.106:6789/0 conn(0x7f7724071e30 legacy=0x7f77240710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:59.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.201+0000 7f772259c640 1 -- 172.21.15.106:0/3906872623 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240708a0 con 0x7f77240c5ca0 2023-12-22T09:16:59.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.202+0000 7f772259c640 1 --2- 172.21.15.106:0/3906872623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77240c5ca0 0x7f7724150af0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f771c009d90 tx=0x7f771c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed7a727a4e1e5fb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:59.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f772159a640 1 -- 172.21.15.106:0/3906872623 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c02cbd0 con 0x7f77240c5ca0 2023-12-22T09:16:59.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f772159a640 1 -- 172.21.15.106:0/3906872623 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c02cd30 con 0x7f77240c5ca0 2023-12-22T09:16:59.203 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f772159a640 1 -- 172.21.15.106:0/3906872623 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c02cea0 con 0x7f77240c5ca0 2023-12-22T09:16:59.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f7728c84640 1 -- 172.21.15.106:0/3906872623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77240c5ca0 msgr2=0x7f7724150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:59.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f7728c84640 1 --2- 172.21.15.106:0/3906872623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77240c5ca0 0x7f7724150af0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f771c009d90 tx=0x7f771c02be20 comp rx=0 tx=0).stop 2023-12-22T09:16:59.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f7728c84640 1 -- 172.21.15.106:0/3906872623 shutdown_connections 2023-12-22T09:16:59.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f7728c84640 1 --2- 172.21.15.106:0/3906872623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77240c5ca0 0x7f7724150af0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:59.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f7728c84640 1 -- 172.21.15.106:0/3906872623 >> 172.21.15.106:0/3906872623 conn(0x7f772406a220 msgr2=0x7f77240c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:16:59.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f7728c84640 1 -- 172.21.15.106:0/3906872623 shutdown_connections 2023-12-22T09:16:59.204 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.203+0000 7f7728c84640 1 -- 172.21.15.106:0/3906872623 wait complete. 2023-12-22T09:16:59.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.205+0000 7f7728c84640 1 Processor -- start 2023-12-22T09:16:59.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.205+0000 7f7728c84640 1 -- start start 2023-12-22T09:16:59.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.206+0000 7f7728c84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f772406bdc0 0x7f77240becd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:59.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.206+0000 7f7728c84640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724071e30 0x7f77241ec040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:59.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.206+0000 7f7728c84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77240c5ca0 0x7f77241ec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:59.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.206+0000 7f7728c84640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241ecbf0 con 0x7f7724071e30 2023-12-22T09:16:59.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.206+0000 7f7728c84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240bf210 con 0x7f77240c5ca0 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.206+0000 7f7728c84640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77241ece90 con 0x7f772406bdc0 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.206+0000 7f7721d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724071e30 0x7f77241ec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f7721d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724071e30 0x7f77241ec040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43684/0 (socket says 172.21.15.106:43684) 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f7721d9b640 1 -- 172.21.15.106:0/20628118 learned_addr learned my addr 172.21.15.106:0/20628118 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f772259c640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f772406bdc0 0x7f77240becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f7722d9d640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77240c5ca0 0x7f77241ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f7721d9b640 1 -- 172.21.15.106:0/20628118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f772406bdc0 msgr2=0x7f77240becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f7721d9b640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f772406bdc0 0x7f77240becd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f7721d9b640 1 -- 172.21.15.106:0/20628118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77240c5ca0 msgr2=0x7f77241ec580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f7721d9b640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77240c5ca0 0x7f77241ec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:16:59.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f7721d9b640 1 -- 172.21.15.106:0/20628118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c009a70 con 0x7f7724071e30 2023-12-22T09:16:59.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f7721d9b640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724071e30 0x7f77241ec040 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c4d0 tx=0x7f770c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:59.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.207+0000 7f771affd640 1 -- 172.21.15.106:0/20628118 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c005ce0 con 0x7f7724071e30 2023-12-22T09:16:59.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.208+0000 7f771affd640 1 -- 172.21.15.106:0/20628118 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c005e40 con 0x7f7724071e30 2023-12-22T09:16:59.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.208+0000 7f771affd640 1 -- 172.21.15.106:0/20628118 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c007270 con 0x7f7724071e30 2023-12-22T09:16:59.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.208+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7724154a40 con 0x7f7724071e30 2023-12-22T09:16:59.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.208+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77240c29f0 con 0x7f7724071e30 2023-12-22T09:16:59.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.209+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7724073f10 con 0x7f7724071e30 2023-12-22T09:16:59.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.210+0000 7f771affd640 1 -- 172.21.15.106:0/20628118 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f770c0073d0 con 0x7f7724071e30 2023-12-22T09:16:59.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.211+0000 7f771affd640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f770406a430 0x7f770406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:16:59.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.211+0000 7f771affd640 1 -- 172.21.15.106:0/20628118 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f770c087e20 con 0x7f7724071e30 2023-12-22T09:16:59.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.211+0000 7f772259c640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f770406a430 0x7f770406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:16:59.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.211+0000 7f772259c640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f770406a430 0x7f770406c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f771c036000 tx=0x7f771c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:16:59.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.215+0000 7f771affd640 1 -- 172.21.15.106:0/20628118 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f770c053370 con 0x7f7724071e30 2023-12-22T09:16:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:16:59.442+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f772406b230 con 0x7f7724071e30 2023-12-22T09:17:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.109+0000 7f771affd640 1 -- 172.21.15.106:0/20628118 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f770c017020 con 0x7f7724071e30 2023-12-22T09:17:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f770406a430 msgr2=0x7f770406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f770406a430 0x7f770406c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f771c036000 tx=0x7f771c030000 comp rx=0 tx=0).stop 2023-12-22T09:17:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724071e30 msgr2=0x7f77241ec040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724071e30 0x7f77241ec040 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c4d0 tx=0x7f770c00c990 comp rx=0 tx=0).stop 2023-12-22T09:17:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 shutdown_connections 2023-12-22T09:17:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f770406a430 0x7f770406c8f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77240c5ca0 0x7f77241ec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7724071e30 0x7f77241ec040 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 --2- 172.21.15.106:0/20628118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f772406bdc0 0x7f77240becd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 >> 172.21.15.106:0/20628118 conn(0x7f772406a220 msgr2=0x7f77240c4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 shutdown_connections 2023-12-22T09:17:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.113+0000 7f7728c84640 1 -- 172.21.15.106:0/20628118 wait complete. 2023-12-22T09:17:00.135 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T09:17:00.135 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T09:17:00.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.352+0000 7fc36d7ab640 1 Processor -- start 2023-12-22T09:17:00.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.352+0000 7fc36d7ab640 1 -- start start 2023-12-22T09:17:00.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.353+0000 7fc36d7ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc368151630 0x7fc3680c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:00.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.353+0000 7fc36d7ab640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc36806fc30 0x7fc368157360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:00.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.353+0000 7fc36d7ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc368154960 con 0x7fc3680c1f50 2023-12-22T09:17:00.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.353+0000 7fc36d7ab640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3680c3dd0 con 0x7fc36806fc30 2023-12-22T09:17:00.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.353+0000 7fc36d7ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc368157fb0 con 0x7fc368151630 2023-12-22T09:17:00.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.354+0000 7fc3667fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc36806fc30 0x7fc368157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:00.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.354+0000 7fc3667fc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc36806fc30 0x7fc368157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43694/0 (socket says 172.21.15.106:43694) 2023-12-22T09:17:00.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.354+0000 7fc3667fc640 1 -- 172.21.15.106:0/1204325532 learned_addr learned my addr 172.21.15.106:0/1204325532 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:00.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.354+0000 7fc3667fc640 1 -- 172.21.15.106:0/1204325532 >> v2:172.21.15.132:3300/0 conn(0x7fc368151630 msgr2=0x7fc3680c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:00.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.354+0000 7fc3667fc640 1 --2- 172.21.15.106:0/1204325532 >> v2:172.21.15.132:3300/0 conn(0x7fc368151630 0x7fc3680c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:00.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.354+0000 7fc3667fc640 1 -- 172.21.15.106:0/1204325532 >> v1:172.21.15.132:6789/0 conn(0x7fc3680c1f50 legacy=0x7fc3681578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:00.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.354+0000 7fc3667fc640 1 -- 172.21.15.106:0/1204325532 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680c3810 con 0x7fc36806fc30 2023-12-22T09:17:00.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.355+0000 7fc3667fc640 1 --2- 172.21.15.106:0/1204325532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 0x7fc368157360 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc36806dbb0 tx=0x7fc35002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b067dd3224ba88 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:00.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.355+0000 7fc365ffb640 1 -- 172.21.15.106:0/1204325532 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350031870 con 0x7fc36806fc30 2023-12-22T09:17:00.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.355+0000 7fc365ffb640 1 -- 172.21.15.106:0/1204325532 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3500319d0 con 0x7fc36806fc30 2023-12-22T09:17:00.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.355+0000 7fc365ffb640 1 -- 172.21.15.106:0/1204325532 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350031d60 con 0x7fc36806fc30 2023-12-22T09:17:00.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.356+0000 7fc36d7ab640 1 -- 172.21.15.106:0/1204325532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 msgr2=0x7fc368157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:00.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.356+0000 7fc36d7ab640 1 --2- 172.21.15.106:0/1204325532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 0x7fc368157360 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc36806dbb0 tx=0x7fc35002b910 comp rx=0 tx=0).stop 2023-12-22T09:17:00.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.356+0000 7fc36d7ab640 1 -- 172.21.15.106:0/1204325532 shutdown_connections 2023-12-22T09:17:00.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.356+0000 7fc36d7ab640 1 --2- 172.21.15.106:0/1204325532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 0x7fc368157360 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:00.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.356+0000 7fc36d7ab640 1 --2- 172.21.15.106:0/1204325532 >> v2:172.21.15.132:3300/0 conn(0x7fc368151630 0x7fc3680c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:00.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.356+0000 7fc36d7ab640 1 -- 172.21.15.106:0/1204325532 >> 172.21.15.106:0/1204325532 conn(0x7fc3680a9160 msgr2=0x7fc3680a9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:00.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.356+0000 7fc36d7ab640 1 -- 172.21.15.106:0/1204325532 shutdown_connections 2023-12-22T09:17:00.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.356+0000 7fc36d7ab640 1 -- 172.21.15.106:0/1204325532 wait complete. 2023-12-22T09:17:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.359+0000 7fc36d7ab640 1 Processor -- start 2023-12-22T09:17:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.359+0000 7fc36d7ab640 1 -- start start 2023-12-22T09:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.360+0000 7fc36d7ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 0x7fc3680c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.360+0000 7fc36d7ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3680c1f50 0x7fc36814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.360+0000 7fc36d7ab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc368151630 0x7fc36814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.360+0000 7fc36d7ab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc368150390 con 0x7fc36806fc30 2023-12-22T09:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.360+0000 7fc36d7ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680ac230 con 0x7fc3680c1f50 2023-12-22T09:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.360+0000 7fc36d7ab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680aad90 con 0x7fc368151630 2023-12-22T09:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.360+0000 7fc366ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 0x7fc3680c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.360+0000 7fc366ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 0x7fc3680c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43698/0 (socket says 172.21.15.106:43698) 2023-12-22T09:17:00.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.360+0000 7fc366ffd640 1 -- 172.21.15.106:0/2792770200 learned_addr learned my addr 172.21.15.106:0/2792770200 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc3667fc640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3680c1f50 0x7fc36814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc3677fe640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc368151630 0x7fc36814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc366ffd640 1 -- 172.21.15.106:0/2792770200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc368151630 msgr2=0x7fc36814fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc366ffd640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc368151630 0x7fc36814fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc366ffd640 1 -- 172.21.15.106:0/2792770200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3680c1f50 msgr2=0x7fc36814f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc366ffd640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3680c1f50 0x7fc36814f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc366ffd640 1 -- 172.21.15.106:0/2792770200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3500094d0 con 0x7fc36806fc30 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc3677fe640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc368151630 0x7fc36814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc366ffd640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 0x7fc3680c69f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc35800ba50 tx=0x7fc35800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc35f7fe640 1 -- 172.21.15.106:0/2792770200 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800cbe0 con 0x7fc36806fc30 2023-12-22T09:17:00.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc35f7fe640 1 -- 172.21.15.106:0/2792770200 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35800cd60 con 0x7fc36806fc30 2023-12-22T09:17:00.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.361+0000 7fc35f7fe640 1 -- 172.21.15.106:0/2792770200 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358014680 con 0x7fc36806fc30 2023-12-22T09:17:00.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.362+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3681ed2f0 con 0x7fc36806fc30 2023-12-22T09:17:00.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.362+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3680ac630 con 0x7fc36806fc30 2023-12-22T09:17:00.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.363+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3681523c0 con 0x7fc36806fc30 2023-12-22T09:17:00.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.364+0000 7fc35f7fe640 1 -- 172.21.15.106:0/2792770200 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc35801d3b0 con 0x7fc36806fc30 2023-12-22T09:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.364+0000 7fc35f7fe640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc34806a430 0x7fc34806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.365+0000 7fc35f7fe640 1 -- 172.21.15.106:0/2792770200 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc3580889c0 con 0x7fc36806fc30 2023-12-22T09:17:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.365+0000 7fc3667fc640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc34806a430 0x7fc34806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.365+0000 7fc3667fc640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc34806a430 0x7fc34806c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc350036000 tx=0x7fc35003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.369+0000 7fc35f7fe640 1 -- 172.21.15.106:0/2792770200 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc358053f00 con 0x7fc36806fc30 2023-12-22T09:17:00.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:00.594+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc368073f10 con 0x7fc36806fc30 2023-12-22T09:17:01.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.113+0000 7fc35f7fe640 1 -- 172.21.15.106:0/2792770200 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc358019020 con 0x7fc36806fc30 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.116+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc34806a430 msgr2=0x7fc34806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.116+0000 7fc36d7ab640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc34806a430 0x7fc34806c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc350036000 tx=0x7fc35003c040 comp rx=0 tx=0).stop 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.116+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 msgr2=0x7fc3680c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.117+0000 7fc36d7ab640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 0x7fc3680c69f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc35800ba50 tx=0x7fc35800bf10 comp rx=0 tx=0).stop 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.117+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 shutdown_connections 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.117+0000 7fc36d7ab640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc34806a430 0x7fc34806c8f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.117+0000 7fc36d7ab640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc368151630 0x7fc36814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.117+0000 7fc36d7ab640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3680c1f50 0x7fc36814f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.117+0000 7fc36d7ab640 1 --2- 172.21.15.106:0/2792770200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc36806fc30 0x7fc3680c69f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.117+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 >> 172.21.15.106:0/2792770200 conn(0x7fc3680a9160 msgr2=0x7fc3681526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.117+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 shutdown_connections 2023-12-22T09:17:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.117+0000 7fc36d7ab640 1 -- 172.21.15.106:0/2792770200 wait complete. 2023-12-22T09:17:01.171 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T09:17:01.171 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:17:01.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.390+0000 7f9bde57e640 1 Processor -- start 2023-12-22T09:17:01.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.390+0000 7f9bde57e640 1 -- start start 2023-12-22T09:17:01.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bde57e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd80a8150 0x7f9bd8070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bde57e640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9bd80c16f0 0x7f9bd8071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bde57e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd8152300 con 0x7f9bd814f050 2023-12-22T09:17:01.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bde57e640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd814f430 con 0x7f9bd80c16f0 2023-12-22T09:17:01.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bde57e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd81519f0 con 0x7f9bd80a8150 2023-12-22T09:17:01.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bddd7d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9bd80c16f0 0x7f9bd8071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bddd7d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9bd80c16f0 0x7f9bd8071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43710/0 (socket says 172.21.15.106:43710) 2023-12-22T09:17:01.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bddd7d640 1 -- 172.21.15.106:0/2561959974 learned_addr learned my addr 172.21.15.106:0/2561959974 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:01.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bdcd7b640 1 --2- 172.21.15.106:0/2561959974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd80a8150 0x7f9bd8070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bddd7d640 1 -- 172.21.15.106:0/2561959974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd80a8150 msgr2=0x7f9bd8070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:01.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bddd7d640 1 --2- 172.21.15.106:0/2561959974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd80a8150 0x7f9bd8070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bddd7d640 1 -- 172.21.15.106:0/2561959974 >> v1:172.21.15.132:6789/0 conn(0x7f9bd814f050 legacy=0x7f9bd80c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:01.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.391+0000 7f9bddd7d640 1 -- 172.21.15.106:0/2561959974 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80c0860 con 0x7f9bd80c16f0 2023-12-22T09:17:01.393 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bddd7d640 1 --2- 172.21.15.106:0/2561959974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 0x7f9bd8071340 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009e50 tx=0x7f9bd002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ea903ab59e01a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:01.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bcffff640 1 -- 172.21.15.106:0/2561959974 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd002c9e0 con 0x7f9bd80c16f0 2023-12-22T09:17:01.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bcffff640 1 -- 172.21.15.106:0/2561959974 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd002cb40 con 0x7f9bd80c16f0 2023-12-22T09:17:01.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bcffff640 1 -- 172.21.15.106:0/2561959974 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd00343f0 con 0x7f9bd80c16f0 2023-12-22T09:17:01.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bde57e640 1 -- 172.21.15.106:0/2561959974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 msgr2=0x7f9bd8071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bde57e640 1 --2- 172.21.15.106:0/2561959974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 0x7f9bd8071340 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009e50 tx=0x7f9bd002be40 comp rx=0 tx=0).stop 2023-12-22T09:17:01.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bde57e640 1 -- 172.21.15.106:0/2561959974 shutdown_connections 2023-12-22T09:17:01.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bde57e640 1 --2- 172.21.15.106:0/2561959974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 0x7f9bd8071340 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bde57e640 1 --2- 172.21.15.106:0/2561959974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd80a8150 0x7f9bd8070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bde57e640 1 -- 172.21.15.106:0/2561959974 >> 172.21.15.106:0/2561959974 conn(0x7f9bd8069dd0 msgr2=0x7f9bd806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:01.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bde57e640 1 -- 172.21.15.106:0/2561959974 shutdown_connections 2023-12-22T09:17:01.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.394+0000 7f9bde57e640 1 -- 172.21.15.106:0/2561959974 wait complete. 2023-12-22T09:17:01.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.397+0000 7f9bde57e640 1 Processor -- start 2023-12-22T09:17:01.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.397+0000 7f9bde57e640 1 -- start start 2023-12-22T09:17:01.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bde57e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bd80a8150 0x7f9bd81ea620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bde57e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 0x7f9bd81467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bde57e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd814f050 0x7f9bd8146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bde57e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd81ea1d0 con 0x7f9bd80c16f0 2023-12-22T09:17:01.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bde57e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd81eae60 con 0x7f9bd80a8150 2023-12-22T09:17:01.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bde57e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80c5ac0 con 0x7f9bd814f050 2023-12-22T09:17:01.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdcd7b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 0x7f9bd81467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdcd7b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 0x7f9bd81467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43716/0 (socket says 172.21.15.106:43716) 2023-12-22T09:17:01.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdcd7b640 1 -- 172.21.15.106:0/2777534760 learned_addr learned my addr 172.21.15.106:0/2777534760 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:01.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdd57c640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bd80a8150 0x7f9bd81ea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bddd7d640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd814f050 0x7f9bd8146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdcd7b640 1 -- 172.21.15.106:0/2777534760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd814f050 msgr2=0x7f9bd8146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdcd7b640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd814f050 0x7f9bd8146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdcd7b640 1 -- 172.21.15.106:0/2777534760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bd80a8150 msgr2=0x7f9bd81ea620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdcd7b640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bd80a8150 0x7f9bd81ea620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdcd7b640 1 -- 172.21.15.106:0/2777534760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd0009b30 con 0x7f9bd80c16f0 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdd57c640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bd80a8150 0x7f9bd81ea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bdcd7b640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 0x7f9bd81467f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800d800 tx=0x7f9bc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bcdffb640 1 -- 172.21.15.106:0/2777534760 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800b6c0 con 0x7f9bd80c16f0 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bcdffb640 1 -- 172.21.15.106:0/2777534760 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc800b820 con 0x7f9bd80c16f0 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bcdffb640 1 -- 172.21.15.106:0/2777534760 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800bbb0 con 0x7f9bd80c16f0 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.398+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd81eb100 con 0x7f9bd80c16f0 2023-12-22T09:17:01.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.399+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd80c5d80 con 0x7f9bd80c16f0 2023-12-22T09:17:01.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.401+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd81eb340 con 0x7f9bd80c16f0 2023-12-22T09:17:01.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.401+0000 7f9bcdffb640 1 -- 172.21.15.106:0/2777534760 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9bc800bd10 con 0x7f9bd80c16f0 2023-12-22T09:17:01.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.402+0000 7f9bcdffb640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9bbc06a430 0x7f9bbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.402+0000 7f9bcdffb640 1 -- 172.21.15.106:0/2777534760 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9bc8088f70 con 0x7f9bd80c16f0 2023-12-22T09:17:01.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.402+0000 7f9bdd57c640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9bbc06a430 0x7f9bbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.402+0000 7f9bdd57c640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9bbc06a430 0x7f9bbc06c8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400a830 tx=0x7f9bd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:01.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.406+0000 7f9bcdffb640 1 -- 172.21.15.106:0/2777534760 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9bc8054410 con 0x7f9bd80c16f0 2023-12-22T09:17:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.636+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bd804e8d0 con 0x7f9bd80c16f0 2023-12-22T09:17:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.637+0000 7f9bcdffb640 1 -- 172.21.15.106:0/2777534760 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f9bc8057a30 con 0x7f9bd80c16f0 2023-12-22T09:17:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:01.637 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/3487360091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3487360091},{"type":"v1","addr":"172.21.15.132:6834","nonce":3487360091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2434839099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2434839099},{"type":"v1","addr":"172.21.15.132:6835","nonce":2434839099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1984802419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1984802419},{"type":"v1","addr":"172.21.15.106:6836","nonce":1984802419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:58.096259+0000","modified":"2023-12-22T09:17:01.107058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/520784305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":520784305},{"type":"v1","addr":"172.21.15.106:6837","nonce":520784305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-22T09:17:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 30 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.639+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9bbc06a430 msgr2=0x7f9bbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.639+0000 7f9bde57e640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9bbc06a430 0x7f9bbc06c8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400a830 tx=0x7f9bd4008040 comp rx=0 tx=0).stop 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.639+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 msgr2=0x7f9bd81467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.639+0000 7f9bde57e640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 0x7f9bd81467f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800d800 tx=0x7f9bc800dcc0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.640+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 shutdown_connections 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.640+0000 7f9bde57e640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f9bbc06a430 0x7f9bbc06c8f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.640+0000 7f9bde57e640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9bd814f050 0x7f9bd8146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.640+0000 7f9bde57e640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bd80c16f0 0x7f9bd81467f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.640+0000 7f9bde57e640 1 --2- 172.21.15.106:0/2777534760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9bd80a8150 0x7f9bd81ea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.640+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 >> 172.21.15.106:0/2777534760 conn(0x7f9bd8069dd0 msgr2=0x7f9bd814a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.640+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 shutdown_connections 2023-12-22T09:17:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.640+0000 7f9bde57e640 1 -- 172.21.15.106:0/2777534760 wait complete. 2023-12-22T09:17:01.659 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:17:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.871+0000 7f376cd8e640 1 Processor -- start 2023-12-22T09:17:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.871+0000 7f376cd8e640 1 -- start start 2023-12-22T09:17:01.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.873+0000 7f376cd8e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37680c4100 0x7f37681571a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.873+0000 7f376cd8e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768154360 0x7f3768154790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.873+0000 7f376cd8e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37680c4bf0 con 0x7f37680c7410 2023-12-22T09:17:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.873+0000 7f376cd8e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37680c5e20 con 0x7f37680c4100 2023-12-22T09:17:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.873+0000 7f376cd8e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3768153c30 con 0x7f3768154360 2023-12-22T09:17:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.873+0000 7f375ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f37680c7410 0x7f37680c44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59734/0 (socket says 172.21.15.106:59734) 2023-12-22T09:17:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.873+0000 7f375ffff640 1 -- 172.21.15.106:0/2916598172 learned_addr learned my addr 172.21.15.106:0/2916598172 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.873+0000 7f37677fe640 1 --2- 172.21.15.106:0/2916598172 >> v2:172.21.15.132:3300/0 conn(0x7f37680c4100 0x7f37681571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272097194 0 0) 0x7f37680c4bf0 con 0x7f37680c7410 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3767fff640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768154360 0x7f3768154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3754003520 con 0x7f37680c7410 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 584065303 0 0) 0x7f3754003520 con 0x7f37680c7410 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768154360 msgr2=0x7f3768154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768154360 0x7f3768154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 >> v2:172.21.15.132:3300/0 conn(0x7f37680c4100 msgr2=0x7f37681571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 --2- 172.21.15.106:0/2916598172 >> v2:172.21.15.132:3300/0 conn(0x7f37680c4100 0x7f37681571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768153ed0 con 0x7f37680c7410 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f3750001690 con 0x7f37680c7410 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 >> v1:172.21.15.106:6789/0 conn(0x7f37680c7410 legacy=0x7f37680c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3754003970 0x7f3754003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3754004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768154360 0x7f37540051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37680c5e20 con 0x7f37540047c0 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768153c30 con 0x7f3754003970 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375400bb10 con 0x7f3768154360 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.874+0000 7f375ffff640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3754004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.875+0000 7f3767fff640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768154360 0x7f37540051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.875+0000 7f375ffff640 1 -- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768154360 msgr2=0x7f37540051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.875+0000 7f37677fe640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3754003970 0x7f3754003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.875+0000 7f375ffff640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768154360 0x7f37540051a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.875+0000 7f375ffff640 1 -- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3754003970 msgr2=0x7f3754003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.875+0000 7f375ffff640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3754003970 0x7f3754003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.875+0000 7f375ffff640 1 -- 172.21.15.106:0/2916598172 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754003520 con 0x7f37540047c0 2023-12-22T09:17:01.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.876+0000 7f375ffff640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3754004c40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f375000c160 tx=0x7f37540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5eac190f6f3c10 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:01.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.876+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750005ad0 con 0x7f37540047c0 2023-12-22T09:17:01.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.876+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3750005c30 con 0x7f37540047c0 2023-12-22T09:17:01.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.876+0000 7f3766ffd640 1 -- 172.21.15.106:0/2916598172 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375002c810 con 0x7f37540047c0 2023-12-22T09:17:01.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.877+0000 7f376cd8e640 1 -- 172.21.15.106:0/2916598172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 msgr2=0x7f3754004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.877+0000 7f376cd8e640 1 --2- 172.21.15.106:0/2916598172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3754004c40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f375000c160 tx=0x7f37540057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.877+0000 7f3767fff640 1 -- 172.21.15.106:0/2916598172 reap_dead start 2023-12-22T09:17:01.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.877+0000 7f376cd8e640 1 -- 172.21.15.106:0/2916598172 shutdown_connections 2023-12-22T09:17:01.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.877+0000 7f376cd8e640 1 -- 172.21.15.106:0/2916598172 >> 172.21.15.106:0/2916598172 conn(0x7f37680c5f90 msgr2=0x7f37680c63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:01.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.877+0000 7f376cd8e640 1 -- 172.21.15.106:0/2916598172 shutdown_connections 2023-12-22T09:17:01.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.877+0000 7f376cd8e640 1 -- 172.21.15.106:0/2916598172 wait complete. 2023-12-22T09:17:01.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.879+0000 7f376cd8e640 1 Processor -- start 2023-12-22T09:17:01.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.879+0000 7f376cd8e640 1 -- start start 2023-12-22T09:17:01.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f376cd8e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3768155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f376cd8e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768150320 0x7f37680aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f376cd8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37681479c0 0x7f3768147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f376cd8e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768156300 con 0x7f37540047c0 2023-12-22T09:17:01.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f376cd8e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768156120 con 0x7f37681479c0 2023-12-22T09:17:01.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f376cd8e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37681ecff0 con 0x7f3768150320 2023-12-22T09:17:01.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f37677fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3768155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f37677fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3768155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43742/0 (socket says 172.21.15.106:43742) 2023-12-22T09:17:01.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f37677fe640 1 -- 172.21.15.106:0/382826938 learned_addr learned my addr 172.21.15.106:0/382826938 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:01.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f37677fe640 1 -- 172.21.15.106:0/382826938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768150320 msgr2=0x7f37680aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f37677fe640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768150320 0x7f37680aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f3767fff640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37681479c0 0x7f3768147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f37677fe640 1 -- 172.21.15.106:0/382826938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37681479c0 msgr2=0x7f3768147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:01.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f37677fe640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37681479c0 0x7f3768147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:01.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.880+0000 7f37677fe640 1 -- 172.21.15.106:0/382826938 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37681ecb60 con 0x7f37540047c0 2023-12-22T09:17:01.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.881+0000 7f37677fe640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3768155be0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3758010940 tx=0x7f3758010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:01.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.881+0000 7f3764ff9640 1 -- 172.21.15.106:0/382826938 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758009690 con 0x7f37540047c0 2023-12-22T09:17:01.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.881+0000 7f3764ff9640 1 -- 172.21.15.106:0/382826938 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375800ec20 con 0x7f37540047c0 2023-12-22T09:17:01.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.881+0000 7f3764ff9640 1 -- 172.21.15.106:0/382826938 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375801c400 con 0x7f37540047c0 2023-12-22T09:17:01.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.881+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37681ec230 con 0x7f37540047c0 2023-12-22T09:17:01.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.881+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37681ec7f0 con 0x7f37540047c0 2023-12-22T09:17:01.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.882+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376804e8d0 con 0x7f37540047c0 2023-12-22T09:17:01.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.883+0000 7f3764ff9640 1 -- 172.21.15.106:0/382826938 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f375801c560 con 0x7f37540047c0 2023-12-22T09:17:01.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.884+0000 7f3764ff9640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f374806a460 0x7f374806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:01.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.884+0000 7f3764ff9640 1 -- 172.21.15.106:0/382826938 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3758089060 con 0x7f37540047c0 2023-12-22T09:17:01.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.885+0000 7f375ffff640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f374806a460 0x7f374806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:01.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.885+0000 7f375ffff640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f374806a460 0x7f374806c920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f37680c9310 tx=0x7f375002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:01.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:01.889+0000 7f3764ff9640 1 -- 172.21.15.106:0/382826938 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3758054650 con 0x7f37540047c0 2023-12-22T09:17:02.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.083+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37680c8300 con 0x7f37540047c0 2023-12-22T09:17:02.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.086+0000 7f3764ff9640 1 -- 172.21.15.106:0/382826938 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16296 (secure 0 0 0) 0x7f3758057c70 con 0x7f37540047c0 2023-12-22T09:17:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:02.086 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":59,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:59.100239+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:16:55.972567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-22T09:16:57.103965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f374806a460 msgr2=0x7f374806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f374806a460 0x7f374806c920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f37680c9310 tx=0x7f375002e000 comp rx=0 tx=0).stop 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 msgr2=0x7f3768155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3768155be0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3758010940 tx=0x7f3758010e00 comp rx=0 tx=0).stop 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 shutdown_connections 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f374806a460 0x7f374806c920 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37681479c0 0x7f3768147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3768150320 0x7f37680aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 --2- 172.21.15.106:0/382826938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37540047c0 0x7f3768155be0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 >> 172.21.15.106:0/382826938 conn(0x7f37680c5f90 msgr2=0x7f37680c63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 shutdown_connections 2023-12-22T09:17:02.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.089+0000 7f376cd8e640 1 -- 172.21.15.106:0/382826938 wait complete. 2023-12-22T09:17:02.108 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T09:17:02.108 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:17:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.319+0000 7f7f1ae83640 1 Processor -- start 2023-12-22T09:17:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.319+0000 7f7f1ae83640 1 -- start start 2023-12-22T09:17:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.321+0000 7f7f1ae83640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f140aeb90 0x7f7f140c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.321+0000 7f7f1ae83640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7f140c64e0 0x7f7f1406b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.321+0000 7f7f1ae83640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f140c43b0 con 0x7f7f140c7500 2023-12-22T09:17:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.321+0000 7f7f1ae83640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f140aef70 con 0x7f7f140c64e0 2023-12-22T09:17:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.321+0000 7f7f1ae83640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f14154650 con 0x7f7f140aeb90 2023-12-22T09:17:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.321+0000 7f7f1a682640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7f140c64e0 0x7f7f1406b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.321+0000 7f7f19680640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7f140c7500 0x7f7f1406af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59738/0 (socket says 172.21.15.106:59738) 2023-12-22T09:17:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.321+0000 7f7f19680640 1 -- 172.21.15.106:0/138433878 learned_addr learned my addr 172.21.15.106:0/138433878 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.321+0000 7f7f19e81640 1 --2- 172.21.15.106:0/138433878 >> v2:172.21.15.132:3300/0 conn(0x7f7f140aeb90 0x7f7f140c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.322+0000 7f7f1a682640 1 -- 172.21.15.106:0/138433878 >> v2:172.21.15.132:3300/0 conn(0x7f7f140aeb90 msgr2=0x7f7f140c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.322+0000 7f7f1a682640 1 --2- 172.21.15.106:0/138433878 >> v2:172.21.15.132:3300/0 conn(0x7f7f140aeb90 0x7f7f140c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.322+0000 7f7f1a682640 1 -- 172.21.15.106:0/138433878 >> v1:172.21.15.106:6789/0 conn(0x7f7f140c7500 legacy=0x7f7f1406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.322+0000 7f7f1a682640 1 -- 172.21.15.106:0/138433878 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14154b80 con 0x7f7f140c64e0 2023-12-22T09:17:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.322+0000 7f7f18e7f640 1 -- 172.21.15.106:0/138433878 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439551101 0 0) 0x7f7f140c43b0 con 0x7f7f140c7500 2023-12-22T09:17:02.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.323+0000 7f7f1a682640 1 --2- 172.21.15.106:0/138433878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140c64e0 0x7f7f1406b620 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7f140ca630 tx=0x7f7f0c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8236add69ec5549d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:02.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.323+0000 7f7f18e7f640 1 -- 172.21.15.106:0/138433878 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c02cb60 con 0x7f7f140c64e0 2023-12-22T09:17:02.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.323+0000 7f7f18e7f640 1 -- 172.21.15.106:0/138433878 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c02ccc0 con 0x7f7f140c64e0 2023-12-22T09:17:02.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.323+0000 7f7f18e7f640 1 -- 172.21.15.106:0/138433878 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c034660 con 0x7f7f140c64e0 2023-12-22T09:17:02.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.324+0000 7f7f1ae83640 1 -- 172.21.15.106:0/138433878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140c64e0 msgr2=0x7f7f1406b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.324+0000 7f7f1ae83640 1 --2- 172.21.15.106:0/138433878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140c64e0 0x7f7f1406b620 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7f140ca630 tx=0x7f7f0c02bdb0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.324+0000 7f7f1ae83640 1 -- 172.21.15.106:0/138433878 shutdown_connections 2023-12-22T09:17:02.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.324+0000 7f7f1ae83640 1 --2- 172.21.15.106:0/138433878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140c64e0 0x7f7f1406b620 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.324+0000 7f7f1ae83640 1 --2- 172.21.15.106:0/138433878 >> v2:172.21.15.132:3300/0 conn(0x7f7f140aeb90 0x7f7f140c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.324+0000 7f7f1ae83640 1 -- 172.21.15.106:0/138433878 >> 172.21.15.106:0/138433878 conn(0x7f7f140ab120 msgr2=0x7f7f140ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:02.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.324+0000 7f7f1ae83640 1 -- 172.21.15.106:0/138433878 shutdown_connections 2023-12-22T09:17:02.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.324+0000 7f7f1ae83640 1 -- 172.21.15.106:0/138433878 wait complete. 2023-12-22T09:17:02.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.326+0000 7f7f1ae83640 1 Processor -- start 2023-12-22T09:17:02.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.326+0000 7f7f1ae83640 1 -- start start 2023-12-22T09:17:02.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.327+0000 7f7f1ae83640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140aeb90 0x7f7f14157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.327+0000 7f7f1ae83640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f140c64e0 0x7f7f140c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.327+0000 7f7f1ae83640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f140c7500 0x7f7f140c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.327+0000 7f7f1ae83640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140ae010 con 0x7f7f140aeb90 2023-12-22T09:17:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.327+0000 7f7f1ae83640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14154e60 con 0x7f7f140c7500 2023-12-22T09:17:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.327+0000 7f7f1ae83640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14155140 con 0x7f7f140c64e0 2023-12-22T09:17:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.327+0000 7f7f19e81640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140aeb90 0x7f7f14157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.327+0000 7f7f19e81640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140aeb90 0x7f7f14157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43770/0 (socket says 172.21.15.106:43770) 2023-12-22T09:17:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.327+0000 7f7f19e81640 1 -- 172.21.15.106:0/2648475701 learned_addr learned my addr 172.21.15.106:0/2648475701 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f19e81640 1 -- 172.21.15.106:0/2648475701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f140c64e0 msgr2=0x7f7f140c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f19e81640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f140c64e0 0x7f7f140c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f19e81640 1 -- 172.21.15.106:0/2648475701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f140c7500 msgr2=0x7f7f140c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f19e81640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f140c7500 0x7f7f140c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f19e81640 1 -- 172.21.15.106:0/2648475701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c009a70 con 0x7f7f140aeb90 2023-12-22T09:17:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f19e81640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140aeb90 0x7f7f14157950 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000d5f0 tx=0x7f7f1000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f0a7fc640 1 -- 172.21.15.106:0/2648475701 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100125f0 con 0x7f7f140aeb90 2023-12-22T09:17:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f0a7fc640 1 -- 172.21.15.106:0/2648475701 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f10012750 con 0x7f7f140aeb90 2023-12-22T09:17:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f0a7fc640 1 -- 172.21.15.106:0/2648475701 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10012b00 con 0x7f7f140aeb90 2023-12-22T09:17:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f140c1c60 con 0x7f7f140aeb90 2023-12-22T09:17:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.328+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f140c2220 con 0x7f7f140aeb90 2023-12-22T09:17:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.330+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f14073f10 con 0x7f7f140aeb90 2023-12-22T09:17:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.331+0000 7f7f0a7fc640 1 -- 172.21.15.106:0/2648475701 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f10012c60 con 0x7f7f140aeb90 2023-12-22T09:17:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.331+0000 7f7f0a7fc640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7ef806a430 0x7f7ef806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.332+0000 7f7f0a7fc640 1 -- 172.21.15.106:0/2648475701 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f10088ea0 con 0x7f7f140aeb90 2023-12-22T09:17:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.332+0000 7f7f19680640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7ef806a430 0x7f7ef806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.332+0000 7f7f19680640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7ef806a430 0x7f7ef806c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f04007fd0 tx=0x7f7f04007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.336+0000 7f7f0a7fc640 1 -- 172.21.15.106:0/2648475701 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7f10054350 con 0x7f7f140aeb90 2023-12-22T09:17:02.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.521+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f141548a0 con 0x7f7ef806a430 2023-12-22T09:17:02.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.532+0000 7f7f0a7fc640 1 -- 172.21.15.106:0/2648475701 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275690 (secure 0 0 0) 0x7f7f04007070 con 0x7f7ef806a430 2023-12-22T09:17:02.535 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:02.536 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:17:02.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.536+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7ef806a430 msgr2=0x7f7ef806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.536+0000 7f7f1ae83640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7ef806a430 0x7f7ef806c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f04007fd0 tx=0x7f7f04007960 comp rx=0 tx=0).stop 2023-12-22T09:17:02.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140aeb90 msgr2=0x7f7f14157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140aeb90 0x7f7f14157950 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000d5f0 tx=0x7f7f1000dab0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 shutdown_connections 2023-12-22T09:17:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f7ef806a430 0x7f7ef806c8f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f140c7500 0x7f7f140c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7f140c64e0 0x7f7f140c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 --2- 172.21.15.106:0/2648475701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f140aeb90 0x7f7f14157950 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 >> 172.21.15.106:0/2648475701 conn(0x7f7f140ab120 msgr2=0x7f7f14153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 shutdown_connections 2023-12-22T09:17:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.537+0000 7f7f1ae83640 1 -- 172.21.15.106:0/2648475701 wait complete. 2023-12-22T09:17:02.556 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-12-22T09:17:00.747070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":226036,"kb_used_data":6324,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754748684,"statfs":{"total":773094113280,"available":772862652416,"internally_reserved":0,"allocated":6475776,"data_stored":3547193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.146309"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.613971+0000","last_change":"2023-12-22T09:16:56.613971+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.613971+0000","last_undegraded":"2023-12-22T09:16:56.613971+0000","last_fullsized":"2023-12-22T09:16:56.613971+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.605805+0000","last_change":"2023-12-22T09:16:56.605805+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.605805+0000","last_undegraded":"2023-12-22T09:16:56.605805+0000","last_fullsized":"2023-12-22T09:16:56.605805+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:42.697488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.607980+0000","last_change":"2023-12-22T09:16:56.607980+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.607980+0000","last_undegraded":"2023-12-22T09:16:56.607980+0000","last_fullsized":"2023-12-22T09:16:56.607980+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:38.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.605807+0000","last_change":"2023-12-22T09:16:56.605807+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.605807+0000","last_undegraded":"2023-12-22T09:16:56.605807+0000","last_fullsized":"2023-12-22T09:16:56.605807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:55.506978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.609905+0000","last_change":"2023-12-22T09:16:56.609905+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.609905+0000","last_undegraded":"2023-12-22T09:16:56.609905+0000","last_fullsized":"2023-12-22T09:16:56.609905+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:15.308735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.609993+0000","last_change":"2023-12-22T09:16:56.609993+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.609993+0000","last_undegraded":"2023-12-22T09:16:56.609993+0000","last_fullsized":"2023-12-22T09:16:56.609993+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:10.350226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.611158+0000","last_change":"2023-12-22T09:16:56.611158+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.611158+0000","last_undegraded":"2023-12-22T09:16:56.611158+0000","last_fullsized":"2023-12-22T09:16:56.611158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:37:23.822669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:56.581783+0000","last_change":"2023-12-22T09:16:56.581783+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.581783+0000","last_undegraded":"2023-12-22T09:16:56.581783+0000","last_fullsized":"2023-12-22T09:16:56.581783+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.606925+0000","last_change":"2023-12-22T09:16:56.606925+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.606925+0000","last_undegraded":"2023-12-22T09:16:56.606925+0000","last_fullsized":"2023-12-22T09:16:56.606925+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.617509+0000","last_change":"2023-12-22T09:16:56.617509+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.617509+0000","last_undegraded":"2023-12-22T09:16:56.617509+0000","last_fullsized":"2023-12-22T09:16:56.617509+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:48.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.608316+0000","last_change":"2023-12-22T09:16:56.608316+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.608316+0000","last_undegraded":"2023-12-22T09:16:56.608316+0000","last_fullsized":"2023-12-22T09:16:56.608316+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:41:54.745043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.614746+0000","last_change":"2023-12-22T09:16:56.614746+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.614746+0000","last_undegraded":"2023-12-22T09:16:56.614746+0000","last_fullsized":"2023-12-22T09:16:56.614746+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.608480+0000","last_change":"2023-12-22T09:16:56.608480+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.608480+0000","last_undegraded":"2023-12-22T09:16:56.608480+0000","last_fullsized":"2023-12-22T09:16:56.608480+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.620381+0000","last_change":"2023-12-22T09:16:56.620381+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.620381+0000","last_undegraded":"2023-12-22T09:16:56.620381+0000","last_fullsized":"2023-12-22T09:16:56.620381+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:53.090112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.607022+0000","last_change":"2023-12-22T09:16:56.607022+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.607022+0000","last_undegraded":"2023-12-22T09:16:56.607022+0000","last_fullsized":"2023-12-22T09:16:56.607022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.617537+0000","last_change":"2023-12-22T09:16:56.617537+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.617537+0000","last_undegraded":"2023-12-22T09:16:56.617537+0000","last_fullsized":"2023-12-22T09:16:56.617537+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:19:59.812662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.619867+0000","last_change":"2023-12-22T09:16:56.619867+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.619867+0000","last_undegraded":"2023-12-22T09:16:56.619867+0000","last_fullsized":"2023-12-22T09:16:56.619867+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.607252+0000","last_change":"2023-12-22T09:16:56.607252+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.607252+0000","last_undegraded":"2023-12-22T09:16:56.607252+0000","last_fullsized":"2023-12-22T09:16:56.607252+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.607012+0000","last_change":"2023-12-22T09:16:56.607012+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.607012+0000","last_undegraded":"2023-12-22T09:16:56.607012+0000","last_fullsized":"2023-12-22T09:16:56.607012+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:15.191139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.609061+0000","last_change":"2023-12-22T09:16:56.609061+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.609061+0000","last_undegraded":"2023-12-22T09:16:56.609061+0000","last_fullsized":"2023-12-22T09:16:56.609061+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:00.331386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.605887+0000","last_change":"2023-12-22T09:16:56.605887+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.605887+0000","last_undegraded":"2023-12-22T09:16:56.605887+0000","last_fullsized":"2023-12-22T09:16:56.605887+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:42.294395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.617497+0000","last_change":"2023-12-22T09:16:56.617497+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.617497+0000","last_undegraded":"2023-12-22T09:16:56.617497+0000","last_fullsized":"2023-12-22T09:16:56.617497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.605703+0000","last_change":"2023-12-22T09:16:56.605703+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.605703+0000","last_undegraded":"2023-12-22T09:16:56.605703+0000","last_fullsized":"2023-12-22T09:16:56.605703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:13.807363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.618872+0000","last_change":"2023-12-22T09:16:56.618872+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.618872+0000","last_undegraded":"2023-12-22T09:16:56.618872+0000","last_fullsized":"2023-12-22T09:16:56.618872+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.618531+0000","last_change":"2023-12-22T09:16:56.618531+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.618531+0000","last_undegraded":"2023-12-22T09:16:56.618531+0000","last_fullsized":"2023-12-22T09:16:56.618531+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.606787+0000","last_change":"2023-12-22T09:16:56.606787+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.606787+0000","last_undegraded":"2023-12-22T09:16:56.606787+0000","last_fullsized":"2023-12-22T09:16:56.606787+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:18.179171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.613988+0000","last_change":"2023-12-22T09:16:56.613988+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.613988+0000","last_undegraded":"2023-12-22T09:16:56.613988+0000","last_fullsized":"2023-12-22T09:16:56.613988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.607103+0000","last_change":"2023-12-22T09:16:56.607103+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.607103+0000","last_undegraded":"2023-12-22T09:16:56.607103+0000","last_fullsized":"2023-12-22T09:16:56.607103+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:40.073052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.608845+0000","last_change":"2023-12-22T09:16:56.608845+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.608845+0000","last_undegraded":"2023-12-22T09:16:56.608845+0000","last_fullsized":"2023-12-22T09:16:56.608845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:11.216158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.609982+0000","last_change":"2023-12-22T09:16:56.609982+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.609982+0000","last_undegraded":"2023-12-22T09:16:56.609982+0000","last_fullsized":"2023-12-22T09:16:56.609982+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:33.101510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.614085+0000","last_change":"2023-12-22T09:16:56.614085+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.614085+0000","last_undegraded":"2023-12-22T09:16:56.614085+0000","last_fullsized":"2023-12-22T09:16:56.614085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:16:57.598810+0000","last_change":"2023-12-22T09:16:57.598810+0000","last_active":"2023-12-22T09:16:57.598810+0000","last_peered":"2023-12-22T09:16:57.598810+0000","last_clean":"2023-12-22T09:16:57.598810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:57.598810+0000","last_undegraded":"2023-12-22T09:16:57.598810+0000","last_fullsized":"2023-12-22T09:16:57.598810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-22T09:16:56.607973+0000","last_change":"2023-12-22T09:16:56.607973+0000","last_active":"2023-12-22T09:16:56.581783+0000","last_peered":"2023-12-22T09:16:56.581783+0000","last_clean":"2023-12-22T09:16:56.581783+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:16:56.607973+0000","last_undegraded":"2023-12-22T09:16:56.607973+0000","last_fullsized":"2023-12-22T09:16:56.607973+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:36.593161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-22T09:16:53.980883+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:16:53.980883+0000","last_peered":"2023-12-22T09:16:53.980883+0000","last_clean":"2023-12-22T09:16:53.980883+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:16:53.980883+0000","last_undegraded":"2023-12-22T09:16:53.980883+0000","last_fullsized":"2023-12-22T09:16:53.980883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":62,"acting":62,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1253376,"data_stored":885408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.173,"15min":1.1870000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1060000000000001,"15min":1.129},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.409,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1910000000000001,"15min":1.1990000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.2769999999999999,"15min":1.3220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.339,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1539999999999999,"15min":1.1739999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.3799999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":1.266}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.24,"15min":1.256},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.427,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.014},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3600000000000001,"15min":1.3720000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":1.1639999999999999}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.268,"15min":1.2809999999999999},"min":{"1min":0.81399999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":1.038,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.6319999999999999,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.1259999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.458,"15min":1.427},"min":{"1min":0.91400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":8.1620000000000008,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":1.335},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.476,"15min":1.504},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.6220000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.2989999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.5649999999999999,"15min":1.5740000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":1.349},{"interface":"front","average":{"1min":1.393,"5min":1.554,"15min":1.581},"min":{"1min":1.127,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.655,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.2290000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.1100000000000001,"15min":1.1319999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.085,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4810000000000001,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":1.0449999999999999}]},{"osd":1,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.978,"15min":1.978},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5189999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.4830000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.661,"5min":1.915,"15min":1.915},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.268,"15min":1.282},"min":{"1min":0.74099999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.234}]},{"osd":3,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4950000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.381},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3580000000000001,"15min":1.3740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.736,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.302}]},{"osd":4,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.494,"15min":1.52},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.5549999999999999,"15min":1.585},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.722,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.544}]},{"osd":5,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.5760000000000001,"15min":1.6060000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.74,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.337},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.671,"15min":1.6970000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.952,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.508}]},{"osd":7,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.6379999999999999,"15min":1.6619999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.859,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.591},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.6240000000000001,"15min":1.637},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":2.0459999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.1859999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":0.97099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3240000000000001,"5min":1.677,"15min":1.677},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4650000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.256}]},{"osd":1,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.107,"15min":1.1180000000000001},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.48,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.444},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.24,"15min":1.26},"min":{"1min":0.73499999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.802,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.3640000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5449999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.9950000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.159,"15min":1.169},"min":{"1min":0.748,"5min":0.629,"15min":0.629},"max":{"1min":1.4419999999999999,"5min":1.762,"15min":1.762},"last":1.413}]},{"osd":3,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.256,"15min":1.264},"min":{"1min":0.88,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5640000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.544},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.284,"15min":1.306},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8089999999999999,"5min":2.431,"15min":2.431},"last":1.851}]},{"osd":4,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.304,"15min":1.3120000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5629999999999999,"5min":1.889,"15min":1.889},"last":1.506},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4870000000000001,"15min":1.5},"min":{"1min":0.874,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.641}]},{"osd":6,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4099999999999999,"15min":1.4299999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.982,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":2.2000000000000002},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4179999999999999,"15min":1.4359999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7889999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":2.0379999999999998}]},{"osd":7,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.464,"15min":1.48},"min":{"1min":0.97499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.8540000000000001,"5min":3.298,"15min":3.298},"last":1.9159999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.504,"15min":1.5249999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.0899999999999999,"5min":2.589,"15min":2.589},"last":2.1040000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3320000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.093},{"interface":"front","average":{"1min":1.083,"5min":1.115,"15min":1.121},"min":{"1min":0.70399999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5409999999999999,"5min":2.25,"15min":2.25},"last":1.0209999999999999}]},{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.113,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.345,"5min":1.782,"15min":1.782},"last":1.452},{"interface":"front","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.425,"5min":1.494,"15min":1.494},"last":1.2689999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4890000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.147,"5min":1.2130000000000001,"15min":1.224},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7749999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.1319999999999999,"15min":1.149},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.542,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.198},{"interface":"front","average":{"1min":1.161,"5min":1.2929999999999999,"15min":1.3149999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.4690000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3380000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3320000000000001,"15min":1.3520000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.909,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.268,"15min":1.286},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.679,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.3169999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4950000000000001,"5min":2.052,"15min":2.052},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.5069999999999999,"15min":1.5329999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.5700000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.4079999999999999,"15min":1.4350000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7470000000000001,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.407},{"interface":"front","average":{"1min":1.339,"5min":1.512,"15min":1.5409999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.629,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.637}]}]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88500000000000001,"15min":0.89700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.627,"5min":1.716,"15min":1.716},"last":0.76900000000000002}]},{"osd":1,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4430000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.998},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.65500000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.093,"15min":1.105},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1719999999999999,"15min":1.1899999999999999},"min":{"1min":0.66700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4019999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.244,"15min":1.25},"min":{"1min":0.90900000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.722,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.92200000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.571,"5min":2.508,"15min":2.508},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":2.0030000000000001,"15min":2.1219999999999999},"min":{"1min":0.86299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6519999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.258,"5min":2.254,"15min":2.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.6739999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":1.234}]},{"osd":6,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":2.423,"15min":2.6219999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.752,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.173},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.1970000000000001,"15min":2.339},"min":{"1min":0.98999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.722,"5min":27.181999999999999,"15min":27.181999999999999},"last":1.2050000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2,"15min":2.121},"min":{"1min":1.016,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5069999999999999,"5min":22.715,"15min":22.715},"last":1.323},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.3860000000000001,"15min":2.5619999999999998},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.643,"5min":30.108000000000001,"15min":30.108000000000001},"last":1.27}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.85599999999999998,"15min":0.88},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.395,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.95699999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.381,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":1.0069999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.357,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.98899999999999999,"15min":1.002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5489999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0049999999999999,"15min":1.016},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5289999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.173,"15min":1.1910000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6279999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.76800000000000002}]},{"osd":4,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.377,"15min":1.4179999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6160000000000001,"5min":2.802,"15min":2.802},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.276,"5min":1.4139999999999999,"15min":1.4370000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.758,"5min":2.46,"15min":2.46},"last":1.0600000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2889999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.595,"5min":3.327,"15min":3.327},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.371,"15min":1.399},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4279999999999999,"15min":1.452},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9950000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.369,"15min":1.3999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.554,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":1.2470000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.4870000000000001,"15min":1.516},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.823,"5min":2.867,"15min":2.867},"last":0.997},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4670000000000001,"15min":1.4950000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.724,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":1.1559999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":659456,"data_stored":295040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.879,"15min":0.90700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.262,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.2589999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3260000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.90600000000000003,"15min":0.92800000000000005},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.218,"5min":1.504,"15min":1.504},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.103,"15min":1.143},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.282,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.4990000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.0409999999999999,"15min":1.0700000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.54,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.266,"15min":1.3069999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4430000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.417}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.68799999999999994,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4330000000000001,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.206},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.3129999999999999,"15min":1.3500000000000001},"min":{"1min":0.77200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6599999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.1850000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.4019999999999999,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.1720000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.325},{"interface":"front","average":{"1min":1.214,"5min":1.534,"15min":1.5880000000000001},"min":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.649,"5min":4.524,"15min":4.524},"last":1.3640000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.5349999999999999,"15min":1.581},"min":{"1min":0.80900000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3879999999999999,"15min":1.4139999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.881,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.127}]},{"osd":7,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.474,"15min":1.5089999999999999},"min":{"1min":0.79800000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.29,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.458},{"interface":"front","average":{"1min":1.319,"5min":1.52,"15min":1.554},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.766,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":1.6020000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":891545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0129999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.0229999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2689999999999999,"5min":1.548,"15min":1.548},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.98099999999999998,"15min":1.0129999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.242,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.506}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.1930000000000001,"15min":1.238},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6120000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.0900000000000001,"15min":1.1319999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3939999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.753}]},{"osd":4,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1799999999999999,"15min":1.1990000000000001},"min":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.601,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.357,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":3.589,"15min":3.589},"last":0.878}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5920000000000001,"5min":1.748,"15min":1.748},"last":1.121},{"interface":"front","average":{"1min":1.167,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.72599999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.49,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.84699999999999998}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.268,"15min":1.282},"min":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.611,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.194},{"interface":"front","average":{"1min":1.155,"5min":1.3069999999999999,"15min":1.333},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.5529999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.365,"15min":1.3879999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8109999999999999,"5min":2.157,"15min":2.157},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.419,"15min":1.452},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6439999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.633}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:17:02.563 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:17:02.565 INFO:tasks.ceph.mds.c.smithi106.stderr:2023-12-22T09:17:02.565+0000 7f8d69991640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T09:17:02.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.780+0000 7f27d4a38640 1 Processor -- start 2023-12-22T09:17:02.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.780+0000 7f27d4a38640 1 -- start start 2023-12-22T09:17:02.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.781+0000 7f27d4a38640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f27d0151670 0x7f27d00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.781+0000 7f27d4a38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d006afe0 0x7f27d00c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.782+0000 7f27d4a38640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d006a590 con 0x7f27d006b440 2023-12-22T09:17:02.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.782+0000 7f27d4a38640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d0154930 con 0x7f27d0151670 2023-12-22T09:17:02.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.782+0000 7f27d4a38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0154c10 con 0x7f27d006afe0 2023-12-22T09:17:02.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.782+0000 7f27ced9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f27d006b440 0x7f27d0153e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38262/0 (socket says 172.21.15.106:38262) 2023-12-22T09:17:02.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.782+0000 7f27ced9d640 1 -- 172.21.15.106:0/1123603028 learned_addr learned my addr 172.21.15.106:0/1123603028 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.782+0000 7f27cdd9b640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d006afe0 0x7f27d00c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.782+0000 7f27ce59c640 1 --2- 172.21.15.106:0/1123603028 >> v2:172.21.15.132:3300/0 conn(0x7f27d0151670 0x7f27d00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.782+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511548036 0 0) 0x7f27d006a590 con 0x7f27d006b440 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.782+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b8003520 con 0x7f27d006b440 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1026172322 0 0) 0x7f27b8003520 con 0x7f27d006b440 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d006afe0 msgr2=0x7f27d00c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d006afe0 0x7f27d00c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 >> v2:172.21.15.132:3300/0 conn(0x7f27d0151670 msgr2=0x7f27d00c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 --2- 172.21.15.106:0/1123603028 >> v2:172.21.15.132:3300/0 conn(0x7f27d0151670 0x7f27d00c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d006a7e0 con 0x7f27d006b440 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f27c80019f0 con 0x7f27d006b440 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 >> v1:172.21.15.106:6789/0 conn(0x7f27d006b440 legacy=0x7f27d0153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d006afe0 0x7f27b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27b8004d00 0x7f27b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0154930 con 0x7f27b8003ef0 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0154c10 con 0x7f27b8004d00 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b800ba60 con 0x7f27d006afe0 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.783+0000 7f27cdd9b640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.784+0000 7f27ce59c640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d006afe0 0x7f27b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.784+0000 7f27cdd9b640 1 -- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d006afe0 msgr2=0x7f27b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.784+0000 7f27ced9d640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27b8004d00 0x7f27b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.784+0000 7f27cdd9b640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d006afe0 0x7f27b8003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.784+0000 7f27cdd9b640 1 -- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27b8004d00 msgr2=0x7f27b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:02.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.784+0000 7f27cdd9b640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27b8004d00 0x7f27b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.784+0000 7f27cdd9b640 1 -- 172.21.15.106:0/1123603028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b8003520 con 0x7f27b8003ef0 2023-12-22T09:17:02.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.784+0000 7f27ced9d640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27b8004d00 0x7f27b8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:02.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.785+0000 7f27cdd9b640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27b80047c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009ac0 tx=0x7f27b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fa683245b77697 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.785+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c402c6b0 con 0x7f27b8003ef0 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.785+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c402c810 con 0x7f27b8003ef0 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.785+0000 7f27cd59a640 1 -- 172.21.15.106:0/1123603028 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c402cba0 con 0x7f27b8003ef0 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.786+0000 7f27d4a38640 1 -- 172.21.15.106:0/1123603028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 msgr2=0x7f27b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.786+0000 7f27d4a38640 1 --2- 172.21.15.106:0/1123603028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27b80047c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009ac0 tx=0x7f27b80057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.786+0000 7f27ced9d640 1 -- 172.21.15.106:0/1123603028 reap_dead start 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.786+0000 7f27d4a38640 1 -- 172.21.15.106:0/1123603028 shutdown_connections 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.786+0000 7f27d4a38640 1 -- 172.21.15.106:0/1123603028 >> 172.21.15.106:0/1123603028 conn(0x7f27d00c96e0 msgr2=0x7f27d00c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.786+0000 7f27d4a38640 1 -- 172.21.15.106:0/1123603028 shutdown_connections 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.786+0000 7f27d4a38640 1 -- 172.21.15.106:0/1123603028 wait complete. 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.788+0000 7f27d4a38640 1 Processor -- start 2023-12-22T09:17:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.788+0000 7f27d4a38640 1 -- start start 2023-12-22T09:17:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27d4a38640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27d00c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27d4a38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27d014bb80 0x7f27d00aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27d4a38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d0149880 0x7f27d0149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27d4a38640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0152560 con 0x7f27b8003ef0 2023-12-22T09:17:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27d4a38640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0153790 con 0x7f27d014bb80 2023-12-22T09:17:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27d4a38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0152230 con 0x7f27d0149880 2023-12-22T09:17:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27ce59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27d00c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27ce59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27d00c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59570/0 (socket says 172.21.15.106:59570) 2023-12-22T09:17:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27ce59c640 1 -- 172.21.15.106:0/2653537351 learned_addr learned my addr 172.21.15.106:0/2653537351 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27ce59c640 1 -- 172.21.15.106:0/2653537351 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d0149880 msgr2=0x7f27d0149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27ce59c640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d0149880 0x7f27d0149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27ce59c640 1 -- 172.21.15.106:0/2653537351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27d014bb80 msgr2=0x7f27d00aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27ce59c640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27d014bb80 0x7f27d00aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.789+0000 7f27ce59c640 1 -- 172.21.15.106:0/2653537351 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d01e97a0 con 0x7f27b8003ef0 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.790+0000 7f27ce59c640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27d00c74e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f27c00108e0 tx=0x7f27c0010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.790+0000 7f27beffd640 1 -- 172.21.15.106:0/2653537351 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000eb60 con 0x7f27b8003ef0 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.790+0000 7f27beffd640 1 -- 172.21.15.106:0/2653537351 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000ecc0 con 0x7f27b8003ef0 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.790+0000 7f27beffd640 1 -- 172.21.15.106:0/2653537351 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c001c400 con 0x7f27b8003ef0 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.790+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d01e9a80 con 0x7f27b8003ef0 2023-12-22T09:17:02.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.790+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d01da850 con 0x7f27b8003ef0 2023-12-22T09:17:02.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.791+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d01523a0 con 0x7f27b8003ef0 2023-12-22T09:17:02.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.792+0000 7f27beffd640 1 -- 172.21.15.106:0/2653537351 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f27c001c560 con 0x7f27b8003ef0 2023-12-22T09:17:02.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.793+0000 7f27beffd640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f27b006a430 0x7f27b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:02.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.794+0000 7f27beffd640 1 -- 172.21.15.106:0/2653537351 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f27c0089280 con 0x7f27b8003ef0 2023-12-22T09:17:02.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.794+0000 7f27cdd9b640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f27b006a430 0x7f27b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:02.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.794+0000 7f27cdd9b640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f27b006a430 0x7f27b006c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f27c4036000 tx=0x7f27c402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:02.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.798+0000 7f27beffd640 1 -- 172.21.15.106:0/2653537351 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f27d01523a0 con 0x7f27b8003ef0 2023-12-22T09:17:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:02.987+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27d0151a50 con 0x7f27b006a430 2023-12-22T09:17:03.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.002+0000 7f27beffd640 1 -- 172.21.15.106:0/2653537351 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286850 (secure 0 0 0) 0x7f27c402c980 con 0x7f27b006a430 2023-12-22T09:17:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:03.008 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:17:03.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f27b006a430 msgr2=0x7f27b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f27b006a430 0x7f27b006c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f27c4036000 tx=0x7f27c402e000 comp rx=0 tx=0).stop 2023-12-22T09:17:03.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 msgr2=0x7f27d00c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27d00c74e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f27c00108e0 tx=0x7f27c0010da0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 shutdown_connections 2023-12-22T09:17:03.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f27b006a430 0x7f27b006c8f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27d0149880 0x7f27d0149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27d014bb80 0x7f27d00aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 --2- 172.21.15.106:0/2653537351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27b8003ef0 0x7f27d00c74e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 >> 172.21.15.106:0/2653537351 conn(0x7f27d00c96e0 msgr2=0x7f27d014f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:03.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 shutdown_connections 2023-12-22T09:17:03.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.009+0000 7f27d4a38640 1 -- 172.21.15.106:0/2653537351 wait complete. 2023-12-22T09:17:03.027 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-12-22T09:17:02.747616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230568,"kb_used_data":6760,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744152,"statfs":{"total":773094113280,"available":772858011648,"internally_reserved":0,"allocated":6922240,"data_stored":3757292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001886"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.224696+0000","last_change":"2023-12-22T09:16:58.138391+0000","last_active":"2023-12-22T09:16:59.224696+0000","last_peered":"2023-12-22T09:16:59.224696+0000","last_clean":"2023-12-22T09:16:59.224696+0000","last_became_active":"2023-12-22T09:16:58.138138+0000","last_became_peered":"2023-12-22T09:16:58.138138+0000","last_unstale":"2023-12-22T09:16:59.224696+0000","last_undegraded":"2023-12-22T09:16:59.224696+0000","last_fullsized":"2023-12-22T09:16:59.224696+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.224562+0000","last_change":"2023-12-22T09:16:58.122537+0000","last_active":"2023-12-22T09:16:59.224562+0000","last_peered":"2023-12-22T09:16:59.224562+0000","last_clean":"2023-12-22T09:16:59.224562+0000","last_became_active":"2023-12-22T09:16:58.122285+0000","last_became_peered":"2023-12-22T09:16:58.122285+0000","last_unstale":"2023-12-22T09:16:59.224562+0000","last_undegraded":"2023-12-22T09:16:59.224562+0000","last_fullsized":"2023-12-22T09:16:59.224562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.112970+0000","last_change":"2023-12-22T09:16:58.155070+0000","last_active":"2023-12-22T09:16:59.112970+0000","last_peered":"2023-12-22T09:16:59.112970+0000","last_clean":"2023-12-22T09:16:59.112970+0000","last_became_active":"2023-12-22T09:16:58.154786+0000","last_became_peered":"2023-12-22T09:16:58.154786+0000","last_unstale":"2023-12-22T09:16:59.112970+0000","last_undegraded":"2023-12-22T09:16:59.112970+0000","last_fullsized":"2023-12-22T09:16:59.112970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.307642+0000","last_change":"2023-12-22T09:16:58.137625+0000","last_active":"2023-12-22T09:16:59.307642+0000","last_peered":"2023-12-22T09:16:59.307642+0000","last_clean":"2023-12-22T09:16:59.307642+0000","last_became_active":"2023-12-22T09:16:58.137368+0000","last_became_peered":"2023-12-22T09:16:58.137368+0000","last_unstale":"2023-12-22T09:16:59.307642+0000","last_undegraded":"2023-12-22T09:16:59.307642+0000","last_fullsized":"2023-12-22T09:16:59.307642+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:34:37.197489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.114091+0000","last_change":"2023-12-22T09:16:58.143885+0000","last_active":"2023-12-22T09:16:59.114091+0000","last_peered":"2023-12-22T09:16:59.114091+0000","last_clean":"2023-12-22T09:16:59.114091+0000","last_became_active":"2023-12-22T09:16:58.143627+0000","last_became_peered":"2023-12-22T09:16:58.143627+0000","last_unstale":"2023-12-22T09:16:59.114091+0000","last_undegraded":"2023-12-22T09:16:59.114091+0000","last_fullsized":"2023-12-22T09:16:59.114091+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:50:47.328724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:01.336368+0000","last_change":"2023-12-22T09:16:58.140402+0000","last_active":"2023-12-22T09:17:01.336368+0000","last_peered":"2023-12-22T09:17:01.336368+0000","last_clean":"2023-12-22T09:17:01.336368+0000","last_became_active":"2023-12-22T09:16:58.140117+0000","last_became_peered":"2023-12-22T09:16:58.140117+0000","last_unstale":"2023-12-22T09:17:01.336368+0000","last_undegraded":"2023-12-22T09:17:01.336368+0000","last_fullsized":"2023-12-22T09:17:01.336368+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:25:20.515272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.718972+0000","last_change":"2023-12-22T09:16:58.138038+0000","last_active":"2023-12-22T09:17:00.718972+0000","last_peered":"2023-12-22T09:17:00.718972+0000","last_clean":"2023-12-22T09:17:00.718972+0000","last_became_active":"2023-12-22T09:16:58.137394+0000","last_became_peered":"2023-12-22T09:16:58.137394+0000","last_unstale":"2023-12-22T09:17:00.718972+0000","last_undegraded":"2023-12-22T09:17:00.718972+0000","last_fullsized":"2023-12-22T09:17:00.718972+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:53.435793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.729260+0000","last_change":"2023-12-22T09:16:58.139475+0000","last_active":"2023-12-22T09:17:00.729260+0000","last_peered":"2023-12-22T09:17:00.729260+0000","last_clean":"2023-12-22T09:17:00.729260+0000","last_became_active":"2023-12-22T09:16:58.139166+0000","last_became_peered":"2023-12-22T09:16:58.139166+0000","last_unstale":"2023-12-22T09:17:00.729260+0000","last_undegraded":"2023-12-22T09:17:00.729260+0000","last_fullsized":"2023-12-22T09:17:00.729260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.113484+0000","last_change":"2023-12-22T09:16:58.153587+0000","last_active":"2023-12-22T09:16:59.113484+0000","last_peered":"2023-12-22T09:16:59.113484+0000","last_clean":"2023-12-22T09:16:59.113484+0000","last_became_active":"2023-12-22T09:16:58.153215+0000","last_became_peered":"2023-12-22T09:16:58.153215+0000","last_unstale":"2023-12-22T09:16:59.113484+0000","last_undegraded":"2023-12-22T09:16:59.113484+0000","last_fullsized":"2023-12-22T09:16:59.113484+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.112941+0000","last_change":"2023-12-22T09:16:58.146315+0000","last_active":"2023-12-22T09:16:59.112941+0000","last_peered":"2023-12-22T09:16:59.112941+0000","last_clean":"2023-12-22T09:16:59.112941+0000","last_became_active":"2023-12-22T09:16:58.143702+0000","last_became_peered":"2023-12-22T09:16:58.143702+0000","last_unstale":"2023-12-22T09:16:59.112941+0000","last_undegraded":"2023-12-22T09:16:59.112941+0000","last_fullsized":"2023-12-22T09:16:59.112941+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.307760+0000","last_change":"2023-12-22T09:16:58.144346+0000","last_active":"2023-12-22T09:16:59.307760+0000","last_peered":"2023-12-22T09:16:59.307760+0000","last_clean":"2023-12-22T09:16:59.307760+0000","last_became_active":"2023-12-22T09:16:58.144068+0000","last_became_peered":"2023-12-22T09:16:58.144068+0000","last_unstale":"2023-12-22T09:16:59.307760+0000","last_undegraded":"2023-12-22T09:16:59.307760+0000","last_fullsized":"2023-12-22T09:16:59.307760+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.729522+0000","last_change":"2023-12-22T09:16:58.147804+0000","last_active":"2023-12-22T09:17:00.729522+0000","last_peered":"2023-12-22T09:17:00.729522+0000","last_clean":"2023-12-22T09:17:00.729522+0000","last_became_active":"2023-12-22T09:16:58.147510+0000","last_became_peered":"2023-12-22T09:16:58.147510+0000","last_unstale":"2023-12-22T09:17:00.729522+0000","last_undegraded":"2023-12-22T09:17:00.729522+0000","last_fullsized":"2023-12-22T09:17:00.729522+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:59:31.258825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.729578+0000","last_change":"2023-12-22T09:16:58.149202+0000","last_active":"2023-12-22T09:17:00.729578+0000","last_peered":"2023-12-22T09:17:00.729578+0000","last_clean":"2023-12-22T09:17:00.729578+0000","last_became_active":"2023-12-22T09:16:58.148243+0000","last_became_peered":"2023-12-22T09:16:58.148243+0000","last_unstale":"2023-12-22T09:17:00.729578+0000","last_undegraded":"2023-12-22T09:17:00.729578+0000","last_fullsized":"2023-12-22T09:17:00.729578+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.113544+0000","last_change":"2023-12-22T09:16:58.156229+0000","last_active":"2023-12-22T09:16:59.113544+0000","last_peered":"2023-12-22T09:16:59.113544+0000","last_clean":"2023-12-22T09:16:59.113544+0000","last_became_active":"2023-12-22T09:16:58.154667+0000","last_became_peered":"2023-12-22T09:16:58.154667+0000","last_unstale":"2023-12-22T09:16:59.113544+0000","last_undegraded":"2023-12-22T09:16:59.113544+0000","last_fullsized":"2023-12-22T09:16:59.113544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.112567+0000","last_change":"2023-12-22T09:16:58.144597+0000","last_active":"2023-12-22T09:16:59.112567+0000","last_peered":"2023-12-22T09:16:59.112567+0000","last_clean":"2023-12-22T09:16:59.112567+0000","last_became_active":"2023-12-22T09:16:58.144358+0000","last_became_peered":"2023-12-22T09:16:58.144358+0000","last_unstale":"2023-12-22T09:16:59.112567+0000","last_undegraded":"2023-12-22T09:16:59.112567+0000","last_fullsized":"2023-12-22T09:16:59.112567+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.718972+0000","last_change":"2023-12-22T09:16:58.139134+0000","last_active":"2023-12-22T09:17:00.718972+0000","last_peered":"2023-12-22T09:17:00.718972+0000","last_clean":"2023-12-22T09:17:00.718972+0000","last_became_active":"2023-12-22T09:16:58.138883+0000","last_became_peered":"2023-12-22T09:16:58.138883+0000","last_unstale":"2023-12-22T09:17:00.718972+0000","last_undegraded":"2023-12-22T09:17:00.718972+0000","last_fullsized":"2023-12-22T09:17:00.718972+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.662952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.224711+0000","last_change":"2023-12-22T09:16:58.139935+0000","last_active":"2023-12-22T09:16:59.224711+0000","last_peered":"2023-12-22T09:16:59.224711+0000","last_clean":"2023-12-22T09:16:59.224711+0000","last_became_active":"2023-12-22T09:16:58.139665+0000","last_became_peered":"2023-12-22T09:16:58.139665+0000","last_unstale":"2023-12-22T09:16:59.224711+0000","last_undegraded":"2023-12-22T09:16:59.224711+0000","last_fullsized":"2023-12-22T09:16:59.224711+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.307864+0000","last_change":"2023-12-22T09:16:58.135060+0000","last_active":"2023-12-22T09:16:59.307864+0000","last_peered":"2023-12-22T09:16:59.307864+0000","last_clean":"2023-12-22T09:16:59.307864+0000","last_became_active":"2023-12-22T09:16:58.134796+0000","last_became_peered":"2023-12-22T09:16:58.134796+0000","last_unstale":"2023-12-22T09:16:59.307864+0000","last_undegraded":"2023-12-22T09:16:59.307864+0000","last_fullsized":"2023-12-22T09:16:59.307864+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:56:40.950128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.114335+0000","last_change":"2023-12-22T09:16:58.133014+0000","last_active":"2023-12-22T09:16:59.114335+0000","last_peered":"2023-12-22T09:16:59.114335+0000","last_clean":"2023-12-22T09:16:59.114335+0000","last_became_active":"2023-12-22T09:16:58.132669+0000","last_became_peered":"2023-12-22T09:16:58.132669+0000","last_unstale":"2023-12-22T09:16:59.114335+0000","last_undegraded":"2023-12-22T09:16:59.114335+0000","last_fullsized":"2023-12-22T09:16:59.114335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:59:55.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.107751+0000","last_change":"2023-12-22T09:16:58.139698+0000","last_active":"2023-12-22T09:16:59.107751+0000","last_peered":"2023-12-22T09:16:59.107751+0000","last_clean":"2023-12-22T09:16:59.107751+0000","last_became_active":"2023-12-22T09:16:58.139450+0000","last_became_peered":"2023-12-22T09:16:58.139450+0000","last_unstale":"2023-12-22T09:16:59.107751+0000","last_undegraded":"2023-12-22T09:16:59.107751+0000","last_fullsized":"2023-12-22T09:16:59.107751+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:40.452271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.729764+0000","last_change":"2023-12-22T09:16:58.138002+0000","last_active":"2023-12-22T09:17:00.729764+0000","last_peered":"2023-12-22T09:17:00.729764+0000","last_clean":"2023-12-22T09:17:00.729764+0000","last_became_active":"2023-12-22T09:16:58.137587+0000","last_became_peered":"2023-12-22T09:16:58.137587+0000","last_unstale":"2023-12-22T09:17:00.729764+0000","last_undegraded":"2023-12-22T09:17:00.729764+0000","last_fullsized":"2023-12-22T09:17:00.729764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.108303+0000","last_change":"2023-12-22T09:16:58.143017+0000","last_active":"2023-12-22T09:16:59.108303+0000","last_peered":"2023-12-22T09:16:59.108303+0000","last_clean":"2023-12-22T09:16:59.108303+0000","last_became_active":"2023-12-22T09:16:58.142609+0000","last_became_peered":"2023-12-22T09:16:58.142609+0000","last_unstale":"2023-12-22T09:16:59.108303+0000","last_undegraded":"2023-12-22T09:16:59.108303+0000","last_fullsized":"2023-12-22T09:16:59.108303+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:22.037240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.107715+0000","last_change":"2023-12-22T09:16:58.137672+0000","last_active":"2023-12-22T09:16:59.107715+0000","last_peered":"2023-12-22T09:16:59.107715+0000","last_clean":"2023-12-22T09:16:59.107715+0000","last_became_active":"2023-12-22T09:16:58.137418+0000","last_became_peered":"2023-12-22T09:16:58.137418+0000","last_unstale":"2023-12-22T09:16:59.107715+0000","last_undegraded":"2023-12-22T09:16:59.107715+0000","last_fullsized":"2023-12-22T09:16:59.107715+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:11.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.111903+0000","last_change":"2023-12-22T09:16:58.151378+0000","last_active":"2023-12-22T09:16:59.111903+0000","last_peered":"2023-12-22T09:16:59.111903+0000","last_clean":"2023-12-22T09:16:59.111903+0000","last_became_active":"2023-12-22T09:16:58.148696+0000","last_became_peered":"2023-12-22T09:16:58.148696+0000","last_unstale":"2023-12-22T09:16:59.111903+0000","last_undegraded":"2023-12-22T09:16:59.111903+0000","last_fullsized":"2023-12-22T09:16:59.111903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.730104+0000","last_change":"2023-12-22T09:16:58.134012+0000","last_active":"2023-12-22T09:17:00.730104+0000","last_peered":"2023-12-22T09:17:00.730104+0000","last_clean":"2023-12-22T09:17:00.730104+0000","last_became_active":"2023-12-22T09:16:58.133668+0000","last_became_peered":"2023-12-22T09:16:58.133668+0000","last_unstale":"2023-12-22T09:17:00.730104+0000","last_undegraded":"2023-12-22T09:17:00.730104+0000","last_fullsized":"2023-12-22T09:17:00.730104+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:57:16.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.729768+0000","last_change":"2023-12-22T09:16:58.138808+0000","last_active":"2023-12-22T09:17:00.729768+0000","last_peered":"2023-12-22T09:17:00.729768+0000","last_clean":"2023-12-22T09:17:00.729768+0000","last_became_active":"2023-12-22T09:16:58.138287+0000","last_became_peered":"2023-12-22T09:16:58.138287+0000","last_unstale":"2023-12-22T09:17:00.729768+0000","last_undegraded":"2023-12-22T09:17:00.729768+0000","last_fullsized":"2023-12-22T09:17:00.729768+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:36.638731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.308053+0000","last_change":"2023-12-22T09:16:58.148258+0000","last_active":"2023-12-22T09:16:59.308053+0000","last_peered":"2023-12-22T09:16:59.308053+0000","last_clean":"2023-12-22T09:16:59.308053+0000","last_became_active":"2023-12-22T09:16:58.148003+0000","last_became_peered":"2023-12-22T09:16:58.148003+0000","last_unstale":"2023-12-22T09:16:59.308053+0000","last_undegraded":"2023-12-22T09:16:59.308053+0000","last_fullsized":"2023-12-22T09:16:59.308053+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:42.621461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.224237+0000","last_change":"2023-12-22T09:16:58.133892+0000","last_active":"2023-12-22T09:16:59.224237+0000","last_peered":"2023-12-22T09:16:59.224237+0000","last_clean":"2023-12-22T09:16:59.224237+0000","last_became_active":"2023-12-22T09:16:58.133436+0000","last_became_peered":"2023-12-22T09:16:58.133436+0000","last_unstale":"2023-12-22T09:16:59.224237+0000","last_undegraded":"2023-12-22T09:16:59.224237+0000","last_fullsized":"2023-12-22T09:16:59.224237+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.112746+0000","last_change":"2023-12-22T09:16:58.149316+0000","last_active":"2023-12-22T09:16:59.112746+0000","last_peered":"2023-12-22T09:16:59.112746+0000","last_clean":"2023-12-22T09:16:59.112746+0000","last_became_active":"2023-12-22T09:16:58.148642+0000","last_became_peered":"2023-12-22T09:16:58.148642+0000","last_unstale":"2023-12-22T09:16:59.112746+0000","last_undegraded":"2023-12-22T09:16:59.112746+0000","last_fullsized":"2023-12-22T09:16:59.112746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.729848+0000","last_change":"2023-12-22T09:16:58.155683+0000","last_active":"2023-12-22T09:17:00.729848+0000","last_peered":"2023-12-22T09:17:00.729848+0000","last_clean":"2023-12-22T09:17:00.729848+0000","last_became_active":"2023-12-22T09:16:58.155388+0000","last_became_peered":"2023-12-22T09:16:58.155388+0000","last_unstale":"2023-12-22T09:17:00.729848+0000","last_undegraded":"2023-12-22T09:17:00.729848+0000","last_fullsized":"2023-12-22T09:17:00.729848+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.307118+0000","last_change":"2023-12-22T09:16:58.147756+0000","last_active":"2023-12-22T09:16:59.307118+0000","last_peered":"2023-12-22T09:16:59.307118+0000","last_clean":"2023-12-22T09:16:59.307118+0000","last_became_active":"2023-12-22T09:16:58.146595+0000","last_became_peered":"2023-12-22T09:16:58.146595+0000","last_unstale":"2023-12-22T09:16:59.307118+0000","last_undegraded":"2023-12-22T09:16:59.307118+0000","last_fullsized":"2023-12-22T09:16:59.307118+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:20:04.358268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:01.336215+0000","last_change":"2023-12-22T09:16:58.125759+0000","last_active":"2023-12-22T09:17:01.336215+0000","last_peered":"2023-12-22T09:17:01.336215+0000","last_clean":"2023-12-22T09:17:01.336215+0000","last_became_active":"2023-12-22T09:16:58.125192+0000","last_became_peered":"2023-12-22T09:16:58.125192+0000","last_unstale":"2023-12-22T09:17:01.336215+0000","last_undegraded":"2023-12-22T09:17:01.336215+0000","last_fullsized":"2023-12-22T09:17:01.336215+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:11.972408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.114210+0000","last_change":"2023-12-22T09:16:58.132380+0000","last_active":"2023-12-22T09:16:59.114210+0000","last_peered":"2023-12-22T09:16:59.114210+0000","last_clean":"2023-12-22T09:16:59.114210+0000","last_became_active":"2023-12-22T09:16:58.131960+0000","last_became_peered":"2023-12-22T09:16:58.131960+0000","last_unstale":"2023-12-22T09:16:59.114210+0000","last_undegraded":"2023-12-22T09:16:59.114210+0000","last_fullsized":"2023-12-22T09:16:59.114210+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:39:55.787513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.136408+0000","last_change":"2023-12-22T09:16:57.644639+0000","last_active":"2023-12-22T09:16:58.136408+0000","last_peered":"2023-12-22T09:16:58.136408+0000","last_clean":"2023-12-22T09:16:58.136408+0000","last_became_active":"2023-12-22T09:16:57.641016+0000","last_became_peered":"2023-12-22T09:16:57.641016+0000","last_unstale":"2023-12-22T09:16:58.136408+0000","last_undegraded":"2023-12-22T09:16:58.136408+0000","last_fullsized":"2023-12-22T09:16:58.136408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.308141+0000","last_change":"2023-12-22T09:16:58.152605+0000","last_active":"2023-12-22T09:16:59.308141+0000","last_peered":"2023-12-22T09:16:59.308141+0000","last_clean":"2023-12-22T09:16:59.308141+0000","last_became_active":"2023-12-22T09:16:58.149099+0000","last_became_peered":"2023-12-22T09:16:58.149099+0000","last_unstale":"2023-12-22T09:16:59.308141+0000","last_undegraded":"2023-12-22T09:16:59.308141+0000","last_fullsized":"2023-12-22T09:16:59.308141+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:10.205321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.140085+0000","last_change":"2023-12-22T09:16:57.643725+0000","last_active":"2023-12-22T09:16:58.140085+0000","last_peered":"2023-12-22T09:16:58.140085+0000","last_clean":"2023-12-22T09:16:58.140085+0000","last_became_active":"2023-12-22T09:16:57.642742+0000","last_became_peered":"2023-12-22T09:16:57.642742+0000","last_unstale":"2023-12-22T09:16:58.140085+0000","last_undegraded":"2023-12-22T09:16:58.140085+0000","last_fullsized":"2023-12-22T09:16:58.140085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:42.697488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:01.336680+0000","last_change":"2023-12-22T09:16:58.124625+0000","last_active":"2023-12-22T09:17:01.336680+0000","last_peered":"2023-12-22T09:17:01.336680+0000","last_clean":"2023-12-22T09:17:01.336680+0000","last_became_active":"2023-12-22T09:16:58.124353+0000","last_became_peered":"2023-12-22T09:16:58.124353+0000","last_unstale":"2023-12-22T09:17:01.336680+0000","last_undegraded":"2023-12-22T09:17:01.336680+0000","last_fullsized":"2023-12-22T09:17:01.336680+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:30:35.111753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.140567+0000","last_change":"2023-12-22T09:16:57.655128+0000","last_active":"2023-12-22T09:16:58.140567+0000","last_peered":"2023-12-22T09:16:58.140567+0000","last_clean":"2023-12-22T09:16:58.140567+0000","last_became_active":"2023-12-22T09:16:57.654793+0000","last_became_peered":"2023-12-22T09:16:57.654793+0000","last_unstale":"2023-12-22T09:16:58.140567+0000","last_undegraded":"2023-12-22T09:16:58.140567+0000","last_fullsized":"2023-12-22T09:16:58.140567+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:38.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.113253+0000","last_change":"2023-12-22T09:16:58.153226+0000","last_active":"2023-12-22T09:16:59.113253+0000","last_peered":"2023-12-22T09:16:59.113253+0000","last_clean":"2023-12-22T09:16:59.113253+0000","last_became_active":"2023-12-22T09:16:58.151970+0000","last_became_peered":"2023-12-22T09:16:58.151970+0000","last_unstale":"2023-12-22T09:16:59.113253+0000","last_undegraded":"2023-12-22T09:16:59.113253+0000","last_fullsized":"2023-12-22T09:16:59.113253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.127951+0000","last_change":"2023-12-22T09:16:57.635854+0000","last_active":"2023-12-22T09:16:58.127951+0000","last_peered":"2023-12-22T09:16:58.127951+0000","last_clean":"2023-12-22T09:16:58.127951+0000","last_became_active":"2023-12-22T09:16:57.635365+0000","last_became_peered":"2023-12-22T09:16:57.635365+0000","last_unstale":"2023-12-22T09:16:58.127951+0000","last_undegraded":"2023-12-22T09:16:58.127951+0000","last_fullsized":"2023-12-22T09:16:58.127951+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:55.506978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.719252+0000","last_change":"2023-12-22T09:16:58.111968+0000","last_active":"2023-12-22T09:17:00.719252+0000","last_peered":"2023-12-22T09:17:00.719252+0000","last_clean":"2023-12-22T09:17:00.719252+0000","last_became_active":"2023-12-22T09:16:58.111712+0000","last_became_peered":"2023-12-22T09:16:58.111712+0000","last_unstale":"2023-12-22T09:17:00.719252+0000","last_undegraded":"2023-12-22T09:17:00.719252+0000","last_fullsized":"2023-12-22T09:17:00.719252+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:31:26.301820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.122889+0000","last_change":"2023-12-22T09:16:57.646140+0000","last_active":"2023-12-22T09:16:58.122889+0000","last_peered":"2023-12-22T09:16:58.122889+0000","last_clean":"2023-12-22T09:16:58.122889+0000","last_became_active":"2023-12-22T09:16:57.645839+0000","last_became_peered":"2023-12-22T09:16:57.645839+0000","last_unstale":"2023-12-22T09:16:58.122889+0000","last_undegraded":"2023-12-22T09:16:58.122889+0000","last_fullsized":"2023-12-22T09:16:58.122889+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:15.308735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.224166+0000","last_change":"2023-12-22T09:16:58.148277+0000","last_active":"2023-12-22T09:16:59.224166+0000","last_peered":"2023-12-22T09:16:59.224166+0000","last_clean":"2023-12-22T09:16:59.224166+0000","last_became_active":"2023-12-22T09:16:58.147042+0000","last_became_peered":"2023-12-22T09:16:58.147042+0000","last_unstale":"2023-12-22T09:16:59.224166+0000","last_undegraded":"2023-12-22T09:16:59.224166+0000","last_fullsized":"2023-12-22T09:16:59.224166+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.121107+0000","last_change":"2023-12-22T09:16:57.641319+0000","last_active":"2023-12-22T09:16:58.121107+0000","last_peered":"2023-12-22T09:16:58.121107+0000","last_clean":"2023-12-22T09:16:58.121107+0000","last_became_active":"2023-12-22T09:16:57.641031+0000","last_became_peered":"2023-12-22T09:16:57.641031+0000","last_unstale":"2023-12-22T09:16:58.121107+0000","last_undegraded":"2023-12-22T09:16:58.121107+0000","last_fullsized":"2023-12-22T09:16:58.121107+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:10.350226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.111782+0000","last_change":"2023-12-22T09:16:58.130875+0000","last_active":"2023-12-22T09:16:59.111782+0000","last_peered":"2023-12-22T09:16:59.111782+0000","last_clean":"2023-12-22T09:16:59.111782+0000","last_became_active":"2023-12-22T09:16:58.130606+0000","last_became_peered":"2023-12-22T09:16:58.130606+0000","last_unstale":"2023-12-22T09:16:59.111782+0000","last_undegraded":"2023-12-22T09:16:59.111782+0000","last_fullsized":"2023-12-22T09:16:59.111782+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:30.649529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.109490+0000","last_change":"2023-12-22T09:16:57.642097+0000","last_active":"2023-12-22T09:16:58.109490+0000","last_peered":"2023-12-22T09:16:58.109490+0000","last_clean":"2023-12-22T09:16:58.109490+0000","last_became_active":"2023-12-22T09:16:57.641830+0000","last_became_peered":"2023-12-22T09:16:57.641830+0000","last_unstale":"2023-12-22T09:16:58.109490+0000","last_undegraded":"2023-12-22T09:16:58.109490+0000","last_fullsized":"2023-12-22T09:16:58.109490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:37:23.822669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.108024+0000","last_change":"2023-12-22T09:16:58.147991+0000","last_active":"2023-12-22T09:16:59.108024+0000","last_peered":"2023-12-22T09:16:59.108024+0000","last_clean":"2023-12-22T09:16:59.108024+0000","last_became_active":"2023-12-22T09:16:58.147595+0000","last_became_peered":"2023-12-22T09:16:58.147595+0000","last_unstale":"2023-12-22T09:16:59.108024+0000","last_undegraded":"2023-12-22T09:16:59.108024+0000","last_fullsized":"2023-12-22T09:16:59.108024+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:14.136005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.112018+0000","last_change":"2023-12-22T09:16:57.647073+0000","last_active":"2023-12-22T09:16:59.112018+0000","last_peered":"2023-12-22T09:16:59.112018+0000","last_clean":"2023-12-22T09:16:59.112018+0000","last_became_active":"2023-12-22T09:16:57.646655+0000","last_became_peered":"2023-12-22T09:16:57.646655+0000","last_unstale":"2023-12-22T09:16:59.112018+0000","last_undegraded":"2023-12-22T09:16:59.112018+0000","last_fullsized":"2023-12-22T09:16:59.112018+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:52.036721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.224455+0000","last_change":"2023-12-22T09:16:58.112827+0000","last_active":"2023-12-22T09:16:59.224455+0000","last_peered":"2023-12-22T09:16:59.224455+0000","last_clean":"2023-12-22T09:16:59.224455+0000","last_became_active":"2023-12-22T09:16:58.112533+0000","last_became_peered":"2023-12-22T09:16:58.112533+0000","last_unstale":"2023-12-22T09:16:59.224455+0000","last_undegraded":"2023-12-22T09:16:59.224455+0000","last_fullsized":"2023-12-22T09:16:59.224455+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.134287+0000","last_change":"2023-12-22T09:16:57.653443+0000","last_active":"2023-12-22T09:16:58.134287+0000","last_peered":"2023-12-22T09:16:58.134287+0000","last_clean":"2023-12-22T09:16:58.134287+0000","last_became_active":"2023-12-22T09:16:57.653141+0000","last_became_peered":"2023-12-22T09:16:57.653141+0000","last_unstale":"2023-12-22T09:16:58.134287+0000","last_undegraded":"2023-12-22T09:16:58.134287+0000","last_fullsized":"2023-12-22T09:16:58.134287+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.107927+0000","last_change":"2023-12-22T09:16:58.138339+0000","last_active":"2023-12-22T09:16:59.107927+0000","last_peered":"2023-12-22T09:16:59.107927+0000","last_clean":"2023-12-22T09:16:59.107927+0000","last_became_active":"2023-12-22T09:16:58.137859+0000","last_became_peered":"2023-12-22T09:16:58.137859+0000","last_unstale":"2023-12-22T09:16:59.107927+0000","last_undegraded":"2023-12-22T09:16:59.107927+0000","last_fullsized":"2023-12-22T09:16:59.107927+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:20.962415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.138490+0000","last_change":"2023-12-22T09:16:57.655164+0000","last_active":"2023-12-22T09:16:58.138490+0000","last_peered":"2023-12-22T09:16:58.138490+0000","last_clean":"2023-12-22T09:16:58.138490+0000","last_became_active":"2023-12-22T09:16:57.654845+0000","last_became_peered":"2023-12-22T09:16:57.654845+0000","last_unstale":"2023-12-22T09:16:58.138490+0000","last_undegraded":"2023-12-22T09:16:58.138490+0000","last_fullsized":"2023-12-22T09:16:58.138490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:48.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.114450+0000","last_change":"2023-12-22T09:16:58.140359+0000","last_active":"2023-12-22T09:16:59.114450+0000","last_peered":"2023-12-22T09:16:59.114450+0000","last_clean":"2023-12-22T09:16:59.114450+0000","last_became_active":"2023-12-22T09:16:58.140013+0000","last_became_peered":"2023-12-22T09:16:58.140013+0000","last_unstale":"2023-12-22T09:16:59.114450+0000","last_undegraded":"2023-12-22T09:16:59.114450+0000","last_fullsized":"2023-12-22T09:16:59.114450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:10:45.503921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.155217+0000","last_change":"2023-12-22T09:16:57.649245+0000","last_active":"2023-12-22T09:16:58.155217+0000","last_peered":"2023-12-22T09:16:58.155217+0000","last_clean":"2023-12-22T09:16:58.155217+0000","last_became_active":"2023-12-22T09:16:57.648941+0000","last_became_peered":"2023-12-22T09:16:57.648941+0000","last_unstale":"2023-12-22T09:16:58.155217+0000","last_undegraded":"2023-12-22T09:16:58.155217+0000","last_fullsized":"2023-12-22T09:16:58.155217+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:41:54.745043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.308107+0000","last_change":"2023-12-22T09:16:58.136583+0000","last_active":"2023-12-22T09:16:59.308107+0000","last_peered":"2023-12-22T09:16:59.308107+0000","last_clean":"2023-12-22T09:16:59.308107+0000","last_became_active":"2023-12-22T09:16:58.136313+0000","last_became_peered":"2023-12-22T09:16:58.136313+0000","last_unstale":"2023-12-22T09:16:59.308107+0000","last_undegraded":"2023-12-22T09:16:59.308107+0000","last_fullsized":"2023-12-22T09:16:59.308107+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:04.972480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"58'6","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.154064+0000","last_change":"2023-12-22T09:16:57.656118+0000","last_active":"2023-12-22T09:16:58.154064+0000","last_peered":"2023-12-22T09:16:58.154064+0000","last_clean":"2023-12-22T09:16:58.154064+0000","last_became_active":"2023-12-22T09:16:57.655712+0000","last_became_peered":"2023-12-22T09:16:57.655712+0000","last_unstale":"2023-12-22T09:16:58.154064+0000","last_undegraded":"2023-12-22T09:16:58.154064+0000","last_fullsized":"2023-12-22T09:16:58.154064+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.307095+0000","last_change":"2023-12-22T09:16:58.146066+0000","last_active":"2023-12-22T09:16:59.307095+0000","last_peered":"2023-12-22T09:16:59.307095+0000","last_clean":"2023-12-22T09:16:59.307095+0000","last_became_active":"2023-12-22T09:16:58.145703+0000","last_became_peered":"2023-12-22T09:16:58.145703+0000","last_unstale":"2023-12-22T09:16:59.307095+0000","last_undegraded":"2023-12-22T09:16:59.307095+0000","last_fullsized":"2023-12-22T09:16:59.307095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:02.557319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.153672+0000","last_change":"2023-12-22T09:16:57.649967+0000","last_active":"2023-12-22T09:16:58.153672+0000","last_peered":"2023-12-22T09:16:58.153672+0000","last_clean":"2023-12-22T09:16:58.153672+0000","last_became_active":"2023-12-22T09:16:57.649500+0000","last_became_peered":"2023-12-22T09:16:57.649500+0000","last_unstale":"2023-12-22T09:16:58.153672+0000","last_undegraded":"2023-12-22T09:16:58.153672+0000","last_fullsized":"2023-12-22T09:16:58.153672+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.729569+0000","last_change":"2023-12-22T09:16:58.134889+0000","last_active":"2023-12-22T09:17:00.729569+0000","last_peered":"2023-12-22T09:17:00.729569+0000","last_clean":"2023-12-22T09:17:00.729569+0000","last_became_active":"2023-12-22T09:16:58.134552+0000","last_became_peered":"2023-12-22T09:16:58.134552+0000","last_unstale":"2023-12-22T09:17:00.729569+0000","last_undegraded":"2023-12-22T09:17:00.729569+0000","last_fullsized":"2023-12-22T09:17:00.729569+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.123653+0000","last_change":"2023-12-22T09:16:57.651390+0000","last_active":"2023-12-22T09:16:58.123653+0000","last_peered":"2023-12-22T09:16:58.123653+0000","last_clean":"2023-12-22T09:16:58.123653+0000","last_became_active":"2023-12-22T09:16:57.650566+0000","last_became_peered":"2023-12-22T09:16:57.650566+0000","last_unstale":"2023-12-22T09:16:58.123653+0000","last_undegraded":"2023-12-22T09:16:58.123653+0000","last_fullsized":"2023-12-22T09:16:58.123653+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:53.090112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.112047+0000","last_change":"2023-12-22T09:16:58.127084+0000","last_active":"2023-12-22T09:16:59.112047+0000","last_peered":"2023-12-22T09:16:59.112047+0000","last_clean":"2023-12-22T09:16:59.112047+0000","last_became_active":"2023-12-22T09:16:58.126598+0000","last_became_peered":"2023-12-22T09:16:58.126598+0000","last_unstale":"2023-12-22T09:16:59.112047+0000","last_undegraded":"2023-12-22T09:16:59.112047+0000","last_fullsized":"2023-12-22T09:16:59.112047+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:57.174680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.133472+0000","last_change":"2023-12-22T09:16:57.643354+0000","last_active":"2023-12-22T09:16:58.133472+0000","last_peered":"2023-12-22T09:16:58.133472+0000","last_clean":"2023-12-22T09:16:58.133472+0000","last_became_active":"2023-12-22T09:16:57.643102+0000","last_became_peered":"2023-12-22T09:16:57.643102+0000","last_unstale":"2023-12-22T09:16:58.133472+0000","last_undegraded":"2023-12-22T09:16:58.133472+0000","last_fullsized":"2023-12-22T09:16:58.133472+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.224292+0000","last_change":"2023-12-22T09:16:58.146073+0000","last_active":"2023-12-22T09:16:59.224292+0000","last_peered":"2023-12-22T09:16:59.224292+0000","last_clean":"2023-12-22T09:16:59.224292+0000","last_became_active":"2023-12-22T09:16:58.145780+0000","last_became_peered":"2023-12-22T09:16:58.145780+0000","last_unstale":"2023-12-22T09:16:59.224292+0000","last_undegraded":"2023-12-22T09:16:59.224292+0000","last_fullsized":"2023-12-22T09:16:59.224292+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.156781+0000","last_change":"2023-12-22T09:16:57.651320+0000","last_active":"2023-12-22T09:16:58.156781+0000","last_peered":"2023-12-22T09:16:58.156781+0000","last_clean":"2023-12-22T09:16:58.156781+0000","last_became_active":"2023-12-22T09:16:57.651060+0000","last_became_peered":"2023-12-22T09:16:57.651060+0000","last_unstale":"2023-12-22T09:16:58.156781+0000","last_undegraded":"2023-12-22T09:16:58.156781+0000","last_fullsized":"2023-12-22T09:16:58.156781+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:19:59.812662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.112742+0000","last_change":"2023-12-22T09:16:58.148310+0000","last_active":"2023-12-22T09:16:59.112742+0000","last_peered":"2023-12-22T09:16:59.112742+0000","last_clean":"2023-12-22T09:16:59.112742+0000","last_became_active":"2023-12-22T09:16:58.147993+0000","last_became_peered":"2023-12-22T09:16:58.147993+0000","last_unstale":"2023-12-22T09:16:59.112742+0000","last_undegraded":"2023-12-22T09:16:59.112742+0000","last_fullsized":"2023-12-22T09:16:59.112742+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.138740+0000","last_change":"2023-12-22T09:16:57.654251+0000","last_active":"2023-12-22T09:16:58.138740+0000","last_peered":"2023-12-22T09:16:58.138740+0000","last_clean":"2023-12-22T09:16:58.138740+0000","last_became_active":"2023-12-22T09:16:57.653954+0000","last_became_peered":"2023-12-22T09:16:57.653954+0000","last_unstale":"2023-12-22T09:16:58.138740+0000","last_undegraded":"2023-12-22T09:16:58.138740+0000","last_fullsized":"2023-12-22T09:16:58.138740+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.114435+0000","last_change":"2023-12-22T09:16:58.152892+0000","last_active":"2023-12-22T09:16:59.114435+0000","last_peered":"2023-12-22T09:16:59.114435+0000","last_clean":"2023-12-22T09:16:59.114435+0000","last_became_active":"2023-12-22T09:16:58.152538+0000","last_became_peered":"2023-12-22T09:16:58.152538+0000","last_unstale":"2023-12-22T09:16:59.114435+0000","last_undegraded":"2023-12-22T09:16:59.114435+0000","last_fullsized":"2023-12-22T09:16:59.114435+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:12:00.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.150516+0000","last_change":"2023-12-22T09:16:57.659614+0000","last_active":"2023-12-22T09:16:58.150516+0000","last_peered":"2023-12-22T09:16:58.150516+0000","last_clean":"2023-12-22T09:16:58.150516+0000","last_became_active":"2023-12-22T09:16:57.659211+0000","last_became_peered":"2023-12-22T09:16:57.659211+0000","last_unstale":"2023-12-22T09:16:58.150516+0000","last_undegraded":"2023-12-22T09:16:58.150516+0000","last_fullsized":"2023-12-22T09:16:58.150516+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.308050+0000","last_change":"2023-12-22T09:16:58.144680+0000","last_active":"2023-12-22T09:16:59.308050+0000","last_peered":"2023-12-22T09:16:59.308050+0000","last_clean":"2023-12-22T09:16:59.308050+0000","last_became_active":"2023-12-22T09:16:58.144401+0000","last_became_peered":"2023-12-22T09:16:58.144401+0000","last_unstale":"2023-12-22T09:16:59.308050+0000","last_undegraded":"2023-12-22T09:16:59.308050+0000","last_fullsized":"2023-12-22T09:16:59.308050+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:43.213252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.145640+0000","last_change":"2023-12-22T09:16:57.651659+0000","last_active":"2023-12-22T09:16:58.145640+0000","last_peered":"2023-12-22T09:16:58.145640+0000","last_clean":"2023-12-22T09:16:58.145640+0000","last_became_active":"2023-12-22T09:16:57.650353+0000","last_became_peered":"2023-12-22T09:16:57.650353+0000","last_unstale":"2023-12-22T09:16:58.145640+0000","last_undegraded":"2023-12-22T09:16:58.145640+0000","last_fullsized":"2023-12-22T09:16:58.145640+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:15.191139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.114515+0000","last_change":"2023-12-22T09:16:58.139368+0000","last_active":"2023-12-22T09:16:59.114515+0000","last_peered":"2023-12-22T09:16:59.114515+0000","last_clean":"2023-12-22T09:16:59.114515+0000","last_became_active":"2023-12-22T09:16:58.134697+0000","last_became_peered":"2023-12-22T09:16:58.134697+0000","last_unstale":"2023-12-22T09:16:59.114515+0000","last_undegraded":"2023-12-22T09:16:59.114515+0000","last_fullsized":"2023-12-22T09:16:59.114515+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:40.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.111197+0000","last_change":"2023-12-22T09:16:57.659460+0000","last_active":"2023-12-22T09:16:58.111197+0000","last_peered":"2023-12-22T09:16:58.111197+0000","last_clean":"2023-12-22T09:16:58.111197+0000","last_became_active":"2023-12-22T09:16:57.659124+0000","last_became_peered":"2023-12-22T09:16:57.659124+0000","last_unstale":"2023-12-22T09:16:58.111197+0000","last_undegraded":"2023-12-22T09:16:58.111197+0000","last_fullsized":"2023-12-22T09:16:58.111197+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:00.331386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:01.336516+0000","last_change":"2023-12-22T09:16:58.122054+0000","last_active":"2023-12-22T09:17:01.336516+0000","last_peered":"2023-12-22T09:17:01.336516+0000","last_clean":"2023-12-22T09:17:01.336516+0000","last_became_active":"2023-12-22T09:16:58.121132+0000","last_became_peered":"2023-12-22T09:16:58.121132+0000","last_unstale":"2023-12-22T09:17:01.336516+0000","last_undegraded":"2023-12-22T09:17:01.336516+0000","last_fullsized":"2023-12-22T09:17:01.336516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.141427+0000","last_change":"2023-12-22T09:16:57.643365+0000","last_active":"2023-12-22T09:16:58.141427+0000","last_peered":"2023-12-22T09:16:58.141427+0000","last_clean":"2023-12-22T09:16:58.141427+0000","last_became_active":"2023-12-22T09:16:57.642191+0000","last_became_peered":"2023-12-22T09:16:57.642191+0000","last_unstale":"2023-12-22T09:16:58.141427+0000","last_undegraded":"2023-12-22T09:16:58.141427+0000","last_fullsized":"2023-12-22T09:16:58.141427+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:42.294395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.729332+0000","last_change":"2023-12-22T09:16:58.139882+0000","last_active":"2023-12-22T09:17:00.729332+0000","last_peered":"2023-12-22T09:17:00.729332+0000","last_clean":"2023-12-22T09:17:00.729332+0000","last_became_active":"2023-12-22T09:16:58.139602+0000","last_became_peered":"2023-12-22T09:16:58.139602+0000","last_unstale":"2023-12-22T09:17:00.729332+0000","last_undegraded":"2023-12-22T09:17:00.729332+0000","last_fullsized":"2023-12-22T09:17:00.729332+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.121887+0000","last_change":"2023-12-22T09:16:57.651581+0000","last_active":"2023-12-22T09:16:58.121887+0000","last_peered":"2023-12-22T09:16:58.121887+0000","last_clean":"2023-12-22T09:16:58.121887+0000","last_became_active":"2023-12-22T09:16:57.651050+0000","last_became_peered":"2023-12-22T09:16:57.651050+0000","last_unstale":"2023-12-22T09:16:58.121887+0000","last_undegraded":"2023-12-22T09:16:58.121887+0000","last_fullsized":"2023-12-22T09:16:58.121887+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.112447+0000","last_change":"2023-12-22T09:16:58.127943+0000","last_active":"2023-12-22T09:16:59.112447+0000","last_peered":"2023-12-22T09:16:59.112447+0000","last_clean":"2023-12-22T09:16:59.112447+0000","last_became_active":"2023-12-22T09:16:58.127679+0000","last_became_peered":"2023-12-22T09:16:58.127679+0000","last_unstale":"2023-12-22T09:16:59.112447+0000","last_undegraded":"2023-12-22T09:16:59.112447+0000","last_fullsized":"2023-12-22T09:16:59.112447+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:34.212746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.113959+0000","last_change":"2023-12-22T09:16:57.643620+0000","last_active":"2023-12-22T09:16:58.113959+0000","last_peered":"2023-12-22T09:16:58.113959+0000","last_clean":"2023-12-22T09:16:58.113959+0000","last_became_active":"2023-12-22T09:16:57.643322+0000","last_became_peered":"2023-12-22T09:16:57.643322+0000","last_unstale":"2023-12-22T09:16:58.113959+0000","last_undegraded":"2023-12-22T09:16:58.113959+0000","last_fullsized":"2023-12-22T09:16:58.113959+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:13.807363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:01.336479+0000","last_change":"2023-12-22T09:16:58.147612+0000","last_active":"2023-12-22T09:17:01.336479+0000","last_peered":"2023-12-22T09:17:01.336479+0000","last_clean":"2023-12-22T09:17:01.336479+0000","last_became_active":"2023-12-22T09:16:58.147333+0000","last_became_peered":"2023-12-22T09:16:58.147333+0000","last_unstale":"2023-12-22T09:17:01.336479+0000","last_undegraded":"2023-12-22T09:17:01.336479+0000","last_fullsized":"2023-12-22T09:17:01.336479+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:55.463677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.138847+0000","last_change":"2023-12-22T09:16:57.654900+0000","last_active":"2023-12-22T09:16:58.138847+0000","last_peered":"2023-12-22T09:16:58.138847+0000","last_clean":"2023-12-22T09:16:58.138847+0000","last_became_active":"2023-12-22T09:16:57.654611+0000","last_became_peered":"2023-12-22T09:16:57.654611+0000","last_unstale":"2023-12-22T09:16:58.138847+0000","last_undegraded":"2023-12-22T09:16:58.138847+0000","last_fullsized":"2023-12-22T09:16:58.138847+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.719306+0000","last_change":"2023-12-22T09:16:58.122982+0000","last_active":"2023-12-22T09:17:00.719306+0000","last_peered":"2023-12-22T09:17:00.719306+0000","last_clean":"2023-12-22T09:17:00.719306+0000","last_became_active":"2023-12-22T09:16:58.122683+0000","last_became_peered":"2023-12-22T09:16:58.122683+0000","last_unstale":"2023-12-22T09:17:00.719306+0000","last_undegraded":"2023-12-22T09:17:00.719306+0000","last_fullsized":"2023-12-22T09:17:00.719306+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:03:37.012223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.129950+0000","last_change":"2023-12-22T09:16:57.652367+0000","last_active":"2023-12-22T09:16:58.129950+0000","last_peered":"2023-12-22T09:16:58.129950+0000","last_clean":"2023-12-22T09:16:58.129950+0000","last_became_active":"2023-12-22T09:16:57.651997+0000","last_became_peered":"2023-12-22T09:16:57.651997+0000","last_unstale":"2023-12-22T09:16:58.129950+0000","last_undegraded":"2023-12-22T09:16:58.129950+0000","last_fullsized":"2023-12-22T09:16:58.129950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.730033+0000","last_change":"2023-12-22T09:16:58.134298+0000","last_active":"2023-12-22T09:17:00.730033+0000","last_peered":"2023-12-22T09:17:00.730033+0000","last_clean":"2023-12-22T09:17:00.730033+0000","last_became_active":"2023-12-22T09:16:58.134027+0000","last_became_peered":"2023-12-22T09:16:58.134027+0000","last_unstale":"2023-12-22T09:17:00.730033+0000","last_undegraded":"2023-12-22T09:17:00.730033+0000","last_fullsized":"2023-12-22T09:17:00.730033+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.118535+0000","last_change":"2023-12-22T09:16:57.651565+0000","last_active":"2023-12-22T09:16:58.118535+0000","last_peered":"2023-12-22T09:16:58.118535+0000","last_clean":"2023-12-22T09:16:58.118535+0000","last_became_active":"2023-12-22T09:16:57.651295+0000","last_became_peered":"2023-12-22T09:16:57.651295+0000","last_unstale":"2023-12-22T09:16:58.118535+0000","last_undegraded":"2023-12-22T09:16:58.118535+0000","last_fullsized":"2023-12-22T09:16:58.118535+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:18.179171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.114708+0000","last_change":"2023-12-22T09:16:58.142640+0000","last_active":"2023-12-22T09:16:59.114708+0000","last_peered":"2023-12-22T09:16:59.114708+0000","last_clean":"2023-12-22T09:16:59.114708+0000","last_became_active":"2023-12-22T09:16:58.142334+0000","last_became_peered":"2023-12-22T09:16:58.142334+0000","last_unstale":"2023-12-22T09:16:59.114708+0000","last_undegraded":"2023-12-22T09:16:59.114708+0000","last_fullsized":"2023-12-22T09:16:59.114708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:35:36.019628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.107341+0000","last_change":"2023-12-22T09:16:57.655954+0000","last_active":"2023-12-22T09:16:58.107341+0000","last_peered":"2023-12-22T09:16:58.107341+0000","last_clean":"2023-12-22T09:16:58.107341+0000","last_became_active":"2023-12-22T09:16:57.655335+0000","last_became_peered":"2023-12-22T09:16:57.655335+0000","last_unstale":"2023-12-22T09:16:58.107341+0000","last_undegraded":"2023-12-22T09:16:58.107341+0000","last_fullsized":"2023-12-22T09:16:58.107341+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.111782+0000","last_change":"2023-12-22T09:16:58.121917+0000","last_active":"2023-12-22T09:16:59.111782+0000","last_peered":"2023-12-22T09:16:59.111782+0000","last_clean":"2023-12-22T09:16:59.111782+0000","last_became_active":"2023-12-22T09:16:58.118511+0000","last_became_peered":"2023-12-22T09:16:58.118511+0000","last_unstale":"2023-12-22T09:16:59.111782+0000","last_undegraded":"2023-12-22T09:16:59.111782+0000","last_fullsized":"2023-12-22T09:16:59.111782+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:33:40.126107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.136297+0000","last_change":"2023-12-22T09:16:57.647202+0000","last_active":"2023-12-22T09:16:58.136297+0000","last_peered":"2023-12-22T09:16:58.136297+0000","last_clean":"2023-12-22T09:16:58.136297+0000","last_became_active":"2023-12-22T09:16:57.646930+0000","last_became_peered":"2023-12-22T09:16:57.646930+0000","last_unstale":"2023-12-22T09:16:58.136297+0000","last_undegraded":"2023-12-22T09:16:58.136297+0000","last_fullsized":"2023-12-22T09:16:58.136297+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:40.073052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.307404+0000","last_change":"2023-12-22T09:16:58.139737+0000","last_active":"2023-12-22T09:16:59.307404+0000","last_peered":"2023-12-22T09:16:59.307404+0000","last_clean":"2023-12-22T09:16:59.307404+0000","last_became_active":"2023-12-22T09:16:58.139455+0000","last_became_peered":"2023-12-22T09:16:58.139455+0000","last_unstale":"2023-12-22T09:16:59.307404+0000","last_undegraded":"2023-12-22T09:16:59.307404+0000","last_fullsized":"2023-12-22T09:16:59.307404+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:21.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.111088+0000","last_change":"2023-12-22T09:16:57.640845+0000","last_active":"2023-12-22T09:16:58.111088+0000","last_peered":"2023-12-22T09:16:58.111088+0000","last_clean":"2023-12-22T09:16:58.111088+0000","last_became_active":"2023-12-22T09:16:57.640523+0000","last_became_peered":"2023-12-22T09:16:57.640523+0000","last_unstale":"2023-12-22T09:16:58.111088+0000","last_undegraded":"2023-12-22T09:16:58.111088+0000","last_fullsized":"2023-12-22T09:16:58.111088+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:11.216158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.224305+0000","last_change":"2023-12-22T09:16:58.136215+0000","last_active":"2023-12-22T09:16:59.224305+0000","last_peered":"2023-12-22T09:16:59.224305+0000","last_clean":"2023-12-22T09:16:59.224305+0000","last_became_active":"2023-12-22T09:16:58.135936+0000","last_became_peered":"2023-12-22T09:16:58.135936+0000","last_unstale":"2023-12-22T09:16:59.224305+0000","last_undegraded":"2023-12-22T09:16:59.224305+0000","last_fullsized":"2023-12-22T09:16:59.224305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.109595+0000","last_change":"2023-12-22T09:16:57.641987+0000","last_active":"2023-12-22T09:16:58.109595+0000","last_peered":"2023-12-22T09:16:58.109595+0000","last_clean":"2023-12-22T09:16:58.109595+0000","last_became_active":"2023-12-22T09:16:57.641712+0000","last_became_peered":"2023-12-22T09:16:57.641712+0000","last_unstale":"2023-12-22T09:16:58.109595+0000","last_undegraded":"2023-12-22T09:16:58.109595+0000","last_fullsized":"2023-12-22T09:16:58.109595+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:33.101510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:17:00.719029+0000","last_change":"2023-12-22T09:16:58.150323+0000","last_active":"2023-12-22T09:17:00.719029+0000","last_peered":"2023-12-22T09:17:00.719029+0000","last_clean":"2023-12-22T09:17:00.719029+0000","last_became_active":"2023-12-22T09:16:58.150063+0000","last_became_peered":"2023-12-22T09:16:58.150063+0000","last_unstale":"2023-12-22T09:17:00.719029+0000","last_undegraded":"2023-12-22T09:17:00.719029+0000","last_fullsized":"2023-12-22T09:17:00.719029+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:25.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.105391+0000","last_change":"2023-12-22T09:16:57.643219+0000","last_active":"2023-12-22T09:16:58.105391+0000","last_peered":"2023-12-22T09:16:58.105391+0000","last_clean":"2023-12-22T09:16:58.105391+0000","last_became_active":"2023-12-22T09:16:57.642986+0000","last_became_peered":"2023-12-22T09:16:57.642986+0000","last_unstale":"2023-12-22T09:16:58.105391+0000","last_undegraded":"2023-12-22T09:16:58.105391+0000","last_fullsized":"2023-12-22T09:16:58.105391+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-22T09:16:59.113909+0000","last_change":"2023-12-22T09:16:58.125951+0000","last_active":"2023-12-22T09:16:59.113909+0000","last_peered":"2023-12-22T09:16:59.113909+0000","last_clean":"2023-12-22T09:16:59.113909+0000","last_became_active":"2023-12-22T09:16:58.125435+0000","last_became_peered":"2023-12-22T09:16:58.125435+0000","last_unstale":"2023-12-22T09:16:59.113909+0000","last_undegraded":"2023-12-22T09:16:59.113909+0000","last_fullsized":"2023-12-22T09:16:59.113909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:30:10.376413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.109440+0000","last_change":"2023-12-22T09:16:57.639438+0000","last_active":"2023-12-22T09:16:58.109440+0000","last_peered":"2023-12-22T09:16:58.109440+0000","last_clean":"2023-12-22T09:16:58.109440+0000","last_became_active":"2023-12-22T09:16:57.639148+0000","last_became_peered":"2023-12-22T09:16:57.639148+0000","last_unstale":"2023-12-22T09:16:58.109440+0000","last_undegraded":"2023-12-22T09:16:58.109440+0000","last_fullsized":"2023-12-22T09:16:58.109440+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:36.593161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-22T09:16:58.133585+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:16:58.133585+0000","last_peered":"2023-12-22T09:16:58.133585+0000","last_clean":"2023-12-22T09:16:58.133585+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:16:58.133585+0000","last_undegraded":"2023-12-22T09:16:58.133585+0000","last_fullsized":"2023-12-22T09:16:58.133585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1318912,"data_stored":912623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.173,"15min":1.1870000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.2829999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1060000000000001,"15min":1.129},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.409,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.339}]},{"osd":1,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1910000000000001,"15min":1.1990000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.2769999999999999,"15min":1.3220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.339,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.4890000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1539999999999999,"15min":1.1739999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.3799999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":1.1499999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.24,"15min":1.256},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.427,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.425},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3600000000000001,"15min":1.3720000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.94299999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.268,"15min":1.2809999999999999},"min":{"1min":0.81399999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.585},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":1.038,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.6319999999999999,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.613}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.458,"15min":1.427},"min":{"1min":0.91400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":8.1620000000000008,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":1.544},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.476,"15min":1.504},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.6220000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.7130000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.5649999999999999,"15min":1.5740000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":1.645},{"interface":"front","average":{"1min":1.393,"5min":1.554,"15min":1.581},"min":{"1min":1.127,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.655,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.6839999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":712704,"data_stored":321513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.1100000000000001,"15min":1.1319999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.085,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4810000000000001,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.978,"15min":1.978},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5189999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.661,"5min":1.915,"15min":1.915},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.268,"15min":1.282},"min":{"1min":0.74099999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.4870000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4950000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.141},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3580000000000001,"15min":1.3740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.736,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.216}]},{"osd":4,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.494,"15min":1.52},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.581},{"interface":"front","average":{"1min":1.375,"5min":1.5549999999999999,"15min":1.585},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.722,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.5389999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.5760000000000001,"15min":1.6060000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.74,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.631},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.671,"15min":1.6970000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.952,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.677}]},{"osd":7,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.6379999999999999,"15min":1.6619999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.859,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.407},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.6240000000000001,"15min":1.637},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":2.0459999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.698}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":712704,"data_stored":321501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":0.97099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3240000000000001,"5min":1.677,"15min":1.677},"last":1.004},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4650000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.3180000000000001}]},{"osd":1,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.107,"15min":1.1180000000000001},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.48,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.24,"15min":1.26},"min":{"1min":0.73499999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.802,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.147}]},{"osd":2,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5449999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.377},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.159,"15min":1.169},"min":{"1min":0.748,"5min":0.629,"15min":0.629},"max":{"1min":1.4419999999999999,"5min":1.762,"15min":1.762},"last":1.538}]},{"osd":3,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.256,"15min":1.264},"min":{"1min":0.88,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5640000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.284,"15min":1.306},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8089999999999999,"5min":2.431,"15min":2.431},"last":2.0209999999999999}]},{"osd":4,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.304,"15min":1.3120000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5629999999999999,"5min":1.889,"15min":1.889},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4870000000000001,"15min":1.5},"min":{"1min":0.874,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.597}]},{"osd":6,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4099999999999999,"15min":1.4299999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.982,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4179999999999999,"15min":1.4359999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7889999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.248}]},{"osd":7,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.464,"15min":1.48},"min":{"1min":0.97499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.8540000000000001,"5min":3.298,"15min":3.298},"last":1.895},{"interface":"front","average":{"1min":1.377,"5min":1.504,"15min":1.5249999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.0899999999999999,"5min":2.589,"15min":2.589},"last":1.952}]}]},{"osd":4,"up_from":14,"seq":60129542180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":323043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3320000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.296},{"interface":"front","average":{"1min":1.083,"5min":1.115,"15min":1.121},"min":{"1min":0.70399999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5409999999999999,"5min":2.25,"15min":2.25},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.113,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.345,"5min":1.782,"15min":1.782},"last":1.042},{"interface":"front","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.425,"5min":1.494,"15min":1.494},"last":0.98999999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4890000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.208},{"interface":"front","average":{"1min":1.147,"5min":1.2130000000000001,"15min":1.224},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7749999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.167}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.1319999999999999,"15min":1.149},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.542,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.2929999999999999,"15min":1.3149999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.4690000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.3660000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3320000000000001,"15min":1.3520000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.909,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.268,"15min":1.286},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.679,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4950000000000001,"5min":2.052,"15min":2.052},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.5069999999999999,"15min":1.5329999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.236}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.4079999999999999,"15min":1.4350000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7470000000000001,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.266},{"interface":"front","average":{"1min":1.339,"5min":1.512,"15min":1.5409999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.629,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.4159999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542181,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":708608,"data_stored":321479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88500000000000001,"15min":0.89700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.627,"5min":1.716,"15min":1.716},"last":0.91200000000000003}]},{"osd":1,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4430000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.871},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.65500000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.107}]},{"osd":2,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.093,"15min":1.105},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1719999999999999,"15min":1.1899999999999999},"min":{"1min":0.66700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4019999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.4199999999999999}]},{"osd":4,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.244,"15min":1.25},"min":{"1min":0.90900000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.722,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.278},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.92200000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.571,"5min":2.508,"15min":2.508},"last":1.4630000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":2.0030000000000001,"15min":2.1219999999999999},"min":{"1min":0.86299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6519999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.258,"5min":2.254,"15min":2.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.6739999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":1.369}]},{"osd":6,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":2.423,"15min":2.6219999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.752,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.629},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.1970000000000001,"15min":2.339},"min":{"1min":0.98999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.722,"5min":27.181999999999999,"15min":27.181999999999999},"last":1.6699999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2,"15min":2.121},"min":{"1min":1.016,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5069999999999999,"5min":22.715,"15min":22.715},"last":1.605},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.3860000000000001,"15min":2.5619999999999998},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.643,"5min":30.108000000000001,"15min":30.108000000000001},"last":1.5580000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":708608,"data_stored":321479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.85599999999999998,"15min":0.88},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.395,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.95699999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.381,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.89600000000000002}]},{"osd":1,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":1.0069999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.357,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.171},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.98899999999999999,"15min":1.002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5489999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.98699999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0049999999999999,"15min":1.016},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5289999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.173,"15min":1.1910000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6279999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.625}]},{"osd":4,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.377,"15min":1.4179999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6160000000000001,"5min":2.802,"15min":2.802},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.4139999999999999,"15min":1.4370000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.758,"5min":2.46,"15min":2.46},"last":1.776}]},{"osd":5,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2889999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.595,"5min":3.327,"15min":3.327},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.371,"15min":1.399},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":1.8999999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4279999999999999,"15min":1.452},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9950000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.534},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.369,"15min":1.3999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.554,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":1.853}]},{"osd":7,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.4870000000000001,"15min":1.516},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.823,"5min":2.867,"15min":2.867},"last":1.667},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4670000000000001,"15min":1.4950000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.724,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":1.9570000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":323807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.879,"15min":0.90700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.262,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3260000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.377}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.90600000000000003,"15min":0.92800000000000005},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.218,"5min":1.504,"15min":1.504},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.103,"15min":1.143},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.282,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.0409999999999999,"15min":1.0700000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.54,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.266,"15min":1.3069999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4430000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.68799999999999994,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4330000000000001,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.3129999999999999,"15min":1.3500000000000001},"min":{"1min":0.77200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6599999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.4019999999999999,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.1720000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.214,"5min":1.534,"15min":1.5880000000000001},"min":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.649,"5min":4.524,"15min":4.524},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.5349999999999999,"15min":1.581},"min":{"1min":0.80900000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3879999999999999,"15min":1.4139999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.881,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.474,"15min":1.5089999999999999},"min":{"1min":0.79800000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.29,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.131},{"interface":"front","average":{"1min":1.319,"5min":1.52,"15min":1.554},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.766,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":1.044}]}]},{"osd":0,"up_from":14,"seq":60129542180,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1302528,"data_stored":911847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.0229999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2689999999999999,"5min":1.548,"15min":1.548},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.98099999999999998,"15min":1.0129999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.242,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.96699999999999997}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.1930000000000001,"15min":1.238},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6120000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.0900000000000001,"15min":1.1319999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3939999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1799999999999999,"15min":1.1990000000000001},"min":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.601,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.357,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":3.589,"15min":3.589},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5920000000000001,"5min":1.748,"15min":1.748},"last":1.153},{"interface":"front","average":{"1min":1.167,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.72599999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.49,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.2050000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.268,"15min":1.282},"min":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.611,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.413},{"interface":"front","average":{"1min":1.155,"5min":1.3069999999999999,"15min":1.333},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3089999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.365,"15min":1.3879999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8109999999999999,"5min":2.157,"15min":2.157},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.419,"15min":1.452},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6439999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.3600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:17:03.032 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T09:17:03.037 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T09:17:03.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.291+0000 7f936a316640 1 Processor -- start 2023-12-22T09:17:03.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.291+0000 7f936a316640 1 -- start start 2023-12-22T09:17:03.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.292+0000 7f936a316640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93640c5ca0 0x7f9364150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f936a316640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9364071e30 0x7f93640710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f936a316640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9364070000 con 0x7f936406bdc0 2023-12-22T09:17:03.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f936a316640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640702e0 con 0x7f93640c5ca0 2023-12-22T09:17:03.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f936a316640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93640705c0 con 0x7f9364071e30 2023-12-22T09:17:03.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f93688b3640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f936406bdc0 0x7f936414a5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38264/0 (socket says 172.21.15.106:38264) 2023-12-22T09:17:03.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f93688b3640 1 -- 172.21.15.106:0/3366210426 learned_addr learned my addr 172.21.15.106:0/3366210426 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:03.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f93637fe640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9364071e30 0x7f93640710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f9363fff640 1 --2- 172.21.15.106:0/3366210426 >> v2:172.21.15.132:3300/0 conn(0x7f93640c5ca0 0x7f9364150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958620362 0 0) 0x7f9364070000 con 0x7f936406bdc0 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.293+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f934c005730 con 0x7f936406bdc0 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1415424421 0 0) 0x7f934c005730 con 0x7f936406bdc0 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9364071e30 msgr2=0x7f93640710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9364071e30 0x7f93640710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 >> v2:172.21.15.132:3300/0 conn(0x7f93640c5ca0 msgr2=0x7f9364150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 --2- 172.21.15.106:0/3366210426 >> v2:172.21.15.132:3300/0 conn(0x7f93640c5ca0 0x7f9364150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640708a0 con 0x7f936406bdc0 2023-12-22T09:17:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f935c0019f0 con 0x7f936406bdc0 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 >> v1:172.21.15.106:6789/0 conn(0x7f936406bdc0 legacy=0x7f936414a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f934c005b80 0x7f934c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f934c006a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f934c007210 0x7f934c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640702e0 con 0x7f934c006570 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640705c0 con 0x7f934c007210 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c00e1b0 con 0x7f934c005b80 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f93637fe640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9364071e30 0x7f93640710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f93637fe640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f934c006a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.294+0000 7f9363fff640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f934c005b80 0x7f934c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.295+0000 7f93688b3640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f934c007210 0x7f934c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.295+0000 7f93637fe640 1 -- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f934c005b80 msgr2=0x7f934c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.295+0000 7f93637fe640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f934c005b80 0x7f934c005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.295+0000 7f93637fe640 1 -- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f934c007210 msgr2=0x7f934c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:03.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.295+0000 7f93637fe640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f934c007210 0x7f934c00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.295+0000 7f93637fe640 1 -- 172.21.15.106:0/3366210426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c005730 con 0x7f934c006570 2023-12-22T09:17:03.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.296+0000 7f93637fe640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f934c006a50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9358006e80 tx=0x7f934c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149514763c90e485 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:03.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.296+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358032600 con 0x7f934c006570 2023-12-22T09:17:03.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.296+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935802e050 con 0x7f934c006570 2023-12-22T09:17:03.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.296+0000 7f9362ffd640 1 -- 172.21.15.106:0/3366210426 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580329c0 con 0x7f934c006570 2023-12-22T09:17:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.296+0000 7f936a316640 1 -- 172.21.15.106:0/3366210426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 msgr2=0x7f934c006a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.296+0000 7f936a316640 1 --2- 172.21.15.106:0/3366210426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f934c006a50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9358006e80 tx=0x7f934c007a00 comp rx=0 tx=0).stop 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.297+0000 7f93688b3640 1 -- 172.21.15.106:0/3366210426 reap_dead start 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.297+0000 7f936a316640 1 -- 172.21.15.106:0/3366210426 shutdown_connections 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.297+0000 7f936a316640 1 -- 172.21.15.106:0/3366210426 >> 172.21.15.106:0/3366210426 conn(0x7f936406a220 msgr2=0x7f93640c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.297+0000 7f936a316640 1 -- 172.21.15.106:0/3366210426 shutdown_connections 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.297+0000 7f936a316640 1 -- 172.21.15.106:0/3366210426 wait complete. 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.298+0000 7f936a316640 1 Processor -- start 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.298+0000 7f936a316640 1 -- start start 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.299+0000 7f936a316640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f9364153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.299+0000 7f936a316640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93640bd260 0x7f93641ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.299+0000 7f936a316640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93640bee70 0x7f936414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.299+0000 7f936a316640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640bd6e0 con 0x7f934c006570 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.299+0000 7f936a316640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93641ed220 con 0x7f93640bd260 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.299+0000 7f936a316640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9364153fb0 con 0x7f93640bee70 2023-12-22T09:17:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.299+0000 7f9363fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f9364153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9363fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f9364153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59582/0 (socket says 172.21.15.106:59582) 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9363fff640 1 -- 172.21.15.106:0/3155013136 learned_addr learned my addr 172.21.15.106:0/3155013136 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9363fff640 1 -- 172.21.15.106:0/3155013136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93640bee70 msgr2=0x7f936414e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9363fff640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93640bee70 0x7f936414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9363fff640 1 -- 172.21.15.106:0/3155013136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93640bd260 msgr2=0x7f93641ecce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f93637fe640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93640bd260 0x7f93641ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9363fff640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93640bd260 0x7f93641ecce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9363fff640 1 -- 172.21.15.106:0/3155013136 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640bc780 con 0x7f934c006570 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9363fff640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f9364153940 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f93540116d0 tx=0x7f9354011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9360ff9640 1 -- 172.21.15.106:0/3155013136 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935400f9c0 con 0x7f934c006570 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f9360ff9640 1 -- 172.21.15.106:0/3155013136 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935400fb20 con 0x7f934c006570 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.300+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93640bca60 con 0x7f934c006570 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.301+0000 7f9360ff9640 1 -- 172.21.15.106:0/3155013136 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935400fe90 con 0x7f934c006570 2023-12-22T09:17:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.301+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93640bf2f0 con 0x7f934c006570 2023-12-22T09:17:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.302+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9364073f10 con 0x7f934c006570 2023-12-22T09:17:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.303+0000 7f9360ff9640 1 -- 172.21.15.106:0/3155013136 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9354015460 con 0x7f934c006570 2023-12-22T09:17:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.304+0000 7f9360ff9640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f935006a430 0x7f935006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.304+0000 7f9360ff9640 1 -- 172.21.15.106:0/3155013136 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93540892e0 con 0x7f934c006570 2023-12-22T09:17:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.304+0000 7f93637fe640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f935006a430 0x7f935006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.304+0000 7f93637fe640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f935006a430 0x7f935006c8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9358035000 tx=0x7f9358030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:03.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.308+0000 7f9360ff9640 1 -- 172.21.15.106:0/3155013136 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9354054820 con 0x7f934c006570 2023-12-22T09:17:03.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.544+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f93640c5740 con 0x7f934c006570 2023-12-22T09:17:03.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.553+0000 7f9360ff9640 1 -- 172.21.15.106:0/3155013136 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9354057e40 con 0x7f934c006570 2023-12-22T09:17:03.553 INFO:teuthology.orchestra.run.smithi106.stderr:updated caps for client.0 2023-12-22T09:17:03.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f935006a430 msgr2=0x7f935006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f935006a430 0x7f935006c8f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9358035000 tx=0x7f9358030000 comp rx=0 tx=0).stop 2023-12-22T09:17:03.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 msgr2=0x7f9364153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f9364153940 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f93540116d0 tx=0x7f9354011b90 comp rx=0 tx=0).stop 2023-12-22T09:17:03.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 shutdown_connections 2023-12-22T09:17:03.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f935006a430 0x7f935006c8f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93640bee70 0x7f936414e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93640bd260 0x7f93641ecce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 --2- 172.21.15.106:0/3155013136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f934c006570 0x7f9364153940 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 >> 172.21.15.106:0/3155013136 conn(0x7f936406a220 msgr2=0x7f93640c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:03.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 shutdown_connections 2023-12-22T09:17:03.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.556+0000 7f936a316640 1 -- 172.21.15.106:0/3155013136 wait complete. 2023-12-22T09:17:03.573 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:17:03.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.782+0000 7f76a533c640 1 Processor -- start 2023-12-22T09:17:03.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.783+0000 7f76a533c640 1 -- start start 2023-12-22T09:17:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.784+0000 7f76a533c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76a01514b0 0x7f76a00c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.784+0000 7f76a533c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76a00c4130 0x7f76a0154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.784+0000 7f76a533c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76a0154a80 0x7f76a00c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.784+0000 7f76a533c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a00c4660 con 0x7f76a01514b0 2023-12-22T09:17:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.784+0000 7f76a533c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a0153d60 con 0x7f76a0154a80 2023-12-22T09:17:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.784+0000 7f76a533c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a006b250 con 0x7f76a00c4130 2023-12-22T09:17:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.784+0000 7f769effd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76a01514b0 0x7f76a00c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.784+0000 7f769effd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76a01514b0 0x7f76a00c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59598/0 (socket says 172.21.15.106:59598) 2023-12-22T09:17:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.784+0000 7f769effd640 1 -- 172.21.15.106:0/2659477247 learned_addr learned my addr 172.21.15.106:0/2659477247 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.785+0000 7f769e7fc640 1 --2- 172.21.15.106:0/2659477247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76a00c4130 0x7f76a0154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.785+0000 7f769effd640 1 -- 172.21.15.106:0/2659477247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76a00c4130 msgr2=0x7f76a0154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.785+0000 7f769effd640 1 --2- 172.21.15.106:0/2659477247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76a00c4130 0x7f76a0154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.785+0000 7f769effd640 1 -- 172.21.15.106:0/2659477247 >> v2:172.21.15.132:3300/0 conn(0x7f76a0154a80 msgr2=0x7f76a00c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.785+0000 7f769f7fe640 1 --2- 172.21.15.106:0/2659477247 >> v2:172.21.15.132:3300/0 conn(0x7f76a0154a80 0x7f76a00c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.785+0000 7f769effd640 1 --2- 172.21.15.106:0/2659477247 >> v2:172.21.15.132:3300/0 conn(0x7f76a0154a80 0x7f76a00c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.785+0000 7f769effd640 1 -- 172.21.15.106:0/2659477247 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a006b530 con 0x7f76a01514b0 2023-12-22T09:17:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.786+0000 7f769effd640 1 --2- 172.21.15.106:0/2659477247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a01514b0 0x7f76a00c75b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f76a00ac090 tx=0x7f768802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15f73c7bdd9e502 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.786+0000 7f769dffb640 1 -- 172.21.15.106:0/2659477247 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76880317e0 con 0x7f76a01514b0 2023-12-22T09:17:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.786+0000 7f769dffb640 1 -- 172.21.15.106:0/2659477247 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7688031940 con 0x7f76a01514b0 2023-12-22T09:17:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.786+0000 7f769dffb640 1 -- 172.21.15.106:0/2659477247 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688031cd0 con 0x7f76a01514b0 2023-12-22T09:17:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.787+0000 7f76a533c640 1 -- 172.21.15.106:0/2659477247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a01514b0 msgr2=0x7f76a00c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.787+0000 7f76a533c640 1 --2- 172.21.15.106:0/2659477247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a01514b0 0x7f76a00c75b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f76a00ac090 tx=0x7f768802b880 comp rx=0 tx=0).stop 2023-12-22T09:17:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.787+0000 7f76a533c640 1 -- 172.21.15.106:0/2659477247 shutdown_connections 2023-12-22T09:17:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.787+0000 7f76a533c640 1 --2- 172.21.15.106:0/2659477247 >> v2:172.21.15.132:3300/0 conn(0x7f76a0154a80 0x7f76a00c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.787+0000 7f76a533c640 1 --2- 172.21.15.106:0/2659477247 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76a00c4130 0x7f76a0154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.787+0000 7f76a533c640 1 --2- 172.21.15.106:0/2659477247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a01514b0 0x7f76a00c75b0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.787+0000 7f76a533c640 1 -- 172.21.15.106:0/2659477247 >> 172.21.15.106:0/2659477247 conn(0x7f76a00ab1a0 msgr2=0x7f76a00ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.787+0000 7f76a533c640 1 -- 172.21.15.106:0/2659477247 shutdown_connections 2023-12-22T09:17:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.787+0000 7f76a533c640 1 -- 172.21.15.106:0/2659477247 wait complete. 2023-12-22T09:17:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.789+0000 7f76a533c640 1 Processor -- start 2023-12-22T09:17:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.789+0000 7f76a533c640 1 -- start start 2023-12-22T09:17:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.790+0000 7f76a533c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a00c4130 0x7f76a01e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.790+0000 7f76a533c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76a01514b0 0x7f76a00c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.790+0000 7f76a533c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a00bd780 0x7f76a00c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.790+0000 7f76a533c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00c0820 con 0x7f76a00bd780 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.790+0000 7f76a533c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00c0b00 con 0x7f76a00c4130 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.790+0000 7f76a533c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00c0de0 con 0x7f76a01514b0 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.790+0000 7f769f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a00bd780 0x7f76a00c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.790+0000 7f769f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a00bd780 0x7f76a00c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59614/0 (socket says 172.21.15.106:59614) 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.790+0000 7f769f7fe640 1 -- 172.21.15.106:0/1767333954 learned_addr learned my addr 172.21.15.106:0/1767333954 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f769effd640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a00c4130 0x7f76a01e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f769f7fe640 1 -- 172.21.15.106:0/1767333954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76a01514b0 msgr2=0x7f76a00c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f769f7fe640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76a01514b0 0x7f76a00c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f769f7fe640 1 -- 172.21.15.106:0/1767333954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a00c4130 msgr2=0x7f76a01e8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f769f7fe640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a00c4130 0x7f76a01e8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f769f7fe640 1 -- 172.21.15.106:0/1767333954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880094d0 con 0x7f76a00bd780 2023-12-22T09:17:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f769effd640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a00c4130 0x7f76a01e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f769f7fe640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a00bd780 0x7f76a00c1e00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f769800c510 tx=0x7f769800c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f76977fe640 1 -- 172.21.15.106:0/1767333954 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698004220 con 0x7f76a00bd780 2023-12-22T09:17:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f76977fe640 1 -- 172.21.15.106:0/1767333954 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76980043a0 con 0x7f76a00bd780 2023-12-22T09:17:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f76977fe640 1 -- 172.21.15.106:0/1767333954 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698003850 con 0x7f76a00bd780 2023-12-22T09:17:03.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a00c10c0 con 0x7f76a00bd780 2023-12-22T09:17:03.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.791+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a00bca80 con 0x7f76a00bd780 2023-12-22T09:17:03.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.792+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a00c15e0 con 0x7f76a00bd780 2023-12-22T09:17:03.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.793+0000 7f76977fe640 1 -- 172.21.15.106:0/1767333954 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76980039b0 con 0x7f76a00bd780 2023-12-22T09:17:03.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.794+0000 7f76977fe640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f768006a430 0x7f768006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:03.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.794+0000 7f76977fe640 1 -- 172.21.15.106:0/1767333954 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7698088730 con 0x7f76a00bd780 2023-12-22T09:17:03.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.795+0000 7f769effd640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f768006a430 0x7f768006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:03.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.795+0000 7f769effd640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f768006a430 0x7f768006c8f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7688036000 tx=0x7f768803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:03.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:03.799+0000 7f76977fe640 1 -- 172.21.15.106:0/1767333954 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f76a00c15e0 con 0x7f76a00bd780 2023-12-22T09:17:04.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.027+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76a00c15e0 con 0x7f76a00bd780 2023-12-22T09:17:04.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.029+0000 7f76977fe640 1 -- 172.21.15.106:0/1767333954 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4658 (secure 0 0 0) 0x7f76a00c15e0 con 0x7f76a00bd780 2023-12-22T09:17:04.029 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:04.029 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/3487360091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3487360091},{"type":"v1","addr":"172.21.15.132:6834","nonce":3487360091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2434839099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2434839099},{"type":"v1","addr":"172.21.15.132:6835","nonce":2434839099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1984802419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1984802419},{"type":"v1","addr":"172.21.15.106:6836","nonce":1984802419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:58.096259+0000","modified":"2023-12-22T09:17:01.107058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/520784305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":520784305},{"type":"v1","addr":"172.21.15.106:6837","nonce":520784305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-22T09:17:04.029 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 30 2023-12-22T09:17:04.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.031+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f768006a430 msgr2=0x7f768006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.031+0000 7f76a533c640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f768006a430 0x7f768006c8f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7688036000 tx=0x7f768803d040 comp rx=0 tx=0).stop 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.031+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a00bd780 msgr2=0x7f76a00c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.031+0000 7f76a533c640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a00bd780 0x7f76a00c1e00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f769800c510 tx=0x7f769800c9d0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.032+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 shutdown_connections 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.032+0000 7f76a533c640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f768006a430 0x7f768006c8f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.032+0000 7f76a533c640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76a00bd780 0x7f76a00c1e00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.032+0000 7f76a533c640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f76a01514b0 0x7f76a00c18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.032+0000 7f76a533c640 1 --2- 172.21.15.106:0/1767333954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a00c4130 0x7f76a01e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.032+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 >> 172.21.15.106:0/1767333954 conn(0x7f76a00ab1a0 msgr2=0x7f76a0152420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.032+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 shutdown_connections 2023-12-22T09:17:04.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.032+0000 7f76a533c640 1 -- 172.21.15.106:0/1767333954 wait complete. 2023-12-22T09:17:04.453 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T09:16:58.096259+0000', 'modified': '2023-12-22T09:17:01.107058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5185}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5185': {'gid': 5185, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6837/520784305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6835', 'nonce': 520784305}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 520784305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T09:17:04.453 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T09:17:04.454 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-22T09:17:04.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.679+0000 7fe483fc4640 1 Processor -- start 2023-12-22T09:17:04.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.680+0000 7fe483fc4640 1 -- start start 2023-12-22T09:17:04.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.681+0000 7fe483fc4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe47c0c4130 0x7fe47c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.681+0000 7fe483fc4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0c4660 con 0x7fe47c1514b0 2023-12-22T09:17:04.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.681+0000 7fe483fc4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c153d60 con 0x7fe47c06aad0 2023-12-22T09:17:04.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.681+0000 7fe483fc4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c154c50 con 0x7fe47c0c4130 2023-12-22T09:17:04.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.682+0000 7fe481d60640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe47c1514b0 0x7fe47c154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38272/0 (socket says 172.21.15.106:38272) 2023-12-22T09:17:04.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.682+0000 7fe481d60640 1 -- 172.21.15.106:0/2656085404 learned_addr learned my addr 172.21.15.106:0/2656085404 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:04.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.682+0000 7fe48155f640 1 --2- 172.21.15.106:0/2656085404 >> v2:172.21.15.132:3300/0 conn(0x7fe47c0c4130 0x7fe47c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.682+0000 7fe480d5e640 1 -- 172.21.15.106:0/2656085404 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346840804 0 0) 0x7fe47c0c4660 con 0x7fe47c1514b0 2023-12-22T09:17:04.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.682+0000 7fe480d5e640 1 -- 172.21.15.106:0/2656085404 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe468003520 con 0x7fe47c1514b0 2023-12-22T09:17:04.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.682+0000 7fe48155f640 1 -- 172.21.15.106:0/2656085404 >> v1:172.21.15.132:6789/0 conn(0x7fe47c06aad0 legacy=0x7fe47c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.682+0000 7fe48155f640 1 -- 172.21.15.106:0/2656085404 >> v1:172.21.15.106:6789/0 conn(0x7fe47c1514b0 legacy=0x7fe47c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.682+0000 7fe480d5e640 1 -- 172.21.15.106:0/2656085404 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4213092164 0 0) 0x7fe468003520 con 0x7fe47c1514b0 2023-12-22T09:17:04.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.682+0000 7fe48155f640 1 -- 172.21.15.106:0/2656085404 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c06b250 con 0x7fe47c0c4130 2023-12-22T09:17:04.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.684+0000 7fe48155f640 1 --2- 172.21.15.106:0/2656085404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c0c4130 0x7fe47c0c75b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0097a0 tx=0x7fe46c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2f5c97481259def server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.684+0000 7fe480d5e640 1 -- 172.21.15.106:0/2656085404 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478001670 con 0x7fe47c0c4130 2023-12-22T09:17:04.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.684+0000 7fe480d5e640 1 -- 172.21.15.106:0/2656085404 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c02e050 con 0x7fe47c0c4130 2023-12-22T09:17:04.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.684+0000 7fe480d5e640 1 -- 172.21.15.106:0/2656085404 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c030710 con 0x7fe47c0c4130 2023-12-22T09:17:04.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.685+0000 7fe483fc4640 1 -- 172.21.15.106:0/2656085404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c0c4130 msgr2=0x7fe47c0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.685+0000 7fe483fc4640 1 --2- 172.21.15.106:0/2656085404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c0c4130 0x7fe47c0c75b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0097a0 tx=0x7fe46c02b790 comp rx=0 tx=0).stop 2023-12-22T09:17:04.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.685+0000 7fe483fc4640 1 -- 172.21.15.106:0/2656085404 shutdown_connections 2023-12-22T09:17:04.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.685+0000 7fe483fc4640 1 --2- 172.21.15.106:0/2656085404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c0c4130 0x7fe47c0c75b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.685+0000 7fe483fc4640 1 -- 172.21.15.106:0/2656085404 >> 172.21.15.106:0/2656085404 conn(0x7fe47c0ab1a0 msgr2=0x7fe47c0ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:04.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.685+0000 7fe483fc4640 1 -- 172.21.15.106:0/2656085404 shutdown_connections 2023-12-22T09:17:04.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.685+0000 7fe483fc4640 1 -- 172.21.15.106:0/2656085404 wait complete. 2023-12-22T09:17:04.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.687+0000 7fe483fc4640 1 Processor -- start 2023-12-22T09:17:04.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.687+0000 7fe483fc4640 1 -- start start 2023-12-22T09:17:04.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe483fc4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c06aad0 0x7fe47c1ec800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe483fc4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe47c0c4130 0x7fe47c1eadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe483fc4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c1514b0 0x7fe47c1eb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe483fc4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1ea960 con 0x7fe47c1514b0 2023-12-22T09:17:04.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe483fc4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1ed490 con 0x7fe47c06aad0 2023-12-22T09:17:04.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe483fc4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1ea630 con 0x7fe47c0c4130 2023-12-22T09:17:04.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe482561640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c1514b0 0x7fe47c1eb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe482561640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c1514b0 0x7fe47c1eb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59630/0 (socket says 172.21.15.106:59630) 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe482561640 1 -- 172.21.15.106:0/3053941703 learned_addr learned my addr 172.21.15.106:0/3053941703 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe481d60640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c06aad0 0x7fe47c1ec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe48155f640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe47c0c4130 0x7fe47c1eadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe482561640 1 -- 172.21.15.106:0/3053941703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe47c0c4130 msgr2=0x7fe47c1eadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe482561640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe47c0c4130 0x7fe47c1eadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe482561640 1 -- 172.21.15.106:0/3053941703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c06aad0 msgr2=0x7fe47c1ec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe482561640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c06aad0 0x7fe47c1ec800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe482561640 1 -- 172.21.15.106:0/3053941703 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009400 con 0x7fe47c1514b0 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.688+0000 7fe481d60640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c06aad0 0x7fe47c1ec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.689+0000 7fe482561640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c1514b0 0x7fe47c1eb330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c7a0 tx=0x7fe47400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.689+0000 7fe4727fc640 1 -- 172.21.15.106:0/3053941703 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474003b70 con 0x7fe47c1514b0 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.689+0000 7fe4727fc640 1 -- 172.21.15.106:0/3053941703 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe474003cf0 con 0x7fe47c1514b0 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.689+0000 7fe4727fc640 1 -- 172.21.15.106:0/3053941703 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400aa90 con 0x7fe47c1514b0 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.689+0000 7fe483fc4640 1 -- 172.21.15.106:0/3053941703 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c1ed1b0 con 0x7fe47c1514b0 2023-12-22T09:17:04.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.689+0000 7fe483fc4640 1 -- 172.21.15.106:0/3053941703 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c1ecd40 con 0x7fe47c1514b0 2023-12-22T09:17:04.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.692+0000 7fe4727fc640 1 -- 172.21.15.106:0/3053941703 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe47400abf0 con 0x7fe47c1514b0 2023-12-22T09:17:04.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.693+0000 7fe4727fc640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe46006a430 0x7fe46006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.693+0000 7fe4727fc640 1 -- 172.21.15.106:0/3053941703 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe474088880 con 0x7fe47c1514b0 2023-12-22T09:17:04.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.693+0000 7fe481d60640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe46006a430 0x7fe46006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.694+0000 7fe486c0a740 1 Processor -- start 2023-12-22T09:17:04.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.694+0000 7fe486c0a740 1 -- start start 2023-12-22T09:17:04.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.694+0000 7fe481d60640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe46006a430 0x7fe46006c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe4780011e0 tx=0x7fe478009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.694+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f36057d0 0x5611f36400c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3605bb0 0x5611f3640600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3606860 0x5611f3641630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe486c0a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f356ff80 con 0x5611f3605bb0 2023-12-22T09:17:04.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe486c0a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f356d710 con 0x5611f36057d0 2023-12-22T09:17:04.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe486c0a740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611f3569000 con 0x5611f3606860 2023-12-22T09:17:04.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe48155f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3605bb0 0x5611f3640600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe48155f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3605bb0 0x5611f3640600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59640/0 (socket says 172.21.15.106:59640) 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe48155f640 1 -- 172.21.15.106:0/21210410 learned_addr learned my addr 172.21.15.106:0/21210410 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe481d60640 1 --2- 172.21.15.106:0/21210410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f36057d0 0x5611f36400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe48155f640 1 -- 172.21.15.106:0/21210410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3606860 msgr2=0x5611f3641630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe48155f640 1 --2- 172.21.15.106:0/21210410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3606860 0x5611f3641630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe48155f640 1 -- 172.21.15.106:0/21210410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f36057d0 msgr2=0x5611f36400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe48155f640 1 --2- 172.21.15.106:0/21210410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f36057d0 0x5611f36400c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe48155f640 1 -- 172.21.15.106:0/21210410 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611f3530690 con 0x5611f3605bb0 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.695+0000 7fe481d60640 1 --2- 172.21.15.106:0/21210410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f36057d0 0x5611f36400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.696+0000 7fe48155f640 1 --2- 172.21.15.106:0/21210410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3605bb0 0x5611f3640600 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe46c000c00 tx=0x7fe46c02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13aff1acb9affbb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.696+0000 7fe45f7fe640 1 -- 172.21.15.106:0/21210410 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0043c0 con 0x5611f3605bb0 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.696+0000 7fe45f7fe640 1 -- 172.21.15.106:0/21210410 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c003610 con 0x5611f3605bb0 2023-12-22T09:17:04.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.696+0000 7fe45f7fe640 1 -- 172.21.15.106:0/21210410 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c004520 con 0x5611f3605bb0 2023-12-22T09:17:04.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 -- 172.21.15.106:0/21210410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3605bb0 msgr2=0x5611f3640600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 --2- 172.21.15.106:0/21210410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3605bb0 0x5611f3640600 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe46c000c00 tx=0x7fe46c02d000 comp rx=0 tx=0).stop 2023-12-22T09:17:04.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 -- 172.21.15.106:0/21210410 shutdown_connections 2023-12-22T09:17:04.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 --2- 172.21.15.106:0/21210410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3606860 0x5611f3641630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 --2- 172.21.15.106:0/21210410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3605bb0 0x5611f3640600 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 --2- 172.21.15.106:0/21210410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f36057d0 0x5611f36400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 -- 172.21.15.106:0/21210410 >> 172.21.15.106:0/21210410 conn(0x5611f3601ea0 msgr2=0x5611f36268b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:04.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 -- 172.21.15.106:0/21210410 shutdown_connections 2023-12-22T09:17:04.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 -- 172.21.15.106:0/21210410 wait complete. 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.697+0000 7fe486c0a740 1 -- start start 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.698+0000 7fe486c0a740 1 Processor -- start 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 0x5611f36499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3606860 0x5611f3654660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3623150 0x5611f36235d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe486c0a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f350a7d0 con 0x5611f3606860 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe486c0a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f350a470 con 0x5611f3605bb0 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe486c0a740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611f32d0f20 con 0x5611f3623150 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe486c0a740 10 client.0 _ll_register_callbacks cb 0x5611f35591b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe48155f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3606860 0x5611f3654660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe48155f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3606860 0x5611f3654660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59646/0 (socket says 172.21.15.106:59646) 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe48155f640 1 -- 172.21.15.106:0/2894504996 learned_addr learned my addr 172.21.15.106:0/2894504996 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe481d60640 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 0x5611f36499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe48155f640 1 -- 172.21.15.106:0/2894504996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3623150 msgr2=0x5611f36235d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe48155f640 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3623150 0x5611f36235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe48155f640 1 -- 172.21.15.106:0/2894504996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 msgr2=0x5611f36499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe48155f640 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 0x5611f36499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.699+0000 7fe48155f640 1 -- 172.21.15.106:0/2894504996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c06b250 con 0x5611f3606860 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe48155f640 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3606860 0x5611f3654660 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe46c02bda0 tx=0x7fe46c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675bd2f85d8195f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe45cff9640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe45cff9640 1 -- 172.21.15.106:0/2894504996 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003d30 con 0x5611f3606860 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe486c0a740 1 -- 172.21.15.106:0/2894504996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611f3593550 con 0x5611f3606860 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe45cff9640 1 -- 172.21.15.106:0/2894504996 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe46c030510 con 0x5611f3606860 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe45cff9640 1 -- 172.21.15.106:0/2894504996 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe46c003e90 con 0x5611f3606860 2023-12-22T09:17:04.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe486c0a740 10 client.6078 fetch_fsmap learned FSMap version 30 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe486c0a740 1 -- 172.21.15.106:0/2894504996 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5611f3567680 con 0x5611f3606860 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe45cff9640 1 -- 172.21.15.106:0/2894504996 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611f3593550 con 0x5611f3606860 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.700+0000 7fe45cff9640 1 -- 172.21.15.106:0/2894504996 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 30) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe46c0306d0 con 0x5611f3606860 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.701+0000 7fe486c0a740 10 client.6078 fetch_fsmap finished waiting for FSMap version 30 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.701+0000 7fe486c0a740 10 client.6078 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.701+0000 7fe486c0a740 20 client.6078 populate_metadata read hostname 'smithi106' 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.701+0000 7fe486c0a740 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] conn(0x5611f365e160 0x5611f3660550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.701+0000 7fe486c0a740 4 client.6078 mds_command: new command op to 5185 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.701+0000 7fe486c0a740 1 -- 172.21.15.106:0/2894504996 --> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611f355bb50 con 0x5611f365e160 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.701+0000 7fe481d60640 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] conn(0x5611f365e160 0x5611f3660550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.702+0000 7fe45cff9640 10 client.6078 ms_handle_connect on v2:172.21.15.106:6835/520784305 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.702+0000 7fe481d60640 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] conn(0x5611f365e160 0x5611f3660550 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3330eb20d4769259 server_cookie=956d89ecbf408a54 in_seq=0 out_seq=0 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.702+0000 7fe45cff9640 1 -- 172.21.15.106:0/2894504996 <== mds.0 v2:172.21.15.106:6835/520784305 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5611f355bb50 con 0x5611f365e160 2023-12-22T09:17:04.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.702+0000 7fe45cff9640 10 client.6078 handle_command_reply: tid=0 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 client.6078 shutdown 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 -- 172.21.15.106:0/2894504996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3606860 msgr2=0x5611f3654660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3606860 0x5611f3654660 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe46c02bda0 tx=0x7fe46c004730 comp rx=0 tx=0).stop 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 -- 172.21.15.106:0/2894504996 shutdown_connections 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] conn(0x5611f365e160 0x5611f3660550 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3623150 0x5611f36235d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3606860 0x5611f3654660 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 --2- 172.21.15.106:0/2894504996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 0x5611f36499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 -- 172.21.15.106:0/2894504996 >> 172.21.15.106:0/2894504996 conn(0x5611f36057d0 msgr2=0x5611f3626e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe45cff9640 0 client.6078 ms_handle_reset on v2:172.21.15.106:6835/520784305 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 -- 172.21.15.106:0/2894504996 shutdown_connections 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 1 -- 172.21.15.106:0/2894504996 wait complete. 2023-12-22T09:17:04.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.703+0000 7fe486c0a740 20 client.6078 trim_cache size 0 max 16384 2023-12-22T09:17:04.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.719+0000 7fe486c0a740 1 Processor -- start 2023-12-22T09:17:04.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.719+0000 7fe486c0a740 1 -- start start 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.720+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 0x5611f35ff460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.720+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3606860 0x5611f35ffc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.720+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f3625f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.720+0000 7fe486c0a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f356f0f0 con 0x5611f3623150 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.720+0000 7fe486c0a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f36244d0 con 0x5611f3605bb0 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.720+0000 7fe486c0a740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611f3644b10 con 0x5611f3606860 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe482561640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f3625f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe482561640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f3625f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59658/0 (socket says 172.21.15.106:59658) 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe482561640 1 -- 172.21.15.106:0/1710127588 learned_addr learned my addr 172.21.15.106:0/1710127588 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe48155f640 1 --2- 172.21.15.106:0/1710127588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3606860 0x5611f35ffc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe482561640 1 -- 172.21.15.106:0/1710127588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3606860 msgr2=0x5611f35ffc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe482561640 1 --2- 172.21.15.106:0/1710127588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3606860 0x5611f35ffc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe482561640 1 -- 172.21.15.106:0/1710127588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 msgr2=0x5611f35ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe481d60640 1 --2- 172.21.15.106:0/1710127588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 0x5611f35ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe482561640 1 --2- 172.21.15.106:0/1710127588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 0x5611f35ff460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe482561640 1 -- 172.21.15.106:0/1710127588 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611f35099e0 con 0x5611f3623150 2023-12-22T09:17:04.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe482561640 1 --2- 172.21.15.106:0/1710127588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f3625f20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe474057700 tx=0x7fe474053e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6415e454225eacb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.721+0000 7fe45ffff640 1 -- 172.21.15.106:0/1710127588 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474057a00 con 0x5611f3623150 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe45ffff640 1 -- 172.21.15.106:0/1710127588 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47405b830 con 0x5611f3623150 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe45ffff640 1 -- 172.21.15.106:0/1710127588 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47405f9e0 con 0x5611f3623150 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe486c0a740 1 -- 172.21.15.106:0/1710127588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 msgr2=0x5611f3625f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe486c0a740 1 --2- 172.21.15.106:0/1710127588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f3625f20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe474057700 tx=0x7fe474053e70 comp rx=0 tx=0).stop 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe486c0a740 1 -- 172.21.15.106:0/1710127588 shutdown_connections 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe486c0a740 1 --2- 172.21.15.106:0/1710127588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f3625f20 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe486c0a740 1 --2- 172.21.15.106:0/1710127588 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3606860 0x5611f35ffc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe486c0a740 1 --2- 172.21.15.106:0/1710127588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3605bb0 0x5611f35ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe486c0a740 1 -- 172.21.15.106:0/1710127588 >> 172.21.15.106:0/1710127588 conn(0x5611f36057d0 msgr2=0x5611f3664750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe486c0a740 1 -- 172.21.15.106:0/1710127588 shutdown_connections 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.722+0000 7fe486c0a740 1 -- 172.21.15.106:0/1710127588 wait complete. 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.723+0000 7fe486c0a740 1 -- start start 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.723+0000 7fe486c0a740 1 Processor -- start 2023-12-22T09:17:04.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3605bb0 0x5611f3629700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3606860 0x5611f3648940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe486c0a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f36a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe486c0a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f36a6cd0 con 0x5611f3623150 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe486c0a740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f3643520 con 0x5611f3606860 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe486c0a740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611f3626b50 con 0x5611f3605bb0 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe486c0a740 10 client.0 _ll_register_callbacks cb 0x7fe46c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe482561640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f36a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe482561640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f36a3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59660/0 (socket says 172.21.15.106:59660) 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.724+0000 7fe482561640 1 -- 172.21.15.106:0/3321900645 learned_addr learned my addr 172.21.15.106:0/3321900645 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe481d60640 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3605bb0 0x5611f3629700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe482561640 1 -- 172.21.15.106:0/3321900645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3605bb0 msgr2=0x5611f3629700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe482561640 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3605bb0 0x5611f3629700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe482561640 1 -- 172.21.15.106:0/3321900645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3606860 msgr2=0x5611f3648940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe48155f640 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3606860 0x5611f3648940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe482561640 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3606860 0x5611f3648940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe482561640 1 -- 172.21.15.106:0/3321900645 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c1ecd40 con 0x5611f3623150 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe482561640 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f36a3ba0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe474053f00 tx=0x7fe47401d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf4d32d9cd86349 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe45cff9640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe45cff9640 1 -- 172.21.15.106:0/3321900645 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474057a00 con 0x5611f3623150 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe45cff9640 1 -- 172.21.15.106:0/3321900645 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe474080e40 con 0x5611f3623150 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe486c0a740 1 -- 172.21.15.106:0/3321900645 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe46c003610 con 0x5611f3623150 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe45cff9640 1 -- 172.21.15.106:0/3321900645 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe47405f9e0 con 0x5611f3623150 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe486c0a740 10 client.6084 fetch_fsmap learned FSMap version 30 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.725+0000 7fe486c0a740 1 -- 172.21.15.106:0/3321900645 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5611f352eef0 con 0x5611f3623150 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.726+0000 7fe45cff9640 1 -- 172.21.15.106:0/3321900645 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c003610 con 0x5611f3623150 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.726+0000 7fe45cff9640 1 -- 172.21.15.106:0/3321900645 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 30) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fe474019020 con 0x5611f3623150 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.726+0000 7fe486c0a740 10 client.6084 fetch_fsmap finished waiting for FSMap version 30 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.726+0000 7fe486c0a740 10 client.6084 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.726+0000 7fe486c0a740 20 client.6084 populate_metadata read hostname 'smithi106' 2023-12-22T09:17:04.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.726+0000 7fe486c0a740 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] conn(0x5611f36a40e0 0x5611f365a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.726+0000 7fe486c0a740 4 client.6084 mds_command: new command op to 5185 tid=0[{"prefix": "status"}] 2023-12-22T09:17:04.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.726+0000 7fe486c0a740 1 -- 172.21.15.106:0/3321900645 --> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611f3562080 con 0x5611f36a40e0 2023-12-22T09:17:04.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.726+0000 7fe481d60640 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] conn(0x5611f36a40e0 0x5611f365a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe481d60640 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] conn(0x5611f36a40e0 0x5611f365a610 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9c5c4b7e6d8d787 server_cookie=fe5b96ade4986f57 in_seq=0 out_seq=0 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe45cff9640 10 client.6084 ms_handle_connect on v2:172.21.15.106:6835/520784305 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe45cff9640 1 -- 172.21.15.106:0/3321900645 <== mds.0 v2:172.21.15.106:6835/520784305 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5611f3562080 con 0x5611f36a40e0 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe45cff9640 10 client.6084 handle_command_reply: tid=0 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 client.6084 shutdown 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 -- 172.21.15.106:0/3321900645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 msgr2=0x5611f36a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f36a3ba0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe474053f00 tx=0x7fe47401d070 comp rx=0 tx=0).stop 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 -- 172.21.15.106:0/3321900645 shutdown_connections 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.106:6835/520784305,v1:172.21.15.106:6837/520784305] conn(0x5611f36a40e0 0x5611f365a610 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5611f3623150 0x5611f36a3ba0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5611f3606860 0x5611f3648940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 --2- 172.21.15.106:0/3321900645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5611f3605bb0 0x5611f3629700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe45cff9640 0 client.6084 ms_handle_reset on v2:172.21.15.106:6835/520784305 2023-12-22T09:17:04.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 -- 172.21.15.106:0/3321900645 >> 172.21.15.106:0/3321900645 conn(0x5611f36057d0 msgr2=0x5611f362a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:04.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 -- 172.21.15.106:0/3321900645 shutdown_connections 2023-12-22T09:17:04.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.727+0000 7fe486c0a740 1 -- 172.21.15.106:0/3321900645 wait complete. 2023-12-22T09:17:04.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe486c0a740 20 client.6084 trim_cache size 0 max 16384 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "c9422aac-a1e3-428b-87d0-2dbf321c6b46", 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 5185, 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 6.6246709350000001, 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 30, 2023-12-22T09:17:04.733 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 59, 2023-12-22T09:17:04.734 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 59, 2023-12-22T09:17:04.734 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 12.619066181000001 2023-12-22T09:17:04.734 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-12-22T09:17:04.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 -- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe46006a430 msgr2=0x7fe46006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe46006a430 0x7fe46006c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe4780011e0 tx=0x7fe478009040 comp rx=0 tx=0).stop 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 -- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c1514b0 msgr2=0x7fe47c1eb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c1514b0 0x7fe47c1eb330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c7a0 tx=0x7fe47400cc60 comp rx=0 tx=0).stop 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 -- 172.21.15.106:0/3053941703 shutdown_connections 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fe46006a430 0x7fe46006c8f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c1514b0 0x7fe47c1eb330 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe47c0c4130 0x7fe47c1eadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 --2- 172.21.15.106:0/3053941703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe47c06aad0 0x7fe47c1ec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 -- 172.21.15.106:0/3053941703 >> 172.21.15.106:0/3053941703 conn(0x7fe47c0ab1a0 msgr2=0x7fe47c152130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 -- 172.21.15.106:0/3053941703 shutdown_connections 2023-12-22T09:17:04.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.728+0000 7fe483fc4640 1 -- 172.21.15.106:0/3053941703 wait complete. 2023-12-22T09:17:04.745 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:17:04.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.951+0000 7fb652448640 1 Processor -- start 2023-12-22T09:17:04.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.951+0000 7fb652448640 1 -- start start 2023-12-22T09:17:04.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.952+0000 7fb652448640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb64c0be700 0x7fb64c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.952+0000 7fb652448640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c153e90 con 0x7fb64c157c80 2023-12-22T09:17:04.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.952+0000 7fb652448640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c154c10 con 0x7fb64c069e60 2023-12-22T09:17:04.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.952+0000 7fb652448640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c153c80 con 0x7fb64c0be700 2023-12-22T09:17:04.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.953+0000 7fb643fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb64c157c80 0x7fb64c070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38276/0 (socket says 172.21.15.106:38276) 2023-12-22T09:17:04.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.953+0000 7fb643fff640 1 -- 172.21.15.106:0/1989697346 learned_addr learned my addr 172.21.15.106:0/1989697346 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:04.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.953+0000 7fb6509e5640 1 --2- 172.21.15.106:0/1989697346 >> v2:172.21.15.132:3300/0 conn(0x7fb64c0be700 0x7fb64c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.953+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363384646 0 0) 0x7fb64c153e90 con 0x7fb64c157c80 2023-12-22T09:17:04.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.953+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb638003520 con 0x7fb64c157c80 2023-12-22T09:17:04.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.953+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629954838 0 0) 0x7fb638003520 con 0x7fb64c157c80 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.953+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 >> v2:172.21.15.132:3300/0 conn(0x7fb64c0be700 msgr2=0x7fb64c0711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.953+0000 7fb64b7fe640 1 --2- 172.21.15.106:0/1989697346 >> v2:172.21.15.132:3300/0 conn(0x7fb64c0be700 0x7fb64c0711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 >> v1:172.21.15.132:6789/0 conn(0x7fb64c069e60 legacy=0x7fb64c13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c154130 con 0x7fb64c157c80 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fb634001670 con 0x7fb64c157c80 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 >> v1:172.21.15.106:6789/0 conn(0x7fb64c157c80 legacy=0x7fb64c070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb638003970 0x7fb638003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6380047c0 0x7fb638004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb638005180 0x7fb63800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c153c80 con 0x7fb6380047c0 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63800c120 con 0x7fb638005180 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63800c2e0 con 0x7fb638003970 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb643fff640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6380047c0 0x7fb638004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb64bfff640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb638003970 0x7fb638003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb6509e5640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb638005180 0x7fb63800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb643fff640 1 -- 172.21.15.106:0/1989697346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb638003970 msgr2=0x7fb638003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb643fff640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb638003970 0x7fb638003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb643fff640 1 -- 172.21.15.106:0/1989697346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb638005180 msgr2=0x7fb63800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:04.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb643fff640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb638005180 0x7fb63800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb643fff640 1 -- 172.21.15.106:0/1989697346 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb638003520 con 0x7fb6380047c0 2023-12-22T09:17:04.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.954+0000 7fb6509e5640 1 -- 172.21.15.106:0/1989697346 reap_dead start 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.956+0000 7fb643fff640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6380047c0 0x7fb638004c40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c210 tx=0x7fb6380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bdd09dc2a28f4e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.956+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634005ad0 con 0x7fb6380047c0 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.956+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634005c30 con 0x7fb6380047c0 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.956+0000 7fb64b7fe640 1 -- 172.21.15.106:0/1989697346 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63402c850 con 0x7fb6380047c0 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.956+0000 7fb652448640 1 -- 172.21.15.106:0/1989697346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6380047c0 msgr2=0x7fb638004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.956+0000 7fb652448640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6380047c0 0x7fb638004c40 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c210 tx=0x7fb6380057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.956+0000 7fb652448640 1 -- 172.21.15.106:0/1989697346 shutdown_connections 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.956+0000 7fb652448640 1 --2- 172.21.15.106:0/1989697346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6380047c0 0x7fb638004c40 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.956+0000 7fb652448640 1 -- 172.21.15.106:0/1989697346 >> 172.21.15.106:0/1989697346 conn(0x7fb64c0c5360 msgr2=0x7fb64c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.957+0000 7fb652448640 1 -- 172.21.15.106:0/1989697346 shutdown_connections 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.957+0000 7fb652448640 1 -- 172.21.15.106:0/1989697346 wait complete. 2023-12-22T09:17:04.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.958+0000 7fb652448640 1 Processor -- start 2023-12-22T09:17:04.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.958+0000 7fb652448640 1 -- start start 2023-12-22T09:17:04.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.959+0000 7fb652448640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6380047c0 0x7fb64c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.959+0000 7fb652448640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb64c139310 0x7fb64c1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.959+0000 7fb652448640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb64c0aaef0 0x7fb64c138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.959+0000 7fb652448640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c139160 con 0x7fb64c0aaef0 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.959+0000 7fb652448640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c1e9840 con 0x7fb64c139310 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.959+0000 7fb652448640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c1e8c30 con 0x7fb6380047c0 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb6509e5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb64c0aaef0 0x7fb64c138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb6509e5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb64c0aaef0 0x7fb64c138c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59672/0 (socket says 172.21.15.106:59672) 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb6509e5640 1 -- 172.21.15.106:0/3567615817 learned_addr learned my addr 172.21.15.106:0/3567615817 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb6509e5640 1 -- 172.21.15.106:0/3567615817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6380047c0 msgr2=0x7fb64c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb643fff640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb64c139310 0x7fb64c1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb6509e5640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6380047c0 0x7fb64c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb6509e5640 1 -- 172.21.15.106:0/3567615817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb64c139310 msgr2=0x7fb64c1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb6509e5640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb64c139310 0x7fb64c1386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb6509e5640 1 -- 172.21.15.106:0/3567615817 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c1e8f10 con 0x7fb64c0aaef0 2023-12-22T09:17:04.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.960+0000 7fb6509e5640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb64c0aaef0 0x7fb64c138c20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb64c06a8a0 tx=0x7fb64400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.961+0000 7fb6497fa640 1 -- 172.21.15.106:0/3567615817 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644016420 con 0x7fb64c0aaef0 2023-12-22T09:17:04.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.961+0000 7fb6497fa640 1 -- 172.21.15.106:0/3567615817 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6440165a0 con 0x7fb64c0aaef0 2023-12-22T09:17:04.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.961+0000 7fb6497fa640 1 -- 172.21.15.106:0/3567615817 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644016950 con 0x7fb64c0aaef0 2023-12-22T09:17:04.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.961+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c1e91f0 con 0x7fb64c0aaef0 2023-12-22T09:17:04.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.961+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c150d10 con 0x7fb64c0aaef0 2023-12-22T09:17:04.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.962+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64c073f10 con 0x7fb64c0aaef0 2023-12-22T09:17:04.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.963+0000 7fb6497fa640 1 -- 172.21.15.106:0/3567615817 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb644016ab0 con 0x7fb64c0aaef0 2023-12-22T09:17:04.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.964+0000 7fb6497fa640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb62c06a400 0x7fb62c06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:04.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.964+0000 7fb6497fa640 1 -- 172.21.15.106:0/3567615817 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb644089a60 con 0x7fb64c0aaef0 2023-12-22T09:17:04.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.964+0000 7fb64bfff640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb62c06a400 0x7fb62c06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:04.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.965+0000 7fb64bfff640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb62c06a400 0x7fb62c06c8c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb63c007fd0 tx=0x7fb63c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:04.969+0000 7fb6497fa640 1 -- 172.21.15.106:0/3567615817 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb644054f10 con 0x7fb64c0aaef0 2023-12-22T09:17:05.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.198+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb64c1e99b0 con 0x7fb64c0aaef0 2023-12-22T09:17:05.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.198+0000 7fb6497fa640 1 -- 172.21.15.106:0/3567615817 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb644058530 con 0x7fb64c0aaef0 2023-12-22T09:17:05.198 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T09:17:05.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb62c06a400 msgr2=0x7fb62c06c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:05.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb62c06a400 0x7fb62c06c8c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb63c007fd0 tx=0x7fb63c009040 comp rx=0 tx=0).stop 2023-12-22T09:17:05.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb64c0aaef0 msgr2=0x7fb64c138c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:05.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb64c0aaef0 0x7fb64c138c20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb64c06a8a0 tx=0x7fb64400f520 comp rx=0 tx=0).stop 2023-12-22T09:17:05.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 shutdown_connections 2023-12-22T09:17:05.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb62c06a400 0x7fb62c06c8c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:05.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb64c0aaef0 0x7fb64c138c20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:05.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb64c139310 0x7fb64c1386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:05.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 --2- 172.21.15.106:0/3567615817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6380047c0 0x7fb64c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:05.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 >> 172.21.15.106:0/3567615817 conn(0x7fb64c0c5360 msgr2=0x7fb64c0716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:05.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 shutdown_connections 2023-12-22T09:17:05.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:05.201+0000 7fb652448640 1 -- 172.21.15.106:0/3567615817 wait complete. 2023-12-22T09:17:05.220 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T09:17:05.220 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:17:05.220 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2023-12-22T09:17:05.220 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T09:17:05.220 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T09:17:05.220 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T09:17:05.221 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T09:17:05.221 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T09:17:05.221 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:17:05.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:05.221 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42210sec preferred_lft 42210sec 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 1a:08:33:e3:a0:21 brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::b017:8aff:febf:6d1d/64 scope link 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:05.271 INFO:teuthology.orchestra.run.smithi106.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T09:17:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 1a:08:33:e3:a0:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T09:17:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::1808:33ff:fee3:a021/64 scope link 2023-12-22T09:17:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:05.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:05.272 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:17:05.360 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-12-22T09:17:05.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:05.365 DEBUG:teuthology.orchestra.run.smithi106:> route 2023-12-22T09:17:05.420 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2023-12-22T09:17:05.420 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:17:05.420 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:17:05.420 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:17:05.420 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:17:05.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:05.420 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-12-22T09:17:05.421 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-12-22T09:17:05.421 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:17:05.421 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:17:05.421 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:17:05.421 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-12-22T09:17:05.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:05.605 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-12-22T09:17:05.657 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T09:17:05.658 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T09:17:05.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:05.658 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2023-12-22T09:17:05.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:17:05.751 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T09:17:05.804 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:17:05.804 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T09:17:05.855 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T09:17:05.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:05.856 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:17:05.994 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:17:05.994 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T09:17:05.994 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:17:06.015 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:17:06.016 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T09:17:06.016 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:17:06.016 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:17:06.016 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:17:06.042 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T09:17:06.042 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T09:17:06.042 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-12-22T09:17:06.042 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:17:06.043 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:17:06.043 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790" 2023-12-22T09:17:06.043 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2023-12-22T09:17:06.043 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c9422aac-a1e3-428b-87d0-2dbf321c6b46" will pass to kernel 2023-12-22T09:17:06.045 INFO:teuthology.orchestra.run.smithi106.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T09:17:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: You just mounted a file system that supports labels which does not 2023-12-22T09:17:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T09:17:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T09:17:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T09:17:06.049 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T09:17:06.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:06.049 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T09:17:06.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:06.140 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:17:06.202 INFO:teuthology.orchestra.run.smithi106.stdout:client4907 2023-12-22T09:17:06.202 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:17:06.202 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:17:06.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:17:06.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.506+0000 7f0ace555640 1 Processor -- start 2023-12-22T09:17:06.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.506+0000 7f0ace555640 1 -- start start 2023-12-22T09:17:06.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.508+0000 7f0ace555640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ac8069e60 0x7f0ac814a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:06.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.508+0000 7f0ace555640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8152680 0x7f0ac814abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:06.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.508+0000 7f0ace555640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80bfce0 con 0x7f0ac8150a80 2023-12-22T09:17:06.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.508+0000 7f0ace555640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac80c0960 con 0x7f0ac8069e60 2023-12-22T09:17:06.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.508+0000 7f0ace555640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac806aba0 con 0x7f0ac8152680 2023-12-22T09:17:06.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.508+0000 7f0abffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0ac8150a80 0x7f0ac8151f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38288/0 (socket says 172.21.15.106:38288) 2023-12-22T09:17:06.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.508+0000 7f0abffff640 1 -- 172.21.15.106:0/2396038585 learned_addr learned my addr 172.21.15.106:0/2396038585 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:06.509 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.508+0000 7f0ac7fff640 1 --2- 172.21.15.106:0/2396038585 >> v2:172.21.15.106:3300/0 conn(0x7f0ac8069e60 0x7f0ac814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:06.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.508+0000 7f0accaf2640 1 --2- 172.21.15.106:0/2396038585 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8152680 0x7f0ac814abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:06.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.509+0000 7f0ac77fe640 1 -- 172.21.15.106:0/2396038585 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104870834 0 0) 0x7f0ac80bfce0 con 0x7f0ac8150a80 2023-12-22T09:17:06.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.509+0000 7f0ac77fe640 1 -- 172.21.15.106:0/2396038585 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab4003520 con 0x7f0ac8150a80 2023-12-22T09:17:06.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.509+0000 7f0ac7fff640 1 -- 172.21.15.106:0/2396038585 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8152680 msgr2=0x7f0ac814abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:06.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.509+0000 7f0ac7fff640 1 --2- 172.21.15.106:0/2396038585 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8152680 0x7f0ac814abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:06.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.509+0000 7f0ac7fff640 1 -- 172.21.15.106:0/2396038585 >> v1:172.21.15.106:6789/0 conn(0x7f0ac8150a80 legacy=0x7f0ac8151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:06.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.509+0000 7f0ac7fff640 1 -- 172.21.15.106:0/2396038585 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac80bffc0 con 0x7f0ac8069e60 2023-12-22T09:17:06.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.510+0000 7f0ac7fff640 1 --2- 172.21.15.106:0/2396038585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8069e60 0x7f0ac814a670 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80097c0 tx=0x7f0ab802b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6c68c61af5122 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.510+0000 7f0ac77fe640 1 -- 172.21.15.106:0/2396038585 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80316d0 con 0x7f0ac8069e60 2023-12-22T09:17:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ac77fe640 1 -- 172.21.15.106:0/2396038585 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab8031830 con 0x7f0ac8069e60 2023-12-22T09:17:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ac77fe640 1 -- 172.21.15.106:0/2396038585 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8031ba0 con 0x7f0ac8069e60 2023-12-22T09:17:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ace555640 1 -- 172.21.15.106:0/2396038585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8069e60 msgr2=0x7f0ac814a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ace555640 1 --2- 172.21.15.106:0/2396038585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8069e60 0x7f0ac814a670 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80097c0 tx=0x7f0ab802b770 comp rx=0 tx=0).stop 2023-12-22T09:17:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ace555640 1 -- 172.21.15.106:0/2396038585 shutdown_connections 2023-12-22T09:17:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ace555640 1 --2- 172.21.15.106:0/2396038585 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8152680 0x7f0ac814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ace555640 1 --2- 172.21.15.106:0/2396038585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8069e60 0x7f0ac814a670 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ace555640 1 -- 172.21.15.106:0/2396038585 >> 172.21.15.106:0/2396038585 conn(0x7f0ac80c5360 msgr2=0x7f0ac80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ace555640 1 -- 172.21.15.106:0/2396038585 shutdown_connections 2023-12-22T09:17:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.511+0000 7f0ace555640 1 -- 172.21.15.106:0/2396038585 wait complete. 2023-12-22T09:17:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.513+0000 7f0ace555640 1 Processor -- start 2023-12-22T09:17:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.513+0000 7f0ace555640 1 -- start start 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0ace555640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8069e60 0x7f0ac80be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0ace555640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac8150a80 0x7f0ac8141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0ace555640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8152680 0x7f0ac81ec010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0ace555640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac814b690 con 0x7f0ac8152680 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0ace555640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81e96c0 con 0x7f0ac8150a80 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0ace555640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac814b930 con 0x7f0ac8069e60 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0accaf2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8152680 0x7f0ac81ec010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0accaf2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8152680 0x7f0ac81ec010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59686/0 (socket says 172.21.15.106:59686) 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0accaf2640 1 -- 172.21.15.106:0/2868481167 learned_addr learned my addr 172.21.15.106:0/2868481167 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0ac7fff640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8069e60 0x7f0ac80be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.514+0000 7f0accaf2640 1 -- 172.21.15.106:0/2868481167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8069e60 msgr2=0x7f0ac80be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0accaf2640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8069e60 0x7f0ac80be8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0accaf2640 1 -- 172.21.15.106:0/2868481167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac8150a80 msgr2=0x7f0ac8141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0abffff640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac8150a80 0x7f0ac8141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0accaf2640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac8150a80 0x7f0ac8141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0accaf2640 1 -- 172.21.15.106:0/2868481167 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80093a0 con 0x7f0ac8152680 2023-12-22T09:17:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0abffff640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac8150a80 0x7f0ac8141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0accaf2640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8152680 0x7f0ac81ec010 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000efc0 tx=0x7f0ac000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0ac57fa640 1 -- 172.21.15.106:0/2868481167 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0009ba0 con 0x7f0ac8152680 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0ac57fa640 1 -- 172.21.15.106:0/2868481167 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac000f040 con 0x7f0ac8152680 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac81e99a0 con 0x7f0ac8152680 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0ac57fa640 1 -- 172.21.15.106:0/2868481167 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00146c0 con 0x7f0ac8152680 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.515+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac8154ec0 con 0x7f0ac8152680 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.516+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac814bb50 con 0x7f0ac8152680 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.517+0000 7f0ac57fa640 1 -- 172.21.15.106:0/2868481167 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ac0014820 con 0x7f0ac8152680 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.518+0000 7f0ac57fa640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0aa806a460 0x7f0aa806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.518+0000 7f0ac57fa640 1 -- 172.21.15.106:0/2868481167 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0ac00894c0 con 0x7f0ac8152680 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.519+0000 7f0ac7fff640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0aa806a460 0x7f0aa806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.519+0000 7f0ac7fff640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0aa806a460 0x7f0aa806c920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8036000 tx=0x7f0ab8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.523+0000 7f0ac57fa640 1 -- 172.21.15.106:0/2868481167 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ac0054a00 con 0x7f0ac8152680 2023-12-22T09:17:06.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.751+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ac8073f10 con 0x7f0ac8152680 2023-12-22T09:17:06.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.752+0000 7f0ac57fa640 1 -- 172.21.15.106:0/2868481167 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0ac0058020 con 0x7f0ac8152680 2023-12-22T09:17:06.752 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T09:17:06.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0aa806a460 msgr2=0x7f0aa806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:06.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0aa806a460 0x7f0aa806c920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8036000 tx=0x7f0ab8008030 comp rx=0 tx=0).stop 2023-12-22T09:17:06.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8152680 msgr2=0x7f0ac81ec010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:06.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8152680 0x7f0ac81ec010 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000efc0 tx=0x7f0ac000c490 comp rx=0 tx=0).stop 2023-12-22T09:17:06.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 shutdown_connections 2023-12-22T09:17:06.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f0aa806a460 0x7f0aa806c920 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:06.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ac8152680 0x7f0ac81ec010 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:06.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ac8150a80 0x7f0ac8141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:06.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 --2- 172.21.15.106:0/2868481167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0ac8069e60 0x7f0ac80be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:06.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 >> 172.21.15.106:0/2868481167 conn(0x7f0ac80c5360 msgr2=0x7f0ac80c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:06.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 shutdown_connections 2023-12-22T09:17:06.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:06.755+0000 7f0ace555640 1 -- 172.21.15.106:0/2868481167 wait complete. 2023-12-22T09:17:06.776 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T09:17:06.776 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:17:06.776 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-22T09:17:06.776 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T09:17:06.776 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T09:17:06.776 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T09:17:06.777 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T09:17:06.777 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T09:17:06.777 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:17:06.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:06.777 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-22T09:17:06.834 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:17:06.835 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42208sec preferred_lft 42208sec 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 9e:b3:3a:4a:07:97 brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::fc76:1aff:fe8a:2e61/64 scope link 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:06.836 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T09:17:06.837 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 9e:b3:3a:4a:07:97 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T09:17:06.837 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::9cb3:3aff:fe4a:797/64 scope link 2023-12-22T09:17:06.837 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:06.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:06.838 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:17:06.924 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-22T09:17:06.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:06.929 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-22T09:17:06.983 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-22T09:17:06.983 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:17:06.983 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:17:06.983 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:17:06.983 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:17:06.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:06.984 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-22T09:17:06.984 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-22T09:17:06.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:17:06.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:17:06.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:17:06.984 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-22T09:17:07.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:07.162 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-22T09:17:07.210 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T09:17:07.211 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:17:07.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:07.212 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-22T09:17:07.302 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:17:07.302 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T09:17:07.354 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:17:07.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:17:07.355 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:17:07.407 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T09:17:07.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:07.408 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:17:07.549 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:17:07.549 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-22T09:17:07.549 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:17:07.571 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:17:07.571 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-22T09:17:07.571 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:17:07.571 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:17:07.571 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:17:07.603 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-22T09:17:07.603 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-22T09:17:07.603 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:17:07.603 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:17:07.604 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:17:07.604 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790" 2023-12-22T09:17:07.604 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2023-12-22T09:17:07.604 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c9422aac-a1e3-428b-87d0-2dbf321c6b46" will pass to kernel 2023-12-22T09:17:07.607 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T09:17:07.607 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-12-22T09:17:07.607 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T09:17:07.607 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T09:17:07.607 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T09:17:07.612 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T09:17:07.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:07.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:17:07.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:07.689 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:17:07.742 INFO:teuthology.orchestra.run.smithi132.stdout:client6102 2023-12-22T09:17:07.742 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:17:07.743 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:17:07.793 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-22T09:17:08.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.016+0000 7fa693238640 1 Processor -- start 2023-12-22T09:17:08.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.016+0000 7fa693238640 1 -- start start 2023-12-22T09:17:08.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.018+0000 7fa693238640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa68c069e60 0x7fa68c1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.018+0000 7fa693238640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa68c15c070 0x7fa68c155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.018+0000 7fa693238640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c06fe60 con 0x7fa68c070480 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.018+0000 7fa693238640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c15c5e0 con 0x7fa68c069e60 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.018+0000 7fa693238640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c070140 con 0x7fa68c15c070 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.018+0000 7fa690fd4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa68c069e60 0x7fa68c1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.018+0000 7fa690fd4640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa68c069e60 0x7fa68c1551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59692/0 (socket says 172.21.15.106:59692) 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.018+0000 7fa690fd4640 1 -- 172.21.15.106:0/827665677 learned_addr learned my addr 172.21.15.106:0/827665677 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.019+0000 7fa68bfff640 1 --2- 172.21.15.106:0/827665677 >> v2:172.21.15.132:3300/0 conn(0x7fa68c15c070 0x7fa68c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.019+0000 7fa690fd4640 1 -- 172.21.15.106:0/827665677 >> v2:172.21.15.132:3300/0 conn(0x7fa68c15c070 msgr2=0x7fa68c155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.019+0000 7fa690fd4640 1 --2- 172.21.15.106:0/827665677 >> v2:172.21.15.132:3300/0 conn(0x7fa68c15c070 0x7fa68c155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.019+0000 7fa690fd4640 1 -- 172.21.15.106:0/827665677 >> v1:172.21.15.132:6789/0 conn(0x7fa68c070480 legacy=0x7fa68c0bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:08.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.019+0000 7fa690fd4640 1 -- 172.21.15.106:0/827665677 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0c1440 con 0x7fa68c069e60 2023-12-22T09:17:08.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.020+0000 7fa690fd4640 1 --2- 172.21.15.106:0/827665677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c069e60 0x7fa68c1551f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa680009850 tx=0x7fa68002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115eedb51914a8ca server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:08.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.020+0000 7fa68b7fe640 1 -- 172.21.15.106:0/827665677 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680004230 con 0x7fa68c069e60 2023-12-22T09:17:08.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.020+0000 7fa68b7fe640 1 -- 172.21.15.106:0/827665677 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa680004390 con 0x7fa68c069e60 2023-12-22T09:17:08.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.020+0000 7fa68b7fe640 1 -- 172.21.15.106:0/827665677 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680003810 con 0x7fa68c069e60 2023-12-22T09:17:08.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.021+0000 7fa693238640 1 -- 172.21.15.106:0/827665677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c069e60 msgr2=0x7fa68c1551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.021+0000 7fa693238640 1 --2- 172.21.15.106:0/827665677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c069e60 0x7fa68c1551f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa680009850 tx=0x7fa68002b8f0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.021+0000 7fa693238640 1 -- 172.21.15.106:0/827665677 shutdown_connections 2023-12-22T09:17:08.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.021+0000 7fa693238640 1 --2- 172.21.15.106:0/827665677 >> v2:172.21.15.132:3300/0 conn(0x7fa68c15c070 0x7fa68c155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.021+0000 7fa693238640 1 --2- 172.21.15.106:0/827665677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c069e60 0x7fa68c1551f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.021+0000 7fa693238640 1 -- 172.21.15.106:0/827665677 >> 172.21.15.106:0/827665677 conn(0x7fa68c0c5360 msgr2=0x7fa68c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:08.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.021+0000 7fa693238640 1 -- 172.21.15.106:0/827665677 shutdown_connections 2023-12-22T09:17:08.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.021+0000 7fa693238640 1 -- 172.21.15.106:0/827665677 wait complete. 2023-12-22T09:17:08.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.023+0000 7fa693238640 1 Processor -- start 2023-12-22T09:17:08.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.023+0000 7fa693238640 1 -- start start 2023-12-22T09:17:08.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa693238640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c069e60 0x7fa68c0aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa693238640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c070480 0x7fa68c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa693238640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa68c15c070 0x7fa68c1ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa693238640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0a8cd0 con 0x7fa68c070480 2023-12-22T09:17:08.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa693238640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0a8fb0 con 0x7fa68c069e60 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa693238640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0a9290 con 0x7fa68c15c070 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa68bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c070480 0x7fa68c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa68bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c070480 0x7fa68c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59698/0 (socket says 172.21.15.106:59698) 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa68bfff640 1 -- 172.21.15.106:0/3830573923 learned_addr learned my addr 172.21.15.106:0/3830573923 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa690fd4640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c069e60 0x7fa68c0aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa68bfff640 1 -- 172.21.15.106:0/3830573923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa68c15c070 msgr2=0x7fa68c1ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa68bfff640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa68c15c070 0x7fa68c1ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa68bfff640 1 -- 172.21.15.106:0/3830573923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c069e60 msgr2=0x7fa68c0aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa68bfff640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c069e60 0x7fa68c0aa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.024+0000 7fa68bfff640 1 -- 172.21.15.106:0/3830573923 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680009460 con 0x7fa68c070480 2023-12-22T09:17:08.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.025+0000 7fa68bfff640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c070480 0x7fa68c1587d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c7f0 tx=0x7fa67800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:08.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.025+0000 7fa6897fa640 1 -- 172.21.15.106:0/3830573923 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678004220 con 0x7fa68c070480 2023-12-22T09:17:08.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.025+0000 7fa6897fa640 1 -- 172.21.15.106:0/3830573923 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6780043a0 con 0x7fa68c070480 2023-12-22T09:17:08.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.025+0000 7fa6897fa640 1 -- 172.21.15.106:0/3830573923 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678007860 con 0x7fa68c070480 2023-12-22T09:17:08.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.025+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c1ed090 con 0x7fa68c070480 2023-12-22T09:17:08.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.025+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c0a9570 con 0x7fa68c070480 2023-12-22T09:17:08.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.026+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c1ecef0 con 0x7fa68c070480 2023-12-22T09:17:08.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.027+0000 7fa6897fa640 1 -- 172.21.15.106:0/3830573923 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa678007bd0 con 0x7fa68c070480 2023-12-22T09:17:08.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.028+0000 7fa6897fa640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa67006a430 0x7fa67006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.028+0000 7fa6897fa640 1 -- 172.21.15.106:0/3830573923 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa678088ab0 con 0x7fa68c070480 2023-12-22T09:17:08.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.028+0000 7fa690fd4640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa67006a430 0x7fa67006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.029+0000 7fa690fd4640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa67006a430 0x7fa67006c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa680035000 tx=0x7fa680008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:08.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.032+0000 7fa6897fa640 1 -- 172.21.15.106:0/3830573923 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa68c1ecef0 con 0x7fa68c070480 2023-12-22T09:17:08.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.290+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fa68c1ecef0 con 0x7fa68c070480 2023-12-22T09:17:08.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.291+0000 7fa6897fa640 1 -- 172.21.15.106:0/3830573923 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v16) v1 ==== 84+0+0 (secure 0 0 0) 0x7fa68c1ecef0 con 0x7fa68c070480 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.293+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa67006a430 msgr2=0x7fa67006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.293+0000 7fa693238640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa67006a430 0x7fa67006c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa680035000 tx=0x7fa680008030 comp rx=0 tx=0).stop 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.293+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c070480 msgr2=0x7fa68c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.293+0000 7fa693238640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c070480 0x7fa68c1587d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c7f0 tx=0x7fa67800ccb0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.294+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 shutdown_connections 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.294+0000 7fa693238640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa67006a430 0x7fa67006c8f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.294+0000 7fa693238640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa68c15c070 0x7fa68c1ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.294+0000 7fa693238640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa68c070480 0x7fa68c1587d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.294+0000 7fa693238640 1 --2- 172.21.15.106:0/3830573923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa68c069e60 0x7fa68c0aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.294+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 >> 172.21.15.106:0/3830573923 conn(0x7fa68c0c5360 msgr2=0x7fa68c155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.294+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 shutdown_connections 2023-12-22T09:17:08.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.294+0000 7fa693238640 1 -- 172.21.15.106:0/3830573923 wait complete. 2023-12-22T09:17:08.313 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:17:08.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.521+0000 7fc09b70a640 1 Processor -- start 2023-12-22T09:17:08.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.521+0000 7fc09b70a640 1 -- start start 2023-12-22T09:17:08.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.522+0000 7fc09b70a640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0941514b0 0x7fc0940c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.522+0000 7fc09b70a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 0x7fc094154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc09b70a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc094154a80 0x7fc0940c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc09b70a640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940c4660 con 0x7fc0941514b0 2023-12-22T09:17:08.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc09b70a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc094153d60 con 0x7fc094154a80 2023-12-22T09:17:08.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc09b70a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09406b250 con 0x7fc0940c4130 2023-12-22T09:17:08.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc0994a6640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0941514b0 0x7fc0940c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc0994a6640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0941514b0 0x7fc0940c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59700/0 (socket says 172.21.15.106:59700) 2023-12-22T09:17:08.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc0994a6640 1 -- 172.21.15.106:0/1328823086 learned_addr learned my addr 172.21.15.106:0/1328823086 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:08.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc0994a6640 1 -- 172.21.15.106:0/1328823086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 msgr2=0x7fc094154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:08.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc0994a6640 1 --2- 172.21.15.106:0/1328823086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 0x7fc094154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc0994a6640 1 -- 172.21.15.106:0/1328823086 >> v2:172.21.15.132:3300/0 conn(0x7fc094154a80 msgr2=0x7fc0940c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:08.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc0994a6640 1 --2- 172.21.15.106:0/1328823086 >> v2:172.21.15.132:3300/0 conn(0x7fc094154a80 0x7fc0940c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.523+0000 7fc0994a6640 1 -- 172.21.15.106:0/1328823086 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09406b530 con 0x7fc0941514b0 2023-12-22T09:17:08.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.524+0000 7fc0994a6640 1 --2- 172.21.15.106:0/1328823086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0941514b0 0x7fc0940c75b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc0940ac090 tx=0x7fc09002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ac58b4b33752d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:08.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc08bfff640 1 -- 172.21.15.106:0/1328823086 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090031800 con 0x7fc0941514b0 2023-12-22T09:17:08.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc08bfff640 1 -- 172.21.15.106:0/1328823086 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090031960 con 0x7fc0941514b0 2023-12-22T09:17:08.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc08bfff640 1 -- 172.21.15.106:0/1328823086 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090031cf0 con 0x7fc0941514b0 2023-12-22T09:17:08.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc09b70a640 1 -- 172.21.15.106:0/1328823086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0941514b0 msgr2=0x7fc0940c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1328823086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0941514b0 0x7fc0940c75b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc0940ac090 tx=0x7fc09002b8a0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc09b70a640 1 -- 172.21.15.106:0/1328823086 shutdown_connections 2023-12-22T09:17:08.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1328823086 >> v2:172.21.15.132:3300/0 conn(0x7fc094154a80 0x7fc0940c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1328823086 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 0x7fc094154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1328823086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0941514b0 0x7fc0940c75b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc09b70a640 1 -- 172.21.15.106:0/1328823086 >> 172.21.15.106:0/1328823086 conn(0x7fc0940ab1a0 msgr2=0x7fc0940ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:08.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc09b70a640 1 -- 172.21.15.106:0/1328823086 shutdown_connections 2023-12-22T09:17:08.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.525+0000 7fc09b70a640 1 -- 172.21.15.106:0/1328823086 wait complete. 2023-12-22T09:17:08.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.527+0000 7fc09b70a640 1 Processor -- start 2023-12-22T09:17:08.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.527+0000 7fc09b70a640 1 -- start start 2023-12-22T09:17:08.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.528+0000 7fc09b70a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 0x7fc09414a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.528+0000 7fc09b70a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0941514b0 0x7fc0941e8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.528+0000 7fc09b70a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0940c0300 0x7fc09414da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.528+0000 7fc09b70a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940c1700 con 0x7fc0940c0300 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.528+0000 7fc09b70a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940beb20 con 0x7fc0941514b0 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.528+0000 7fc09b70a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940bfe70 con 0x7fc0940c4130 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.528+0000 7fc099ca7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0940c0300 0x7fc09414da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.528+0000 7fc099ca7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0940c0300 0x7fc09414da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59716/0 (socket says 172.21.15.106:59716) 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.528+0000 7fc099ca7640 1 -- 172.21.15.106:0/1033315727 learned_addr learned my addr 172.21.15.106:0/1033315727 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc098ca5640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0941514b0 0x7fc0941e8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc0994a6640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 0x7fc09414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc099ca7640 1 -- 172.21.15.106:0/1033315727 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 msgr2=0x7fc09414a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc099ca7640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 0x7fc09414a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc099ca7640 1 -- 172.21.15.106:0/1033315727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0941514b0 msgr2=0x7fc0941e8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc099ca7640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0941514b0 0x7fc0941e8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc099ca7640 1 -- 172.21.15.106:0/1033315727 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0900094d0 con 0x7fc0940c0300 2023-12-22T09:17:08.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc0994a6640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 0x7fc09414a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:08.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc099ca7640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0940c0300 0x7fc09414da20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b9e0 tx=0x7fc08c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc089ffb640 1 -- 172.21.15.106:0/1033315727 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00cb20 con 0x7fc0940c0300 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc089ffb640 1 -- 172.21.15.106:0/1033315727 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00cc80 con 0x7fc0940c0300 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc089ffb640 1 -- 172.21.15.106:0/1033315727 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c014680 con 0x7fc0940c0300 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0941e96a0 con 0x7fc0940c0300 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.529+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0940c2670 con 0x7fc0940c0300 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.530+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc094073f10 con 0x7fc0940c0300 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.531+0000 7fc089ffb640 1 -- 172.21.15.106:0/1033315727 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc08c01d3b0 con 0x7fc0940c0300 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.532+0000 7fc089ffb640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc07806a430 0x7fc07806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.532+0000 7fc089ffb640 1 -- 172.21.15.106:0/1033315727 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc08c088a00 con 0x7fc0940c0300 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.532+0000 7fc0994a6640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc07806a430 0x7fc07806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.533+0000 7fc0994a6640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc07806a430 0x7fc07806c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc090036000 tx=0x7fc09003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:08.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.536+0000 7fc089ffb640 1 -- 172.21.15.106:0/1033315727 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc08c053e10 con 0x7fc0940c0300 2023-12-22T09:17:08.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.712+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0940bffb0 con 0x7fc0940c0300 2023-12-22T09:17:08.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.714+0000 7fc089ffb640 1 -- 172.21.15.106:0/1033315727 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16296 (secure 0 0 0) 0x7fc08c019020 con 0x7fc0940c0300 2023-12-22T09:17:08.714 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:08.715 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":59,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:16:59.100239+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:16:55.972567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-22T09:16:57.103965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc07806a430 msgr2=0x7fc07806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc07806a430 0x7fc07806c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc090036000 tx=0x7fc09003c040 comp rx=0 tx=0).stop 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0940c0300 msgr2=0x7fc09414da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0940c0300 0x7fc09414da20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b9e0 tx=0x7fc08c00bea0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 shutdown_connections 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc07806a430 0x7fc07806c8f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0940c0300 0x7fc09414da20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0941514b0 0x7fc0941e8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 --2- 172.21.15.106:0/1033315727 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0940c4130 0x7fc09414a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 >> 172.21.15.106:0/1033315727 conn(0x7fc0940ab1a0 msgr2=0x7fc0940ab580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:08.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 shutdown_connections 2023-12-22T09:17:08.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.717+0000 7fc09b70a640 1 -- 172.21.15.106:0/1033315727 wait complete. 2023-12-22T09:17:08.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:16:55.972567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:16:57.103965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:17:08.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:17:08.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.947+0000 7f4d7058b640 1 Processor -- start 2023-12-22T09:17:08.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.947+0000 7f4d7058b640 1 -- start start 2023-12-22T09:17:08.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.948+0000 7f4d7058b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4d6814dfe0 0x7f4d68154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d7058b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d68151760 0x7f4d680a8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d7058b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d68150cc0 con 0x7f4d680a88a0 2023-12-22T09:17:08.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d7058b640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d68150ab0 con 0x7f4d68151760 2023-12-22T09:17:08.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d7058b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d68072130 con 0x7f4d6814dfe0 2023-12-22T09:17:08.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6db26640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d68151760 0x7f4d680a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6db26640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d68151760 0x7f4d680a8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59728/0 (socket says 172.21.15.106:59728) 2023-12-22T09:17:08.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6db26640 1 -- 172.21.15.106:0/554848073 learned_addr learned my addr 172.21.15.106:0/554848073 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:08.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6db26640 1 -- 172.21.15.106:0/554848073 >> v2:172.21.15.132:3300/0 conn(0x7f4d6814dfe0 msgr2=0x7f4d68154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:08.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6e327640 1 --2- 172.21.15.106:0/554848073 >> v2:172.21.15.132:3300/0 conn(0x7f4d6814dfe0 0x7f4d68154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6db26640 1 --2- 172.21.15.106:0/554848073 >> v2:172.21.15.132:3300/0 conn(0x7f4d6814dfe0 0x7f4d68154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6db26640 1 -- 172.21.15.106:0/554848073 >> v1:172.21.15.106:6789/0 conn(0x7f4d680a88a0 legacy=0x7f4d680c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6db26640 1 -- 172.21.15.106:0/554848073 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d68154ff0 con 0x7f4d68151760 2023-12-22T09:17:08.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6e327640 1 --2- 172.21.15.106:0/554848073 >> v2:172.21.15.132:3300/0 conn(0x7f4d6814dfe0 0x7f4d68154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:08.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.949+0000 7f4d6d325640 1 -- 172.21.15.106:0/554848073 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302247926 0 0) 0x7f4d68150cc0 con 0x7f4d680a88a0 2023-12-22T09:17:08.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.950+0000 7f4d6db26640 1 --2- 172.21.15.106:0/554848073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 0x7f4d680a8360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4d6806abb0 tx=0x7f4d5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdac566ca40de452 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:08.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d6d325640 1 -- 172.21.15.106:0/554848073 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c031870 con 0x7f4d68151760 2023-12-22T09:17:08.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d6d325640 1 -- 172.21.15.106:0/554848073 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c0319d0 con 0x7f4d68151760 2023-12-22T09:17:08.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d6d325640 1 -- 172.21.15.106:0/554848073 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c031d60 con 0x7f4d68151760 2023-12-22T09:17:08.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d7058b640 1 -- 172.21.15.106:0/554848073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 msgr2=0x7f4d680a8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d7058b640 1 --2- 172.21.15.106:0/554848073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 0x7f4d680a8360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4d6806abb0 tx=0x7f4d5c02b910 comp rx=0 tx=0).stop 2023-12-22T09:17:08.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d7058b640 1 -- 172.21.15.106:0/554848073 shutdown_connections 2023-12-22T09:17:08.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d7058b640 1 --2- 172.21.15.106:0/554848073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 0x7f4d680a8360 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d7058b640 1 --2- 172.21.15.106:0/554848073 >> v2:172.21.15.132:3300/0 conn(0x7f4d6814dfe0 0x7f4d68154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d7058b640 1 -- 172.21.15.106:0/554848073 >> 172.21.15.106:0/554848073 conn(0x7f4d68069dd0 msgr2=0x7f4d6806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:08.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.951+0000 7f4d7058b640 1 -- 172.21.15.106:0/554848073 shutdown_connections 2023-12-22T09:17:08.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.952+0000 7f4d7058b640 1 -- 172.21.15.106:0/554848073 wait complete. 2023-12-22T09:17:08.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.953+0000 7f4d7058b640 1 Processor -- start 2023-12-22T09:17:08.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.953+0000 7f4d7058b640 1 -- start start 2023-12-22T09:17:08.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.954+0000 7f4d7058b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4d680a88a0 0x7f4d6815e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.954+0000 7f4d7058b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d6814dfe0 0x7f4d6814fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.954+0000 7f4d7058b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 0x7f4d6806c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.954+0000 7f4d7058b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d681e9c70 con 0x7f4d68151760 2023-12-22T09:17:08.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.954+0000 7f4d7058b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680c4b00 con 0x7f4d6814dfe0 2023-12-22T09:17:08.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.954+0000 7f4d7058b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6815d8d0 con 0x7f4d680a88a0 2023-12-22T09:17:08.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.954+0000 7f4d6eb28640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 0x7f4d6806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6eb28640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 0x7f4d6806c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59738/0 (socket says 172.21.15.106:59738) 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6eb28640 1 -- 172.21.15.106:0/2604581986 learned_addr learned my addr 172.21.15.106:0/2604581986 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6db26640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d6814dfe0 0x7f4d6814fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6e327640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4d680a88a0 0x7f4d6815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6eb28640 1 -- 172.21.15.106:0/2604581986 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4d680a88a0 msgr2=0x7f4d6815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6eb28640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4d680a88a0 0x7f4d6815e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6eb28640 1 -- 172.21.15.106:0/2604581986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d6814dfe0 msgr2=0x7f4d6814fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6eb28640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d6814dfe0 0x7f4d6814fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6eb28640 1 -- 172.21.15.106:0/2604581986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0094d0 con 0x7f4d68151760 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d6eb28640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 0x7f4d6806c700 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c780 tx=0x7f4d6000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.955+0000 7f4d5affd640 1 -- 172.21.15.106:0/2604581986 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60003da0 con 0x7f4d68151760 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.956+0000 7f4d5affd640 1 -- 172.21.15.106:0/2604581986 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000ce90 con 0x7f4d68151760 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.956+0000 7f4d5affd640 1 -- 172.21.15.106:0/2604581986 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d600052b0 con 0x7f4d68151760 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.956+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6815db90 con 0x7f4d68151760 2023-12-22T09:17:08.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.956+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6806c370 con 0x7f4d68151760 2023-12-22T09:17:08.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.957+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6815dd20 con 0x7f4d68151760 2023-12-22T09:17:08.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.958+0000 7f4d5affd640 1 -- 172.21.15.106:0/2604581986 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d60005410 con 0x7f4d68151760 2023-12-22T09:17:08.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.959+0000 7f4d5affd640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:08.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.959+0000 7f4d5affd640 1 -- 172.21.15.106:0/2604581986 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d60088360 con 0x7f4d68151760 2023-12-22T09:17:08.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.959+0000 7f4d6e327640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:08.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.959+0000 7f4d6e327640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d64008850 tx=0x7f4d64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:08.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:08.963+0000 7f4d5affd640 1 -- 172.21.15.106:0/2604581986 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d60053770 con 0x7f4d68151760 2023-12-22T09:17:09.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.140+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d68073f10 con 0x7f4d68151760 2023-12-22T09:17:09.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.140+0000 7f4d5affd640 1 -- 172.21.15.106:0/2604581986 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d60017020 con 0x7f4d68151760 2023-12-22T09:17:09.140 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4d4c06a430 msgr2=0x7f4d4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d64008850 tx=0x7f4d64008040 comp rx=0 tx=0).stop 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 msgr2=0x7f4d6806c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 0x7f4d6806c700 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c780 tx=0x7f4d6000cc40 comp rx=0 tx=0).stop 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 shutdown_connections 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f4d4c06a430 0x7f4d4c06c8f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d68151760 0x7f4d6806c700 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d6814dfe0 0x7f4d6814fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 --2- 172.21.15.106:0/2604581986 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4d680a88a0 0x7f4d6815e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 >> 172.21.15.106:0/2604581986 conn(0x7f4d68069dd0 msgr2=0x7f4d680a8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 shutdown_connections 2023-12-22T09:17:09.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.143+0000 7f4d7058b640 1 -- 172.21.15.106:0/2604581986 wait complete. 2023-12-22T09:17:09.159 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:17:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.363+0000 7fc572188640 1 Processor -- start 2023-12-22T09:17:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.364+0000 7fc572188640 1 -- start start 2023-12-22T09:17:09.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.365+0000 7fc572188640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc56c13d0f0 0x7fc56c157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.365+0000 7fc572188640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c154430 con 0x7fc56c0c5320 2023-12-22T09:17:09.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.365+0000 7fc572188640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c0beb70 con 0x7fc56c0be6e0 2023-12-22T09:17:09.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.365+0000 7fc572188640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c153de0 con 0x7fc56c13d0f0 2023-12-22T09:17:09.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.365+0000 7fc571186640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc56c0c5320 0x7fc56c13c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38304/0 (socket says 172.21.15.106:38304) 2023-12-22T09:17:09.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.365+0000 7fc571186640 1 -- 172.21.15.106:0/1124741993 learned_addr learned my addr 172.21.15.106:0/1124741993 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc571987640 1 --2- 172.21.15.106:0/1124741993 >> v2:172.21.15.132:3300/0 conn(0x7fc56c13d0f0 0x7fc56c157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905022574 0 0) 0x7fc56c154430 con 0x7fc56c0c5320 2023-12-22T09:17:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc558003520 con 0x7fc56c0c5320 2023-12-22T09:17:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229735376 0 0) 0x7fc558003520 con 0x7fc56c0c5320 2023-12-22T09:17:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 >> v2:172.21.15.132:3300/0 conn(0x7fc56c13d0f0 msgr2=0x7fc56c157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 --2- 172.21.15.106:0/1124741993 >> v2:172.21.15.132:3300/0 conn(0x7fc56c13d0f0 0x7fc56c157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 >> v1:172.21.15.132:6789/0 conn(0x7fc56c0be6e0 legacy=0x7fc56c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c1540c0 con 0x7fc56c0c5320 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fc568001670 con 0x7fc56c0c5320 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 >> v1:172.21.15.106:6789/0 conn(0x7fc56c0c5320 legacy=0x7fc56c13c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5580039c0 0x7fc558003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5580047c0 0x7fc558004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.366+0000 7fc563fff640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc558005180 0x7fc55800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c153de0 con 0x7fc5580047c0 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55800c080 con 0x7fc558005180 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55800c240 con 0x7fc5580039c0 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc570985640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5580047c0 0x7fc558004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc571186640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5580039c0 0x7fc558003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc571987640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc558005180 0x7fc55800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc570985640 1 -- 172.21.15.106:0/1124741993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5580039c0 msgr2=0x7fc558003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc570985640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5580039c0 0x7fc558003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc570985640 1 -- 172.21.15.106:0/1124741993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc558005180 msgr2=0x7fc55800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc570985640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc558005180 0x7fc55800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc571987640 1 -- 172.21.15.106:0/1124741993 reap_dead start 2023-12-22T09:17:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.367+0000 7fc570985640 1 -- 172.21.15.106:0/1124741993 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558003520 con 0x7fc5580047c0 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.368+0000 7fc570985640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5580047c0 0x7fc558004c40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc55c001750 tx=0x7fc5580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f2909fe4231825 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0052d0 con 0x7fc5580047c0 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c02e050 con 0x7fc5580047c0 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc563fff640 1 -- 172.21.15.106:0/1124741993 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c003830 con 0x7fc5580047c0 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc572188640 1 -- 172.21.15.106:0/1124741993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5580047c0 msgr2=0x7fc558004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc572188640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5580047c0 0x7fc558004c40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc55c001750 tx=0x7fc5580057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc572188640 1 -- 172.21.15.106:0/1124741993 shutdown_connections 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc572188640 1 --2- 172.21.15.106:0/1124741993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5580047c0 0x7fc558004c40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc572188640 1 -- 172.21.15.106:0/1124741993 >> 172.21.15.106:0/1124741993 conn(0x7fc56c069bf0 msgr2=0x7fc56c069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc572188640 1 -- 172.21.15.106:0/1124741993 shutdown_connections 2023-12-22T09:17:09.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.369+0000 7fc572188640 1 -- 172.21.15.106:0/1124741993 wait complete. 2023-12-22T09:17:09.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.371+0000 7fc572188640 1 Processor -- start 2023-12-22T09:17:09.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.371+0000 7fc572188640 1 -- start start 2023-12-22T09:17:09.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.372+0000 7fc572188640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5580047c0 0x7fc56c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.372+0000 7fc572188640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c138d50 0x7fc56c1348f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.372+0000 7fc572188640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc56c1328d0 0x7fc56c132d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.372+0000 7fc572188640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0c4e00 con 0x7fc56c1328d0 2023-12-22T09:17:09.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.372+0000 7fc572188640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c1ed3a0 con 0x7fc56c138d50 2023-12-22T09:17:09.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.372+0000 7fc572188640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0c47e0 con 0x7fc5580047c0 2023-12-22T09:17:09.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.372+0000 7fc571987640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc56c1328d0 0x7fc56c132d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.372+0000 7fc571987640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc56c1328d0 0x7fc56c132d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59750/0 (socket says 172.21.15.106:59750) 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.372+0000 7fc571987640 1 -- 172.21.15.106:0/3640822868 learned_addr learned my addr 172.21.15.106:0/3640822868 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc570985640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c138d50 0x7fc56c1348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc571186640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5580047c0 0x7fc56c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc571987640 1 -- 172.21.15.106:0/3640822868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5580047c0 msgr2=0x7fc56c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc571987640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5580047c0 0x7fc56c157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc571987640 1 -- 172.21.15.106:0/3640822868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c138d50 msgr2=0x7fc56c1348f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc571987640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c138d50 0x7fc56c1348f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc571987640 1 -- 172.21.15.106:0/3640822868 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0c4500 con 0x7fc56c1328d0 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc570985640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c138d50 0x7fc56c1348f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc571987640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc56c1328d0 0x7fc56c132d50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc56c13d500 tx=0x7fc56400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc561ffb640 1 -- 172.21.15.106:0/3640822868 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564016420 con 0x7fc56c1328d0 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc561ffb640 1 -- 172.21.15.106:0/3640822868 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564016580 con 0x7fc56c1328d0 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c1ecfc0 con 0x7fc56c1328d0 2023-12-22T09:17:09.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.373+0000 7fc561ffb640 1 -- 172.21.15.106:0/3640822868 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564016930 con 0x7fc56c1328d0 2023-12-22T09:17:09.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.374+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c133290 con 0x7fc56c1328d0 2023-12-22T09:17:09.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.375+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c04e8d0 con 0x7fc56c1328d0 2023-12-22T09:17:09.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.376+0000 7fc561ffb640 1 -- 172.21.15.106:0/3640822868 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc564016a90 con 0x7fc56c1328d0 2023-12-22T09:17:09.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.376+0000 7fc561ffb640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc55006a430 0x7fc55006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.377+0000 7fc561ffb640 1 -- 172.21.15.106:0/3640822868 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc564089a40 con 0x7fc56c1328d0 2023-12-22T09:17:09.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.377+0000 7fc571186640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc55006a430 0x7fc55006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.377+0000 7fc571186640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc55006a430 0x7fc55006c8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc5680017a0 tx=0x7fc568009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:09.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.381+0000 7fc561ffb640 1 -- 172.21.15.106:0/3640822868 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc564054ed0 con 0x7fc56c1328d0 2023-12-22T09:17:09.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.556+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc56c13a040 con 0x7fc56c1328d0 2023-12-22T09:17:09.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.557+0000 7fc561ffb640 1 -- 172.21.15.106:0/3640822868 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5640584f0 con 0x7fc56c1328d0 2023-12-22T09:17:09.557 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.559+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc55006a430 msgr2=0x7fc55006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.559+0000 7fc572188640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc55006a430 0x7fc55006c8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc5680017a0 tx=0x7fc568009040 comp rx=0 tx=0).stop 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.559+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc56c1328d0 msgr2=0x7fc56c132d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.559+0000 7fc572188640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc56c1328d0 0x7fc56c132d50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc56c13d500 tx=0x7fc56400f520 comp rx=0 tx=0).stop 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.560+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 shutdown_connections 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.560+0000 7fc572188640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc55006a430 0x7fc55006c8f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.560+0000 7fc572188640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc56c1328d0 0x7fc56c132d50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.560+0000 7fc572188640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56c138d50 0x7fc56c1348f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.560+0000 7fc572188640 1 --2- 172.21.15.106:0/3640822868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5580047c0 0x7fc56c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.560+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 >> 172.21.15.106:0/3640822868 conn(0x7fc56c069bf0 msgr2=0x7fc56c069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.560+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 shutdown_connections 2023-12-22T09:17:09.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.560+0000 7fc572188640 1 -- 172.21.15.106:0/3640822868 wait complete. 2023-12-22T09:17:09.577 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:17:09.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.796+0000 7f36f68da640 1 Processor -- start 2023-12-22T09:17:09.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.797+0000 7f36f68da640 1 -- start start 2023-12-22T09:17:09.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.798+0000 7f36f68da640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 0x7f36f013ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.798+0000 7f36f68da640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36f0153cc0 0x7f36f013cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.798+0000 7f36f68da640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f01572b0 con 0x7f36f006cd10 2023-12-22T09:17:09.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.798+0000 7f36f68da640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f00bfb00 con 0x7f36f0153cc0 2023-12-22T09:17:09.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.798+0000 7f36f68da640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0154240 con 0x7f36f00c1e00 2023-12-22T09:17:09.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.799+0000 7f36f50d7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36f0153cc0 0x7f36f013cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.799+0000 7f36f58d8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 0x7f36f013ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.799+0000 7f36f50d7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36f0153cc0 0x7f36f013cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:50222/0 (socket says 172.21.15.106:50222) 2023-12-22T09:17:09.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.799+0000 7f36f50d7640 1 -- 172.21.15.106:0/3028017330 learned_addr learned my addr 172.21.15.106:0/3028017330 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:09.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.800+0000 7f36f50d7640 1 -- 172.21.15.106:0/3028017330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 msgr2=0x7f36f013ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:09.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.800+0000 7f36f50d7640 1 --2- 172.21.15.106:0/3028017330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 0x7f36f013ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.800+0000 7f36f50d7640 1 -- 172.21.15.106:0/3028017330 >> v1:172.21.15.132:6789/0 conn(0x7f36f006cd10 legacy=0x7f36f0157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.800+0000 7f36f50d7640 1 -- 172.21.15.106:0/3028017330 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0154520 con 0x7f36f0153cc0 2023-12-22T09:17:09.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.800+0000 7f36f48d6640 1 -- 172.21.15.106:0/3028017330 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591268733 0 0) 0x7f36f01572b0 con 0x7f36f006cd10 2023-12-22T09:17:09.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.801+0000 7f36f50d7640 1 --2- 172.21.15.106:0/3028017330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36f0153cc0 0x7f36f013cf40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009870 tx=0x7f36e402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c577228f8b22c705 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:09.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.802+0000 7f36f48d6640 1 -- 172.21.15.106:0/3028017330 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4031640 con 0x7f36f0153cc0 2023-12-22T09:17:09.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.802+0000 7f36f48d6640 1 -- 172.21.15.106:0/3028017330 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e40317a0 con 0x7f36f0153cc0 2023-12-22T09:17:09.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.802+0000 7f36f48d6640 1 -- 172.21.15.106:0/3028017330 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4031b30 con 0x7f36f0153cc0 2023-12-22T09:17:09.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.802+0000 7f36f68da640 1 -- 172.21.15.106:0/3028017330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36f0153cc0 msgr2=0x7f36f013cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.802+0000 7f36f68da640 1 --2- 172.21.15.106:0/3028017330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36f0153cc0 0x7f36f013cf40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009870 tx=0x7f36e402b8f0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.802+0000 7f36f68da640 1 -- 172.21.15.106:0/3028017330 shutdown_connections 2023-12-22T09:17:09.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.802+0000 7f36f68da640 1 --2- 172.21.15.106:0/3028017330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36f0153cc0 0x7f36f013cf40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.802+0000 7f36f68da640 1 --2- 172.21.15.106:0/3028017330 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 0x7f36f013ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.803+0000 7f36f68da640 1 -- 172.21.15.106:0/3028017330 >> 172.21.15.106:0/3028017330 conn(0x7f36f0069bf0 msgr2=0x7f36f0069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:09.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.803+0000 7f36f68da640 1 -- 172.21.15.106:0/3028017330 shutdown_connections 2023-12-22T09:17:09.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.803+0000 7f36f68da640 1 -- 172.21.15.106:0/3028017330 wait complete. 2023-12-22T09:17:09.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.804+0000 7f36f68da640 1 Processor -- start 2023-12-22T09:17:09.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.804+0000 7f36f68da640 1 -- start start 2023-12-22T09:17:09.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.805+0000 7f36f68da640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36f006cd10 0x7f36f0138980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.805+0000 7f36f68da640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 0x7f36f00aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.805+0000 7f36f68da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36f0153cc0 0x7f36f00aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.805+0000 7f36f68da640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0155790 con 0x7f36f006cd10 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.805+0000 7f36f68da640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00ab310 con 0x7f36f0153cc0 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.805+0000 7f36f68da640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00c2f60 con 0x7f36f00c1e00 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f58d8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36f006cd10 0x7f36f0138980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f58d8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36f006cd10 0x7f36f0138980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59752/0 (socket says 172.21.15.106:59752) 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f58d8640 1 -- 172.21.15.106:0/3630838720 learned_addr learned my addr 172.21.15.106:0/3630838720 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f50d7640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 0x7f36f00aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f58d8640 1 -- 172.21.15.106:0/3630838720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 msgr2=0x7f36f00aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f58d8640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 0x7f36f00aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f58d8640 1 -- 172.21.15.106:0/3630838720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36f0153cc0 msgr2=0x7f36f00aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f60d9640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36f0153cc0 0x7f36f00aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f58d8640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36f0153cc0 0x7f36f00aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f58d8640 1 -- 172.21.15.106:0/3630838720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40094d0 con 0x7f36f006cd10 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.806+0000 7f36f58d8640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36f006cd10 0x7f36f0138980 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e9b0 tx=0x7f36ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.807+0000 7f36e27fc640 1 -- 172.21.15.106:0/3630838720 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec009670 con 0x7f36f006cd10 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.807+0000 7f36e27fc640 1 -- 172.21.15.106:0/3630838720 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec00c9a0 con 0x7f36f006cd10 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.807+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f01e95f0 con 0x7f36f006cd10 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.807+0000 7f36e27fc640 1 -- 172.21.15.106:0/3630838720 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00cd50 con 0x7f36f006cd10 2023-12-22T09:17:09.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.807+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f01e9bb0 con 0x7f36f006cd10 2023-12-22T09:17:09.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.808+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f00bf7d0 con 0x7f36f006cd10 2023-12-22T09:17:09.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.809+0000 7f36e27fc640 1 -- 172.21.15.106:0/3630838720 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f36ec013470 con 0x7f36f006cd10 2023-12-22T09:17:09.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.810+0000 7f36e27fc640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f36d406a430 0x7f36d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:09.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.810+0000 7f36e27fc640 1 -- 172.21.15.106:0/3630838720 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f36ec088d30 con 0x7f36f006cd10 2023-12-22T09:17:09.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.810+0000 7f36f50d7640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f36d406a430 0x7f36d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:09.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.811+0000 7f36f50d7640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f36d406a430 0x7f36d406c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f36e4036000 tx=0x7f36e403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:09.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:09.815+0000 7f36e27fc640 1 -- 172.21.15.106:0/3630838720 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f36ec0541d0 con 0x7f36f006cd10 2023-12-22T09:17:10.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.012+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36f00c30d0 con 0x7f36f006cd10 2023-12-22T09:17:10.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.013+0000 7f36e27fc640 1 -- 172.21.15.106:0/3630838720 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36ec0170a0 con 0x7f36f006cd10 2023-12-22T09:17:10.013 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:17:10.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f36d406a430 msgr2=0x7f36d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f36d406a430 0x7f36d406c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f36e4036000 tx=0x7f36e403c040 comp rx=0 tx=0).stop 2023-12-22T09:17:10.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36f006cd10 msgr2=0x7f36f0138980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36f006cd10 0x7f36f0138980 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e9b0 tx=0x7f36ec00ee70 comp rx=0 tx=0).stop 2023-12-22T09:17:10.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 shutdown_connections 2023-12-22T09:17:10.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f36d406a430 0x7f36d406c8f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36f0153cc0 0x7f36f00aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36f00c1e00 0x7f36f00aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 --2- 172.21.15.106:0/3630838720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36f006cd10 0x7f36f0138980 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 >> 172.21.15.106:0/3630838720 conn(0x7f36f0069bf0 msgr2=0x7f36f00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:10.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.016+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 shutdown_connections 2023-12-22T09:17:10.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.017+0000 7f36f68da640 1 -- 172.21.15.106:0/3630838720 wait complete. 2023-12-22T09:17:10.035 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T09:17:10.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.240+0000 7f995bbea640 1 Processor -- start 2023-12-22T09:17:10.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.240+0000 7f995bbea640 1 -- start start 2023-12-22T09:17:10.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.242+0000 7f995bbea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99540c0dc0 0x7f995406ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.242+0000 7f995bbea640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99540a87b0 con 0x7f99540a8360 2023-12-22T09:17:10.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.242+0000 7f995bbea640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9954154f30 con 0x7f995406c670 2023-12-22T09:17:10.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.242+0000 7f995bbea640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995406d7f0 con 0x7f99540c0dc0 2023-12-22T09:17:10.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.242+0000 7f995a187640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f99540a8360 0x7f995415b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38316/0 (socket says 172.21.15.106:38316) 2023-12-22T09:17:10.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.242+0000 7f995a187640 1 -- 172.21.15.106:0/2551967029 learned_addr learned my addr 172.21.15.106:0/2551967029 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.242+0000 7f9959986640 1 --2- 172.21.15.106:0/2551967029 >> v2:172.21.15.132:3300/0 conn(0x7f99540c0dc0 0x7f995406ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826128514 0 0) 0x7f994c001490 con 0x7f99540a8360 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9940003520 con 0x7f99540a8360 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1678708866 0 0) 0x7f9940003520 con 0x7f99540a8360 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 >> v2:172.21.15.132:3300/0 conn(0x7f99540c0dc0 msgr2=0x7f995406ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 --2- 172.21.15.106:0/2551967029 >> v2:172.21.15.132:3300/0 conn(0x7f99540c0dc0 0x7f995406ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 >> v1:172.21.15.132:6789/0 conn(0x7f995406c670 legacy=0x7f9954154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995406dad0 con 0x7f99540a8360 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f994c001b80 con 0x7f99540a8360 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 >> v1:172.21.15.106:6789/0 conn(0x7f99540a8360 legacy=0x7f995415b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 --2- 172.21.15.106:0/2551967029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9940003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 --2- 172.21.15.106:0/2551967029 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99400047c0 0x7f9940004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 --2- 172.21.15.106:0/2551967029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9940005180 0x7f994000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995406d7f0 con 0x7f99400039c0 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994000c080 con 0x7f9940005180 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994000c240 con 0x7f99400047c0 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.243+0000 7f9959986640 1 --2- 172.21.15.106:0/2551967029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9940003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.244+0000 7f9959986640 1 -- 172.21.15.106:0/2551967029 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99400047c0 msgr2=0x7f9940004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.244+0000 7f9959986640 1 --2- 172.21.15.106:0/2551967029 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99400047c0 0x7f9940004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.244+0000 7f9959986640 1 -- 172.21.15.106:0/2551967029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9940005180 msgr2=0x7f994000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.244+0000 7f9959986640 1 --2- 172.21.15.106:0/2551967029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9940005180 0x7f994000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.244+0000 7f9959986640 1 -- 172.21.15.106:0/2551967029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940003520 con 0x7f99400039c0 2023-12-22T09:17:10.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.244+0000 7f995a187640 1 -- 172.21.15.106:0/2551967029 reap_dead start 2023-12-22T09:17:10.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.245+0000 7f9959986640 1 --2- 172.21.15.106:0/2551967029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9940003de0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9950009640 tx=0x7f99400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8332d4ccefcfded server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:10.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.245+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950005990 con 0x7f99400039c0 2023-12-22T09:17:10.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.245+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950005af0 con 0x7f99400039c0 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.245+0000 7f9958984640 1 -- 172.21.15.106:0/2551967029 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950005ea0 con 0x7f99400039c0 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.246+0000 7f995bbea640 1 -- 172.21.15.106:0/2551967029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 msgr2=0x7f9940003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.246+0000 7f995bbea640 1 --2- 172.21.15.106:0/2551967029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9940003de0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9950009640 tx=0x7f99400057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.246+0000 7f995bbea640 1 -- 172.21.15.106:0/2551967029 shutdown_connections 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.246+0000 7f995bbea640 1 --2- 172.21.15.106:0/2551967029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9940003de0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.246+0000 7f995bbea640 1 -- 172.21.15.106:0/2551967029 >> 172.21.15.106:0/2551967029 conn(0x7f99540c1db0 msgr2=0x7f99540c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.246+0000 7f995bbea640 1 -- 172.21.15.106:0/2551967029 shutdown_connections 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.246+0000 7f995bbea640 1 -- 172.21.15.106:0/2551967029 wait complete. 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.248+0000 7f995bbea640 1 Processor -- start 2023-12-22T09:17:10.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.248+0000 7f995bbea640 1 -- start start 2023-12-22T09:17:10.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f995bbea640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9954071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f995bbea640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99541529f0 0x7f99540be950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f995bbea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f995413cfe0 0x7f995413d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f995bbea640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99541534a0 con 0x7f99400039c0 2023-12-22T09:17:10.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f995bbea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9954152e70 con 0x7f995413cfe0 2023-12-22T09:17:10.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f995bbea640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995413f3a0 con 0x7f99541529f0 2023-12-22T09:17:10.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f9959986640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9954071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f9959986640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9954071a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59772/0 (socket says 172.21.15.106:59772) 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f9959986640 1 -- 172.21.15.106:0/2744270383 learned_addr learned my addr 172.21.15.106:0/2744270383 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f9959986640 1 -- 172.21.15.106:0/2744270383 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99541529f0 msgr2=0x7f99540be950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f9959986640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99541529f0 0x7f99540be950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f9959986640 1 -- 172.21.15.106:0/2744270383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f995413cfe0 msgr2=0x7f995413d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f9959986640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f995413cfe0 0x7f995413d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.249+0000 7f9959986640 1 -- 172.21.15.106:0/2744270383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99541ed820 con 0x7f99400039c0 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.250+0000 7f9959986640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9954071a90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f995002e590 tx=0x7f9950004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.250+0000 7f994a7fc640 1 -- 172.21.15.106:0/2744270383 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950006030 con 0x7f99400039c0 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.250+0000 7f994a7fc640 1 -- 172.21.15.106:0/2744270383 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950006190 con 0x7f99400039c0 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.250+0000 7f994a7fc640 1 -- 172.21.15.106:0/2744270383 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950006500 con 0x7f99400039c0 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.250+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995413d9d0 con 0x7f99400039c0 2023-12-22T09:17:10.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.250+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99541ecef0 con 0x7f99400039c0 2023-12-22T09:17:10.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.251+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9954073f10 con 0x7f99400039c0 2023-12-22T09:17:10.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.252+0000 7f994a7fc640 1 -- 172.21.15.106:0/2744270383 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9950006660 con 0x7f99400039c0 2023-12-22T09:17:10.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.253+0000 7f994a7fc640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f993806a460 0x7f993806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.253+0000 7f994a7fc640 1 -- 172.21.15.106:0/2744270383 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f99500aa7b0 con 0x7f99400039c0 2023-12-22T09:17:10.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.253+0000 7f9959185640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f993806a460 0x7f993806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.254+0000 7f9959185640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f993806a460 0x7f993806c920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f995413f7a0 tx=0x7f99440079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:10.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.257+0000 7f994a7fc640 1 -- 172.21.15.106:0/2744270383 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9950075e40 con 0x7f99400039c0 2023-12-22T09:17:10.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.447+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f99540aa4e0 con 0x7f99400039c0 2023-12-22T09:17:10.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.448+0000 7f994a7fc640 1 -- 172.21.15.106:0/2744270383 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+208 (secure 0 0 0) 0x7f9950043090 con 0x7f99400039c0 2023-12-22T09:17:10.448 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:10.448 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2023-12-22T09:17:10.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:17:10.448 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2023-12-22T09:17:10.448 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2023-12-22T09:17:10.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:17:10.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:17:10.449 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 9, 2023-12-22T09:17:10.449 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": "cephfs_metadata" 2023-12-22T09:17:10.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-12-22T09:17:10.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-12-22T09:17:10.449 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 10, 2023-12-22T09:17:10.449 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": "cephfs_data" 2023-12-22T09:17:10.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-12-22T09:17:10.449 INFO:teuthology.orchestra.run.smithi106.stdout:] 2023-12-22T09:17:10.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f993806a460 msgr2=0x7f993806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f993806a460 0x7f993806c920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f995413f7a0 tx=0x7f99440079d0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 msgr2=0x7f9954071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9954071a90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f995002e590 tx=0x7f9950004730 comp rx=0 tx=0).stop 2023-12-22T09:17:10.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 shutdown_connections 2023-12-22T09:17:10.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f993806a460 0x7f993806c920 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f995413cfe0 0x7f995413d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99541529f0 0x7f99540be950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 --2- 172.21.15.106:0/2744270383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99400039c0 0x7f9954071a90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.452+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 >> 172.21.15.106:0/2744270383 conn(0x7f99540c1db0 msgr2=0x7f99540c0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:10.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.453+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 shutdown_connections 2023-12-22T09:17:10.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.453+0000 7f995bbea640 1 -- 172.21.15.106:0/2744270383 wait complete. 2023-12-22T09:17:10.471 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-22T09:17:10.471 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-22T09:17:10.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.682+0000 7f2f308c3640 1 Processor -- start 2023-12-22T09:17:10.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.682+0000 7f2f308c3640 1 -- start start 2023-12-22T09:17:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.683+0000 7f2f308c3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c14d590 0x7f2f2c0aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.683+0000 7f2f308c3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f2c06c460 0x7f2f2c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.684+0000 7f2f308c3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c150000 con 0x7f2f2c0aaf40 2023-12-22T09:17:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.684+0000 7f2f308c3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c070ae0 con 0x7f2f2c06c460 2023-12-22T09:17:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.684+0000 7f2f308c3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1502c0 con 0x7f2f2c14d590 2023-12-22T09:17:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.684+0000 7f2f2b59e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2f2c0aaf40 0x7f2f2c0703d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38326/0 (socket says 172.21.15.106:38326) 2023-12-22T09:17:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.684+0000 7f2f2b59e640 1 -- 172.21.15.106:0/587002915 learned_addr learned my addr 172.21.15.106:0/587002915 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.684+0000 7f2f2ad9d640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c14d590 0x7f2f2c0aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.684+0000 7f2f23fff640 1 --2- 172.21.15.106:0/587002915 >> v2:172.21.15.132:3300/0 conn(0x7f2f2c06c460 0x7f2f2c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.684+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262491246 0 0) 0x7f2f2c150000 con 0x7f2f2c0aaf40 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.684+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f0c003520 con 0x7f2f2c0aaf40 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263627389 0 0) 0x7f2f0c003520 con 0x7f2f2c0aaf40 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c14d590 msgr2=0x7f2f2c0aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c14d590 0x7f2f2c0aaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 >> v2:172.21.15.132:3300/0 conn(0x7f2f2c06c460 msgr2=0x7f2f2c06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 --2- 172.21.15.106:0/587002915 >> v2:172.21.15.132:3300/0 conn(0x7f2f2c06c460 0x7f2f2c06fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c1505a0 con 0x7f2f2c0aaf40 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f2f240019f0 con 0x7f2f2c0aaf40 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 >> v1:172.21.15.106:6789/0 conn(0x7f2f2c0aaf40 legacy=0x7f2f2c0703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f0c003970 0x7f2f0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c14d590 0x7f2f0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1502c0 con 0x7f2f0c0047c0 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c00ba30 con 0x7f2f0c003970 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c00bba0 con 0x7f2f2c14d590 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f23fff640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.685+0000 7f2f23fff640 1 -- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c14d590 msgr2=0x7f2f0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.686+0000 7f2f23fff640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c14d590 0x7f2f0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.686+0000 7f2f2ad9d640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f0c003970 0x7f2f0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.686+0000 7f2f23fff640 1 -- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f0c003970 msgr2=0x7f2f0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.686+0000 7f2f23fff640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f0c003970 0x7f2f0c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.686+0000 7f2f23fff640 1 -- 172.21.15.106:0/587002915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c003520 con 0x7f2f0c0047c0 2023-12-22T09:17:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.687+0000 7f2f23fff640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f0c004c40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009650 tx=0x7f2f0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c4c2d5a6955135 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.687+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14030ac0 con 0x7f2f0c0047c0 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.687+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f14030c20 con 0x7f2f0c0047c0 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.687+0000 7f2f2a59c640 1 -- 172.21.15.106:0/587002915 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14038440 con 0x7f2f0c0047c0 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.687+0000 7f2f308c3640 1 -- 172.21.15.106:0/587002915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 msgr2=0x7f2f0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.687+0000 7f2f308c3640 1 --2- 172.21.15.106:0/587002915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f0c004c40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009650 tx=0x7f2f0c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.687+0000 7f2f2b59e640 1 -- 172.21.15.106:0/587002915 reap_dead start 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.687+0000 7f2f308c3640 1 -- 172.21.15.106:0/587002915 shutdown_connections 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.687+0000 7f2f308c3640 1 -- 172.21.15.106:0/587002915 >> 172.21.15.106:0/587002915 conn(0x7f2f2c0c1ba0 msgr2=0x7f2f2c0c1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.688+0000 7f2f308c3640 1 -- 172.21.15.106:0/587002915 shutdown_connections 2023-12-22T09:17:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.688+0000 7f2f308c3640 1 -- 172.21.15.106:0/587002915 wait complete. 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.689+0000 7f2f308c3640 1 Processor -- start 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.689+0000 7f2f308c3640 1 -- start start 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.690+0000 7f2f308c3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f2c146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.690+0000 7f2f308c3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c1dbf50 0x7f2f2c1da530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.690+0000 7f2f308c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0aa0b0 0x7f2f2c147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.690+0000 7f2f308c3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c149970 con 0x7f2f0c0047c0 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.690+0000 7f2f308c3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1dc4c0 con 0x7f2f2c0aa0b0 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.690+0000 7f2f308c3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1d9770 con 0x7f2f2c1dbf50 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.690+0000 7f2f2ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f2c146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f2ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f2c146540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59796/0 (socket says 172.21.15.106:59796) 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f2ad9d640 1 -- 172.21.15.106:0/1922276004 learned_addr learned my addr 172.21.15.106:0/1922276004 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:10.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f2b59e640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0aa0b0 0x7f2f2c147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f2ad9d640 1 -- 172.21.15.106:0/1922276004 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c1dbf50 msgr2=0x7f2f2c1da530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f2ad9d640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c1dbf50 0x7f2f2c1da530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f2ad9d640 1 -- 172.21.15.106:0/1922276004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0aa0b0 msgr2=0x7f2f2c147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f2ad9d640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0aa0b0 0x7f2f2c147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f2ad9d640 1 -- 172.21.15.106:0/1922276004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c1d9a50 con 0x7f2f0c0047c0 2023-12-22T09:17:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f2ad9d640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f2c146540 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c010860 tx=0x7f2f1c010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f237fe640 1 -- 172.21.15.106:0/1922276004 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c009610 con 0x7f2f0c0047c0 2023-12-22T09:17:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.691+0000 7f2f237fe640 1 -- 172.21.15.106:0/1922276004 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c00eb60 con 0x7f2f0c0047c0 2023-12-22T09:17:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.692+0000 7f2f237fe640 1 -- 172.21.15.106:0/1922276004 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c01c400 con 0x7f2f0c0047c0 2023-12-22T09:17:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.692+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c1d9d30 con 0x7f2f0c0047c0 2023-12-22T09:17:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.692+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c146c20 con 0x7f2f0c0047c0 2023-12-22T09:17:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.693+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c14adb0 con 0x7f2f0c0047c0 2023-12-22T09:17:10.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.694+0000 7f2f237fe640 1 -- 172.21.15.106:0/1922276004 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2f1c01c560 con 0x7f2f0c0047c0 2023-12-22T09:17:10.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.695+0000 7f2f237fe640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2f1006a460 0x7f2f1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:10.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.695+0000 7f2f237fe640 1 -- 172.21.15.106:0/1922276004 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f2f1c088ea0 con 0x7f2f0c0047c0 2023-12-22T09:17:10.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.695+0000 7f2f23fff640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2f1006a460 0x7f2f1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:10.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.696+0000 7f2f23fff640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2f1006a460 0x7f2f1006c920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2f1403a000 tx=0x7f2f14032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:10.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.699+0000 7f2f237fe640 1 -- 172.21.15.106:0/1922276004 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2f1c054410 con 0x7f2f0c0047c0 2023-12-22T09:17:10.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:10.888+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2f2c04e8d0 con 0x7f2f0c0047c0 2023-12-22T09:17:11.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.004+0000 7f2f237fe640 1 -- 172.21.15.106:0/1922276004 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v61) v1 ==== 140+0+0 (secure 0 0 0) 0x7f2f1c057a30 con 0x7f2f0c0047c0 2023-12-22T09:17:11.004 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs2_metadata' created 2023-12-22T09:17:11.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2f1006a460 msgr2=0x7f2f1006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:11.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2f1006a460 0x7f2f1006c920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2f1403a000 tx=0x7f2f14032000 comp rx=0 tx=0).stop 2023-12-22T09:17:11.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 msgr2=0x7f2f2c146540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:11.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f2c146540 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c010860 tx=0x7f2f1c010d20 comp rx=0 tx=0).stop 2023-12-22T09:17:11.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 shutdown_connections 2023-12-22T09:17:11.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f2f1006a460 0x7f2f1006c920 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2f1403a000 tx=0x7f2f14032000 comp rx=0 tx=0).stop 2023-12-22T09:17:11.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f2c0aa0b0 0x7f2f2c147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:11.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2f2c1dbf50 0x7f2f2c1da530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:11.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 --2- 172.21.15.106:0/1922276004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c0047c0 0x7f2f2c146540 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:11.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.008+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 >> 172.21.15.106:0/1922276004 conn(0x7f2f2c0c1ba0 msgr2=0x7f2f2c0c0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:11.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.009+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 shutdown_connections 2023-12-22T09:17:11.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.009+0000 7f2f308c3640 1 -- 172.21.15.106:0/1922276004 wait complete. 2023-12-22T09:17:11.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T09:17:11.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.233+0000 7fa99265f640 1 Processor -- start 2023-12-22T09:17:11.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.233+0000 7fa99265f640 1 -- start start 2023-12-22T09:17:11.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.235+0000 7fa99265f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 0x7fa98c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:11.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.235+0000 7fa99265f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa98c06bdc0 0x7fa98c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.235+0000 7fa99265f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c070000 con 0x7fa98c071e30 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.235+0000 7fa99265f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c0702e0 con 0x7fa98c06bdc0 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.235+0000 7fa99265f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0705c0 con 0x7fa98c0c5ca0 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.235+0000 7fa990bfc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa98c06bdc0 0x7fa98c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.235+0000 7fa990bfc640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa98c06bdc0 0x7fa98c14a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59810/0 (socket says 172.21.15.106:59810) 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.235+0000 7fa990bfc640 1 -- 172.21.15.106:0/3333477289 learned_addr learned my addr 172.21.15.106:0/3333477289 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.235+0000 7fa98bfff640 1 --2- 172.21.15.106:0/3333477289 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 0x7fa98c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.236+0000 7fa990bfc640 1 -- 172.21.15.106:0/3333477289 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 msgr2=0x7fa98c150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.236+0000 7fa990bfc640 1 --2- 172.21.15.106:0/3333477289 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 0x7fa98c150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.236+0000 7fa990bfc640 1 -- 172.21.15.106:0/3333477289 >> v1:172.21.15.106:6789/0 conn(0x7fa98c071e30 legacy=0x7fa98c0710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.236+0000 7fa990bfc640 1 -- 172.21.15.106:0/3333477289 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0708a0 con 0x7fa98c06bdc0 2023-12-22T09:17:11.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.236+0000 7fa98b7fe640 1 -- 172.21.15.106:0/3333477289 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061264404 0 0) 0x7fa98c070000 con 0x7fa98c071e30 2023-12-22T09:17:11.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.237+0000 7fa990bfc640 1 --2- 172.21.15.106:0/3333477289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 0x7fa98c14a5f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa98400d150 tx=0x7fa98402e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6131fe14ad799b5e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:11.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.237+0000 7fa98b7fe640 1 -- 172.21.15.106:0/3333477289 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98402ea70 con 0x7fa98c06bdc0 2023-12-22T09:17:11.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.237+0000 7fa98b7fe640 1 -- 172.21.15.106:0/3333477289 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98402ebd0 con 0x7fa98c06bdc0 2023-12-22T09:17:11.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.237+0000 7fa98b7fe640 1 -- 172.21.15.106:0/3333477289 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984009600 con 0x7fa98c06bdc0 2023-12-22T09:17:11.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.238+0000 7fa99265f640 1 -- 172.21.15.106:0/3333477289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 msgr2=0x7fa98c14a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:11.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.238+0000 7fa99265f640 1 --2- 172.21.15.106:0/3333477289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 0x7fa98c14a5f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa98400d150 tx=0x7fa98402e0d0 comp rx=0 tx=0).stop 2023-12-22T09:17:11.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.238+0000 7fa99265f640 1 -- 172.21.15.106:0/3333477289 shutdown_connections 2023-12-22T09:17:11.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.238+0000 7fa99265f640 1 --2- 172.21.15.106:0/3333477289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 0x7fa98c14a5f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:11.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.238+0000 7fa99265f640 1 --2- 172.21.15.106:0/3333477289 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 0x7fa98c150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:11.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.238+0000 7fa99265f640 1 -- 172.21.15.106:0/3333477289 >> 172.21.15.106:0/3333477289 conn(0x7fa98c06a220 msgr2=0x7fa98c0c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:11.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.238+0000 7fa99265f640 1 -- 172.21.15.106:0/3333477289 shutdown_connections 2023-12-22T09:17:11.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.238+0000 7fa99265f640 1 -- 172.21.15.106:0/3333477289 wait complete. 2023-12-22T09:17:11.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.239+0000 7fa99265f640 1 Processor -- start 2023-12-22T09:17:11.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.240+0000 7fa99265f640 1 -- start start 2023-12-22T09:17:11.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.240+0000 7fa99265f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 0x7fa98c1e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:11.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.240+0000 7fa99265f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c071e30 0x7fa98c1482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:11.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.240+0000 7fa99265f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 0x7fa98c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:11.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.240+0000 7fa99265f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0bb8f0 con 0x7fa98c06bdc0 2023-12-22T09:17:11.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.240+0000 7fa99265f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c149010 con 0x7fa98c071e30 2023-12-22T09:17:11.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.240+0000 7fa99265f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1492f0 con 0x7fa98c0c5ca0 2023-12-22T09:17:11.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa98bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 0x7fa98c1e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:11.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa98bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 0x7fa98c1e43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59824/0 (socket says 172.21.15.106:59824) 2023-12-22T09:17:11.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa98bfff640 1 -- 172.21.15.106:0/872300100 learned_addr learned my addr 172.21.15.106:0/872300100 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:11.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa990bfc640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 0x7fa98c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:11.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa983fff640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c071e30 0x7fa98c1482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:11.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa98bfff640 1 -- 172.21.15.106:0/872300100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 msgr2=0x7fa98c0b8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa98bfff640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 0x7fa98c0b8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa98bfff640 1 -- 172.21.15.106:0/872300100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c071e30 msgr2=0x7fa98c1482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa98bfff640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c071e30 0x7fa98c1482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa98bfff640 1 -- 172.21.15.106:0/872300100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98400bd40 con 0x7fa98c06bdc0 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.241+0000 7fa983fff640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c071e30 0x7fa98c1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.242+0000 7fa98bfff640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 0x7fa98c1e43b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00d5f0 tx=0x7fa97c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.242+0000 7fa9897fa640 1 -- 172.21.15.106:0/872300100 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0125f0 con 0x7fa98c06bdc0 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.242+0000 7fa9897fa640 1 -- 172.21.15.106:0/872300100 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c012750 con 0x7fa98c06bdc0 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.242+0000 7fa9897fa640 1 -- 172.21.15.106:0/872300100 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c012b00 con 0x7fa98c06bdc0 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.242+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c145c10 con 0x7fa98c06bdc0 2023-12-22T09:17:11.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.242+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c0bbbb0 con 0x7fa98c06bdc0 2023-12-22T09:17:11.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.243+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c0bbd70 con 0x7fa98c06bdc0 2023-12-22T09:17:11.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.244+0000 7fa9897fa640 1 -- 172.21.15.106:0/872300100 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa97c012c60 con 0x7fa98c06bdc0 2023-12-22T09:17:11.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.245+0000 7fa9897fa640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa96c06a430 0x7fa96c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:11.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.245+0000 7fa9897fa640 1 -- 172.21.15.106:0/872300100 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6516+0+0 (secure 0 0 0) 0x7fa97c088ff0 con 0x7fa98c06bdc0 2023-12-22T09:17:11.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.246+0000 7fa983fff640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa96c06a430 0x7fa96c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:11.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.246+0000 7fa983fff640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa96c06a430 0x7fa96c06c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0aa520 tx=0x7fa974009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:11.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.250+0000 7fa9897fa640 1 -- 172.21.15.106:0/872300100 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa97c0bbc80 con 0x7fa98c06bdc0 2023-12-22T09:17:11.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:11.440+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa98c073f10 con 0x7fa98c06bdc0 2023-12-22T09:17:12.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.019+0000 7fa9897fa640 1 -- 172.21.15.106:0/872300100 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v62) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa97c0542e0 con 0x7fa98c06bdc0 2023-12-22T09:17:12.019 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs2_data' created 2023-12-22T09:17:12.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.025+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa96c06a430 msgr2=0x7fa96c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.025+0000 7fa99265f640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa96c06a430 0x7fa96c06c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0aa520 tx=0x7fa974009040 comp rx=0 tx=0).stop 2023-12-22T09:17:12.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.025+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 msgr2=0x7fa98c1e43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.025+0000 7fa99265f640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 0x7fa98c1e43b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00d5f0 tx=0x7fa97c00dab0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.026+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 shutdown_connections 2023-12-22T09:17:12.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.026+0000 7fa99265f640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa96c06a430 0x7fa96c06c8f0 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0aa520 tx=0x7fa974009040 comp rx=0 tx=0).stop 2023-12-22T09:17:12.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.026+0000 7fa99265f640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa98c0c5ca0 0x7fa98c0b8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.026+0000 7fa99265f640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c071e30 0x7fa98c1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.026+0000 7fa99265f640 1 --2- 172.21.15.106:0/872300100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c06bdc0 0x7fa98c1e43b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.026+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 >> 172.21.15.106:0/872300100 conn(0x7fa98c06a220 msgr2=0x7fa98c06ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:12.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.027+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 shutdown_connections 2023-12-22T09:17:12.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.028+0000 7fa99265f640 1 -- 172.21.15.106:0/872300100 wait complete. 2023-12-22T09:17:12.058 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-22T09:17:12.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.245+0000 7ffb9b28b640 1 Processor -- start 2023-12-22T09:17:12.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.245+0000 7ffb9b28b640 1 -- start start 2023-12-22T09:17:12.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.247+0000 7ffb9b28b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb9406b960 0x7ffb94151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.247+0000 7ffb9b28b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb94155120 con 0x7ffb9414f090 2023-12-22T09:17:12.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.247+0000 7ffb9b28b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb94155fa0 con 0x7ffb940c1910 2023-12-22T09:17:12.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.247+0000 7ffb9b28b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9406e080 con 0x7ffb9406b960 2023-12-22T09:17:12.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.247+0000 7ffb99027640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ffb9414f090 0x7ffb94155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38340/0 (socket says 172.21.15.106:38340) 2023-12-22T09:17:12.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.247+0000 7ffb99027640 1 -- 172.21.15.106:0/3707364486 learned_addr learned my addr 172.21.15.106:0/3707364486 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:12.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.247+0000 7ffb99828640 1 --2- 172.21.15.106:0/3707364486 >> v2:172.21.15.132:3300/0 conn(0x7ffb9406b960 0x7ffb94151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.247+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672549158 0 0) 0x7ffb94155120 con 0x7ffb9414f090 2023-12-22T09:17:12.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.247+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb80003520 con 0x7ffb9414f090 2023-12-22T09:17:12.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148644992 0 0) 0x7ffb80003520 con 0x7ffb9414f090 2023-12-22T09:17:12.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 >> v2:172.21.15.132:3300/0 conn(0x7ffb9406b960 msgr2=0x7ffb94151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:12.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 --2- 172.21.15.106:0/3707364486 >> v2:172.21.15.132:3300/0 conn(0x7ffb9406b960 0x7ffb94151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 >> v1:172.21.15.132:6789/0 conn(0x7ffb940c1910 legacy=0x7ffb940c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:12.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb940a8720 con 0x7ffb9414f090 2023-12-22T09:17:12.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7ffb90001670 con 0x7ffb9414f090 2023-12-22T09:17:12.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 >> v1:172.21.15.106:6789/0 conn(0x7ffb9414f090 legacy=0x7ffb94155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb80003970 0x7ffb80003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb800047c0 0x7ffb80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8000c080 con 0x7ffb80005180 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8000c1f0 con 0x7ffb800047c0 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8000c3b0 con 0x7ffb80003970 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.248+0000 7ffb99828640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.249+0000 7ffb99027640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb80003970 0x7ffb80003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.249+0000 7ffb99828640 1 -- 172.21.15.106:0/3707364486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb80003970 msgr2=0x7ffb80003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.249+0000 7ffb98826640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb800047c0 0x7ffb80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.249+0000 7ffb99828640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb80003970 0x7ffb80003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.249+0000 7ffb99828640 1 -- 172.21.15.106:0/3707364486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb800047c0 msgr2=0x7ffb80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.249+0000 7ffb99828640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb800047c0 0x7ffb80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.249+0000 7ffb99828640 1 -- 172.21.15.106:0/3707364486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb80003520 con 0x7ffb80005180 2023-12-22T09:17:12.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.249+0000 7ffb98826640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb800047c0 0x7ffb80004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:12.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.250+0000 7ffb99828640 1 -- 172.21.15.106:0/3707364486 reap_dead start 2023-12-22T09:17:12.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.250+0000 7ffb99828640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009fc0 tx=0x7ffb800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a85b19df48a84b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:12.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.250+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c02cc60 con 0x7ffb80005180 2023-12-22T09:17:12.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.250+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c00f040 con 0x7ffb80005180 2023-12-22T09:17:12.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.250+0000 7ffb8bfff640 1 -- 172.21.15.106:0/3707364486 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c003990 con 0x7ffb80005180 2023-12-22T09:17:12.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.251+0000 7ffb9b28b640 1 -- 172.21.15.106:0/3707364486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb80005180 msgr2=0x7ffb8000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.251+0000 7ffb9b28b640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009fc0 tx=0x7ffb800057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.251+0000 7ffb9b28b640 1 -- 172.21.15.106:0/3707364486 shutdown_connections 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.251+0000 7ffb9b28b640 1 --2- 172.21.15.106:0/3707364486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb80005180 0x7ffb8000b980 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.251+0000 7ffb9b28b640 1 -- 172.21.15.106:0/3707364486 >> 172.21.15.106:0/3707364486 conn(0x7ffb94069dd0 msgr2=0x7ffb9406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.251+0000 7ffb9b28b640 1 -- 172.21.15.106:0/3707364486 shutdown_connections 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.251+0000 7ffb9b28b640 1 -- 172.21.15.106:0/3707364486 wait complete. 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.253+0000 7ffb9b28b640 1 Processor -- start 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.253+0000 7ffb9b28b640 1 -- start start 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb9b28b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80005180 0x7ffb941ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb9b28b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb94146850 0x7ffb941e8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb9b28b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb9414cbe0 0x7ffb94145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb9b28b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb94155020 con 0x7ffb9414cbe0 2023-12-22T09:17:12.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb9b28b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb941ec760 con 0x7ffb80005180 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb9b28b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb94150bb0 con 0x7ffb94146850 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb99828640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb9414cbe0 0x7ffb94145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb99828640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb9414cbe0 0x7ffb94145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59852/0 (socket says 172.21.15.106:59852) 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb99828640 1 -- 172.21.15.106:0/1967164737 learned_addr learned my addr 172.21.15.106:0/1967164737 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb99027640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80005180 0x7ffb941ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb98826640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb94146850 0x7ffb941e8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb99828640 1 -- 172.21.15.106:0/1967164737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb94146850 msgr2=0x7ffb941e8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.254+0000 7ffb99828640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb94146850 0x7ffb941e8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb99828640 1 -- 172.21.15.106:0/1967164737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80005180 msgr2=0x7ffb941ecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb99828640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80005180 0x7ffb941ecb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb99828640 1 -- 172.21.15.106:0/1967164737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb941ed0c0 con 0x7ffb9414cbe0 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb99027640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80005180 0x7ffb941ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb99828640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb9414cbe0 0x7ffb94145b80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c02c6d0 tx=0x7ffb8c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:12.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb89ffb640 1 -- 172.21.15.106:0/1967164737 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c035e40 con 0x7ffb9414cbe0 2023-12-22T09:17:12.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb89ffb640 1 -- 172.21.15.106:0/1967164737 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c003990 con 0x7ffb9414cbe0 2023-12-22T09:17:12.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb89ffb640 1 -- 172.21.15.106:0/1967164737 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c003d40 con 0x7ffb9414cbe0 2023-12-22T09:17:12.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb94154a60 con 0x7ffb9414cbe0 2023-12-22T09:17:12.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.255+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb941ec380 con 0x7ffb9414cbe0 2023-12-22T09:17:12.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.256+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb941ec1e0 con 0x7ffb9414cbe0 2023-12-22T09:17:12.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.257+0000 7ffb89ffb640 1 -- 172.21.15.106:0/1967164737 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb8c004030 con 0x7ffb9414cbe0 2023-12-22T09:17:12.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.258+0000 7ffb89ffb640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb7806a460 0x7ffb7806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.258+0000 7ffb89ffb640 1 -- 172.21.15.106:0/1967164737 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6899+0+0 (secure 0 0 0) 0x7ffb8c0aba90 con 0x7ffb9414cbe0 2023-12-22T09:17:12.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.259+0000 7ffb99027640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb7806a460 0x7ffb7806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.259+0000 7ffb99027640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb7806a460 0x7ffb7806c920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffb90001eb0 tx=0x7ffb90000f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:12.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.263+0000 7ffb89ffb640 1 -- 172.21.15.106:0/1967164737 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffb941ec1e0 con 0x7ffb9414cbe0 2023-12-22T09:17:12.488 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.489+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7ffb941ec8a0 con 0x7ffb9414cbe0 2023-12-22T09:17:12.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.503+0000 7ffb89ffb640 1 -- 172.21.15.106:0/1967164737 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 11 and data pool 12 v31) v1 ==== 177+0+0 (secure 0 0 0) 0x7ffb941ec8a0 con 0x7ffb9414cbe0 2023-12-22T09:17:12.505 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 11 and data pool 12 2023-12-22T09:17:12.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb7806a460 msgr2=0x7ffb7806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb7806a460 0x7ffb7806c920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffb90001eb0 tx=0x7ffb90000f10 comp rx=0 tx=0).stop 2023-12-22T09:17:12.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb9414cbe0 msgr2=0x7ffb94145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb9414cbe0 0x7ffb94145b80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c02c6d0 tx=0x7ffb8c009750 comp rx=0 tx=0).stop 2023-12-22T09:17:12.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 shutdown_connections 2023-12-22T09:17:12.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ffb7806a460 0x7ffb7806c920 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb9414cbe0 0x7ffb94145b80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb94146850 0x7ffb941e8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 --2- 172.21.15.106:0/1967164737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb80005180 0x7ffb941ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 >> 172.21.15.106:0/1967164737 conn(0x7ffb94069dd0 msgr2=0x7ffb9414dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:12.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.507+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 shutdown_connections 2023-12-22T09:17:12.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.508+0000 7ffb9b28b640 1 -- 172.21.15.106:0/1967164737 wait complete. 2023-12-22T09:17:12.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:17:12.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.716+0000 7fba1b004640 1 Processor -- start 2023-12-22T09:17:12.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.716+0000 7fba1b004640 1 -- start start 2023-12-22T09:17:12.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.718+0000 7fba1b004640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba14069e60 0x7fba1414a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.718+0000 7fba1b004640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 0x7fba1414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.718+0000 7fba1b004640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba140bfce0 con 0x7fba14150a80 2023-12-22T09:17:12.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.718+0000 7fba1b004640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140c0960 con 0x7fba14069e60 2023-12-22T09:17:12.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.718+0000 7fba1b004640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1406aba0 con 0x7fba14152680 2023-12-22T09:17:12.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.719+0000 7fba18da0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba14069e60 0x7fba1414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.719+0000 7fba195a1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 0x7fba1414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.719+0000 7fba18da0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba14069e60 0x7fba1414a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:44436/0 (socket says 172.21.15.106:44436) 2023-12-22T09:17:12.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.719+0000 7fba18da0640 1 -- 172.21.15.106:0/2020865585 learned_addr learned my addr 172.21.15.106:0/2020865585 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:12.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.719+0000 7fba18da0640 1 -- 172.21.15.106:0/2020865585 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 msgr2=0x7fba1414abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:12.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.719+0000 7fba18da0640 1 --2- 172.21.15.106:0/2020865585 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 0x7fba1414abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.719+0000 7fba18da0640 1 -- 172.21.15.106:0/2020865585 >> v1:172.21.15.132:6789/0 conn(0x7fba14150a80 legacy=0x7fba14151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.719+0000 7fba18da0640 1 -- 172.21.15.106:0/2020865585 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140bffc0 con 0x7fba14069e60 2023-12-22T09:17:12.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.721+0000 7fba18da0640 1 --2- 172.21.15.106:0/2020865585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba14069e60 0x7fba1414a670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba08009880 tx=0x7fba0802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76ac1eb8e17b4e73 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:12.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.721+0000 7fba137fe640 1 -- 172.21.15.106:0/2020865585 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0802e070 con 0x7fba14069e60 2023-12-22T09:17:12.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.721+0000 7fba137fe640 1 -- 172.21.15.106:0/2020865585 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08004030 con 0x7fba14069e60 2023-12-22T09:17:12.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.721+0000 7fba137fe640 1 -- 172.21.15.106:0/2020865585 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08004420 con 0x7fba14069e60 2023-12-22T09:17:12.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.722+0000 7fba1b004640 1 -- 172.21.15.106:0/2020865585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba14069e60 msgr2=0x7fba1414a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.722+0000 7fba1b004640 1 --2- 172.21.15.106:0/2020865585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba14069e60 0x7fba1414a670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba08009880 tx=0x7fba0802b840 comp rx=0 tx=0).stop 2023-12-22T09:17:12.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.722+0000 7fba1b004640 1 -- 172.21.15.106:0/2020865585 shutdown_connections 2023-12-22T09:17:12.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.722+0000 7fba1b004640 1 --2- 172.21.15.106:0/2020865585 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 0x7fba1414abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.722+0000 7fba1b004640 1 --2- 172.21.15.106:0/2020865585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba14069e60 0x7fba1414a670 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.722+0000 7fba1b004640 1 -- 172.21.15.106:0/2020865585 >> 172.21.15.106:0/2020865585 conn(0x7fba140c5360 msgr2=0x7fba140c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:12.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.722+0000 7fba1b004640 1 -- 172.21.15.106:0/2020865585 shutdown_connections 2023-12-22T09:17:12.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.722+0000 7fba1b004640 1 -- 172.21.15.106:0/2020865585 wait complete. 2023-12-22T09:17:12.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.724+0000 7fba1b004640 1 Processor -- start 2023-12-22T09:17:12.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.724+0000 7fba1b004640 1 -- start start 2023-12-22T09:17:12.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.725+0000 7fba1b004640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba14069e60 0x7fba141420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.725+0000 7fba1b004640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba14150a80 0x7fba14143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.725+0000 7fba1b004640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 0x7fba141438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.725+0000 7fba1b004640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba14153bd0 con 0x7fba14150a80 2023-12-22T09:17:12.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.725+0000 7fba1b004640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba14142610 con 0x7fba14069e60 2023-12-22T09:17:12.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.725+0000 7fba1b004640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba14147db0 con 0x7fba14152680 2023-12-22T09:17:12.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.725+0000 7fba13fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba14150a80 0x7fba14143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.725+0000 7fba13fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba14150a80 0x7fba14143390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40306/0 (socket says 172.21.15.106:40306) 2023-12-22T09:17:12.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.725+0000 7fba13fff640 1 -- 172.21.15.106:0/2528752314 learned_addr learned my addr 172.21.15.106:0/2528752314 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:12.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba18da0640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba14069e60 0x7fba141420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba195a1640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 0x7fba141438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba13fff640 1 -- 172.21.15.106:0/2528752314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 msgr2=0x7fba141438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba13fff640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 0x7fba141438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba13fff640 1 -- 172.21.15.106:0/2528752314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba14069e60 msgr2=0x7fba141420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba13fff640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba14069e60 0x7fba141420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba13fff640 1 -- 172.21.15.106:0/2528752314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08009460 con 0x7fba14150a80 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba13fff640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba14150a80 0x7fba14143390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c430 tx=0x7fba0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba117fa640 1 -- 172.21.15.106:0/2528752314 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000052d0 con 0x7fba14150a80 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba117fa640 1 -- 172.21.15.106:0/2528752314 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba00005430 con 0x7fba14150a80 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.726+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba141543c0 con 0x7fba14150a80 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.727+0000 7fba117fa640 1 -- 172.21.15.106:0/2528752314 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00003830 con 0x7fba14150a80 2023-12-22T09:17:12.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.727+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba141538f0 con 0x7fba14150a80 2023-12-22T09:17:12.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.728+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba14154190 con 0x7fba14150a80 2023-12-22T09:17:12.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.729+0000 7fba117fa640 1 -- 172.21.15.106:0/2528752314 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fba00003990 con 0x7fba14150a80 2023-12-22T09:17:12.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.729+0000 7fba117fa640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f806a430 0x7fb9f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:12.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.730+0000 7fba117fa640 1 -- 172.21.15.106:0/2528752314 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fba000883a0 con 0x7fba14150a80 2023-12-22T09:17:12.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.730+0000 7fba18da0640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f806a430 0x7fb9f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:12.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.730+0000 7fba18da0640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f806a430 0x7fb9f806c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fba08034000 tx=0x7fba08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:12.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.734+0000 7fba117fa640 1 -- 172.21.15.106:0/2528752314 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fba14154190 con 0x7fba14150a80 2023-12-22T09:17:12.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.913+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba14154190 con 0x7fba14150a80 2023-12-22T09:17:12.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.917+0000 7fba117fa640 1 -- 172.21.15.106:0/2528752314 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+20219 (secure 0 0 0) 0x7fba14154190 con 0x7fba14150a80 2023-12-22T09:17:12.918 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:12.918 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":63,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:17:12.490305+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:16:55.972567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-22T09:16:57.103965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:17:10.934795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:17:11.491287+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.34","mappings":[{"from":7,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:17:12.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f806a430 msgr2=0x7fb9f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f806a430 0x7fb9f806c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fba08034000 tx=0x7fba08008030 comp rx=0 tx=0).stop 2023-12-22T09:17:12.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba14150a80 msgr2=0x7fba14143390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:12.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba14150a80 0x7fba14143390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c430 tx=0x7fba0000c8f0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 shutdown_connections 2023-12-22T09:17:12.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb9f806a430 0x7fb9f806c8f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fba14152680 0x7fba141438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba14150a80 0x7fba14143390 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 --2- 172.21.15.106:0/2528752314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba14069e60 0x7fba141420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:12.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 >> 172.21.15.106:0/2528752314 conn(0x7fba140c5360 msgr2=0x7fba14072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:12.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 shutdown_connections 2023-12-22T09:17:12.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:12.920+0000 7fba1b004640 1 -- 172.21.15.106:0/2528752314 wait complete. 2023-12-22T09:17:12.938 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:17:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.136+0000 7fd36bfff640 1 Processor -- start 2023-12-22T09:17:13.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.136+0000 7fd36bfff640 1 -- start start 2023-12-22T09:17:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.137+0000 7fd36bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd36c0a8150 0x7fd36c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.137+0000 7fd36bfff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd36c0c16f0 0x7fd36c071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.137+0000 7fd36bfff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36c152300 con 0x7fd36c14f050 2023-12-22T09:17:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.137+0000 7fd36bfff640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c14f430 con 0x7fd36c0c16f0 2023-12-22T09:17:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.137+0000 7fd36bfff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c1519f0 con 0x7fd36c0a8150 2023-12-22T09:17:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36b7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd36c0c16f0 0x7fd36c071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36affd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd36c14f050 0x7fd36c0c1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49602/0 (socket says 172.21.15.106:49602) 2023-12-22T09:17:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36b7fe640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd36c0c16f0 0x7fd36c071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40322/0 (socket says 172.21.15.106:40322) 2023-12-22T09:17:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36affd640 1 -- 172.21.15.106:0/744554262 learned_addr learned my addr 172.21.15.106:0/744554262 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36a7fc640 1 --2- 172.21.15.106:0/744554262 >> v2:172.21.15.132:3300/0 conn(0x7fd36c0a8150 0x7fd36c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36b7fe640 1 -- 172.21.15.106:0/744554262 >> v2:172.21.15.132:3300/0 conn(0x7fd36c0a8150 msgr2=0x7fd36c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36b7fe640 1 --2- 172.21.15.106:0/744554262 >> v2:172.21.15.132:3300/0 conn(0x7fd36c0a8150 0x7fd36c070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36b7fe640 1 -- 172.21.15.106:0/744554262 >> v1:172.21.15.106:6789/0 conn(0x7fd36c14f050 legacy=0x7fd36c0c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36b7fe640 1 -- 172.21.15.106:0/744554262 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c0c0860 con 0x7fd36c0c16f0 2023-12-22T09:17:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.138+0000 7fd36a7fc640 1 --2- 172.21.15.106:0/744554262 >> v2:172.21.15.132:3300/0 conn(0x7fd36c0a8150 0x7fd36c070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:13.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.139+0000 7fd36b7fe640 1 --2- 172.21.15.106:0/744554262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 0x7fd36c071340 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0a8930 tx=0x7fd36402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51ebaf53490c481 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:13.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd369ffb640 1 -- 172.21.15.106:0/744554262 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36402cbe0 con 0x7fd36c0c16f0 2023-12-22T09:17:13.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd369ffb640 1 -- 172.21.15.106:0/744554262 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36402cd40 con 0x7fd36c0c16f0 2023-12-22T09:17:13.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd369ffb640 1 -- 172.21.15.106:0/744554262 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364034660 con 0x7fd36c0c16f0 2023-12-22T09:17:13.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd36bfff640 1 -- 172.21.15.106:0/744554262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 msgr2=0x7fd36c071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd36bfff640 1 --2- 172.21.15.106:0/744554262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 0x7fd36c071340 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0a8930 tx=0x7fd36402be30 comp rx=0 tx=0).stop 2023-12-22T09:17:13.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd36bfff640 1 -- 172.21.15.106:0/744554262 shutdown_connections 2023-12-22T09:17:13.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd36bfff640 1 --2- 172.21.15.106:0/744554262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 0x7fd36c071340 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd36bfff640 1 --2- 172.21.15.106:0/744554262 >> v2:172.21.15.132:3300/0 conn(0x7fd36c0a8150 0x7fd36c070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd36bfff640 1 -- 172.21.15.106:0/744554262 >> 172.21.15.106:0/744554262 conn(0x7fd36c069dd0 msgr2=0x7fd36c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:13.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd36bfff640 1 -- 172.21.15.106:0/744554262 shutdown_connections 2023-12-22T09:17:13.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.140+0000 7fd36bfff640 1 -- 172.21.15.106:0/744554262 wait complete. 2023-12-22T09:17:13.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.142+0000 7fd36bfff640 1 Processor -- start 2023-12-22T09:17:13.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.142+0000 7fd36bfff640 1 -- start start 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0a8150 0x7fd36c0be740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 0x7fd36c06b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd36c14f050 0x7fd36c1e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36bfff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c148d90 con 0x7fd36c0c16f0 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36bfff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c14c650 con 0x7fd36c0a8150 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36bfff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1e99b0 con 0x7fd36c14f050 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36a7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 0x7fd36c06b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36a7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 0x7fd36c06b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40336/0 (socket says 172.21.15.106:40336) 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36a7fc640 1 -- 172.21.15.106:0/1543045700 learned_addr learned my addr 172.21.15.106:0/1543045700 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36affd640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0a8150 0x7fd36c0be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.143+0000 7fd36b7fe640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd36c14f050 0x7fd36c1e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd36a7fc640 1 -- 172.21.15.106:0/1543045700 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd36c14f050 msgr2=0x7fd36c1e62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd36a7fc640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd36c14f050 0x7fd36c1e62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd36a7fc640 1 -- 172.21.15.106:0/1543045700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0a8150 msgr2=0x7fd36c0be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd36a7fc640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0a8150 0x7fd36c0be740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd36a7fc640 1 -- 172.21.15.106:0/1543045700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364009a70 con 0x7fd36c0c16f0 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd36affd640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0a8150 0x7fd36c0be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd36a7fc640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 0x7fd36c06b860 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c7f0 tx=0x7fd36000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd3537fe640 1 -- 172.21.15.106:0/1543045700 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360007a30 con 0x7fd36c0c16f0 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd3537fe640 1 -- 172.21.15.106:0/1543045700 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360007b90 con 0x7fd36c0c16f0 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd3537fe640 1 -- 172.21.15.106:0/1543045700 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36000ce40 con 0x7fd36c0c16f0 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36c1e9c90 con 0x7fd36c0c16f0 2023-12-22T09:17:13.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.144+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c148ab0 con 0x7fd36c0c16f0 2023-12-22T09:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.145+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c14c800 con 0x7fd36c0c16f0 2023-12-22T09:17:13.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.146+0000 7fd3537fe640 1 -- 172.21.15.106:0/1543045700 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd3600113f0 con 0x7fd36c0c16f0 2023-12-22T09:17:13.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.147+0000 7fd3537fe640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd35806a430 0x7fd35806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.147+0000 7fd3537fe640 1 -- 172.21.15.106:0/1543045700 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fd360088fe0 con 0x7fd36c0c16f0 2023-12-22T09:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.147+0000 7fd36affd640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd35806a430 0x7fd35806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.148+0000 7fd36affd640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd35806a430 0x7fd35806c8f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd35c005880 tx=0x7fd35c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:13.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.151+0000 7fd3537fe640 1 -- 172.21.15.106:0/1543045700 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd36c14c800 con 0x7fd36c0c16f0 2023-12-22T09:17:13.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.328+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd36c14c800 con 0x7fd36c0c16f0 2023-12-22T09:17:13.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.331+0000 7fd3537fe640 1 -- 172.21.15.106:0/1543045700 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+20219 (secure 0 0 0) 0x7fd36c14c800 con 0x7fd36c0c16f0 2023-12-22T09:17:13.332 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:13.332 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":63,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:17:12.490305+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:16:55.972567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-22T09:16:57.103965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:17:10.934795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:17:11.491287+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.34","mappings":[{"from":7,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd35806a430 msgr2=0x7fd35806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd35806a430 0x7fd35806c8f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd35c005880 tx=0x7fd35c009040 comp rx=0 tx=0).stop 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 msgr2=0x7fd36c06b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 0x7fd36c06b860 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd36000c7f0 tx=0x7fd36000cbf0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 shutdown_connections 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd35806a430 0x7fd35806c8f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd36c14f050 0x7fd36c1e62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd36c0c16f0 0x7fd36c06b860 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 --2- 172.21.15.106:0/1543045700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0a8150 0x7fd36c0be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 >> 172.21.15.106:0/1543045700 conn(0x7fd36c069dd0 msgr2=0x7fd36c14f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:13.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 shutdown_connections 2023-12-22T09:17:13.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.334+0000 7fd36bfff640 1 -- 172.21.15.106:0/1543045700 wait complete. 2023-12-22T09:17:13.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-22T09:17:13.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.564+0000 7f1929573640 1 Processor -- start 2023-12-22T09:17:13.564 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.564+0000 7f1929573640 1 -- start start 2023-12-22T09:17:13.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.565+0000 7f1929573640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f19240c6150 0x7f19240c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f1929573640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19240c4560 con 0x7f19240c7640 2023-12-22T09:17:13.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f1929573640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1924154720 con 0x7f192406ca00 2023-12-22T09:17:13.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f1929573640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240c4f90 con 0x7f19240c6150 2023-12-22T09:17:13.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f1922ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f19240c6150 0x7f19240c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f191a7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f19240c7640 0x7f192406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49604/0 (socket says 172.21.15.106:49604) 2023-12-22T09:17:13.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f1922ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f19240c6150 0x7f19240c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40352/0 (socket says 172.21.15.106:40352) 2023-12-22T09:17:13.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f191a7fc640 1 -- 172.21.15.106:0/449021774 learned_addr learned my addr 172.21.15.106:0/449021774 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:13.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f1922ffd640 1 -- 172.21.15.106:0/449021774 >> v1:172.21.15.132:6789/0 conn(0x7f192406ca00 legacy=0x7f192406b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:13.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f1922ffd640 1 -- 172.21.15.106:0/449021774 >> v1:172.21.15.106:6789/0 conn(0x7f19240c7640 legacy=0x7f192406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.566+0000 7f1922ffd640 1 -- 172.21.15.106:0/449021774 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924154c50 con 0x7f19240c6150 2023-12-22T09:17:13.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.567+0000 7f1922ffd640 1 --2- 172.21.15.106:0/449021774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c6150 0x7f19240c6530 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f191402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57d1a583aa8528f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:13.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f19227fc640 1 -- 172.21.15.106:0/449021774 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191402f050 con 0x7f19240c6150 2023-12-22T09:17:13.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f19227fc640 1 -- 172.21.15.106:0/449021774 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1914031700 con 0x7f19240c6150 2023-12-22T09:17:13.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f19227fc640 1 -- 172.21.15.106:0/449021774 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914031a90 con 0x7f19240c6150 2023-12-22T09:17:13.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f1929573640 1 -- 172.21.15.106:0/449021774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c6150 msgr2=0x7f19240c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f1929573640 1 --2- 172.21.15.106:0/449021774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c6150 0x7f19240c6530 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f191402b7a0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f1929573640 1 -- 172.21.15.106:0/449021774 shutdown_connections 2023-12-22T09:17:13.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f1929573640 1 --2- 172.21.15.106:0/449021774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c6150 0x7f19240c6530 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f1929573640 1 -- 172.21.15.106:0/449021774 >> 172.21.15.106:0/449021774 conn(0x7f19240ab330 msgr2=0x7f19240ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:13.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f1929573640 1 -- 172.21.15.106:0/449021774 shutdown_connections 2023-12-22T09:17:13.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.568+0000 7f1929573640 1 -- 172.21.15.106:0/449021774 wait complete. 2023-12-22T09:17:13.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.570+0000 7f1929573640 1 Processor -- start 2023-12-22T09:17:13.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.570+0000 7f1929573640 1 -- start start 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.571+0000 7f1929573640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f192406ca00 0x7f1924150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.571+0000 7f1929573640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19240c6150 0x7f1924155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.571+0000 7f1929573640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c7640 0x7f1924157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.571+0000 7f1929573640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19241581d0 con 0x7f19240c7640 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.571+0000 7f1929573640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240c32a0 con 0x7f192406ca00 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.571+0000 7f1929573640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240c3580 con 0x7f19240c6150 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.571+0000 7f19237fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c7640 0x7f1924157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.571+0000 7f19237fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c7640 0x7f1924157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40358/0 (socket says 172.21.15.106:40358) 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.571+0000 7f19237fe640 1 -- 172.21.15.106:0/1989897309 learned_addr learned my addr 172.21.15.106:0/1989897309 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:13.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.572+0000 7f191a7fc640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19240c6150 0x7f1924155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.572+0000 7f1922ffd640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f192406ca00 0x7f1924150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.572+0000 7f19237fe640 1 -- 172.21.15.106:0/1989897309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19240c6150 msgr2=0x7f1924155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.572+0000 7f19237fe640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19240c6150 0x7f1924155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.572+0000 7f19237fe640 1 -- 172.21.15.106:0/1989897309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f192406ca00 msgr2=0x7f1924150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:13.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.572+0000 7f19237fe640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f192406ca00 0x7f1924150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:13.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.572+0000 7f19237fe640 1 -- 172.21.15.106:0/1989897309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914009400 con 0x7f19240c7640 2023-12-22T09:17:13.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.572+0000 7f19237fe640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c7640 0x7f1924157150 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f191c00b9e0 tx=0x7f191c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:13.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.572+0000 7f191bfff640 1 -- 172.21.15.106:0/1989897309 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00cb20 con 0x7f19240c7640 2023-12-22T09:17:13.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.573+0000 7f191bfff640 1 -- 172.21.15.106:0/1989897309 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00cc80 con 0x7f19240c7640 2023-12-22T09:17:13.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.573+0000 7f191bfff640 1 -- 172.21.15.106:0/1989897309 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c014680 con 0x7f19240c7640 2023-12-22T09:17:13.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.573+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1924156950 con 0x7f19240c7640 2023-12-22T09:17:13.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.573+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1924150680 con 0x7f19240c7640 2023-12-22T09:17:13.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.574+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1924073f10 con 0x7f19240c7640 2023-12-22T09:17:13.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.575+0000 7f191bfff640 1 -- 172.21.15.106:0/1989897309 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f191c01d3b0 con 0x7f19240c7640 2023-12-22T09:17:13.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.576+0000 7f191bfff640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f190406a460 0x7f190406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:13.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.576+0000 7f191bfff640 1 -- 172.21.15.106:0/1989897309 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f191c088d90 con 0x7f19240c7640 2023-12-22T09:17:13.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.576+0000 7f1922ffd640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f190406a460 0x7f190406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:13.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.577+0000 7f1922ffd640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f190406a460 0x7f190406c920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1914035000 tx=0x7f1914008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:13.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.580+0000 7f191bfff640 1 -- 172.21.15.106:0/1989897309 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f191c053dd0 con 0x7f19240c7640 2023-12-22T09:17:13.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:13.803+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f192406c7e0 con 0x7f19240c7640 2023-12-22T09:17:14.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.528+0000 7f191bfff640 1 -- 172.21.15.106:0/1989897309 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 119+0+0 (secure 0 0 0) 0x7f191c019020 con 0x7f19240c7640 2023-12-22T09:17:14.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f190406a460 msgr2=0x7f190406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:14.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f190406a460 0x7f190406c920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1914035000 tx=0x7f1914008030 comp rx=0 tx=0).stop 2023-12-22T09:17:14.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c7640 msgr2=0x7f1924157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:14.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c7640 0x7f1924157150 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f191c00b9e0 tx=0x7f191c00bea0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 shutdown_connections 2023-12-22T09:17:14.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f190406a460 0x7f190406c920 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19240c7640 0x7f1924157150 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19240c6150 0x7f1924155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 --2- 172.21.15.106:0/1989897309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f192406ca00 0x7f1924150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 >> 172.21.15.106:0/1989897309 conn(0x7f19240ab330 msgr2=0x7f19240c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:14.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 shutdown_connections 2023-12-22T09:17:14.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.531+0000 7f1929573640 1 -- 172.21.15.106:0/1989897309 wait complete. 2023-12-22T09:17:14.551 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T09:17:14.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-22T09:17:14.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.774+0000 7fb6d4804640 1 Processor -- start 2023-12-22T09:17:14.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.774+0000 7fb6d4804640 1 -- start start 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.775+0000 7fb6d4804640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 0x7fb6d00c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.775+0000 7fb6d4804640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb6d00705a0 0x7fb6d0157af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.775+0000 7fb6d4804640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d00ab040 con 0x7fb6d00c1960 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.775+0000 7fb6d4804640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d006bdc0 con 0x7fb6d00705a0 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.775+0000 7fb6d4804640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d006caf0 con 0x7fb6d0151640 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.776+0000 7fb6ced9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb6d00705a0 0x7fb6d0157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.776+0000 7fb6ced9d640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb6d00705a0 0x7fb6d0157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40362/0 (socket says 172.21.15.106:40362) 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.776+0000 7fb6ced9d640 1 -- 172.21.15.106:0/2775771827 learned_addr learned my addr 172.21.15.106:0/2775771827 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.776+0000 7fb6ced9d640 1 -- 172.21.15.106:0/2775771827 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 msgr2=0x7fb6d00c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.776+0000 7fb6ce59c640 1 --2- 172.21.15.106:0/2775771827 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 0x7fb6d00c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:14.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.776+0000 7fb6ced9d640 1 --2- 172.21.15.106:0/2775771827 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 0x7fb6d00c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.776+0000 7fb6ced9d640 1 -- 172.21.15.106:0/2775771827 >> v1:172.21.15.132:6789/0 conn(0x7fb6d00c1960 legacy=0x7fb6d01573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:14.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.776+0000 7fb6ced9d640 1 -- 172.21.15.106:0/2775771827 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d006d890 con 0x7fb6d00705a0 2023-12-22T09:17:14.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.777+0000 7fb6ced9d640 1 --2- 172.21.15.106:0/2775771827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00705a0 0x7fb6d0157af0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009e50 tx=0x7fb6c802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26dd2533e5f70832 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:14.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.777+0000 7fb6cdd9b640 1 -- 172.21.15.106:0/2775771827 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c802c950 con 0x7fb6d00705a0 2023-12-22T09:17:14.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6cdd9b640 1 -- 172.21.15.106:0/2775771827 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c802cab0 con 0x7fb6d00705a0 2023-12-22T09:17:14.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6cdd9b640 1 -- 172.21.15.106:0/2775771827 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c802ce40 con 0x7fb6d00705a0 2023-12-22T09:17:14.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6d4804640 1 -- 172.21.15.106:0/2775771827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00705a0 msgr2=0x7fb6d0157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:14.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6d4804640 1 --2- 172.21.15.106:0/2775771827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00705a0 0x7fb6d0157af0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009e50 tx=0x7fb6c802bdb0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6d4804640 1 -- 172.21.15.106:0/2775771827 shutdown_connections 2023-12-22T09:17:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6d4804640 1 --2- 172.21.15.106:0/2775771827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00705a0 0x7fb6d0157af0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6d4804640 1 --2- 172.21.15.106:0/2775771827 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 0x7fb6d00c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6d4804640 1 -- 172.21.15.106:0/2775771827 >> 172.21.15.106:0/2775771827 conn(0x7fb6d006a220 msgr2=0x7fb6d00c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6d4804640 1 -- 172.21.15.106:0/2775771827 shutdown_connections 2023-12-22T09:17:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.778+0000 7fb6d4804640 1 -- 172.21.15.106:0/2775771827 wait complete. 2023-12-22T09:17:14.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.780+0000 7fb6d4804640 1 Processor -- start 2023-12-22T09:17:14.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.780+0000 7fb6d4804640 1 -- start start 2023-12-22T09:17:14.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.781+0000 7fb6d4804640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6d00705a0 0x7fb6d01563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.781+0000 7fb6d4804640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00c1960 0x7fb6d00bee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.781+0000 7fb6d4804640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 0x7fb6d00a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.781+0000 7fb6d4804640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d00a8d70 con 0x7fb6d00c1960 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.781+0000 7fb6d4804640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d014c2e0 con 0x7fb6d00705a0 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.781+0000 7fb6d4804640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d00bf370 con 0x7fb6d0151640 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.781+0000 7fb6c7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00c1960 0x7fb6d00bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.781+0000 7fb6c7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00c1960 0x7fb6d00bee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40372/0 (socket says 172.21.15.106:40372) 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.781+0000 7fb6c7fff640 1 -- 172.21.15.106:0/3218172592 learned_addr learned my addr 172.21.15.106:0/3218172592 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6ced9d640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 0x7fb6d00a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6ce59c640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6d00705a0 0x7fb6d01563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6c7fff640 1 -- 172.21.15.106:0/3218172592 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 msgr2=0x7fb6d00a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:14.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6c7fff640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 0x7fb6d00a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6c7fff640 1 -- 172.21.15.106:0/3218172592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6d00705a0 msgr2=0x7fb6d01563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6c7fff640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6d00705a0 0x7fb6d01563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6c7fff640 1 -- 172.21.15.106:0/3218172592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c8009b30 con 0x7fb6d00c1960 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6ce59c640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6d00705a0 0x7fb6d01563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6c7fff640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00c1960 0x7fb6d00bee30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c460 tx=0x7fb6b800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6c6ffd640 1 -- 172.21.15.106:0/3218172592 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8012830 con 0x7fb6d00c1960 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6c6ffd640 1 -- 172.21.15.106:0/3218172592 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b80129d0 con 0x7fb6d00c1960 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6c6ffd640 1 -- 172.21.15.106:0/3218172592 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8012d80 con 0x7fb6d00c1960 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.782+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d00a9010 con 0x7fb6d00c1960 2023-12-22T09:17:14.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.783+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d01554a0 con 0x7fb6d00c1960 2023-12-22T09:17:14.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.784+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d00a91a0 con 0x7fb6d00c1960 2023-12-22T09:17:14.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.785+0000 7fb6c6ffd640 1 -- 172.21.15.106:0/3218172592 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb6b801a3b0 con 0x7fb6d00c1960 2023-12-22T09:17:14.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.786+0000 7fb6c6ffd640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6b006a430 0x7fb6b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:14.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.786+0000 7fb6c6ffd640 1 -- 172.21.15.106:0/3218172592 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fb6b8088a10 con 0x7fb6d00c1960 2023-12-22T09:17:14.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.786+0000 7fb6ce59c640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6b006a430 0x7fb6b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:14.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.786+0000 7fb6ce59c640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6b006a430 0x7fb6b006c8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000b820 tx=0x7fb6c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:14.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:14.790+0000 7fb6c6ffd640 1 -- 172.21.15.106:0/3218172592 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb6b8053b80 con 0x7fb6d00c1960 2023-12-22T09:17:15.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.020+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb6d0073f10 con 0x7fb6d00c1960 2023-12-22T09:17:15.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.538+0000 7fb6c6ffd640 1 -- 172.21.15.106:0/3218172592 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb6b80571a0 con 0x7fb6d00c1960 2023-12-22T09:17:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6b006a430 msgr2=0x7fb6b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6b006a430 0x7fb6b006c8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000b820 tx=0x7fb6c0008040 comp rx=0 tx=0).stop 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00c1960 msgr2=0x7fb6d00bee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00c1960 0x7fb6d00bee30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c460 tx=0x7fb6b800c920 comp rx=0 tx=0).stop 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 shutdown_connections 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb6b006a430 0x7fb6b006c8f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6d0151640 0x7fb6d00a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6d00c1960 0x7fb6d00bee30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 --2- 172.21.15.106:0/3218172592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6d00705a0 0x7fb6d01563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.543+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 >> 172.21.15.106:0/3218172592 conn(0x7fb6d006a220 msgr2=0x7fb6d0072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.544+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 shutdown_connections 2023-12-22T09:17:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.544+0000 7fb6d4804640 1 -- 172.21.15.106:0/3218172592 wait complete. 2023-12-22T09:17:15.564 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-22T09:17:15.564 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T09:17:15.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.781+0000 7f3099a38640 1 Processor -- start 2023-12-22T09:17:15.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.781+0000 7f3099a38640 1 -- start start 2023-12-22T09:17:15.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.783+0000 7f3099a38640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3094069e60 0x7f30941551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:15.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.783+0000 7f3099a38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 0x7f3094155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:15.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.783+0000 7f3099a38640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309406fe60 con 0x7f3094070480 2023-12-22T09:17:15.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.783+0000 7f3099a38640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309415c5e0 con 0x7f3094069e60 2023-12-22T09:17:15.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.783+0000 7f3099a38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3094070140 con 0x7f309415c070 2023-12-22T09:17:15.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.783+0000 7f3092ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3094069e60 0x7f30941551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:15.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.783+0000 7f3092ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3094069e60 0x7f30941551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40376/0 (socket says 172.21.15.106:40376) 2023-12-22T09:17:15.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.783+0000 7f3092ffd640 1 -- 172.21.15.106:0/2958038763 learned_addr learned my addr 172.21.15.106:0/2958038763 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:15.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.784+0000 7f30927fc640 1 --2- 172.21.15.106:0/2958038763 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 0x7f3094155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:15.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.784+0000 7f3092ffd640 1 -- 172.21.15.106:0/2958038763 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 msgr2=0x7f3094155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:15.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.784+0000 7f3092ffd640 1 --2- 172.21.15.106:0/2958038763 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 0x7f3094155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.784+0000 7f3092ffd640 1 -- 172.21.15.106:0/2958038763 >> v1:172.21.15.132:6789/0 conn(0x7f3094070480 legacy=0x7f30940bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:15.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.784+0000 7f3092ffd640 1 -- 172.21.15.106:0/2958038763 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30940c1440 con 0x7f3094069e60 2023-12-22T09:17:15.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.785+0000 7f3092ffd640 1 --2- 172.21.15.106:0/2958038763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094069e60 0x7f30941551f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3084009850 tx=0x7f308402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e92ae30658b99b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:15.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.786+0000 7f3091ffb640 1 -- 172.21.15.106:0/2958038763 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084004230 con 0x7f3094069e60 2023-12-22T09:17:15.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.786+0000 7f3091ffb640 1 -- 172.21.15.106:0/2958038763 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3084004390 con 0x7f3094069e60 2023-12-22T09:17:15.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.786+0000 7f3091ffb640 1 -- 172.21.15.106:0/2958038763 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084031830 con 0x7f3094069e60 2023-12-22T09:17:15.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.786+0000 7f3099a38640 1 -- 172.21.15.106:0/2958038763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094069e60 msgr2=0x7f30941551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:15.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.786+0000 7f3099a38640 1 --2- 172.21.15.106:0/2958038763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094069e60 0x7f30941551f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3084009850 tx=0x7f308402b8d0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.786+0000 7f3099a38640 1 -- 172.21.15.106:0/2958038763 shutdown_connections 2023-12-22T09:17:15.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.786+0000 7f3099a38640 1 --2- 172.21.15.106:0/2958038763 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 0x7f3094155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.786+0000 7f3099a38640 1 --2- 172.21.15.106:0/2958038763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094069e60 0x7f30941551f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.786+0000 7f3099a38640 1 -- 172.21.15.106:0/2958038763 >> 172.21.15.106:0/2958038763 conn(0x7f30940c5360 msgr2=0x7f30940c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:15.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.787+0000 7f3099a38640 1 -- 172.21.15.106:0/2958038763 shutdown_connections 2023-12-22T09:17:15.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.787+0000 7f3099a38640 1 -- 172.21.15.106:0/2958038763 wait complete. 2023-12-22T09:17:15.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.788+0000 7f3099a38640 1 Processor -- start 2023-12-22T09:17:15.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.788+0000 7f3099a38640 1 -- start start 2023-12-22T09:17:15.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.789+0000 7f3099a38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3094069e60 0x7f30940c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:15.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.789+0000 7f3099a38640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094070480 0x7f30940c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.789+0000 7f3099a38640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 0x7f30940aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.789+0000 7f3099a38640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309414f8d0 con 0x7f3094070480 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.789+0000 7f3099a38640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30941ee190 con 0x7f3094069e60 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.789+0000 7f3099a38640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30941ee430 con 0x7f309415c070 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30927fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094070480 0x7f30940c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30927fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094070480 0x7f30940c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40378/0 (socket says 172.21.15.106:40378) 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30927fc640 1 -- 172.21.15.106:0/2299529554 learned_addr learned my addr 172.21.15.106:0/2299529554 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f3092ffd640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3094069e60 0x7f30940c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30937fe640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 0x7f30940aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30927fc640 1 -- 172.21.15.106:0/2299529554 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 msgr2=0x7f30940aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30927fc640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 0x7f30940aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30927fc640 1 -- 172.21.15.106:0/2299529554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3094069e60 msgr2=0x7f30940c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30927fc640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3094069e60 0x7f30940c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:15.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30927fc640 1 -- 172.21.15.106:0/2299529554 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3084009460 con 0x7f3094070480 2023-12-22T09:17:15.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.790+0000 7f30927fc640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094070480 0x7f30940c4630 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f307c007ef0 tx=0x7f307c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:15.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.791+0000 7f308bfff640 1 -- 172.21.15.106:0/2299529554 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c014620 con 0x7f3094070480 2023-12-22T09:17:15.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.791+0000 7f308bfff640 1 -- 172.21.15.106:0/2299529554 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c014780 con 0x7f3094070480 2023-12-22T09:17:15.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.791+0000 7f308bfff640 1 -- 172.21.15.106:0/2299529554 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c014b30 con 0x7f3094070480 2023-12-22T09:17:15.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.791+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30940c3610 con 0x7f3094070480 2023-12-22T09:17:15.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.791+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30940c3bd0 con 0x7f3094070480 2023-12-22T09:17:15.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.792+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30940c3d60 con 0x7f3094070480 2023-12-22T09:17:15.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.793+0000 7f308bfff640 1 -- 172.21.15.106:0/2299529554 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f307c014c90 con 0x7f3094070480 2023-12-22T09:17:15.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.794+0000 7f308bfff640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f307406a430 0x7f307406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:15.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.794+0000 7f308bfff640 1 -- 172.21.15.106:0/2299529554 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f307c089790 con 0x7f3094070480 2023-12-22T09:17:15.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.794+0000 7f3092ffd640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f307406a430 0x7f307406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:15.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.795+0000 7f3092ffd640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f307406a430 0x7f307406c8f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3084035000 tx=0x7f3084008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:15.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:15.798+0000 7f308bfff640 1 -- 172.21.15.106:0/2299529554 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f307c0548e0 con 0x7f3094070480 2023-12-22T09:17:16.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.025+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3094073f10 con 0x7f3094070480 2023-12-22T09:17:16.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.026+0000 7f308bfff640 1 -- 172.21.15.106:0/2299529554 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5782 (secure 0 0 0) 0x7f307c057f00 con 0x7f3094070480 2023-12-22T09:17:16.026 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:16.026 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6834/3487360091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6833","nonce":3487360091},{"type":"v1","addr":"172.21.15.132:6834","nonce":3487360091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2434839099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2434839099},{"type":"v1","addr":"172.21.15.132:6835","nonce":2434839099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:16:58.096259+0000","modified":"2023-12-22T09:17:01.107058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5185":{"gid":5185,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/520784305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":520784305},{"type":"v1","addr":"172.21.15.106:6837","nonce":520784305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T09:17:12.491152+0000","modified":"2023-12-22T09:17:15.524828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5182":{"gid":5182,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.106:6836/1984802419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1984802419},{"type":"v1","addr":"172.21.15.106:6836","nonce":1984802419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-22T09:17:16.027 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 35 2023-12-22T09:17:16.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f307406a430 msgr2=0x7f307406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f307406a430 0x7f307406c8f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3084035000 tx=0x7f3084008030 comp rx=0 tx=0).stop 2023-12-22T09:17:16.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094070480 msgr2=0x7f30940c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094070480 0x7f30940c4630 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f307c007ef0 tx=0x7f307c00e4b0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 shutdown_connections 2023-12-22T09:17:16.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f307406a430 0x7f307406c8f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f309415c070 0x7f30940aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3094070480 0x7f30940c4630 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 --2- 172.21.15.106:0/2299529554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3094069e60 0x7f30940c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 >> 172.21.15.106:0/2299529554 conn(0x7f30940c5360 msgr2=0x7f3094152930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:16.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 shutdown_connections 2023-12-22T09:17:16.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.029+0000 7f3099a38640 1 -- 172.21.15.106:0/2299529554 wait complete. 2023-12-22T09:17:16.046 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:17:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.256+0000 7fc8a79d3640 1 Processor -- start 2023-12-22T09:17:16.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.256+0000 7fc8a79d3640 1 -- start start 2023-12-22T09:17:16.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.257+0000 7fc8a79d3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc8a013b060 0x7fc8a006a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.257+0000 7fc8a79d3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00bf770 con 0x7fc8a00bfce0 2023-12-22T09:17:16.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.257+0000 7fc8a79d3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a0155120 con 0x7fc8a0151b30 2023-12-22T09:17:16.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.257+0000 7fc8a79d3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0155400 con 0x7fc8a013b060 2023-12-22T09:17:16.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.258+0000 7fc8a4f6e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc8a00bfce0 0x7fc8a0069bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49620/0 (socket says 172.21.15.106:49620) 2023-12-22T09:17:16.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.258+0000 7fc8a4f6e640 1 -- 172.21.15.106:0/2378958950 learned_addr learned my addr 172.21.15.106:0/2378958950 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:16.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.258+0000 7fc8a576f640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc8a013b060 0x7fc8a006a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.258+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093508080 0 0) 0x7fc8a00bf770 con 0x7fc8a00bfce0 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.258+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc88c003520 con 0x7fc8a00bfce0 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.258+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3534414016 0 0) 0x7fc88c003520 con 0x7fc8a00bfce0 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc8a013b060 msgr2=0x7fc8a006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc8a013b060 0x7fc8a006a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 >> v1:172.21.15.132:6789/0 conn(0x7fc8a0151b30 legacy=0x7fc8a0151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a01556e0 con 0x7fc8a00bfce0 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fc890001670 con 0x7fc8a00bfce0 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 >> v1:172.21.15.106:6789/0 conn(0x7fc8a00bfce0 legacy=0x7fc8a0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc88c0039a0 0x7fc88c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc8a013b060 0x7fc88c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc88c004d00 0x7fc88c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0155400 con 0x7fc88c0039a0 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c00bab0 con 0x7fc88c004d00 2023-12-22T09:17:16.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c00bc70 con 0x7fc8a013b060 2023-12-22T09:17:16.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc8a576f640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc88c0039a0 0x7fc88c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc8a4f6e640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc8a013b060 0x7fc88c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc8a576f640 1 -- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc8a013b060 msgr2=0x7fc88c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:16.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc8a576f640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc8a013b060 0x7fc88c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc8a576f640 1 -- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc88c004d00 msgr2=0x7fc88c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:16.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc8a576f640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc88c004d00 0x7fc88c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc8a576f640 1 -- 172.21.15.106:0/2378958950 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c003520 con 0x7fc88c0039a0 2023-12-22T09:17:16.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.259+0000 7fc8a4f6e640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc8a013b060 0x7fc88c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:16.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.260+0000 7fc8a576f640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc88c0039a0 0x7fc88c003dc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009ab0 tx=0x7fc88c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd44cac76c5f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:16.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c005990 con 0x7fc88c0039a0 2023-12-22T09:17:16.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c005af0 con 0x7fc88c0039a0 2023-12-22T09:17:16.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc897fff640 1 -- 172.21.15.106:0/2378958950 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c005ea0 con 0x7fc88c0039a0 2023-12-22T09:17:16.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc8a79d3640 1 -- 172.21.15.106:0/2378958950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc88c0039a0 msgr2=0x7fc88c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc8a79d3640 1 --2- 172.21.15.106:0/2378958950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc88c0039a0 0x7fc88c003dc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009ab0 tx=0x7fc88c0057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc8a5f70640 1 -- 172.21.15.106:0/2378958950 reap_dead start 2023-12-22T09:17:16.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc8a79d3640 1 -- 172.21.15.106:0/2378958950 shutdown_connections 2023-12-22T09:17:16.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc8a79d3640 1 -- 172.21.15.106:0/2378958950 >> 172.21.15.106:0/2378958950 conn(0x7fc8a00c5360 msgr2=0x7fc8a00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:16.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc8a79d3640 1 -- 172.21.15.106:0/2378958950 shutdown_connections 2023-12-22T09:17:16.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.261+0000 7fc8a79d3640 1 -- 172.21.15.106:0/2378958950 wait complete. 2023-12-22T09:17:16.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.263+0000 7fc8a79d3640 1 Processor -- start 2023-12-22T09:17:16.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.263+0000 7fc8a79d3640 1 -- start start 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.264+0000 7fc8a79d3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc88c0039a0 0x7fc8a01376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.264+0000 7fc8a79d3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a01daf80 0x7fc8a0138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.264+0000 7fc8a79d3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8a0139190 0x7fc8a01e8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.264+0000 7fc8a79d3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01db7f0 con 0x7fc8a0139190 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.264+0000 7fc8a79d3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01ecc80 con 0x7fc8a01daf80 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.264+0000 7fc8a79d3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00c49a0 con 0x7fc88c0039a0 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.264+0000 7fc8a5f70640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8a0139190 0x7fc8a01e8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.264+0000 7fc8a5f70640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8a0139190 0x7fc8a01e8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40398/0 (socket says 172.21.15.106:40398) 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.265+0000 7fc8a5f70640 1 -- 172.21.15.106:0/794302692 learned_addr learned my addr 172.21.15.106:0/794302692 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.265+0000 7fc8a4f6e640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a01daf80 0x7fc8a0138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.265+0000 7fc8a576f640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc88c0039a0 0x7fc8a01376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.265+0000 7fc8a5f70640 1 -- 172.21.15.106:0/794302692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc88c0039a0 msgr2=0x7fc8a01376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.265+0000 7fc8a5f70640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc88c0039a0 0x7fc8a01376d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.265+0000 7fc8a5f70640 1 -- 172.21.15.106:0/794302692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a01daf80 msgr2=0x7fc8a0138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.265+0000 7fc8a5f70640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a01daf80 0x7fc8a0138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.265+0000 7fc8a5f70640 1 -- 172.21.15.106:0/794302692 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a014f490 con 0x7fc8a0139190 2023-12-22T09:17:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.265+0000 7fc8a5f70640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8a0139190 0x7fc8a01e8d50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0151f10 tx=0x7fc89800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.266+0000 7fc895ffb640 1 -- 172.21.15.106:0/794302692 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898005d40 con 0x7fc8a0139190 2023-12-22T09:17:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.266+0000 7fc895ffb640 1 -- 172.21.15.106:0/794302692 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89800ced0 con 0x7fc8a0139190 2023-12-22T09:17:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.266+0000 7fc895ffb640 1 -- 172.21.15.106:0/794302692 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800a7f0 con 0x7fc8a0139190 2023-12-22T09:17:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.266+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a01ece70 con 0x7fc8a0139190 2023-12-22T09:17:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.266+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a0152d90 con 0x7fc8a0139190 2023-12-22T09:17:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.267+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a0152be0 con 0x7fc8a0139190 2023-12-22T09:17:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.268+0000 7fc895ffb640 1 -- 172.21.15.106:0/794302692 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc89800a950 con 0x7fc8a0139190 2023-12-22T09:17:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.269+0000 7fc895ffb640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc88406a460 0x7fc88406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.269+0000 7fc895ffb640 1 -- 172.21.15.106:0/794302692 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fc898087d20 con 0x7fc8a0139190 2023-12-22T09:17:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.269+0000 7fc8a576f640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc88406a460 0x7fc88406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.270+0000 7fc8a576f640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc88406a460 0x7fc88406c920 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc89c035000 tx=0x7fc89c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.273+0000 7fc895ffb640 1 -- 172.21.15.106:0/794302692 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc898052f50 con 0x7fc8a0139190 2023-12-22T09:17:16.462 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.462+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8a00c4b10 con 0x7fc8a0139190 2023-12-22T09:17:16.464 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.465+0000 7fc895ffb640 1 -- 172.21.15.106:0/794302692 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+20206 (secure 0 0 0) 0x7fc898056570 con 0x7fc8a0139190 2023-12-22T09:17:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:16.466 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":64,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:17:13.496319+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:16:55.972567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-22T09:16:57.103965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:17:10.934795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:17:11.491287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.34","mappings":[{"from":7,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:17:16.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc88406a460 msgr2=0x7fc88406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc88406a460 0x7fc88406c920 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc89c035000 tx=0x7fc89c030000 comp rx=0 tx=0).stop 2023-12-22T09:17:16.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8a0139190 msgr2=0x7fc8a01e8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8a0139190 0x7fc8a01e8d50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0151f10 tx=0x7fc89800cb90 comp rx=0 tx=0).stop 2023-12-22T09:17:16.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 shutdown_connections 2023-12-22T09:17:16.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fc88406a460 0x7fc88406c920 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8a0139190 0x7fc8a01e8d50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a01daf80 0x7fc8a0138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 --2- 172.21.15.106:0/794302692 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc88c0039a0 0x7fc8a01376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 >> 172.21.15.106:0/794302692 conn(0x7fc8a00c5360 msgr2=0x7fc8a00c07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:16.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 shutdown_connections 2023-12-22T09:17:16.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.468+0000 7fc8a79d3640 1 -- 172.21.15.106:0/794302692 wait complete. 2023-12-22T09:17:16.487 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T09:17:16.487 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:17:16.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.693+0000 7f1ff4484640 1 Processor -- start 2023-12-22T09:17:16.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.693+0000 7f1ff4484640 1 -- start start 2023-12-22T09:17:16.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.695+0000 7f1ff4484640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 0x7f1fec13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.695+0000 7f1ff4484640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1fec157c80 0x7f1fec13d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.695+0000 7f1ff4484640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec153e90 con 0x7f1fec0be700 2023-12-22T09:17:16.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.695+0000 7f1ff4484640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec153c80 con 0x7f1fec157c80 2023-12-22T09:17:16.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.695+0000 7f1ff4484640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec158240 con 0x7f1fec069e60 2023-12-22T09:17:16.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.695+0000 7f1ff1a1f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1fec157c80 0x7f1fec13d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.695+0000 7f1ff1a1f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1fec157c80 0x7f1fec13d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40408/0 (socket says 172.21.15.106:40408) 2023-12-22T09:17:16.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.695+0000 7f1ff1a1f640 1 -- 172.21.15.106:0/3984665914 learned_addr learned my addr 172.21.15.106:0/3984665914 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:16.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.696+0000 7f1ff2220640 1 --2- 172.21.15.106:0/3984665914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 0x7f1fec13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.696+0000 7f1ff1a1f640 1 -- 172.21.15.106:0/3984665914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 msgr2=0x7f1fec13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:16.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.696+0000 7f1ff1a1f640 1 --2- 172.21.15.106:0/3984665914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 0x7f1fec13cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.696+0000 7f1ff1a1f640 1 -- 172.21.15.106:0/3984665914 >> v1:172.21.15.132:6789/0 conn(0x7f1fec0be700 legacy=0x7f1fec070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:16.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.696+0000 7f1ff1a1f640 1 -- 172.21.15.106:0/3984665914 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec154c10 con 0x7f1fec157c80 2023-12-22T09:17:16.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.696+0000 7f1ff2220640 1 --2- 172.21.15.106:0/3984665914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 0x7f1fec13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:16.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.697+0000 7f1ff1a1f640 1 --2- 172.21.15.106:0/3984665914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec157c80 0x7f1fec13d1b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009870 tx=0x7f1fdc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878da132286f850a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:16.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.697+0000 7f1ff121e640 1 -- 172.21.15.106:0/3984665914 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc031640 con 0x7f1fec157c80 2023-12-22T09:17:16.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.697+0000 7f1ff121e640 1 -- 172.21.15.106:0/3984665914 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc0317a0 con 0x7f1fec157c80 2023-12-22T09:17:16.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.697+0000 7f1ff121e640 1 -- 172.21.15.106:0/3984665914 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc031b30 con 0x7f1fec157c80 2023-12-22T09:17:16.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.698+0000 7f1ff4484640 1 -- 172.21.15.106:0/3984665914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec157c80 msgr2=0x7f1fec13d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.698+0000 7f1ff4484640 1 --2- 172.21.15.106:0/3984665914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec157c80 0x7f1fec13d1b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009870 tx=0x7f1fdc02b8f0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.698+0000 7f1ff4484640 1 -- 172.21.15.106:0/3984665914 shutdown_connections 2023-12-22T09:17:16.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.698+0000 7f1ff4484640 1 --2- 172.21.15.106:0/3984665914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec157c80 0x7f1fec13d1b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.698+0000 7f1ff4484640 1 --2- 172.21.15.106:0/3984665914 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 0x7f1fec13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.698+0000 7f1ff4484640 1 -- 172.21.15.106:0/3984665914 >> 172.21.15.106:0/3984665914 conn(0x7f1fec0c5360 msgr2=0x7f1fec0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:16.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.698+0000 7f1ff4484640 1 -- 172.21.15.106:0/3984665914 shutdown_connections 2023-12-22T09:17:16.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.698+0000 7f1ff4484640 1 -- 172.21.15.106:0/3984665914 wait complete. 2023-12-22T09:17:16.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.700+0000 7f1ff4484640 1 Processor -- start 2023-12-22T09:17:16.699 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.700+0000 7f1ff4484640 1 -- start start 2023-12-22T09:17:16.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff4484640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 0x7f1fec0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff4484640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec0be700 0x7f1fec1e8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff4484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fec157c80 0x7f1fec1e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff4484640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec157570 con 0x7f1fec0be700 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff4484640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1ecf00 con 0x7f1fec157c80 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff4484640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1ec310 con 0x7f1fec069e60 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff1a1f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec0be700 0x7f1fec1e8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff1a1f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec0be700 0x7f1fec1e8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40424/0 (socket says 172.21.15.106:40424) 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff1a1f640 1 -- 172.21.15.106:0/1118238974 learned_addr learned my addr 172.21.15.106:0/1118238974 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff2220640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 0x7f1fec0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.701+0000 7f1ff2a21640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fec157c80 0x7f1fec1e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1ff1a1f640 1 -- 172.21.15.106:0/1118238974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 msgr2=0x7f1fec0c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1ff1a1f640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 0x7f1fec0c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1ff1a1f640 1 -- 172.21.15.106:0/1118238974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fec157c80 msgr2=0x7f1fec1e92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1ff1a1f640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fec157c80 0x7f1fec1e92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1ff1a1f640 1 -- 172.21.15.106:0/1118238974 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0094d0 con 0x7f1fec0be700 2023-12-22T09:17:16.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1ff2a21640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fec157c80 0x7f1fec1e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:16.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1ff1a1f640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec0be700 0x7f1fec1e8da0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0090b0 tx=0x7f1fdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:16.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1fe2ffd640 1 -- 172.21.15.106:0/1118238974 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc03bc70 con 0x7f1fec0be700 2023-12-22T09:17:16.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1fe2ffd640 1 -- 172.21.15.106:0/1118238974 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc03bdd0 con 0x7f1fec0be700 2023-12-22T09:17:16.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1fe2ffd640 1 -- 172.21.15.106:0/1118238974 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc045630 con 0x7f1fec0be700 2023-12-22T09:17:16.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec0ab2d0 con 0x7f1fec0be700 2023-12-22T09:17:16.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.702+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec1ec840 con 0x7f1fec0be700 2023-12-22T09:17:16.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.704+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec1ed040 con 0x7f1fec0be700 2023-12-22T09:17:16.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.704+0000 7f1fe2ffd640 1 -- 172.21.15.106:0/1118238974 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1fdc02f050 con 0x7f1fec0be700 2023-12-22T09:17:16.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.705+0000 7f1fe2ffd640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1fd006a430 0x7f1fd006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:16.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.705+0000 7f1fe2ffd640 1 -- 172.21.15.106:0/1118238974 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f1fdc0aaf40 con 0x7f1fec0be700 2023-12-22T09:17:16.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.706+0000 7f1ff2220640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1fd006a430 0x7f1fd006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:16.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.706+0000 7f1ff2220640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1fd006a430 0x7f1fd006c8f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8006fd0 tx=0x7f1fe8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:16.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.709+0000 7f1fe2ffd640 1 -- 172.21.15.106:0/1118238974 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1fec1ed040 con 0x7f1fec0be700 2023-12-22T09:17:16.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.891+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fec154410 con 0x7f1fd006a430 2023-12-22T09:17:16.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.930+0000 7f1fe2ffd640 1 -- 172.21.15.106:0/1118238974 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+516381 (secure 0 0 0) 0x7f1fe800c050 con 0x7f1fd006a430 2023-12-22T09:17:16.938 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:16.942 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:17:16.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1fd006a430 msgr2=0x7f1fd006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1fd006a430 0x7f1fd006c8f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8006fd0 tx=0x7f1fe8008040 comp rx=0 tx=0).stop 2023-12-22T09:17:16.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec0be700 msgr2=0x7f1fec1e8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:16.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec0be700 0x7f1fec1e8da0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0090b0 tx=0x7f1fdc0046c0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 shutdown_connections 2023-12-22T09:17:16.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f1fd006a430 0x7f1fd006c8f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fec157c80 0x7f1fec1e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec0be700 0x7f1fec1e8da0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 --2- 172.21.15.106:0/1118238974 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fec069e60 0x7f1fec0c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:16.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 >> 172.21.15.106:0/1118238974 conn(0x7f1fec0c5360 msgr2=0x7f1fec071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:16.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 shutdown_connections 2023-12-22T09:17:16.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:16.938+0000 7f1ff4484640 1 -- 172.21.15.106:0/1118238974 wait complete. 2023-12-22T09:17:16.960 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-12-22T09:17:16.751885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595789,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":276,"acting":276,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234904,"kb_used_data":7000,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754739816,"statfs":{"total":773094113280,"available":772853571584,"internally_reserved":0,"allocated":7168000,"data_stored":3893746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2805,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.753534"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516357+0000","last_change":"2023-12-22T09:17:12.540063+0000","last_active":"2023-12-22T09:17:13.516357+0000","last_peered":"2023-12-22T09:17:13.516357+0000","last_clean":"2023-12-22T09:17:13.516357+0000","last_became_active":"2023-12-22T09:17:12.538574+0000","last_became_peered":"2023-12-22T09:17:12.538574+0000","last_unstale":"2023-12-22T09:17:13.516357+0000","last_undegraded":"2023-12-22T09:17:13.516357+0000","last_fullsized":"2023-12-22T09:17:13.516357+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:47.737577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987813+0000","last_change":"2023-12-22T09:16:58.138391+0000","last_active":"2023-12-22T09:17:09.987813+0000","last_peered":"2023-12-22T09:17:09.987813+0000","last_clean":"2023-12-22T09:17:09.987813+0000","last_became_active":"2023-12-22T09:16:58.138138+0000","last_became_peered":"2023-12-22T09:16:58.138138+0000","last_unstale":"2023-12-22T09:17:09.987813+0000","last_undegraded":"2023-12-22T09:17:09.987813+0000","last_fullsized":"2023-12-22T09:17:09.987813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987928+0000","last_change":"2023-12-22T09:16:58.122537+0000","last_active":"2023-12-22T09:17:09.987928+0000","last_peered":"2023-12-22T09:17:09.987928+0000","last_clean":"2023-12-22T09:17:09.987928+0000","last_became_active":"2023-12-22T09:16:58.122285+0000","last_became_peered":"2023-12-22T09:16:58.122285+0000","last_unstale":"2023-12-22T09:17:09.987928+0000","last_undegraded":"2023-12-22T09:17:09.987928+0000","last_fullsized":"2023-12-22T09:17:09.987928+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040549+0000","last_change":"2023-12-22T09:16:58.155070+0000","last_active":"2023-12-22T09:17:10.040549+0000","last_peered":"2023-12-22T09:17:10.040549+0000","last_clean":"2023-12-22T09:17:10.040549+0000","last_became_active":"2023-12-22T09:16:58.154786+0000","last_became_peered":"2023-12-22T09:16:58.154786+0000","last_unstale":"2023-12-22T09:17:10.040549+0000","last_undegraded":"2023-12-22T09:17:10.040549+0000","last_fullsized":"2023-12-22T09:17:10.040549+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.038550+0000","last_change":"2023-12-22T09:17:11.034865+0000","last_active":"2023-12-22T09:17:11.038550+0000","last_peered":"2023-12-22T09:17:11.038550+0000","last_clean":"2023-12-22T09:17:11.038550+0000","last_became_active":"2023-12-22T09:17:11.034194+0000","last_became_peered":"2023-12-22T09:17:11.034194+0000","last_unstale":"2023-12-22T09:17:11.038550+0000","last_undegraded":"2023-12-22T09:17:11.038550+0000","last_fullsized":"2023-12-22T09:17:11.038550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:09:17.505510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507609+0000","last_change":"2023-12-22T09:16:58.143885+0000","last_active":"2023-12-22T09:17:12.507609+0000","last_peered":"2023-12-22T09:17:12.507609+0000","last_clean":"2023-12-22T09:17:12.507609+0000","last_became_active":"2023-12-22T09:16:58.143627+0000","last_became_peered":"2023-12-22T09:16:58.143627+0000","last_unstale":"2023-12-22T09:17:12.507609+0000","last_undegraded":"2023-12-22T09:17:12.507609+0000","last_fullsized":"2023-12-22T09:17:12.507609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:50:47.328724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001302+0000","last_change":"2023-12-22T09:16:58.140402+0000","last_active":"2023-12-22T09:17:10.001302+0000","last_peered":"2023-12-22T09:17:10.001302+0000","last_clean":"2023-12-22T09:17:10.001302+0000","last_became_active":"2023-12-22T09:16:58.140117+0000","last_became_peered":"2023-12-22T09:16:58.140117+0000","last_unstale":"2023-12-22T09:17:10.001302+0000","last_undegraded":"2023-12-22T09:17:10.001302+0000","last_fullsized":"2023-12-22T09:17:10.001302+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:25:20.515272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037504+0000","last_change":"2023-12-22T09:16:58.138038+0000","last_active":"2023-12-22T09:17:10.037504+0000","last_peered":"2023-12-22T09:17:10.037504+0000","last_clean":"2023-12-22T09:17:10.037504+0000","last_became_active":"2023-12-22T09:16:58.137394+0000","last_became_peered":"2023-12-22T09:16:58.137394+0000","last_unstale":"2023-12-22T09:17:10.037504+0000","last_undegraded":"2023-12-22T09:17:10.037504+0000","last_fullsized":"2023-12-22T09:17:10.037504+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:53.435793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.032949+0000","last_change":"2023-12-22T09:16:58.139475+0000","last_active":"2023-12-22T09:17:10.032949+0000","last_peered":"2023-12-22T09:17:10.032949+0000","last_clean":"2023-12-22T09:17:10.032949+0000","last_became_active":"2023-12-22T09:16:58.139166+0000","last_became_peered":"2023-12-22T09:16:58.139166+0000","last_unstale":"2023-12-22T09:17:10.032949+0000","last_undegraded":"2023-12-22T09:17:10.032949+0000","last_fullsized":"2023-12-22T09:17:10.032949+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041199+0000","last_change":"2023-12-22T09:16:58.153587+0000","last_active":"2023-12-22T09:17:10.041199+0000","last_peered":"2023-12-22T09:17:10.041199+0000","last_clean":"2023-12-22T09:17:10.041199+0000","last_became_active":"2023-12-22T09:16:58.153215+0000","last_became_peered":"2023-12-22T09:16:58.153215+0000","last_unstale":"2023-12-22T09:17:10.041199+0000","last_undegraded":"2023-12-22T09:17:10.041199+0000","last_fullsized":"2023-12-22T09:17:10.041199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041616+0000","last_change":"2023-12-22T09:16:58.146315+0000","last_active":"2023-12-22T09:17:10.041616+0000","last_peered":"2023-12-22T09:17:10.041616+0000","last_clean":"2023-12-22T09:17:10.041616+0000","last_became_active":"2023-12-22T09:16:58.143702+0000","last_became_peered":"2023-12-22T09:16:58.143702+0000","last_unstale":"2023-12-22T09:17:10.041616+0000","last_undegraded":"2023-12-22T09:17:10.041616+0000","last_fullsized":"2023-12-22T09:17:10.041616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991685+0000","last_change":"2023-12-22T09:16:58.144346+0000","last_active":"2023-12-22T09:17:09.991685+0000","last_peered":"2023-12-22T09:17:09.991685+0000","last_clean":"2023-12-22T09:17:09.991685+0000","last_became_active":"2023-12-22T09:16:58.144068+0000","last_became_peered":"2023-12-22T09:16:58.144068+0000","last_unstale":"2023-12-22T09:17:09.991685+0000","last_undegraded":"2023-12-22T09:17:09.991685+0000","last_fullsized":"2023-12-22T09:17:09.991685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.035380+0000","last_change":"2023-12-22T09:17:11.035380+0000","last_active":"2023-12-22T09:17:11.035380+0000","last_peered":"2023-12-22T09:17:11.035380+0000","last_clean":"2023-12-22T09:17:11.035380+0000","last_became_active":"2023-12-22T09:17:11.035022+0000","last_became_peered":"2023-12-22T09:17:11.035022+0000","last_unstale":"2023-12-22T09:17:11.035380+0000","last_undegraded":"2023-12-22T09:17:11.035380+0000","last_fullsized":"2023-12-22T09:17:11.035380+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:30.877521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033317+0000","last_change":"2023-12-22T09:16:58.149202+0000","last_active":"2023-12-22T09:17:10.033317+0000","last_peered":"2023-12-22T09:17:10.033317+0000","last_clean":"2023-12-22T09:17:10.033317+0000","last_became_active":"2023-12-22T09:16:58.148243+0000","last_became_peered":"2023-12-22T09:16:58.148243+0000","last_unstale":"2023-12-22T09:17:10.033317+0000","last_undegraded":"2023-12-22T09:17:10.033317+0000","last_fullsized":"2023-12-22T09:17:10.033317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040061+0000","last_change":"2023-12-22T09:16:58.156229+0000","last_active":"2023-12-22T09:17:10.040061+0000","last_peered":"2023-12-22T09:17:10.040061+0000","last_clean":"2023-12-22T09:17:10.040061+0000","last_became_active":"2023-12-22T09:16:58.154667+0000","last_became_peered":"2023-12-22T09:16:58.154667+0000","last_unstale":"2023-12-22T09:17:10.040061+0000","last_undegraded":"2023-12-22T09:17:10.040061+0000","last_fullsized":"2023-12-22T09:17:10.040061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039631+0000","last_change":"2023-12-22T09:16:58.144597+0000","last_active":"2023-12-22T09:17:10.039631+0000","last_peered":"2023-12-22T09:17:10.039631+0000","last_clean":"2023-12-22T09:17:10.039631+0000","last_became_active":"2023-12-22T09:16:58.144358+0000","last_became_peered":"2023-12-22T09:16:58.144358+0000","last_unstale":"2023-12-22T09:17:10.039631+0000","last_undegraded":"2023-12-22T09:17:10.039631+0000","last_fullsized":"2023-12-22T09:17:10.039631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037564+0000","last_change":"2023-12-22T09:16:58.139134+0000","last_active":"2023-12-22T09:17:10.037564+0000","last_peered":"2023-12-22T09:17:10.037564+0000","last_clean":"2023-12-22T09:17:10.037564+0000","last_became_active":"2023-12-22T09:16:58.138883+0000","last_became_peered":"2023-12-22T09:16:58.138883+0000","last_unstale":"2023-12-22T09:17:10.037564+0000","last_undegraded":"2023-12-22T09:17:10.037564+0000","last_fullsized":"2023-12-22T09:17:10.037564+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.662952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987920+0000","last_change":"2023-12-22T09:16:58.139935+0000","last_active":"2023-12-22T09:17:09.987920+0000","last_peered":"2023-12-22T09:17:09.987920+0000","last_clean":"2023-12-22T09:17:09.987920+0000","last_became_active":"2023-12-22T09:16:58.139665+0000","last_became_peered":"2023-12-22T09:16:58.139665+0000","last_unstale":"2023-12-22T09:17:09.987920+0000","last_undegraded":"2023-12-22T09:17:09.987920+0000","last_fullsized":"2023-12-22T09:17:09.987920+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991829+0000","last_change":"2023-12-22T09:16:58.135060+0000","last_active":"2023-12-22T09:17:09.991829+0000","last_peered":"2023-12-22T09:17:09.991829+0000","last_clean":"2023-12-22T09:17:09.991829+0000","last_became_active":"2023-12-22T09:16:58.134796+0000","last_became_peered":"2023-12-22T09:16:58.134796+0000","last_unstale":"2023-12-22T09:17:09.991829+0000","last_undegraded":"2023-12-22T09:17:09.991829+0000","last_fullsized":"2023-12-22T09:17:09.991829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:56:40.950128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514119+0000","last_change":"2023-12-22T09:16:58.133014+0000","last_active":"2023-12-22T09:17:12.514119+0000","last_peered":"2023-12-22T09:17:12.514119+0000","last_clean":"2023-12-22T09:17:12.514119+0000","last_became_active":"2023-12-22T09:16:58.132669+0000","last_became_peered":"2023-12-22T09:16:58.132669+0000","last_unstale":"2023-12-22T09:17:12.514119+0000","last_undegraded":"2023-12-22T09:17:12.514119+0000","last_fullsized":"2023-12-22T09:17:12.514119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:59:55.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998957+0000","last_change":"2023-12-22T09:16:58.139698+0000","last_active":"2023-12-22T09:17:09.998957+0000","last_peered":"2023-12-22T09:17:09.998957+0000","last_clean":"2023-12-22T09:17:09.998957+0000","last_became_active":"2023-12-22T09:16:58.139450+0000","last_became_peered":"2023-12-22T09:16:58.139450+0000","last_unstale":"2023-12-22T09:17:09.998957+0000","last_undegraded":"2023-12-22T09:17:09.998957+0000","last_fullsized":"2023-12-22T09:17:09.998957+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:40.452271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033355+0000","last_change":"2023-12-22T09:16:58.138002+0000","last_active":"2023-12-22T09:17:10.033355+0000","last_peered":"2023-12-22T09:17:10.033355+0000","last_clean":"2023-12-22T09:17:10.033355+0000","last_became_active":"2023-12-22T09:16:58.137587+0000","last_became_peered":"2023-12-22T09:16:58.137587+0000","last_unstale":"2023-12-22T09:17:10.033355+0000","last_undegraded":"2023-12-22T09:17:10.033355+0000","last_fullsized":"2023-12-22T09:17:10.033355+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998044+0000","last_change":"2023-12-22T09:16:58.143017+0000","last_active":"2023-12-22T09:17:09.998044+0000","last_peered":"2023-12-22T09:17:09.998044+0000","last_clean":"2023-12-22T09:17:09.998044+0000","last_became_active":"2023-12-22T09:16:58.142609+0000","last_became_peered":"2023-12-22T09:16:58.142609+0000","last_unstale":"2023-12-22T09:17:09.998044+0000","last_undegraded":"2023-12-22T09:17:09.998044+0000","last_fullsized":"2023-12-22T09:17:09.998044+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:22.037240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998160+0000","last_change":"2023-12-22T09:16:58.137672+0000","last_active":"2023-12-22T09:17:09.998160+0000","last_peered":"2023-12-22T09:17:09.998160+0000","last_clean":"2023-12-22T09:17:09.998160+0000","last_became_active":"2023-12-22T09:16:58.137418+0000","last_became_peered":"2023-12-22T09:16:58.137418+0000","last_unstale":"2023-12-22T09:17:09.998160+0000","last_undegraded":"2023-12-22T09:17:09.998160+0000","last_fullsized":"2023-12-22T09:17:09.998160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:11.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039381+0000","last_change":"2023-12-22T09:16:58.151378+0000","last_active":"2023-12-22T09:17:10.039381+0000","last_peered":"2023-12-22T09:17:10.039381+0000","last_clean":"2023-12-22T09:17:10.039381+0000","last_became_active":"2023-12-22T09:16:58.148696+0000","last_became_peered":"2023-12-22T09:16:58.148696+0000","last_unstale":"2023-12-22T09:17:10.039381+0000","last_undegraded":"2023-12-22T09:17:10.039381+0000","last_fullsized":"2023-12-22T09:17:10.039381+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033782+0000","last_change":"2023-12-22T09:16:58.134012+0000","last_active":"2023-12-22T09:17:10.033782+0000","last_peered":"2023-12-22T09:17:10.033782+0000","last_clean":"2023-12-22T09:17:10.033782+0000","last_became_active":"2023-12-22T09:16:58.133668+0000","last_became_peered":"2023-12-22T09:16:58.133668+0000","last_unstale":"2023-12-22T09:17:10.033782+0000","last_undegraded":"2023-12-22T09:17:10.033782+0000","last_fullsized":"2023-12-22T09:17:10.033782+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:57:16.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033615+0000","last_change":"2023-12-22T09:16:58.138808+0000","last_active":"2023-12-22T09:17:10.033615+0000","last_peered":"2023-12-22T09:17:10.033615+0000","last_clean":"2023-12-22T09:17:10.033615+0000","last_became_active":"2023-12-22T09:16:58.138287+0000","last_became_peered":"2023-12-22T09:16:58.138287+0000","last_unstale":"2023-12-22T09:17:10.033615+0000","last_undegraded":"2023-12-22T09:17:10.033615+0000","last_fullsized":"2023-12-22T09:17:10.033615+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:36.638731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991852+0000","last_change":"2023-12-22T09:16:58.148258+0000","last_active":"2023-12-22T09:17:09.991852+0000","last_peered":"2023-12-22T09:17:09.991852+0000","last_clean":"2023-12-22T09:17:09.991852+0000","last_became_active":"2023-12-22T09:16:58.148003+0000","last_became_peered":"2023-12-22T09:16:58.148003+0000","last_unstale":"2023-12-22T09:17:09.991852+0000","last_undegraded":"2023-12-22T09:17:09.991852+0000","last_fullsized":"2023-12-22T09:17:09.991852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:42.621461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987618+0000","last_change":"2023-12-22T09:16:58.133892+0000","last_active":"2023-12-22T09:17:09.987618+0000","last_peered":"2023-12-22T09:17:09.987618+0000","last_clean":"2023-12-22T09:17:09.987618+0000","last_became_active":"2023-12-22T09:16:58.133436+0000","last_became_peered":"2023-12-22T09:16:58.133436+0000","last_unstale":"2023-12-22T09:17:09.987618+0000","last_undegraded":"2023-12-22T09:17:09.987618+0000","last_fullsized":"2023-12-22T09:17:09.987618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039949+0000","last_change":"2023-12-22T09:16:58.149316+0000","last_active":"2023-12-22T09:17:10.039949+0000","last_peered":"2023-12-22T09:17:10.039949+0000","last_clean":"2023-12-22T09:17:10.039949+0000","last_became_active":"2023-12-22T09:16:58.148642+0000","last_became_peered":"2023-12-22T09:16:58.148642+0000","last_unstale":"2023-12-22T09:17:10.039949+0000","last_undegraded":"2023-12-22T09:17:10.039949+0000","last_fullsized":"2023-12-22T09:17:10.039949+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033121+0000","last_change":"2023-12-22T09:16:58.155683+0000","last_active":"2023-12-22T09:17:10.033121+0000","last_peered":"2023-12-22T09:17:10.033121+0000","last_clean":"2023-12-22T09:17:10.033121+0000","last_became_active":"2023-12-22T09:16:58.155388+0000","last_became_peered":"2023-12-22T09:16:58.155388+0000","last_unstale":"2023-12-22T09:17:10.033121+0000","last_undegraded":"2023-12-22T09:17:10.033121+0000","last_fullsized":"2023-12-22T09:17:10.033121+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.990889+0000","last_change":"2023-12-22T09:16:58.147756+0000","last_active":"2023-12-22T09:17:09.990889+0000","last_peered":"2023-12-22T09:17:09.990889+0000","last_clean":"2023-12-22T09:17:09.990889+0000","last_became_active":"2023-12-22T09:16:58.146595+0000","last_became_peered":"2023-12-22T09:16:58.146595+0000","last_unstale":"2023-12-22T09:17:09.990889+0000","last_undegraded":"2023-12-22T09:17:09.990889+0000","last_fullsized":"2023-12-22T09:17:09.990889+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:20:04.358268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001557+0000","last_change":"2023-12-22T09:16:58.125759+0000","last_active":"2023-12-22T09:17:10.001557+0000","last_peered":"2023-12-22T09:17:10.001557+0000","last_clean":"2023-12-22T09:17:10.001557+0000","last_became_active":"2023-12-22T09:16:58.125192+0000","last_became_peered":"2023-12-22T09:16:58.125192+0000","last_unstale":"2023-12-22T09:17:10.001557+0000","last_undegraded":"2023-12-22T09:17:10.001557+0000","last_fullsized":"2023-12-22T09:17:10.001557+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:11.972408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.024204+0000","last_change":"2023-12-22T09:17:11.024204+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.024204+0000","last_undegraded":"2023-12-22T09:17:11.024204+0000","last_fullsized":"2023-12-22T09:17:11.024204+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508856+0000","last_change":"2023-12-22T09:16:58.132380+0000","last_active":"2023-12-22T09:17:12.508856+0000","last_peered":"2023-12-22T09:17:12.508856+0000","last_clean":"2023-12-22T09:17:12.508856+0000","last_became_active":"2023-12-22T09:16:58.131960+0000","last_became_peered":"2023-12-22T09:16:58.131960+0000","last_unstale":"2023-12-22T09:17:12.508856+0000","last_undegraded":"2023-12-22T09:17:12.508856+0000","last_fullsized":"2023-12-22T09:17:12.508856+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:39:55.787513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987907+0000","last_change":"2023-12-22T09:16:57.644639+0000","last_active":"2023-12-22T09:17:09.987907+0000","last_peered":"2023-12-22T09:17:09.987907+0000","last_clean":"2023-12-22T09:17:09.987907+0000","last_became_active":"2023-12-22T09:16:57.641016+0000","last_became_peered":"2023-12-22T09:16:57.641016+0000","last_unstale":"2023-12-22T09:17:09.987907+0000","last_undegraded":"2023-12-22T09:17:09.987907+0000","last_fullsized":"2023-12-22T09:17:09.987907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.533990+0000","last_change":"2023-12-22T09:17:12.042696+0000","last_active":"2023-12-22T09:17:12.533990+0000","last_peered":"2023-12-22T09:17:12.533990+0000","last_clean":"2023-12-22T09:17:12.533990+0000","last_became_active":"2023-12-22T09:17:12.042328+0000","last_became_peered":"2023-12-22T09:17:12.042328+0000","last_unstale":"2023-12-22T09:17:12.533990+0000","last_undegraded":"2023-12-22T09:17:12.533990+0000","last_fullsized":"2023-12-22T09:17:12.533990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:05:59.153455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.018807+0000","last_change":"2023-12-22T09:17:11.012714+0000","last_active":"2023-12-22T09:17:11.018807+0000","last_peered":"2023-12-22T09:17:11.018807+0000","last_clean":"2023-12-22T09:17:11.018807+0000","last_became_active":"2023-12-22T09:17:11.011762+0000","last_became_peered":"2023-12-22T09:17:11.011762+0000","last_unstale":"2023-12-22T09:17:11.018807+0000","last_undegraded":"2023-12-22T09:17:11.018807+0000","last_fullsized":"2023-12-22T09:17:11.018807+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:53:32.651627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001619+0000","last_change":"2023-12-22T09:16:57.643725+0000","last_active":"2023-12-22T09:17:10.001619+0000","last_peered":"2023-12-22T09:17:10.001619+0000","last_clean":"2023-12-22T09:17:10.001619+0000","last_became_active":"2023-12-22T09:16:57.642742+0000","last_became_peered":"2023-12-22T09:16:57.642742+0000","last_unstale":"2023-12-22T09:17:10.001619+0000","last_undegraded":"2023-12-22T09:17:10.001619+0000","last_fullsized":"2023-12-22T09:17:10.001619+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:42.697488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.015046+0000","last_change":"2023-12-22T09:17:11.015046+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.015046+0000","last_undegraded":"2023-12-22T09:17:11.015046+0000","last_fullsized":"2023-12-22T09:17:11.015046+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:27.752298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001410+0000","last_change":"2023-12-22T09:16:58.124625+0000","last_active":"2023-12-22T09:17:10.001410+0000","last_peered":"2023-12-22T09:17:10.001410+0000","last_clean":"2023-12-22T09:17:10.001410+0000","last_became_active":"2023-12-22T09:16:58.124353+0000","last_became_peered":"2023-12-22T09:16:58.124353+0000","last_unstale":"2023-12-22T09:17:10.001410+0000","last_undegraded":"2023-12-22T09:17:10.001410+0000","last_fullsized":"2023-12-22T09:17:10.001410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:30:35.111753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001121+0000","last_change":"2023-12-22T09:16:57.655128+0000","last_active":"2023-12-22T09:17:10.001121+0000","last_peered":"2023-12-22T09:17:10.001121+0000","last_clean":"2023-12-22T09:17:10.001121+0000","last_became_active":"2023-12-22T09:16:57.654793+0000","last_became_peered":"2023-12-22T09:16:57.654793+0000","last_unstale":"2023-12-22T09:17:10.001121+0000","last_undegraded":"2023-12-22T09:17:10.001121+0000","last_fullsized":"2023-12-22T09:17:10.001121+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:38.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.019124+0000","last_change":"2023-12-22T09:17:11.019124+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.019124+0000","last_undegraded":"2023-12-22T09:17:11.019124+0000","last_fullsized":"2023-12-22T09:17:11.019124+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:03.329046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041177+0000","last_change":"2023-12-22T09:16:58.153226+0000","last_active":"2023-12-22T09:17:10.041177+0000","last_peered":"2023-12-22T09:17:10.041177+0000","last_clean":"2023-12-22T09:17:10.041177+0000","last_became_active":"2023-12-22T09:16:58.151970+0000","last_became_peered":"2023-12-22T09:16:58.151970+0000","last_unstale":"2023-12-22T09:17:10.041177+0000","last_undegraded":"2023-12-22T09:17:10.041177+0000","last_fullsized":"2023-12-22T09:17:10.041177+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.002324+0000","last_change":"2023-12-22T09:16:57.635854+0000","last_active":"2023-12-22T09:17:10.002324+0000","last_peered":"2023-12-22T09:17:10.002324+0000","last_clean":"2023-12-22T09:17:10.002324+0000","last_became_active":"2023-12-22T09:16:57.635365+0000","last_became_peered":"2023-12-22T09:16:57.635365+0000","last_unstale":"2023-12-22T09:17:10.002324+0000","last_undegraded":"2023-12-22T09:17:10.002324+0000","last_fullsized":"2023-12-22T09:17:10.002324+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:55.506978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.031825+0000","last_change":"2023-12-22T09:17:11.031825+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.031825+0000","last_undegraded":"2023-12-22T09:17:11.031825+0000","last_fullsized":"2023-12-22T09:17:11.031825+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037660+0000","last_change":"2023-12-22T09:16:58.111968+0000","last_active":"2023-12-22T09:17:10.037660+0000","last_peered":"2023-12-22T09:17:10.037660+0000","last_clean":"2023-12-22T09:17:10.037660+0000","last_became_active":"2023-12-22T09:16:58.111712+0000","last_became_peered":"2023-12-22T09:16:58.111712+0000","last_unstale":"2023-12-22T09:17:10.037660+0000","last_undegraded":"2023-12-22T09:17:10.037660+0000","last_fullsized":"2023-12-22T09:17:10.037660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:31:26.301820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998752+0000","last_change":"2023-12-22T09:16:57.646140+0000","last_active":"2023-12-22T09:17:09.998752+0000","last_peered":"2023-12-22T09:17:09.998752+0000","last_clean":"2023-12-22T09:17:09.998752+0000","last_became_active":"2023-12-22T09:16:57.645839+0000","last_became_peered":"2023-12-22T09:16:57.645839+0000","last_unstale":"2023-12-22T09:17:09.998752+0000","last_undegraded":"2023-12-22T09:17:09.998752+0000","last_fullsized":"2023-12-22T09:17:09.998752+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:15.308735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519978+0000","last_change":"2023-12-22T09:17:12.538499+0000","last_active":"2023-12-22T09:17:13.519978+0000","last_peered":"2023-12-22T09:17:13.519978+0000","last_clean":"2023-12-22T09:17:13.519978+0000","last_became_active":"2023-12-22T09:17:12.537198+0000","last_became_peered":"2023-12-22T09:17:12.537198+0000","last_unstale":"2023-12-22T09:17:13.519978+0000","last_undegraded":"2023-12-22T09:17:13.519978+0000","last_fullsized":"2023-12-22T09:17:13.519978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:33:56.242812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.015535+0000","last_change":"2023-12-22T09:17:11.015535+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.015535+0000","last_undegraded":"2023-12-22T09:17:11.015535+0000","last_fullsized":"2023-12-22T09:17:11.015535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:23.589301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987213+0000","last_change":"2023-12-22T09:16:58.148277+0000","last_active":"2023-12-22T09:17:09.987213+0000","last_peered":"2023-12-22T09:17:09.987213+0000","last_clean":"2023-12-22T09:17:09.987213+0000","last_became_active":"2023-12-22T09:16:58.147042+0000","last_became_peered":"2023-12-22T09:16:58.147042+0000","last_unstale":"2023-12-22T09:17:09.987213+0000","last_undegraded":"2023-12-22T09:17:09.987213+0000","last_fullsized":"2023-12-22T09:17:09.987213+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998289+0000","last_change":"2023-12-22T09:16:57.641319+0000","last_active":"2023-12-22T09:17:09.998289+0000","last_peered":"2023-12-22T09:17:09.998289+0000","last_clean":"2023-12-22T09:17:09.998289+0000","last_became_active":"2023-12-22T09:16:57.641031+0000","last_became_peered":"2023-12-22T09:16:57.641031+0000","last_unstale":"2023-12-22T09:17:09.998289+0000","last_undegraded":"2023-12-22T09:17:09.998289+0000","last_fullsized":"2023-12-22T09:17:09.998289+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:10.350226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.014643+0000","last_change":"2023-12-22T09:17:11.014643+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.014643+0000","last_undegraded":"2023-12-22T09:17:11.014643+0000","last_fullsized":"2023-12-22T09:17:11.014643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:29.709741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506322+0000","last_change":"2023-12-22T09:16:58.130875+0000","last_active":"2023-12-22T09:17:12.506322+0000","last_peered":"2023-12-22T09:17:12.506322+0000","last_clean":"2023-12-22T09:17:12.506322+0000","last_became_active":"2023-12-22T09:16:58.130606+0000","last_became_peered":"2023-12-22T09:16:58.130606+0000","last_unstale":"2023-12-22T09:17:12.506322+0000","last_undegraded":"2023-12-22T09:17:12.506322+0000","last_fullsized":"2023-12-22T09:17:12.506322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:30.649529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998331+0000","last_change":"2023-12-22T09:16:57.642097+0000","last_active":"2023-12-22T09:17:09.998331+0000","last_peered":"2023-12-22T09:17:09.998331+0000","last_clean":"2023-12-22T09:17:09.998331+0000","last_became_active":"2023-12-22T09:16:57.641830+0000","last_became_peered":"2023-12-22T09:16:57.641830+0000","last_unstale":"2023-12-22T09:17:09.998331+0000","last_undegraded":"2023-12-22T09:17:09.998331+0000","last_fullsized":"2023-12-22T09:17:09.998331+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:37:23.822669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.024975+0000","last_change":"2023-12-22T09:17:11.024975+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.024975+0000","last_undegraded":"2023-12-22T09:17:11.024975+0000","last_fullsized":"2023-12-22T09:17:11.024975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:57:47.077419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998660+0000","last_change":"2023-12-22T09:16:58.147991+0000","last_active":"2023-12-22T09:17:09.998660+0000","last_peered":"2023-12-22T09:17:09.998660+0000","last_clean":"2023-12-22T09:17:09.998660+0000","last_became_active":"2023-12-22T09:16:58.147595+0000","last_became_peered":"2023-12-22T09:16:58.147595+0000","last_unstale":"2023-12-22T09:17:09.998660+0000","last_undegraded":"2023-12-22T09:17:09.998660+0000","last_fullsized":"2023-12-22T09:17:09.998660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:14.136005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510671+0000","last_change":"2023-12-22T09:16:57.647073+0000","last_active":"2023-12-22T09:17:12.510671+0000","last_peered":"2023-12-22T09:17:12.510671+0000","last_clean":"2023-12-22T09:17:12.510671+0000","last_became_active":"2023-12-22T09:16:57.646655+0000","last_became_peered":"2023-12-22T09:16:57.646655+0000","last_unstale":"2023-12-22T09:17:12.510671+0000","last_undegraded":"2023-12-22T09:17:12.510671+0000","last_fullsized":"2023-12-22T09:17:12.510671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:52.036721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.016758+0000","last_change":"2023-12-22T09:17:11.016758+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.016758+0000","last_undegraded":"2023-12-22T09:17:11.016758+0000","last_fullsized":"2023-12-22T09:17:11.016758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:28.077725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987998+0000","last_change":"2023-12-22T09:16:58.112827+0000","last_active":"2023-12-22T09:17:09.987998+0000","last_peered":"2023-12-22T09:17:09.987998+0000","last_clean":"2023-12-22T09:17:09.987998+0000","last_became_active":"2023-12-22T09:16:58.112533+0000","last_became_peered":"2023-12-22T09:16:58.112533+0000","last_unstale":"2023-12-22T09:17:09.987998+0000","last_undegraded":"2023-12-22T09:17:09.987998+0000","last_fullsized":"2023-12-22T09:17:09.987998+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041476+0000","last_change":"2023-12-22T09:16:57.653443+0000","last_active":"2023-12-22T09:17:10.041476+0000","last_peered":"2023-12-22T09:17:10.041476+0000","last_clean":"2023-12-22T09:17:10.041476+0000","last_became_active":"2023-12-22T09:16:57.653141+0000","last_became_peered":"2023-12-22T09:16:57.653141+0000","last_unstale":"2023-12-22T09:17:10.041476+0000","last_undegraded":"2023-12-22T09:17:10.041476+0000","last_fullsized":"2023-12-22T09:17:10.041476+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"63'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.552653+0000","last_change":"2023-12-22T09:17:12.045401+0000","last_active":"2023-12-22T09:17:12.552653+0000","last_peered":"2023-12-22T09:17:12.552653+0000","last_clean":"2023-12-22T09:17:12.552653+0000","last_became_active":"2023-12-22T09:17:12.044219+0000","last_became_peered":"2023-12-22T09:17:12.044219+0000","last_unstale":"2023-12-22T09:17:12.552653+0000","last_undegraded":"2023-12-22T09:17:12.552653+0000","last_fullsized":"2023-12-22T09:17:12.552653+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:44.256814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.999418+0000","last_change":"2023-12-22T09:16:58.138339+0000","last_active":"2023-12-22T09:17:09.999418+0000","last_peered":"2023-12-22T09:17:09.999418+0000","last_clean":"2023-12-22T09:17:09.999418+0000","last_became_active":"2023-12-22T09:16:58.137859+0000","last_became_peered":"2023-12-22T09:16:58.137859+0000","last_unstale":"2023-12-22T09:17:09.999418+0000","last_undegraded":"2023-12-22T09:17:09.999418+0000","last_fullsized":"2023-12-22T09:17:09.999418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:20.962415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.993307+0000","last_change":"2023-12-22T09:16:57.655164+0000","last_active":"2023-12-22T09:17:09.993307+0000","last_peered":"2023-12-22T09:17:09.993307+0000","last_clean":"2023-12-22T09:17:09.993307+0000","last_became_active":"2023-12-22T09:16:57.654845+0000","last_became_peered":"2023-12-22T09:16:57.654845+0000","last_unstale":"2023-12-22T09:17:09.993307+0000","last_undegraded":"2023-12-22T09:17:09.993307+0000","last_fullsized":"2023-12-22T09:17:09.993307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:48.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.020619+0000","last_change":"2023-12-22T09:17:11.020619+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.020619+0000","last_undegraded":"2023-12-22T09:17:11.020619+0000","last_fullsized":"2023-12-22T09:17:11.020619+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:44.261501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509885+0000","last_change":"2023-12-22T09:16:58.140359+0000","last_active":"2023-12-22T09:17:12.509885+0000","last_peered":"2023-12-22T09:17:12.509885+0000","last_clean":"2023-12-22T09:17:12.509885+0000","last_became_active":"2023-12-22T09:16:58.140013+0000","last_became_peered":"2023-12-22T09:16:58.140013+0000","last_unstale":"2023-12-22T09:17:12.509885+0000","last_undegraded":"2023-12-22T09:17:12.509885+0000","last_fullsized":"2023-12-22T09:17:12.509885+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:10:45.503921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040698+0000","last_change":"2023-12-22T09:16:57.649245+0000","last_active":"2023-12-22T09:17:10.040698+0000","last_peered":"2023-12-22T09:17:10.040698+0000","last_clean":"2023-12-22T09:17:10.040698+0000","last_became_active":"2023-12-22T09:16:57.648941+0000","last_became_peered":"2023-12-22T09:16:57.648941+0000","last_unstale":"2023-12-22T09:17:10.040698+0000","last_undegraded":"2023-12-22T09:17:10.040698+0000","last_fullsized":"2023-12-22T09:17:10.040698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:41:54.745043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.024241+0000","last_change":"2023-12-22T09:17:11.024241+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.024241+0000","last_undegraded":"2023-12-22T09:17:11.024241+0000","last_fullsized":"2023-12-22T09:17:11.024241+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:49:30.159981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.993833+0000","last_change":"2023-12-22T09:16:58.136583+0000","last_active":"2023-12-22T09:17:09.993833+0000","last_peered":"2023-12-22T09:17:09.993833+0000","last_clean":"2023-12-22T09:17:09.993833+0000","last_became_active":"2023-12-22T09:16:58.136313+0000","last_became_peered":"2023-12-22T09:16:58.136313+0000","last_unstale":"2023-12-22T09:17:09.993833+0000","last_undegraded":"2023-12-22T09:17:09.993833+0000","last_fullsized":"2023-12-22T09:17:09.993833+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:04.972480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"59'9","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.988216+0000","last_change":"2023-12-22T09:16:57.656118+0000","last_active":"2023-12-22T09:17:09.988216+0000","last_peered":"2023-12-22T09:17:09.988216+0000","last_clean":"2023-12-22T09:17:09.988216+0000","last_became_active":"2023-12-22T09:16:57.655712+0000","last_became_peered":"2023-12-22T09:16:57.655712+0000","last_unstale":"2023-12-22T09:17:09.988216+0000","last_undegraded":"2023-12-22T09:17:09.988216+0000","last_fullsized":"2023-12-22T09:17:09.988216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519856+0000","last_change":"2023-12-22T09:17:12.541565+0000","last_active":"2023-12-22T09:17:13.519856+0000","last_peered":"2023-12-22T09:17:13.519856+0000","last_clean":"2023-12-22T09:17:13.519856+0000","last_became_active":"2023-12-22T09:17:12.540916+0000","last_became_peered":"2023-12-22T09:17:12.540916+0000","last_unstale":"2023-12-22T09:17:13.519856+0000","last_undegraded":"2023-12-22T09:17:13.519856+0000","last_fullsized":"2023-12-22T09:17:13.519856+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:48.901354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.015119+0000","last_change":"2023-12-22T09:17:11.015119+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.015119+0000","last_undegraded":"2023-12-22T09:17:11.015119+0000","last_fullsized":"2023-12-22T09:17:11.015119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:43:07.491118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.990860+0000","last_change":"2023-12-22T09:16:58.146066+0000","last_active":"2023-12-22T09:17:09.990860+0000","last_peered":"2023-12-22T09:17:09.990860+0000","last_clean":"2023-12-22T09:17:09.990860+0000","last_became_active":"2023-12-22T09:16:58.145703+0000","last_became_peered":"2023-12-22T09:16:58.145703+0000","last_unstale":"2023-12-22T09:17:09.990860+0000","last_undegraded":"2023-12-22T09:17:09.990860+0000","last_fullsized":"2023-12-22T09:17:09.990860+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:02.557319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040178+0000","last_change":"2023-12-22T09:16:57.649967+0000","last_active":"2023-12-22T09:17:10.040178+0000","last_peered":"2023-12-22T09:17:10.040178+0000","last_clean":"2023-12-22T09:17:10.040178+0000","last_became_active":"2023-12-22T09:16:57.649500+0000","last_became_peered":"2023-12-22T09:16:57.649500+0000","last_unstale":"2023-12-22T09:17:10.040178+0000","last_undegraded":"2023-12-22T09:17:10.040178+0000","last_fullsized":"2023-12-22T09:17:10.040178+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520037+0000","last_change":"2023-12-22T09:17:12.524836+0000","last_active":"2023-12-22T09:17:13.520037+0000","last_peered":"2023-12-22T09:17:13.520037+0000","last_clean":"2023-12-22T09:17:13.520037+0000","last_became_active":"2023-12-22T09:17:12.524505+0000","last_became_peered":"2023-12-22T09:17:12.524505+0000","last_unstale":"2023-12-22T09:17:13.520037+0000","last_undegraded":"2023-12-22T09:17:13.520037+0000","last_fullsized":"2023-12-22T09:17:13.520037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:11:58.590168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.031397+0000","last_change":"2023-12-22T09:17:11.031397+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.031397+0000","last_undegraded":"2023-12-22T09:17:11.031397+0000","last_fullsized":"2023-12-22T09:17:11.031397+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.032956+0000","last_change":"2023-12-22T09:16:58.134889+0000","last_active":"2023-12-22T09:17:10.032956+0000","last_peered":"2023-12-22T09:17:10.032956+0000","last_clean":"2023-12-22T09:17:10.032956+0000","last_became_active":"2023-12-22T09:16:58.134552+0000","last_became_peered":"2023-12-22T09:16:58.134552+0000","last_unstale":"2023-12-22T09:17:10.032956+0000","last_undegraded":"2023-12-22T09:17:10.032956+0000","last_fullsized":"2023-12-22T09:17:10.032956+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033118+0000","last_change":"2023-12-22T09:16:57.651390+0000","last_active":"2023-12-22T09:17:10.033118+0000","last_peered":"2023-12-22T09:17:10.033118+0000","last_clean":"2023-12-22T09:17:10.033118+0000","last_became_active":"2023-12-22T09:16:57.650566+0000","last_became_peered":"2023-12-22T09:16:57.650566+0000","last_unstale":"2023-12-22T09:17:10.033118+0000","last_undegraded":"2023-12-22T09:17:10.033118+0000","last_fullsized":"2023-12-22T09:17:10.033118+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:53.090112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.023927+0000","last_change":"2023-12-22T09:17:11.023927+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.023927+0000","last_undegraded":"2023-12-22T09:17:11.023927+0000","last_fullsized":"2023-12-22T09:17:11.023927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:56:30.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506577+0000","last_change":"2023-12-22T09:16:58.127084+0000","last_active":"2023-12-22T09:17:12.506577+0000","last_peered":"2023-12-22T09:17:12.506577+0000","last_clean":"2023-12-22T09:17:12.506577+0000","last_became_active":"2023-12-22T09:16:58.126598+0000","last_became_peered":"2023-12-22T09:16:58.126598+0000","last_unstale":"2023-12-22T09:17:12.506577+0000","last_undegraded":"2023-12-22T09:17:12.506577+0000","last_fullsized":"2023-12-22T09:17:12.506577+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:57.174680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039920+0000","last_change":"2023-12-22T09:16:57.643354+0000","last_active":"2023-12-22T09:17:10.039920+0000","last_peered":"2023-12-22T09:17:10.039920+0000","last_clean":"2023-12-22T09:17:10.039920+0000","last_became_active":"2023-12-22T09:16:57.643102+0000","last_became_peered":"2023-12-22T09:16:57.643102+0000","last_unstale":"2023-12-22T09:17:10.039920+0000","last_undegraded":"2023-12-22T09:17:10.039920+0000","last_fullsized":"2023-12-22T09:17:10.039920+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519260+0000","last_change":"2023-12-22T09:17:12.526768+0000","last_active":"2023-12-22T09:17:13.519260+0000","last_peered":"2023-12-22T09:17:13.519260+0000","last_clean":"2023-12-22T09:17:13.519260+0000","last_became_active":"2023-12-22T09:17:12.526405+0000","last_became_peered":"2023-12-22T09:17:12.526405+0000","last_unstale":"2023-12-22T09:17:13.519260+0000","last_undegraded":"2023-12-22T09:17:13.519260+0000","last_fullsized":"2023-12-22T09:17:13.519260+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:14:28.665216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.018018+0000","last_change":"2023-12-22T09:17:11.018018+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.018018+0000","last_undegraded":"2023-12-22T09:17:11.018018+0000","last_fullsized":"2023-12-22T09:17:11.018018+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:53.836251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987345+0000","last_change":"2023-12-22T09:16:58.146073+0000","last_active":"2023-12-22T09:17:09.987345+0000","last_peered":"2023-12-22T09:17:09.987345+0000","last_clean":"2023-12-22T09:17:09.987345+0000","last_became_active":"2023-12-22T09:16:58.145780+0000","last_became_peered":"2023-12-22T09:16:58.145780+0000","last_unstale":"2023-12-22T09:17:09.987345+0000","last_undegraded":"2023-12-22T09:17:09.987345+0000","last_fullsized":"2023-12-22T09:17:09.987345+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":21,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.990883+0000","last_change":"2023-12-22T09:16:57.651320+0000","last_active":"2023-12-22T09:17:09.990883+0000","last_peered":"2023-12-22T09:17:09.990883+0000","last_clean":"2023-12-22T09:17:09.990883+0000","last_became_active":"2023-12-22T09:16:57.651060+0000","last_became_peered":"2023-12-22T09:16:57.651060+0000","last_unstale":"2023-12-22T09:17:09.990883+0000","last_undegraded":"2023-12-22T09:17:09.990883+0000","last_fullsized":"2023-12-22T09:17:09.990883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:19:59.812662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.016192+0000","last_change":"2023-12-22T09:17:11.016192+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.016192+0000","last_undegraded":"2023-12-22T09:17:11.016192+0000","last_fullsized":"2023-12-22T09:17:11.016192+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:56.005441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040622+0000","last_change":"2023-12-22T09:16:58.148310+0000","last_active":"2023-12-22T09:17:10.040622+0000","last_peered":"2023-12-22T09:17:10.040622+0000","last_clean":"2023-12-22T09:17:10.040622+0000","last_became_active":"2023-12-22T09:16:58.147993+0000","last_became_peered":"2023-12-22T09:16:58.147993+0000","last_unstale":"2023-12-22T09:17:10.040622+0000","last_undegraded":"2023-12-22T09:17:10.040622+0000","last_fullsized":"2023-12-22T09:17:10.040622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033871+0000","last_change":"2023-12-22T09:16:57.654251+0000","last_active":"2023-12-22T09:17:10.033871+0000","last_peered":"2023-12-22T09:17:10.033871+0000","last_clean":"2023-12-22T09:17:10.033871+0000","last_became_active":"2023-12-22T09:16:57.653954+0000","last_became_peered":"2023-12-22T09:16:57.653954+0000","last_unstale":"2023-12-22T09:17:10.033871+0000","last_undegraded":"2023-12-22T09:17:10.033871+0000","last_fullsized":"2023-12-22T09:17:10.033871+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.011904+0000","last_change":"2023-12-22T09:17:11.011904+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.011904+0000","last_undegraded":"2023-12-22T09:17:11.011904+0000","last_fullsized":"2023-12-22T09:17:11.011904+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:34:22.106083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514253+0000","last_change":"2023-12-22T09:16:58.152892+0000","last_active":"2023-12-22T09:17:12.514253+0000","last_peered":"2023-12-22T09:17:12.514253+0000","last_clean":"2023-12-22T09:17:12.514253+0000","last_became_active":"2023-12-22T09:16:58.152538+0000","last_became_peered":"2023-12-22T09:16:58.152538+0000","last_unstale":"2023-12-22T09:17:12.514253+0000","last_undegraded":"2023-12-22T09:17:12.514253+0000","last_fullsized":"2023-12-22T09:17:12.514253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:12:00.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041640+0000","last_change":"2023-12-22T09:16:57.659614+0000","last_active":"2023-12-22T09:17:10.041640+0000","last_peered":"2023-12-22T09:17:10.041640+0000","last_clean":"2023-12-22T09:17:10.041640+0000","last_became_active":"2023-12-22T09:16:57.659211+0000","last_became_peered":"2023-12-22T09:16:57.659211+0000","last_unstale":"2023-12-22T09:17:10.041640+0000","last_undegraded":"2023-12-22T09:17:10.041640+0000","last_fullsized":"2023-12-22T09:17:10.041640+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.019465+0000","last_change":"2023-12-22T09:17:11.019465+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.019465+0000","last_undegraded":"2023-12-22T09:17:11.019465+0000","last_fullsized":"2023-12-22T09:17:11.019465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:27.519985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.992697+0000","last_change":"2023-12-22T09:16:58.144680+0000","last_active":"2023-12-22T09:17:09.992697+0000","last_peered":"2023-12-22T09:17:09.992697+0000","last_clean":"2023-12-22T09:17:09.992697+0000","last_became_active":"2023-12-22T09:16:58.144401+0000","last_became_peered":"2023-12-22T09:16:58.144401+0000","last_unstale":"2023-12-22T09:17:09.992697+0000","last_undegraded":"2023-12-22T09:17:09.992697+0000","last_fullsized":"2023-12-22T09:17:09.992697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:43.213252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040763+0000","last_change":"2023-12-22T09:16:57.651659+0000","last_active":"2023-12-22T09:17:10.040763+0000","last_peered":"2023-12-22T09:17:10.040763+0000","last_clean":"2023-12-22T09:17:10.040763+0000","last_became_active":"2023-12-22T09:16:57.650353+0000","last_became_peered":"2023-12-22T09:16:57.650353+0000","last_unstale":"2023-12-22T09:17:10.040763+0000","last_undegraded":"2023-12-22T09:17:10.040763+0000","last_fullsized":"2023-12-22T09:17:10.040763+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:15.191139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.014785+0000","last_change":"2023-12-22T09:17:11.014785+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.014785+0000","last_undegraded":"2023-12-22T09:17:11.014785+0000","last_fullsized":"2023-12-22T09:17:11.014785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:47.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509106+0000","last_change":"2023-12-22T09:16:58.139368+0000","last_active":"2023-12-22T09:17:12.509106+0000","last_peered":"2023-12-22T09:17:12.509106+0000","last_clean":"2023-12-22T09:17:12.509106+0000","last_became_active":"2023-12-22T09:16:58.134697+0000","last_became_peered":"2023-12-22T09:16:58.134697+0000","last_unstale":"2023-12-22T09:17:12.509106+0000","last_undegraded":"2023-12-22T09:17:12.509106+0000","last_fullsized":"2023-12-22T09:17:12.509106+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:40.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.999081+0000","last_change":"2023-12-22T09:16:57.659460+0000","last_active":"2023-12-22T09:17:09.999081+0000","last_peered":"2023-12-22T09:17:09.999081+0000","last_clean":"2023-12-22T09:17:09.999081+0000","last_became_active":"2023-12-22T09:16:57.659124+0000","last_became_peered":"2023-12-22T09:16:57.659124+0000","last_unstale":"2023-12-22T09:17:09.999081+0000","last_undegraded":"2023-12-22T09:17:09.999081+0000","last_fullsized":"2023-12-22T09:17:09.999081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:00.331386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.006940+0000","last_change":"2023-12-22T09:17:11.006940+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.006940+0000","last_undegraded":"2023-12-22T09:17:11.006940+0000","last_fullsized":"2023-12-22T09:17:11.006940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:22:18.487717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001788+0000","last_change":"2023-12-22T09:16:58.122054+0000","last_active":"2023-12-22T09:17:10.001788+0000","last_peered":"2023-12-22T09:17:10.001788+0000","last_clean":"2023-12-22T09:17:10.001788+0000","last_became_active":"2023-12-22T09:16:58.121132+0000","last_became_peered":"2023-12-22T09:16:58.121132+0000","last_unstale":"2023-12-22T09:17:10.001788+0000","last_undegraded":"2023-12-22T09:17:10.001788+0000","last_fullsized":"2023-12-22T09:17:10.001788+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.000887+0000","last_change":"2023-12-22T09:16:57.643365+0000","last_active":"2023-12-22T09:17:10.000887+0000","last_peered":"2023-12-22T09:17:10.000887+0000","last_clean":"2023-12-22T09:17:10.000887+0000","last_became_active":"2023-12-22T09:16:57.642191+0000","last_became_peered":"2023-12-22T09:16:57.642191+0000","last_unstale":"2023-12-22T09:17:10.000887+0000","last_undegraded":"2023-12-22T09:17:10.000887+0000","last_fullsized":"2023-12-22T09:17:10.000887+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:42.294395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520118+0000","last_change":"2023-12-22T09:17:12.533494+0000","last_active":"2023-12-22T09:17:13.520118+0000","last_peered":"2023-12-22T09:17:13.520118+0000","last_clean":"2023-12-22T09:17:13.520118+0000","last_became_active":"2023-12-22T09:17:12.532982+0000","last_became_peered":"2023-12-22T09:17:12.532982+0000","last_unstale":"2023-12-22T09:17:13.520118+0000","last_undegraded":"2023-12-22T09:17:13.520118+0000","last_fullsized":"2023-12-22T09:17:13.520118+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:31.400736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.006508+0000","last_change":"2023-12-22T09:17:11.006508+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.006508+0000","last_undegraded":"2023-12-22T09:17:11.006508+0000","last_fullsized":"2023-12-22T09:17:11.006508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:18.691505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033143+0000","last_change":"2023-12-22T09:16:58.139882+0000","last_active":"2023-12-22T09:17:10.033143+0000","last_peered":"2023-12-22T09:17:10.033143+0000","last_clean":"2023-12-22T09:17:10.033143+0000","last_became_active":"2023-12-22T09:16:58.139602+0000","last_became_peered":"2023-12-22T09:16:58.139602+0000","last_unstale":"2023-12-22T09:17:10.033143+0000","last_undegraded":"2023-12-22T09:17:10.033143+0000","last_fullsized":"2023-12-22T09:17:10.033143+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033447+0000","last_change":"2023-12-22T09:16:57.651581+0000","last_active":"2023-12-22T09:17:10.033447+0000","last_peered":"2023-12-22T09:17:10.033447+0000","last_clean":"2023-12-22T09:17:10.033447+0000","last_became_active":"2023-12-22T09:16:57.651050+0000","last_became_peered":"2023-12-22T09:16:57.651050+0000","last_unstale":"2023-12-22T09:17:10.033447+0000","last_undegraded":"2023-12-22T09:17:10.033447+0000","last_fullsized":"2023-12-22T09:17:10.033447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.007077+0000","last_change":"2023-12-22T09:17:11.007077+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.007077+0000","last_undegraded":"2023-12-22T09:17:11.007077+0000","last_fullsized":"2023-12-22T09:17:11.007077+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:24.280048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506960+0000","last_change":"2023-12-22T09:16:58.127943+0000","last_active":"2023-12-22T09:17:12.506960+0000","last_peered":"2023-12-22T09:17:12.506960+0000","last_clean":"2023-12-22T09:17:12.506960+0000","last_became_active":"2023-12-22T09:16:58.127679+0000","last_became_peered":"2023-12-22T09:16:58.127679+0000","last_unstale":"2023-12-22T09:17:12.506960+0000","last_undegraded":"2023-12-22T09:17:12.506960+0000","last_fullsized":"2023-12-22T09:17:12.506960+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:34.212746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.000775+0000","last_change":"2023-12-22T09:16:57.643620+0000","last_active":"2023-12-22T09:17:10.000775+0000","last_peered":"2023-12-22T09:17:10.000775+0000","last_clean":"2023-12-22T09:17:10.000775+0000","last_became_active":"2023-12-22T09:16:57.643322+0000","last_became_peered":"2023-12-22T09:16:57.643322+0000","last_unstale":"2023-12-22T09:17:10.000775+0000","last_undegraded":"2023-12-22T09:17:10.000775+0000","last_fullsized":"2023-12-22T09:17:10.000775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:13.807363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.017956+0000","last_change":"2023-12-22T09:17:11.017956+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.017956+0000","last_undegraded":"2023-12-22T09:17:11.017956+0000","last_fullsized":"2023-12-22T09:17:11.017956+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.002214+0000","last_change":"2023-12-22T09:16:58.147612+0000","last_active":"2023-12-22T09:17:10.002214+0000","last_peered":"2023-12-22T09:17:10.002214+0000","last_clean":"2023-12-22T09:17:10.002214+0000","last_became_active":"2023-12-22T09:16:58.147333+0000","last_became_peered":"2023-12-22T09:16:58.147333+0000","last_unstale":"2023-12-22T09:17:10.002214+0000","last_undegraded":"2023-12-22T09:17:10.002214+0000","last_fullsized":"2023-12-22T09:17:10.002214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:55.463677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":27,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.042027+0000","last_change":"2023-12-22T09:17:11.042027+0000","last_active":"2023-12-22T09:17:11.042027+0000","last_peered":"2023-12-22T09:17:11.042027+0000","last_clean":"2023-12-22T09:17:11.042027+0000","last_became_active":"2023-12-22T09:17:11.038601+0000","last_became_peered":"2023-12-22T09:17:11.038601+0000","last_unstale":"2023-12-22T09:17:11.042027+0000","last_undegraded":"2023-12-22T09:17:11.042027+0000","last_fullsized":"2023-12-22T09:17:11.042027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:48.928040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.017577+0000","last_change":"2023-12-22T09:17:11.017577+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.017577+0000","last_undegraded":"2023-12-22T09:17:11.017577+0000","last_fullsized":"2023-12-22T09:17:11.017577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:10:15.433618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037631+0000","last_change":"2023-12-22T09:16:58.122982+0000","last_active":"2023-12-22T09:17:10.037631+0000","last_peered":"2023-12-22T09:17:10.037631+0000","last_clean":"2023-12-22T09:17:10.037631+0000","last_became_active":"2023-12-22T09:16:58.122683+0000","last_became_peered":"2023-12-22T09:16:58.122683+0000","last_unstale":"2023-12-22T09:17:10.037631+0000","last_undegraded":"2023-12-22T09:17:10.037631+0000","last_fullsized":"2023-12-22T09:17:10.037631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:03:37.012223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033926+0000","last_change":"2023-12-22T09:16:57.652367+0000","last_active":"2023-12-22T09:17:10.033926+0000","last_peered":"2023-12-22T09:17:10.033926+0000","last_clean":"2023-12-22T09:17:10.033926+0000","last_became_active":"2023-12-22T09:16:57.651997+0000","last_became_peered":"2023-12-22T09:16:57.651997+0000","last_unstale":"2023-12-22T09:17:10.033926+0000","last_undegraded":"2023-12-22T09:17:10.033926+0000","last_fullsized":"2023-12-22T09:17:10.033926+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.023744+0000","last_change":"2023-12-22T09:17:11.023744+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.023744+0000","last_undegraded":"2023-12-22T09:17:11.023744+0000","last_fullsized":"2023-12-22T09:17:11.023744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:00.845862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033649+0000","last_change":"2023-12-22T09:16:58.134298+0000","last_active":"2023-12-22T09:17:10.033649+0000","last_peered":"2023-12-22T09:17:10.033649+0000","last_clean":"2023-12-22T09:17:10.033649+0000","last_became_active":"2023-12-22T09:16:58.134027+0000","last_became_peered":"2023-12-22T09:16:58.134027+0000","last_unstale":"2023-12-22T09:17:10.033649+0000","last_undegraded":"2023-12-22T09:17:10.033649+0000","last_fullsized":"2023-12-22T09:17:10.033649+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001315+0000","last_change":"2023-12-22T09:16:57.651565+0000","last_active":"2023-12-22T09:17:10.001315+0000","last_peered":"2023-12-22T09:17:10.001315+0000","last_clean":"2023-12-22T09:17:10.001315+0000","last_became_active":"2023-12-22T09:16:57.651295+0000","last_became_peered":"2023-12-22T09:16:57.651295+0000","last_unstale":"2023-12-22T09:17:10.001315+0000","last_undegraded":"2023-12-22T09:17:10.001315+0000","last_fullsized":"2023-12-22T09:17:10.001315+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:18.179171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516601+0000","last_change":"2023-12-22T09:17:12.523916+0000","last_active":"2023-12-22T09:17:13.516601+0000","last_peered":"2023-12-22T09:17:13.516601+0000","last_clean":"2023-12-22T09:17:13.516601+0000","last_became_active":"2023-12-22T09:17:12.519420+0000","last_became_peered":"2023-12-22T09:17:12.519420+0000","last_unstale":"2023-12-22T09:17:13.516601+0000","last_undegraded":"2023-12-22T09:17:13.516601+0000","last_fullsized":"2023-12-22T09:17:13.516601+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:27:28.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.031752+0000","last_change":"2023-12-22T09:17:11.031752+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.031752+0000","last_undegraded":"2023-12-22T09:17:11.031752+0000","last_fullsized":"2023-12-22T09:17:11.031752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:28:17.921536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509202+0000","last_change":"2023-12-22T09:16:58.142640+0000","last_active":"2023-12-22T09:17:12.509202+0000","last_peered":"2023-12-22T09:17:12.509202+0000","last_clean":"2023-12-22T09:17:12.509202+0000","last_became_active":"2023-12-22T09:16:58.142334+0000","last_became_peered":"2023-12-22T09:16:58.142334+0000","last_unstale":"2023-12-22T09:17:12.509202+0000","last_undegraded":"2023-12-22T09:17:12.509202+0000","last_fullsized":"2023-12-22T09:17:12.509202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:35:36.019628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.988250+0000","last_change":"2023-12-22T09:16:57.655954+0000","last_active":"2023-12-22T09:17:09.988250+0000","last_peered":"2023-12-22T09:17:09.988250+0000","last_clean":"2023-12-22T09:17:09.988250+0000","last_became_active":"2023-12-22T09:16:57.655335+0000","last_became_peered":"2023-12-22T09:16:57.655335+0000","last_unstale":"2023-12-22T09:17:09.988250+0000","last_undegraded":"2023-12-22T09:17:09.988250+0000","last_fullsized":"2023-12-22T09:17:09.988250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509527+0000","last_change":"2023-12-22T09:17:12.034651+0000","last_active":"2023-12-22T09:17:12.509527+0000","last_peered":"2023-12-22T09:17:12.509527+0000","last_clean":"2023-12-22T09:17:12.509527+0000","last_became_active":"2023-12-22T09:17:12.034345+0000","last_became_peered":"2023-12-22T09:17:12.034345+0000","last_unstale":"2023-12-22T09:17:12.509527+0000","last_undegraded":"2023-12-22T09:17:12.509527+0000","last_fullsized":"2023-12-22T09:17:12.509527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:57:00.962453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510462+0000","last_change":"2023-12-22T09:16:58.121917+0000","last_active":"2023-12-22T09:17:12.510462+0000","last_peered":"2023-12-22T09:17:12.510462+0000","last_clean":"2023-12-22T09:17:12.510462+0000","last_became_active":"2023-12-22T09:16:58.118511+0000","last_became_peered":"2023-12-22T09:16:58.118511+0000","last_unstale":"2023-12-22T09:17:12.510462+0000","last_undegraded":"2023-12-22T09:17:12.510462+0000","last_fullsized":"2023-12-22T09:17:12.510462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:33:40.126107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040397+0000","last_change":"2023-12-22T09:16:57.647202+0000","last_active":"2023-12-22T09:17:10.040397+0000","last_peered":"2023-12-22T09:17:10.040397+0000","last_clean":"2023-12-22T09:17:10.040397+0000","last_became_active":"2023-12-22T09:16:57.646930+0000","last_became_peered":"2023-12-22T09:16:57.646930+0000","last_unstale":"2023-12-22T09:17:10.040397+0000","last_undegraded":"2023-12-22T09:17:10.040397+0000","last_fullsized":"2023-12-22T09:17:10.040397+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:40.073052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.011644+0000","last_change":"2023-12-22T09:17:11.011644+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.011644+0000","last_undegraded":"2023-12-22T09:17:11.011644+0000","last_fullsized":"2023-12-22T09:17:11.011644+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:44.983134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991009+0000","last_change":"2023-12-22T09:16:58.139737+0000","last_active":"2023-12-22T09:17:09.991009+0000","last_peered":"2023-12-22T09:17:09.991009+0000","last_clean":"2023-12-22T09:17:09.991009+0000","last_became_active":"2023-12-22T09:16:58.139455+0000","last_became_peered":"2023-12-22T09:16:58.139455+0000","last_unstale":"2023-12-22T09:17:09.991009+0000","last_undegraded":"2023-12-22T09:17:09.991009+0000","last_fullsized":"2023-12-22T09:17:09.991009+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:21.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998540+0000","last_change":"2023-12-22T09:16:57.640845+0000","last_active":"2023-12-22T09:17:09.998540+0000","last_peered":"2023-12-22T09:17:09.998540+0000","last_clean":"2023-12-22T09:17:09.998540+0000","last_became_active":"2023-12-22T09:16:57.640523+0000","last_became_peered":"2023-12-22T09:16:57.640523+0000","last_unstale":"2023-12-22T09:17:09.998540+0000","last_undegraded":"2023-12-22T09:17:09.998540+0000","last_fullsized":"2023-12-22T09:17:09.998540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:11.216158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519019+0000","last_change":"2023-12-22T09:17:12.534422+0000","last_active":"2023-12-22T09:17:13.519019+0000","last_peered":"2023-12-22T09:17:13.519019+0000","last_clean":"2023-12-22T09:17:13.519019+0000","last_became_active":"2023-12-22T09:17:12.534170+0000","last_became_peered":"2023-12-22T09:17:12.534170+0000","last_unstale":"2023-12-22T09:17:13.519019+0000","last_undegraded":"2023-12-22T09:17:13.519019+0000","last_fullsized":"2023-12-22T09:17:13.519019+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:14:37.881358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506696+0000","last_change":"2023-12-22T09:17:12.041999+0000","last_active":"2023-12-22T09:17:12.506696+0000","last_peered":"2023-12-22T09:17:12.506696+0000","last_clean":"2023-12-22T09:17:12.506696+0000","last_became_active":"2023-12-22T09:17:12.041632+0000","last_became_peered":"2023-12-22T09:17:12.041632+0000","last_unstale":"2023-12-22T09:17:12.506696+0000","last_undegraded":"2023-12-22T09:17:12.506696+0000","last_fullsized":"2023-12-22T09:17:12.506696+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:24.728438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.988051+0000","last_change":"2023-12-22T09:16:58.136215+0000","last_active":"2023-12-22T09:17:09.988051+0000","last_peered":"2023-12-22T09:17:09.988051+0000","last_clean":"2023-12-22T09:17:09.988051+0000","last_became_active":"2023-12-22T09:16:58.135936+0000","last_became_peered":"2023-12-22T09:16:58.135936+0000","last_unstale":"2023-12-22T09:17:09.988051+0000","last_undegraded":"2023-12-22T09:17:09.988051+0000","last_fullsized":"2023-12-22T09:17:09.988051+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998273+0000","last_change":"2023-12-22T09:16:57.641987+0000","last_active":"2023-12-22T09:17:09.998273+0000","last_peered":"2023-12-22T09:17:09.998273+0000","last_clean":"2023-12-22T09:17:09.998273+0000","last_became_active":"2023-12-22T09:16:57.641712+0000","last_became_peered":"2023-12-22T09:16:57.641712+0000","last_unstale":"2023-12-22T09:17:09.998273+0000","last_undegraded":"2023-12-22T09:17:09.998273+0000","last_fullsized":"2023-12-22T09:17:09.998273+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:33.101510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519359+0000","last_change":"2023-12-22T09:17:12.537866+0000","last_active":"2023-12-22T09:17:13.519359+0000","last_peered":"2023-12-22T09:17:13.519359+0000","last_clean":"2023-12-22T09:17:13.519359+0000","last_became_active":"2023-12-22T09:17:12.537136+0000","last_became_peered":"2023-12-22T09:17:12.537136+0000","last_unstale":"2023-12-22T09:17:13.519359+0000","last_undegraded":"2023-12-22T09:17:13.519359+0000","last_fullsized":"2023-12-22T09:17:13.519359+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:14.639137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.017533+0000","last_change":"2023-12-22T09:17:11.017533+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.017533+0000","last_undegraded":"2023-12-22T09:17:11.017533+0000","last_fullsized":"2023-12-22T09:17:11.017533+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:15.941299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037566+0000","last_change":"2023-12-22T09:16:58.150323+0000","last_active":"2023-12-22T09:17:10.037566+0000","last_peered":"2023-12-22T09:17:10.037566+0000","last_clean":"2023-12-22T09:17:10.037566+0000","last_became_active":"2023-12-22T09:16:58.150063+0000","last_became_peered":"2023-12-22T09:16:58.150063+0000","last_unstale":"2023-12-22T09:17:10.037566+0000","last_undegraded":"2023-12-22T09:17:10.037566+0000","last_fullsized":"2023-12-22T09:17:10.037566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:25.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987349+0000","last_change":"2023-12-22T09:16:57.643219+0000","last_active":"2023-12-22T09:17:09.987349+0000","last_peered":"2023-12-22T09:17:09.987349+0000","last_clean":"2023-12-22T09:17:09.987349+0000","last_became_active":"2023-12-22T09:16:57.642986+0000","last_became_peered":"2023-12-22T09:16:57.642986+0000","last_unstale":"2023-12-22T09:17:09.987349+0000","last_undegraded":"2023-12-22T09:17:09.987349+0000","last_fullsized":"2023-12-22T09:17:09.987349+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.007014+0000","last_change":"2023-12-22T09:17:11.007014+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.007014+0000","last_undegraded":"2023-12-22T09:17:11.007014+0000","last_fullsized":"2023-12-22T09:17:11.007014+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:33:46.996428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507919+0000","last_change":"2023-12-22T09:16:58.125951+0000","last_active":"2023-12-22T09:17:12.507919+0000","last_peered":"2023-12-22T09:17:12.507919+0000","last_clean":"2023-12-22T09:17:12.507919+0000","last_became_active":"2023-12-22T09:16:58.125435+0000","last_became_peered":"2023-12-22T09:16:58.125435+0000","last_unstale":"2023-12-22T09:17:12.507919+0000","last_undegraded":"2023-12-22T09:17:12.507919+0000","last_fullsized":"2023-12-22T09:17:12.507919+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:30:10.376413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998060+0000","last_change":"2023-12-22T09:16:57.639438+0000","last_active":"2023-12-22T09:17:09.998060+0000","last_peered":"2023-12-22T09:17:09.998060+0000","last_clean":"2023-12-22T09:17:09.998060+0000","last_became_active":"2023-12-22T09:16:57.639148+0000","last_became_peered":"2023-12-22T09:16:57.639148+0000","last_unstale":"2023-12-22T09:17:09.998060+0000","last_undegraded":"2023-12-22T09:17:09.998060+0000","last_fullsized":"2023-12-22T09:17:09.998060+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:36.593161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039687+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:17:10.039687+0000","last_peered":"2023-12-22T09:17:10.039687+0000","last_clean":"2023-12-22T09:17:10.039687+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:17:10.039687+0000","last_undegraded":"2023-12-22T09:17:10.039687+0000","last_fullsized":"2023-12-22T09:17:10.039687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3857,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1343488,"data_stored":926207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.173,"15min":1.1870000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1060000000000001,"15min":1.129},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.409,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1910000000000001,"15min":1.1990000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.2769999999999999,"15min":1.3220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.339,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1539999999999999,"15min":1.1739999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.3799999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":0.94499999999999995}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.24,"15min":1.256},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.427,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3600000000000001,"15min":1.3720000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.268,"15min":1.2809999999999999},"min":{"1min":0.81399999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":1.038,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.6319999999999999,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.458,"15min":1.427},"min":{"1min":0.91400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":8.1620000000000008,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.476,"15min":1.504},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.6220000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.5649999999999999,"15min":1.5740000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.393,"5min":1.554,"15min":1.581},"min":{"1min":1.127,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.655,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.57799999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":359889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.1100000000000001,"15min":1.1319999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.085,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4810000000000001,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":1.111}]},{"osd":1,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.978,"15min":1.978},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5189999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.661,"5min":1.915,"15min":1.915},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.268,"15min":1.282},"min":{"1min":0.74099999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.194}]},{"osd":3,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4950000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3580000000000001,"15min":1.3740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.736,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.29}]},{"osd":4,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.494,"15min":1.52},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.5549999999999999,"15min":1.585},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.722,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.5329999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.5760000000000001,"15min":1.6060000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.74,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.732},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.671,"15min":1.6970000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.952,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.583}]},{"osd":7,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.6379999999999999,"15min":1.6619999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.859,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.6240000000000001,"15min":1.637},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":2.0459999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3380000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":335085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":0.97099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3240000000000001,"5min":1.677,"15min":1.677},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4650000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0129999999999999}]},{"osd":1,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.107,"15min":1.1180000000000001},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.48,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.24,"15min":1.26},"min":{"1min":0.73499999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.802,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.3500000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5449999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.502},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.159,"15min":1.169},"min":{"1min":0.748,"5min":0.629,"15min":0.629},"max":{"1min":1.4419999999999999,"5min":1.762,"15min":1.762},"last":1.1619999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.256,"15min":1.264},"min":{"1min":0.88,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5640000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.284,"15min":1.306},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8089999999999999,"5min":2.431,"15min":2.431},"last":1.627}]},{"osd":4,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.304,"15min":1.3120000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5629999999999999,"5min":1.889,"15min":1.889},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4870000000000001,"15min":1.5},"min":{"1min":0.874,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.996}]},{"osd":6,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4099999999999999,"15min":1.4299999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.982,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4179999999999999,"15min":1.4359999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7889999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.77}]},{"osd":7,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.464,"15min":1.48},"min":{"1min":0.97499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.8540000000000001,"5min":3.298,"15min":3.298},"last":1.9259999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.504,"15min":1.5249999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.0899999999999999,"5min":2.589,"15min":2.589},"last":1.867}]}]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":338122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3320000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.115,"15min":1.121},"min":{"1min":0.70399999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5409999999999999,"5min":2.25,"15min":2.25},"last":1.23}]},{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.113,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.345,"5min":1.782,"15min":1.782},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.425,"5min":1.494,"15min":1.494},"last":1.0920000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4890000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.446},{"interface":"front","average":{"1min":1.147,"5min":1.2130000000000001,"15min":1.224},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7749999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.97499999999999998}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.1319999999999999,"15min":1.149},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.542,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.2929999999999999,"15min":1.3149999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.4690000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1579999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3320000000000001,"15min":1.3520000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.909,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.268,"15min":1.286},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.679,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.419}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4950000000000001,"5min":2.052,"15min":2.052},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.5069999999999999,"15min":1.5329999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.373}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.4079999999999999,"15min":1.4350000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7470000000000001,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.198},{"interface":"front","average":{"1min":1.339,"5min":1.512,"15min":1.5409999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.629,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.5309999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":733184,"data_stored":335063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88500000000000001,"15min":0.89700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.627,"5min":1.716,"15min":1.716},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4430000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.503},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.65500000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.093,"15min":1.105},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1719999999999999,"15min":1.1899999999999999},"min":{"1min":0.66700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4019999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.244,"15min":1.25},"min":{"1min":0.90900000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.722,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.92200000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.571,"5min":2.508,"15min":2.508},"last":0.84499999999999997}]},{"osd":5,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":2.0030000000000001,"15min":2.1219999999999999},"min":{"1min":0.86299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6519999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.258,"5min":2.254,"15min":2.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.6739999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":2.423,"15min":2.6219999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.752,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.056},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.1970000000000001,"15min":2.339},"min":{"1min":0.98999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.722,"5min":27.181999999999999,"15min":27.181999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2,"15min":2.121},"min":{"1min":1.016,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5069999999999999,"5min":22.715,"15min":22.715},"last":1.071},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.3860000000000001,"15min":2.5619999999999998},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.643,"5min":30.108000000000001,"15min":30.108000000000001},"last":0.81599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":335063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.85599999999999998,"15min":0.88},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.395,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.097},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.95699999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.381,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":1.0069999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.357,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.98899999999999999,"15min":1.002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5489999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0049999999999999,"15min":1.016},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5289999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.173,"15min":1.1910000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6279999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.94599999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.377,"15min":1.4179999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6160000000000001,"5min":2.802,"15min":2.802},"last":1.256},{"interface":"front","average":{"1min":1.276,"5min":1.4139999999999999,"15min":1.4370000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.758,"5min":2.46,"15min":2.46},"last":1.1379999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2889999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.595,"5min":3.327,"15min":3.327},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.371,"15min":1.399},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":1.2010000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4279999999999999,"15min":1.452},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9950000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.228},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.369,"15min":1.3999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.554,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":1.5629999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.4870000000000001,"15min":1.516},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.823,"5min":2.867,"15min":2.867},"last":1.302},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4670000000000001,"15min":1.4950000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.724,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":1.609}]}]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":761856,"data_stored":338886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.879,"15min":0.90700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.262,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.083},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3260000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.90600000000000003,"15min":0.92800000000000005},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.218,"5min":1.504,"15min":1.504},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.103,"15min":1.143},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.282,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.224}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.0409999999999999,"15min":1.0700000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.54,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.266,"15min":1.3069999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4430000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.3460000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.68799999999999994,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4330000000000001,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.3129999999999999,"15min":1.3500000000000001},"min":{"1min":0.77200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6599999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.177}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.4019999999999999,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.1720000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.534,"15min":1.5880000000000001},"min":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.649,"5min":4.524,"15min":4.524},"last":1.7909999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.5349999999999999,"15min":1.581},"min":{"1min":0.80900000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.9139999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3879999999999999,"15min":1.4139999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.881,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.1339999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.474,"15min":1.5089999999999999},"min":{"1min":0.79800000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.29,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.421},{"interface":"front","average":{"1min":1.319,"5min":1.52,"15min":1.554},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.766,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":1.8600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1327104,"data_stored":925431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.89600000000000002}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.0229999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2689999999999999,"5min":1.548,"15min":1.548},"last":1.3380000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.98099999999999998,"15min":1.0129999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.242,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.216}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.1930000000000001,"15min":1.238},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6120000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.0900000000000001,"15min":1.1319999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3939999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1799999999999999,"15min":1.1990000000000001},"min":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.601,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.357,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":3.589,"15min":3.589},"last":1.24}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5920000000000001,"5min":1.748,"15min":1.748},"last":1.133},{"interface":"front","average":{"1min":1.167,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.72599999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.49,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.0700000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.268,"15min":1.282},"min":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.611,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.3069999999999999,"15min":1.333},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.96199999999999997}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.365,"15min":1.3879999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8109999999999999,"5min":2.157,"15min":2.157},"last":1.377},{"interface":"front","average":{"1min":1.22,"5min":1.419,"15min":1.452},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6439999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.304}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:17:16.974 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:17:17.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.221+0000 7fbcc448f640 1 Processor -- start 2023-12-22T09:17:17.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.221+0000 7fbcc448f640 1 -- start start 2023-12-22T09:17:17.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.223+0000 7fbcc448f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbcbc150a80 0x7fbcbc151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.223+0000 7fbcc448f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc0bfce0 con 0x7fbcbc071ea0 2023-12-22T09:17:17.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.223+0000 7fbcc448f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc0bffc0 con 0x7fbcbc069e60 2023-12-22T09:17:17.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.223+0000 7fbcc448f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc0c0960 con 0x7fbcbc150a80 2023-12-22T09:17:17.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.223+0000 7fbcc2a2c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbcbc071ea0 0x7fbcbc15b400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49630/0 (socket says 172.21.15.106:49630) 2023-12-22T09:17:17.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.223+0000 7fbcc2a2c640 1 -- 172.21.15.106:0/2608690912 learned_addr learned my addr 172.21.15.106:0/2608690912 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:17.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.223+0000 7fbcc1a2a640 1 --2- 172.21.15.106:0/2608690912 >> v2:172.21.15.132:3300/0 conn(0x7fbcbc150a80 0x7fbcbc151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:17.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.224+0000 7fbcc1229640 1 -- 172.21.15.106:0/2608690912 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515260813 0 0) 0x7fbcbc0bfce0 con 0x7fbcbc071ea0 2023-12-22T09:17:17.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.224+0000 7fbcc1229640 1 -- 172.21.15.106:0/2608690912 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca8005730 con 0x7fbcbc071ea0 2023-12-22T09:17:17.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.224+0000 7fbcc1229640 1 -- 172.21.15.106:0/2608690912 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 658625708 0 0) 0x7fbca8005730 con 0x7fbcbc071ea0 2023-12-22T09:17:17.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.224+0000 7fbcc1a2a640 1 -- 172.21.15.106:0/2608690912 >> v1:172.21.15.132:6789/0 conn(0x7fbcbc069e60 legacy=0x7fbcbc14a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.224+0000 7fbcc1a2a640 1 -- 172.21.15.106:0/2608690912 >> v1:172.21.15.106:6789/0 conn(0x7fbcbc071ea0 legacy=0x7fbcbc15b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.224+0000 7fbcc1a2a640 1 -- 172.21.15.106:0/2608690912 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0c02a0 con 0x7fbcbc150a80 2023-12-22T09:17:17.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.225+0000 7fbcc1a2a640 1 --2- 172.21.15.106:0/2608690912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcbc150a80 0x7fbcbc151f70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0097a0 tx=0x7fbcac02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d51cb0b9c8bdaedb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:17.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.226+0000 7fbcc1229640 1 -- 172.21.15.106:0/2608690912 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb40019f0 con 0x7fbcbc150a80 2023-12-22T09:17:17.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.226+0000 7fbcc1229640 1 -- 172.21.15.106:0/2608690912 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac02e050 con 0x7fbcbc150a80 2023-12-22T09:17:17.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.226+0000 7fbcc1229640 1 -- 172.21.15.106:0/2608690912 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac030710 con 0x7fbcbc150a80 2023-12-22T09:17:17.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.227+0000 7fbcc448f640 1 -- 172.21.15.106:0/2608690912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcbc150a80 msgr2=0x7fbcbc151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.227+0000 7fbcc448f640 1 --2- 172.21.15.106:0/2608690912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcbc150a80 0x7fbcbc151f70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0097a0 tx=0x7fbcac02b710 comp rx=0 tx=0).stop 2023-12-22T09:17:17.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.227+0000 7fbcc448f640 1 -- 172.21.15.106:0/2608690912 shutdown_connections 2023-12-22T09:17:17.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.227+0000 7fbcc448f640 1 --2- 172.21.15.106:0/2608690912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcbc150a80 0x7fbcbc151f70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.227+0000 7fbcc448f640 1 -- 172.21.15.106:0/2608690912 >> 172.21.15.106:0/2608690912 conn(0x7fbcbc0c5360 msgr2=0x7fbcbc0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:17.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.227+0000 7fbcc448f640 1 -- 172.21.15.106:0/2608690912 shutdown_connections 2023-12-22T09:17:17.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.227+0000 7fbcc448f640 1 -- 172.21.15.106:0/2608690912 wait complete. 2023-12-22T09:17:17.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.228+0000 7fbcc448f640 1 Processor -- start 2023-12-22T09:17:17.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.229+0000 7fbcc448f640 1 -- start start 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.229+0000 7fbcc448f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcbc069e60 0x7fbcbc0be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.229+0000 7fbcc448f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcbc071ea0 0x7fbcbc148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.229+0000 7fbcc448f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcbc150a80 0x7fbcbc148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.229+0000 7fbcc448f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc14a0e0 con 0x7fbcbc150a80 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.229+0000 7fbcc448f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc149840 con 0x7fbcbc071ea0 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.229+0000 7fbcc448f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc149b20 con 0x7fbcbc069e60 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.230+0000 7fbcc2a2c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcbc150a80 0x7fbcbc148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.230+0000 7fbcc2a2c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcbc150a80 0x7fbcbc148c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40428/0 (socket says 172.21.15.106:40428) 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.230+0000 7fbcc2a2c640 1 -- 172.21.15.106:0/2151244345 learned_addr learned my addr 172.21.15.106:0/2151244345 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.230+0000 7fbcc2a2c640 1 -- 172.21.15.106:0/2151244345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcbc069e60 msgr2=0x7fbcbc0be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.230+0000 7fbcc2a2c640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcbc069e60 0x7fbcbc0be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.230+0000 7fbcc2a2c640 1 -- 172.21.15.106:0/2151244345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcbc071ea0 msgr2=0x7fbcbc148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.230+0000 7fbcc2a2c640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcbc071ea0 0x7fbcbc148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.230+0000 7fbcc2a2c640 1 -- 172.21.15.106:0/2151244345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac009400 con 0x7fbcbc150a80 2023-12-22T09:17:17.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.230+0000 7fbcc2a2c640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcbc150a80 0x7fbcbc148c90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400cc70 tx=0x7fbcb400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:17.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.231+0000 7fbcb2ffd640 1 -- 172.21.15.106:0/2151244345 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb400ce80 con 0x7fbcbc150a80 2023-12-22T09:17:17.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.231+0000 7fbcb2ffd640 1 -- 172.21.15.106:0/2151244345 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb4012400 con 0x7fbcbc150a80 2023-12-22T09:17:17.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.231+0000 7fbcb2ffd640 1 -- 172.21.15.106:0/2151244345 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb40127b0 con 0x7fbcbc150a80 2023-12-22T09:17:17.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.231+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc149e00 con 0x7fbcbc150a80 2023-12-22T09:17:17.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.231+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc0bee20 con 0x7fbcbc150a80 2023-12-22T09:17:17.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.232+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc148470 con 0x7fbcbc150a80 2023-12-22T09:17:17.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.233+0000 7fbcb2ffd640 1 -- 172.21.15.106:0/2151244345 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbcb4012910 con 0x7fbcbc150a80 2023-12-22T09:17:17.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.234+0000 7fbcb2ffd640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbca006a430 0x7fbca006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.234+0000 7fbcb2ffd640 1 -- 172.21.15.106:0/2151244345 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fbcb4089590 con 0x7fbcbc150a80 2023-12-22T09:17:17.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.234+0000 7fbcc222b640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbca006a430 0x7fbca006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:17.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.234+0000 7fbcc222b640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbca006a430 0x7fbca006c8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8001500 tx=0x7fbcb80079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:17.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.238+0000 7fbcb2ffd640 1 -- 172.21.15.106:0/2151244345 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbcbc148470 con 0x7fbcbc150a80 2023-12-22T09:17:17.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.413+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbcbc0c0580 con 0x7fbca006a430 2023-12-22T09:17:17.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.427+0000 7fbcb2ffd640 1 -- 172.21.15.106:0/2151244345 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+516381 (secure 0 0 0) 0x7fbcb8005080 con 0x7fbca006a430 2023-12-22T09:17:17.432 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:17.438 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:17:17.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbca006a430 msgr2=0x7fbca006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbca006a430 0x7fbca006c8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8001500 tx=0x7fbcb80079c0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcbc150a80 msgr2=0x7fbcbc148c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcbc150a80 0x7fbcbc148c90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400cc70 tx=0x7fbcb400a430 comp rx=0 tx=0).stop 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 shutdown_connections 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fbca006a430 0x7fbca006c8f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcbc150a80 0x7fbcbc148c90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcbc071ea0 0x7fbcbc148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 --2- 172.21.15.106:0/2151244345 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcbc069e60 0x7fbcbc0be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 >> 172.21.15.106:0/2151244345 conn(0x7fbcbc0c5360 msgr2=0x7fbcbc1422b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 shutdown_connections 2023-12-22T09:17:17.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.437+0000 7fbcc448f640 1 -- 172.21.15.106:0/2151244345 wait complete. 2023-12-22T09:17:17.454 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-12-22T09:17:16.751885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595789,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":276,"acting":276,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234904,"kb_used_data":7000,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754739816,"statfs":{"total":773094113280,"available":772853571584,"internally_reserved":0,"allocated":7168000,"data_stored":3893746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2805,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.753534"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516357+0000","last_change":"2023-12-22T09:17:12.540063+0000","last_active":"2023-12-22T09:17:13.516357+0000","last_peered":"2023-12-22T09:17:13.516357+0000","last_clean":"2023-12-22T09:17:13.516357+0000","last_became_active":"2023-12-22T09:17:12.538574+0000","last_became_peered":"2023-12-22T09:17:12.538574+0000","last_unstale":"2023-12-22T09:17:13.516357+0000","last_undegraded":"2023-12-22T09:17:13.516357+0000","last_fullsized":"2023-12-22T09:17:13.516357+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:47.737577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987813+0000","last_change":"2023-12-22T09:16:58.138391+0000","last_active":"2023-12-22T09:17:09.987813+0000","last_peered":"2023-12-22T09:17:09.987813+0000","last_clean":"2023-12-22T09:17:09.987813+0000","last_became_active":"2023-12-22T09:16:58.138138+0000","last_became_peered":"2023-12-22T09:16:58.138138+0000","last_unstale":"2023-12-22T09:17:09.987813+0000","last_undegraded":"2023-12-22T09:17:09.987813+0000","last_fullsized":"2023-12-22T09:17:09.987813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987928+0000","last_change":"2023-12-22T09:16:58.122537+0000","last_active":"2023-12-22T09:17:09.987928+0000","last_peered":"2023-12-22T09:17:09.987928+0000","last_clean":"2023-12-22T09:17:09.987928+0000","last_became_active":"2023-12-22T09:16:58.122285+0000","last_became_peered":"2023-12-22T09:16:58.122285+0000","last_unstale":"2023-12-22T09:17:09.987928+0000","last_undegraded":"2023-12-22T09:17:09.987928+0000","last_fullsized":"2023-12-22T09:17:09.987928+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040549+0000","last_change":"2023-12-22T09:16:58.155070+0000","last_active":"2023-12-22T09:17:10.040549+0000","last_peered":"2023-12-22T09:17:10.040549+0000","last_clean":"2023-12-22T09:17:10.040549+0000","last_became_active":"2023-12-22T09:16:58.154786+0000","last_became_peered":"2023-12-22T09:16:58.154786+0000","last_unstale":"2023-12-22T09:17:10.040549+0000","last_undegraded":"2023-12-22T09:17:10.040549+0000","last_fullsized":"2023-12-22T09:17:10.040549+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.038550+0000","last_change":"2023-12-22T09:17:11.034865+0000","last_active":"2023-12-22T09:17:11.038550+0000","last_peered":"2023-12-22T09:17:11.038550+0000","last_clean":"2023-12-22T09:17:11.038550+0000","last_became_active":"2023-12-22T09:17:11.034194+0000","last_became_peered":"2023-12-22T09:17:11.034194+0000","last_unstale":"2023-12-22T09:17:11.038550+0000","last_undegraded":"2023-12-22T09:17:11.038550+0000","last_fullsized":"2023-12-22T09:17:11.038550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:09:17.505510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507609+0000","last_change":"2023-12-22T09:16:58.143885+0000","last_active":"2023-12-22T09:17:12.507609+0000","last_peered":"2023-12-22T09:17:12.507609+0000","last_clean":"2023-12-22T09:17:12.507609+0000","last_became_active":"2023-12-22T09:16:58.143627+0000","last_became_peered":"2023-12-22T09:16:58.143627+0000","last_unstale":"2023-12-22T09:17:12.507609+0000","last_undegraded":"2023-12-22T09:17:12.507609+0000","last_fullsized":"2023-12-22T09:17:12.507609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:50:47.328724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001302+0000","last_change":"2023-12-22T09:16:58.140402+0000","last_active":"2023-12-22T09:17:10.001302+0000","last_peered":"2023-12-22T09:17:10.001302+0000","last_clean":"2023-12-22T09:17:10.001302+0000","last_became_active":"2023-12-22T09:16:58.140117+0000","last_became_peered":"2023-12-22T09:16:58.140117+0000","last_unstale":"2023-12-22T09:17:10.001302+0000","last_undegraded":"2023-12-22T09:17:10.001302+0000","last_fullsized":"2023-12-22T09:17:10.001302+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:25:20.515272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037504+0000","last_change":"2023-12-22T09:16:58.138038+0000","last_active":"2023-12-22T09:17:10.037504+0000","last_peered":"2023-12-22T09:17:10.037504+0000","last_clean":"2023-12-22T09:17:10.037504+0000","last_became_active":"2023-12-22T09:16:58.137394+0000","last_became_peered":"2023-12-22T09:16:58.137394+0000","last_unstale":"2023-12-22T09:17:10.037504+0000","last_undegraded":"2023-12-22T09:17:10.037504+0000","last_fullsized":"2023-12-22T09:17:10.037504+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:53.435793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.032949+0000","last_change":"2023-12-22T09:16:58.139475+0000","last_active":"2023-12-22T09:17:10.032949+0000","last_peered":"2023-12-22T09:17:10.032949+0000","last_clean":"2023-12-22T09:17:10.032949+0000","last_became_active":"2023-12-22T09:16:58.139166+0000","last_became_peered":"2023-12-22T09:16:58.139166+0000","last_unstale":"2023-12-22T09:17:10.032949+0000","last_undegraded":"2023-12-22T09:17:10.032949+0000","last_fullsized":"2023-12-22T09:17:10.032949+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041199+0000","last_change":"2023-12-22T09:16:58.153587+0000","last_active":"2023-12-22T09:17:10.041199+0000","last_peered":"2023-12-22T09:17:10.041199+0000","last_clean":"2023-12-22T09:17:10.041199+0000","last_became_active":"2023-12-22T09:16:58.153215+0000","last_became_peered":"2023-12-22T09:16:58.153215+0000","last_unstale":"2023-12-22T09:17:10.041199+0000","last_undegraded":"2023-12-22T09:17:10.041199+0000","last_fullsized":"2023-12-22T09:17:10.041199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041616+0000","last_change":"2023-12-22T09:16:58.146315+0000","last_active":"2023-12-22T09:17:10.041616+0000","last_peered":"2023-12-22T09:17:10.041616+0000","last_clean":"2023-12-22T09:17:10.041616+0000","last_became_active":"2023-12-22T09:16:58.143702+0000","last_became_peered":"2023-12-22T09:16:58.143702+0000","last_unstale":"2023-12-22T09:17:10.041616+0000","last_undegraded":"2023-12-22T09:17:10.041616+0000","last_fullsized":"2023-12-22T09:17:10.041616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991685+0000","last_change":"2023-12-22T09:16:58.144346+0000","last_active":"2023-12-22T09:17:09.991685+0000","last_peered":"2023-12-22T09:17:09.991685+0000","last_clean":"2023-12-22T09:17:09.991685+0000","last_became_active":"2023-12-22T09:16:58.144068+0000","last_became_peered":"2023-12-22T09:16:58.144068+0000","last_unstale":"2023-12-22T09:17:09.991685+0000","last_undegraded":"2023-12-22T09:17:09.991685+0000","last_fullsized":"2023-12-22T09:17:09.991685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.035380+0000","last_change":"2023-12-22T09:17:11.035380+0000","last_active":"2023-12-22T09:17:11.035380+0000","last_peered":"2023-12-22T09:17:11.035380+0000","last_clean":"2023-12-22T09:17:11.035380+0000","last_became_active":"2023-12-22T09:17:11.035022+0000","last_became_peered":"2023-12-22T09:17:11.035022+0000","last_unstale":"2023-12-22T09:17:11.035380+0000","last_undegraded":"2023-12-22T09:17:11.035380+0000","last_fullsized":"2023-12-22T09:17:11.035380+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:30.877521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033317+0000","last_change":"2023-12-22T09:16:58.149202+0000","last_active":"2023-12-22T09:17:10.033317+0000","last_peered":"2023-12-22T09:17:10.033317+0000","last_clean":"2023-12-22T09:17:10.033317+0000","last_became_active":"2023-12-22T09:16:58.148243+0000","last_became_peered":"2023-12-22T09:16:58.148243+0000","last_unstale":"2023-12-22T09:17:10.033317+0000","last_undegraded":"2023-12-22T09:17:10.033317+0000","last_fullsized":"2023-12-22T09:17:10.033317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040061+0000","last_change":"2023-12-22T09:16:58.156229+0000","last_active":"2023-12-22T09:17:10.040061+0000","last_peered":"2023-12-22T09:17:10.040061+0000","last_clean":"2023-12-22T09:17:10.040061+0000","last_became_active":"2023-12-22T09:16:58.154667+0000","last_became_peered":"2023-12-22T09:16:58.154667+0000","last_unstale":"2023-12-22T09:17:10.040061+0000","last_undegraded":"2023-12-22T09:17:10.040061+0000","last_fullsized":"2023-12-22T09:17:10.040061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039631+0000","last_change":"2023-12-22T09:16:58.144597+0000","last_active":"2023-12-22T09:17:10.039631+0000","last_peered":"2023-12-22T09:17:10.039631+0000","last_clean":"2023-12-22T09:17:10.039631+0000","last_became_active":"2023-12-22T09:16:58.144358+0000","last_became_peered":"2023-12-22T09:16:58.144358+0000","last_unstale":"2023-12-22T09:17:10.039631+0000","last_undegraded":"2023-12-22T09:17:10.039631+0000","last_fullsized":"2023-12-22T09:17:10.039631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037564+0000","last_change":"2023-12-22T09:16:58.139134+0000","last_active":"2023-12-22T09:17:10.037564+0000","last_peered":"2023-12-22T09:17:10.037564+0000","last_clean":"2023-12-22T09:17:10.037564+0000","last_became_active":"2023-12-22T09:16:58.138883+0000","last_became_peered":"2023-12-22T09:16:58.138883+0000","last_unstale":"2023-12-22T09:17:10.037564+0000","last_undegraded":"2023-12-22T09:17:10.037564+0000","last_fullsized":"2023-12-22T09:17:10.037564+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.662952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987920+0000","last_change":"2023-12-22T09:16:58.139935+0000","last_active":"2023-12-22T09:17:09.987920+0000","last_peered":"2023-12-22T09:17:09.987920+0000","last_clean":"2023-12-22T09:17:09.987920+0000","last_became_active":"2023-12-22T09:16:58.139665+0000","last_became_peered":"2023-12-22T09:16:58.139665+0000","last_unstale":"2023-12-22T09:17:09.987920+0000","last_undegraded":"2023-12-22T09:17:09.987920+0000","last_fullsized":"2023-12-22T09:17:09.987920+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991829+0000","last_change":"2023-12-22T09:16:58.135060+0000","last_active":"2023-12-22T09:17:09.991829+0000","last_peered":"2023-12-22T09:17:09.991829+0000","last_clean":"2023-12-22T09:17:09.991829+0000","last_became_active":"2023-12-22T09:16:58.134796+0000","last_became_peered":"2023-12-22T09:16:58.134796+0000","last_unstale":"2023-12-22T09:17:09.991829+0000","last_undegraded":"2023-12-22T09:17:09.991829+0000","last_fullsized":"2023-12-22T09:17:09.991829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:56:40.950128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514119+0000","last_change":"2023-12-22T09:16:58.133014+0000","last_active":"2023-12-22T09:17:12.514119+0000","last_peered":"2023-12-22T09:17:12.514119+0000","last_clean":"2023-12-22T09:17:12.514119+0000","last_became_active":"2023-12-22T09:16:58.132669+0000","last_became_peered":"2023-12-22T09:16:58.132669+0000","last_unstale":"2023-12-22T09:17:12.514119+0000","last_undegraded":"2023-12-22T09:17:12.514119+0000","last_fullsized":"2023-12-22T09:17:12.514119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:59:55.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998957+0000","last_change":"2023-12-22T09:16:58.139698+0000","last_active":"2023-12-22T09:17:09.998957+0000","last_peered":"2023-12-22T09:17:09.998957+0000","last_clean":"2023-12-22T09:17:09.998957+0000","last_became_active":"2023-12-22T09:16:58.139450+0000","last_became_peered":"2023-12-22T09:16:58.139450+0000","last_unstale":"2023-12-22T09:17:09.998957+0000","last_undegraded":"2023-12-22T09:17:09.998957+0000","last_fullsized":"2023-12-22T09:17:09.998957+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:40.452271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033355+0000","last_change":"2023-12-22T09:16:58.138002+0000","last_active":"2023-12-22T09:17:10.033355+0000","last_peered":"2023-12-22T09:17:10.033355+0000","last_clean":"2023-12-22T09:17:10.033355+0000","last_became_active":"2023-12-22T09:16:58.137587+0000","last_became_peered":"2023-12-22T09:16:58.137587+0000","last_unstale":"2023-12-22T09:17:10.033355+0000","last_undegraded":"2023-12-22T09:17:10.033355+0000","last_fullsized":"2023-12-22T09:17:10.033355+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998044+0000","last_change":"2023-12-22T09:16:58.143017+0000","last_active":"2023-12-22T09:17:09.998044+0000","last_peered":"2023-12-22T09:17:09.998044+0000","last_clean":"2023-12-22T09:17:09.998044+0000","last_became_active":"2023-12-22T09:16:58.142609+0000","last_became_peered":"2023-12-22T09:16:58.142609+0000","last_unstale":"2023-12-22T09:17:09.998044+0000","last_undegraded":"2023-12-22T09:17:09.998044+0000","last_fullsized":"2023-12-22T09:17:09.998044+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:22.037240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998160+0000","last_change":"2023-12-22T09:16:58.137672+0000","last_active":"2023-12-22T09:17:09.998160+0000","last_peered":"2023-12-22T09:17:09.998160+0000","last_clean":"2023-12-22T09:17:09.998160+0000","last_became_active":"2023-12-22T09:16:58.137418+0000","last_became_peered":"2023-12-22T09:16:58.137418+0000","last_unstale":"2023-12-22T09:17:09.998160+0000","last_undegraded":"2023-12-22T09:17:09.998160+0000","last_fullsized":"2023-12-22T09:17:09.998160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:11.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039381+0000","last_change":"2023-12-22T09:16:58.151378+0000","last_active":"2023-12-22T09:17:10.039381+0000","last_peered":"2023-12-22T09:17:10.039381+0000","last_clean":"2023-12-22T09:17:10.039381+0000","last_became_active":"2023-12-22T09:16:58.148696+0000","last_became_peered":"2023-12-22T09:16:58.148696+0000","last_unstale":"2023-12-22T09:17:10.039381+0000","last_undegraded":"2023-12-22T09:17:10.039381+0000","last_fullsized":"2023-12-22T09:17:10.039381+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033782+0000","last_change":"2023-12-22T09:16:58.134012+0000","last_active":"2023-12-22T09:17:10.033782+0000","last_peered":"2023-12-22T09:17:10.033782+0000","last_clean":"2023-12-22T09:17:10.033782+0000","last_became_active":"2023-12-22T09:16:58.133668+0000","last_became_peered":"2023-12-22T09:16:58.133668+0000","last_unstale":"2023-12-22T09:17:10.033782+0000","last_undegraded":"2023-12-22T09:17:10.033782+0000","last_fullsized":"2023-12-22T09:17:10.033782+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:57:16.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033615+0000","last_change":"2023-12-22T09:16:58.138808+0000","last_active":"2023-12-22T09:17:10.033615+0000","last_peered":"2023-12-22T09:17:10.033615+0000","last_clean":"2023-12-22T09:17:10.033615+0000","last_became_active":"2023-12-22T09:16:58.138287+0000","last_became_peered":"2023-12-22T09:16:58.138287+0000","last_unstale":"2023-12-22T09:17:10.033615+0000","last_undegraded":"2023-12-22T09:17:10.033615+0000","last_fullsized":"2023-12-22T09:17:10.033615+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:36.638731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991852+0000","last_change":"2023-12-22T09:16:58.148258+0000","last_active":"2023-12-22T09:17:09.991852+0000","last_peered":"2023-12-22T09:17:09.991852+0000","last_clean":"2023-12-22T09:17:09.991852+0000","last_became_active":"2023-12-22T09:16:58.148003+0000","last_became_peered":"2023-12-22T09:16:58.148003+0000","last_unstale":"2023-12-22T09:17:09.991852+0000","last_undegraded":"2023-12-22T09:17:09.991852+0000","last_fullsized":"2023-12-22T09:17:09.991852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:42.621461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987618+0000","last_change":"2023-12-22T09:16:58.133892+0000","last_active":"2023-12-22T09:17:09.987618+0000","last_peered":"2023-12-22T09:17:09.987618+0000","last_clean":"2023-12-22T09:17:09.987618+0000","last_became_active":"2023-12-22T09:16:58.133436+0000","last_became_peered":"2023-12-22T09:16:58.133436+0000","last_unstale":"2023-12-22T09:17:09.987618+0000","last_undegraded":"2023-12-22T09:17:09.987618+0000","last_fullsized":"2023-12-22T09:17:09.987618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039949+0000","last_change":"2023-12-22T09:16:58.149316+0000","last_active":"2023-12-22T09:17:10.039949+0000","last_peered":"2023-12-22T09:17:10.039949+0000","last_clean":"2023-12-22T09:17:10.039949+0000","last_became_active":"2023-12-22T09:16:58.148642+0000","last_became_peered":"2023-12-22T09:16:58.148642+0000","last_unstale":"2023-12-22T09:17:10.039949+0000","last_undegraded":"2023-12-22T09:17:10.039949+0000","last_fullsized":"2023-12-22T09:17:10.039949+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033121+0000","last_change":"2023-12-22T09:16:58.155683+0000","last_active":"2023-12-22T09:17:10.033121+0000","last_peered":"2023-12-22T09:17:10.033121+0000","last_clean":"2023-12-22T09:17:10.033121+0000","last_became_active":"2023-12-22T09:16:58.155388+0000","last_became_peered":"2023-12-22T09:16:58.155388+0000","last_unstale":"2023-12-22T09:17:10.033121+0000","last_undegraded":"2023-12-22T09:17:10.033121+0000","last_fullsized":"2023-12-22T09:17:10.033121+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.990889+0000","last_change":"2023-12-22T09:16:58.147756+0000","last_active":"2023-12-22T09:17:09.990889+0000","last_peered":"2023-12-22T09:17:09.990889+0000","last_clean":"2023-12-22T09:17:09.990889+0000","last_became_active":"2023-12-22T09:16:58.146595+0000","last_became_peered":"2023-12-22T09:16:58.146595+0000","last_unstale":"2023-12-22T09:17:09.990889+0000","last_undegraded":"2023-12-22T09:17:09.990889+0000","last_fullsized":"2023-12-22T09:17:09.990889+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:20:04.358268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001557+0000","last_change":"2023-12-22T09:16:58.125759+0000","last_active":"2023-12-22T09:17:10.001557+0000","last_peered":"2023-12-22T09:17:10.001557+0000","last_clean":"2023-12-22T09:17:10.001557+0000","last_became_active":"2023-12-22T09:16:58.125192+0000","last_became_peered":"2023-12-22T09:16:58.125192+0000","last_unstale":"2023-12-22T09:17:10.001557+0000","last_undegraded":"2023-12-22T09:17:10.001557+0000","last_fullsized":"2023-12-22T09:17:10.001557+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:11.972408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.024204+0000","last_change":"2023-12-22T09:17:11.024204+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.024204+0000","last_undegraded":"2023-12-22T09:17:11.024204+0000","last_fullsized":"2023-12-22T09:17:11.024204+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508856+0000","last_change":"2023-12-22T09:16:58.132380+0000","last_active":"2023-12-22T09:17:12.508856+0000","last_peered":"2023-12-22T09:17:12.508856+0000","last_clean":"2023-12-22T09:17:12.508856+0000","last_became_active":"2023-12-22T09:16:58.131960+0000","last_became_peered":"2023-12-22T09:16:58.131960+0000","last_unstale":"2023-12-22T09:17:12.508856+0000","last_undegraded":"2023-12-22T09:17:12.508856+0000","last_fullsized":"2023-12-22T09:17:12.508856+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:39:55.787513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987907+0000","last_change":"2023-12-22T09:16:57.644639+0000","last_active":"2023-12-22T09:17:09.987907+0000","last_peered":"2023-12-22T09:17:09.987907+0000","last_clean":"2023-12-22T09:17:09.987907+0000","last_became_active":"2023-12-22T09:16:57.641016+0000","last_became_peered":"2023-12-22T09:16:57.641016+0000","last_unstale":"2023-12-22T09:17:09.987907+0000","last_undegraded":"2023-12-22T09:17:09.987907+0000","last_fullsized":"2023-12-22T09:17:09.987907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.533990+0000","last_change":"2023-12-22T09:17:12.042696+0000","last_active":"2023-12-22T09:17:12.533990+0000","last_peered":"2023-12-22T09:17:12.533990+0000","last_clean":"2023-12-22T09:17:12.533990+0000","last_became_active":"2023-12-22T09:17:12.042328+0000","last_became_peered":"2023-12-22T09:17:12.042328+0000","last_unstale":"2023-12-22T09:17:12.533990+0000","last_undegraded":"2023-12-22T09:17:12.533990+0000","last_fullsized":"2023-12-22T09:17:12.533990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:05:59.153455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.018807+0000","last_change":"2023-12-22T09:17:11.012714+0000","last_active":"2023-12-22T09:17:11.018807+0000","last_peered":"2023-12-22T09:17:11.018807+0000","last_clean":"2023-12-22T09:17:11.018807+0000","last_became_active":"2023-12-22T09:17:11.011762+0000","last_became_peered":"2023-12-22T09:17:11.011762+0000","last_unstale":"2023-12-22T09:17:11.018807+0000","last_undegraded":"2023-12-22T09:17:11.018807+0000","last_fullsized":"2023-12-22T09:17:11.018807+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:53:32.651627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001619+0000","last_change":"2023-12-22T09:16:57.643725+0000","last_active":"2023-12-22T09:17:10.001619+0000","last_peered":"2023-12-22T09:17:10.001619+0000","last_clean":"2023-12-22T09:17:10.001619+0000","last_became_active":"2023-12-22T09:16:57.642742+0000","last_became_peered":"2023-12-22T09:16:57.642742+0000","last_unstale":"2023-12-22T09:17:10.001619+0000","last_undegraded":"2023-12-22T09:17:10.001619+0000","last_fullsized":"2023-12-22T09:17:10.001619+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:42.697488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.015046+0000","last_change":"2023-12-22T09:17:11.015046+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.015046+0000","last_undegraded":"2023-12-22T09:17:11.015046+0000","last_fullsized":"2023-12-22T09:17:11.015046+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:27.752298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001410+0000","last_change":"2023-12-22T09:16:58.124625+0000","last_active":"2023-12-22T09:17:10.001410+0000","last_peered":"2023-12-22T09:17:10.001410+0000","last_clean":"2023-12-22T09:17:10.001410+0000","last_became_active":"2023-12-22T09:16:58.124353+0000","last_became_peered":"2023-12-22T09:16:58.124353+0000","last_unstale":"2023-12-22T09:17:10.001410+0000","last_undegraded":"2023-12-22T09:17:10.001410+0000","last_fullsized":"2023-12-22T09:17:10.001410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:30:35.111753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001121+0000","last_change":"2023-12-22T09:16:57.655128+0000","last_active":"2023-12-22T09:17:10.001121+0000","last_peered":"2023-12-22T09:17:10.001121+0000","last_clean":"2023-12-22T09:17:10.001121+0000","last_became_active":"2023-12-22T09:16:57.654793+0000","last_became_peered":"2023-12-22T09:16:57.654793+0000","last_unstale":"2023-12-22T09:17:10.001121+0000","last_undegraded":"2023-12-22T09:17:10.001121+0000","last_fullsized":"2023-12-22T09:17:10.001121+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:38.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.019124+0000","last_change":"2023-12-22T09:17:11.019124+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.019124+0000","last_undegraded":"2023-12-22T09:17:11.019124+0000","last_fullsized":"2023-12-22T09:17:11.019124+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:03.329046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041177+0000","last_change":"2023-12-22T09:16:58.153226+0000","last_active":"2023-12-22T09:17:10.041177+0000","last_peered":"2023-12-22T09:17:10.041177+0000","last_clean":"2023-12-22T09:17:10.041177+0000","last_became_active":"2023-12-22T09:16:58.151970+0000","last_became_peered":"2023-12-22T09:16:58.151970+0000","last_unstale":"2023-12-22T09:17:10.041177+0000","last_undegraded":"2023-12-22T09:17:10.041177+0000","last_fullsized":"2023-12-22T09:17:10.041177+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.002324+0000","last_change":"2023-12-22T09:16:57.635854+0000","last_active":"2023-12-22T09:17:10.002324+0000","last_peered":"2023-12-22T09:17:10.002324+0000","last_clean":"2023-12-22T09:17:10.002324+0000","last_became_active":"2023-12-22T09:16:57.635365+0000","last_became_peered":"2023-12-22T09:16:57.635365+0000","last_unstale":"2023-12-22T09:17:10.002324+0000","last_undegraded":"2023-12-22T09:17:10.002324+0000","last_fullsized":"2023-12-22T09:17:10.002324+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:55.506978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.031825+0000","last_change":"2023-12-22T09:17:11.031825+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.031825+0000","last_undegraded":"2023-12-22T09:17:11.031825+0000","last_fullsized":"2023-12-22T09:17:11.031825+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037660+0000","last_change":"2023-12-22T09:16:58.111968+0000","last_active":"2023-12-22T09:17:10.037660+0000","last_peered":"2023-12-22T09:17:10.037660+0000","last_clean":"2023-12-22T09:17:10.037660+0000","last_became_active":"2023-12-22T09:16:58.111712+0000","last_became_peered":"2023-12-22T09:16:58.111712+0000","last_unstale":"2023-12-22T09:17:10.037660+0000","last_undegraded":"2023-12-22T09:17:10.037660+0000","last_fullsized":"2023-12-22T09:17:10.037660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:31:26.301820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998752+0000","last_change":"2023-12-22T09:16:57.646140+0000","last_active":"2023-12-22T09:17:09.998752+0000","last_peered":"2023-12-22T09:17:09.998752+0000","last_clean":"2023-12-22T09:17:09.998752+0000","last_became_active":"2023-12-22T09:16:57.645839+0000","last_became_peered":"2023-12-22T09:16:57.645839+0000","last_unstale":"2023-12-22T09:17:09.998752+0000","last_undegraded":"2023-12-22T09:17:09.998752+0000","last_fullsized":"2023-12-22T09:17:09.998752+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:15.308735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519978+0000","last_change":"2023-12-22T09:17:12.538499+0000","last_active":"2023-12-22T09:17:13.519978+0000","last_peered":"2023-12-22T09:17:13.519978+0000","last_clean":"2023-12-22T09:17:13.519978+0000","last_became_active":"2023-12-22T09:17:12.537198+0000","last_became_peered":"2023-12-22T09:17:12.537198+0000","last_unstale":"2023-12-22T09:17:13.519978+0000","last_undegraded":"2023-12-22T09:17:13.519978+0000","last_fullsized":"2023-12-22T09:17:13.519978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:33:56.242812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.015535+0000","last_change":"2023-12-22T09:17:11.015535+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.015535+0000","last_undegraded":"2023-12-22T09:17:11.015535+0000","last_fullsized":"2023-12-22T09:17:11.015535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:23.589301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987213+0000","last_change":"2023-12-22T09:16:58.148277+0000","last_active":"2023-12-22T09:17:09.987213+0000","last_peered":"2023-12-22T09:17:09.987213+0000","last_clean":"2023-12-22T09:17:09.987213+0000","last_became_active":"2023-12-22T09:16:58.147042+0000","last_became_peered":"2023-12-22T09:16:58.147042+0000","last_unstale":"2023-12-22T09:17:09.987213+0000","last_undegraded":"2023-12-22T09:17:09.987213+0000","last_fullsized":"2023-12-22T09:17:09.987213+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998289+0000","last_change":"2023-12-22T09:16:57.641319+0000","last_active":"2023-12-22T09:17:09.998289+0000","last_peered":"2023-12-22T09:17:09.998289+0000","last_clean":"2023-12-22T09:17:09.998289+0000","last_became_active":"2023-12-22T09:16:57.641031+0000","last_became_peered":"2023-12-22T09:16:57.641031+0000","last_unstale":"2023-12-22T09:17:09.998289+0000","last_undegraded":"2023-12-22T09:17:09.998289+0000","last_fullsized":"2023-12-22T09:17:09.998289+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:10.350226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.014643+0000","last_change":"2023-12-22T09:17:11.014643+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.014643+0000","last_undegraded":"2023-12-22T09:17:11.014643+0000","last_fullsized":"2023-12-22T09:17:11.014643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:29.709741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506322+0000","last_change":"2023-12-22T09:16:58.130875+0000","last_active":"2023-12-22T09:17:12.506322+0000","last_peered":"2023-12-22T09:17:12.506322+0000","last_clean":"2023-12-22T09:17:12.506322+0000","last_became_active":"2023-12-22T09:16:58.130606+0000","last_became_peered":"2023-12-22T09:16:58.130606+0000","last_unstale":"2023-12-22T09:17:12.506322+0000","last_undegraded":"2023-12-22T09:17:12.506322+0000","last_fullsized":"2023-12-22T09:17:12.506322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:30.649529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998331+0000","last_change":"2023-12-22T09:16:57.642097+0000","last_active":"2023-12-22T09:17:09.998331+0000","last_peered":"2023-12-22T09:17:09.998331+0000","last_clean":"2023-12-22T09:17:09.998331+0000","last_became_active":"2023-12-22T09:16:57.641830+0000","last_became_peered":"2023-12-22T09:16:57.641830+0000","last_unstale":"2023-12-22T09:17:09.998331+0000","last_undegraded":"2023-12-22T09:17:09.998331+0000","last_fullsized":"2023-12-22T09:17:09.998331+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:37:23.822669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.024975+0000","last_change":"2023-12-22T09:17:11.024975+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.024975+0000","last_undegraded":"2023-12-22T09:17:11.024975+0000","last_fullsized":"2023-12-22T09:17:11.024975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:57:47.077419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998660+0000","last_change":"2023-12-22T09:16:58.147991+0000","last_active":"2023-12-22T09:17:09.998660+0000","last_peered":"2023-12-22T09:17:09.998660+0000","last_clean":"2023-12-22T09:17:09.998660+0000","last_became_active":"2023-12-22T09:16:58.147595+0000","last_became_peered":"2023-12-22T09:16:58.147595+0000","last_unstale":"2023-12-22T09:17:09.998660+0000","last_undegraded":"2023-12-22T09:17:09.998660+0000","last_fullsized":"2023-12-22T09:17:09.998660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:14.136005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510671+0000","last_change":"2023-12-22T09:16:57.647073+0000","last_active":"2023-12-22T09:17:12.510671+0000","last_peered":"2023-12-22T09:17:12.510671+0000","last_clean":"2023-12-22T09:17:12.510671+0000","last_became_active":"2023-12-22T09:16:57.646655+0000","last_became_peered":"2023-12-22T09:16:57.646655+0000","last_unstale":"2023-12-22T09:17:12.510671+0000","last_undegraded":"2023-12-22T09:17:12.510671+0000","last_fullsized":"2023-12-22T09:17:12.510671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:52.036721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.016758+0000","last_change":"2023-12-22T09:17:11.016758+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.016758+0000","last_undegraded":"2023-12-22T09:17:11.016758+0000","last_fullsized":"2023-12-22T09:17:11.016758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:28.077725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987998+0000","last_change":"2023-12-22T09:16:58.112827+0000","last_active":"2023-12-22T09:17:09.987998+0000","last_peered":"2023-12-22T09:17:09.987998+0000","last_clean":"2023-12-22T09:17:09.987998+0000","last_became_active":"2023-12-22T09:16:58.112533+0000","last_became_peered":"2023-12-22T09:16:58.112533+0000","last_unstale":"2023-12-22T09:17:09.987998+0000","last_undegraded":"2023-12-22T09:17:09.987998+0000","last_fullsized":"2023-12-22T09:17:09.987998+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041476+0000","last_change":"2023-12-22T09:16:57.653443+0000","last_active":"2023-12-22T09:17:10.041476+0000","last_peered":"2023-12-22T09:17:10.041476+0000","last_clean":"2023-12-22T09:17:10.041476+0000","last_became_active":"2023-12-22T09:16:57.653141+0000","last_became_peered":"2023-12-22T09:16:57.653141+0000","last_unstale":"2023-12-22T09:17:10.041476+0000","last_undegraded":"2023-12-22T09:17:10.041476+0000","last_fullsized":"2023-12-22T09:17:10.041476+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"63'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.552653+0000","last_change":"2023-12-22T09:17:12.045401+0000","last_active":"2023-12-22T09:17:12.552653+0000","last_peered":"2023-12-22T09:17:12.552653+0000","last_clean":"2023-12-22T09:17:12.552653+0000","last_became_active":"2023-12-22T09:17:12.044219+0000","last_became_peered":"2023-12-22T09:17:12.044219+0000","last_unstale":"2023-12-22T09:17:12.552653+0000","last_undegraded":"2023-12-22T09:17:12.552653+0000","last_fullsized":"2023-12-22T09:17:12.552653+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:44.256814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.999418+0000","last_change":"2023-12-22T09:16:58.138339+0000","last_active":"2023-12-22T09:17:09.999418+0000","last_peered":"2023-12-22T09:17:09.999418+0000","last_clean":"2023-12-22T09:17:09.999418+0000","last_became_active":"2023-12-22T09:16:58.137859+0000","last_became_peered":"2023-12-22T09:16:58.137859+0000","last_unstale":"2023-12-22T09:17:09.999418+0000","last_undegraded":"2023-12-22T09:17:09.999418+0000","last_fullsized":"2023-12-22T09:17:09.999418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:20.962415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.993307+0000","last_change":"2023-12-22T09:16:57.655164+0000","last_active":"2023-12-22T09:17:09.993307+0000","last_peered":"2023-12-22T09:17:09.993307+0000","last_clean":"2023-12-22T09:17:09.993307+0000","last_became_active":"2023-12-22T09:16:57.654845+0000","last_became_peered":"2023-12-22T09:16:57.654845+0000","last_unstale":"2023-12-22T09:17:09.993307+0000","last_undegraded":"2023-12-22T09:17:09.993307+0000","last_fullsized":"2023-12-22T09:17:09.993307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:48.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.020619+0000","last_change":"2023-12-22T09:17:11.020619+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.020619+0000","last_undegraded":"2023-12-22T09:17:11.020619+0000","last_fullsized":"2023-12-22T09:17:11.020619+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:44.261501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509885+0000","last_change":"2023-12-22T09:16:58.140359+0000","last_active":"2023-12-22T09:17:12.509885+0000","last_peered":"2023-12-22T09:17:12.509885+0000","last_clean":"2023-12-22T09:17:12.509885+0000","last_became_active":"2023-12-22T09:16:58.140013+0000","last_became_peered":"2023-12-22T09:16:58.140013+0000","last_unstale":"2023-12-22T09:17:12.509885+0000","last_undegraded":"2023-12-22T09:17:12.509885+0000","last_fullsized":"2023-12-22T09:17:12.509885+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:10:45.503921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040698+0000","last_change":"2023-12-22T09:16:57.649245+0000","last_active":"2023-12-22T09:17:10.040698+0000","last_peered":"2023-12-22T09:17:10.040698+0000","last_clean":"2023-12-22T09:17:10.040698+0000","last_became_active":"2023-12-22T09:16:57.648941+0000","last_became_peered":"2023-12-22T09:16:57.648941+0000","last_unstale":"2023-12-22T09:17:10.040698+0000","last_undegraded":"2023-12-22T09:17:10.040698+0000","last_fullsized":"2023-12-22T09:17:10.040698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:41:54.745043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.024241+0000","last_change":"2023-12-22T09:17:11.024241+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.024241+0000","last_undegraded":"2023-12-22T09:17:11.024241+0000","last_fullsized":"2023-12-22T09:17:11.024241+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:49:30.159981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.993833+0000","last_change":"2023-12-22T09:16:58.136583+0000","last_active":"2023-12-22T09:17:09.993833+0000","last_peered":"2023-12-22T09:17:09.993833+0000","last_clean":"2023-12-22T09:17:09.993833+0000","last_became_active":"2023-12-22T09:16:58.136313+0000","last_became_peered":"2023-12-22T09:16:58.136313+0000","last_unstale":"2023-12-22T09:17:09.993833+0000","last_undegraded":"2023-12-22T09:17:09.993833+0000","last_fullsized":"2023-12-22T09:17:09.993833+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:04.972480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"59'9","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.988216+0000","last_change":"2023-12-22T09:16:57.656118+0000","last_active":"2023-12-22T09:17:09.988216+0000","last_peered":"2023-12-22T09:17:09.988216+0000","last_clean":"2023-12-22T09:17:09.988216+0000","last_became_active":"2023-12-22T09:16:57.655712+0000","last_became_peered":"2023-12-22T09:16:57.655712+0000","last_unstale":"2023-12-22T09:17:09.988216+0000","last_undegraded":"2023-12-22T09:17:09.988216+0000","last_fullsized":"2023-12-22T09:17:09.988216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519856+0000","last_change":"2023-12-22T09:17:12.541565+0000","last_active":"2023-12-22T09:17:13.519856+0000","last_peered":"2023-12-22T09:17:13.519856+0000","last_clean":"2023-12-22T09:17:13.519856+0000","last_became_active":"2023-12-22T09:17:12.540916+0000","last_became_peered":"2023-12-22T09:17:12.540916+0000","last_unstale":"2023-12-22T09:17:13.519856+0000","last_undegraded":"2023-12-22T09:17:13.519856+0000","last_fullsized":"2023-12-22T09:17:13.519856+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:48.901354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.015119+0000","last_change":"2023-12-22T09:17:11.015119+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.015119+0000","last_undegraded":"2023-12-22T09:17:11.015119+0000","last_fullsized":"2023-12-22T09:17:11.015119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:43:07.491118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.990860+0000","last_change":"2023-12-22T09:16:58.146066+0000","last_active":"2023-12-22T09:17:09.990860+0000","last_peered":"2023-12-22T09:17:09.990860+0000","last_clean":"2023-12-22T09:17:09.990860+0000","last_became_active":"2023-12-22T09:16:58.145703+0000","last_became_peered":"2023-12-22T09:16:58.145703+0000","last_unstale":"2023-12-22T09:17:09.990860+0000","last_undegraded":"2023-12-22T09:17:09.990860+0000","last_fullsized":"2023-12-22T09:17:09.990860+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:02.557319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040178+0000","last_change":"2023-12-22T09:16:57.649967+0000","last_active":"2023-12-22T09:17:10.040178+0000","last_peered":"2023-12-22T09:17:10.040178+0000","last_clean":"2023-12-22T09:17:10.040178+0000","last_became_active":"2023-12-22T09:16:57.649500+0000","last_became_peered":"2023-12-22T09:16:57.649500+0000","last_unstale":"2023-12-22T09:17:10.040178+0000","last_undegraded":"2023-12-22T09:17:10.040178+0000","last_fullsized":"2023-12-22T09:17:10.040178+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520037+0000","last_change":"2023-12-22T09:17:12.524836+0000","last_active":"2023-12-22T09:17:13.520037+0000","last_peered":"2023-12-22T09:17:13.520037+0000","last_clean":"2023-12-22T09:17:13.520037+0000","last_became_active":"2023-12-22T09:17:12.524505+0000","last_became_peered":"2023-12-22T09:17:12.524505+0000","last_unstale":"2023-12-22T09:17:13.520037+0000","last_undegraded":"2023-12-22T09:17:13.520037+0000","last_fullsized":"2023-12-22T09:17:13.520037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:11:58.590168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.031397+0000","last_change":"2023-12-22T09:17:11.031397+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.031397+0000","last_undegraded":"2023-12-22T09:17:11.031397+0000","last_fullsized":"2023-12-22T09:17:11.031397+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.032956+0000","last_change":"2023-12-22T09:16:58.134889+0000","last_active":"2023-12-22T09:17:10.032956+0000","last_peered":"2023-12-22T09:17:10.032956+0000","last_clean":"2023-12-22T09:17:10.032956+0000","last_became_active":"2023-12-22T09:16:58.134552+0000","last_became_peered":"2023-12-22T09:16:58.134552+0000","last_unstale":"2023-12-22T09:17:10.032956+0000","last_undegraded":"2023-12-22T09:17:10.032956+0000","last_fullsized":"2023-12-22T09:17:10.032956+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033118+0000","last_change":"2023-12-22T09:16:57.651390+0000","last_active":"2023-12-22T09:17:10.033118+0000","last_peered":"2023-12-22T09:17:10.033118+0000","last_clean":"2023-12-22T09:17:10.033118+0000","last_became_active":"2023-12-22T09:16:57.650566+0000","last_became_peered":"2023-12-22T09:16:57.650566+0000","last_unstale":"2023-12-22T09:17:10.033118+0000","last_undegraded":"2023-12-22T09:17:10.033118+0000","last_fullsized":"2023-12-22T09:17:10.033118+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:53.090112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.023927+0000","last_change":"2023-12-22T09:17:11.023927+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.023927+0000","last_undegraded":"2023-12-22T09:17:11.023927+0000","last_fullsized":"2023-12-22T09:17:11.023927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:56:30.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506577+0000","last_change":"2023-12-22T09:16:58.127084+0000","last_active":"2023-12-22T09:17:12.506577+0000","last_peered":"2023-12-22T09:17:12.506577+0000","last_clean":"2023-12-22T09:17:12.506577+0000","last_became_active":"2023-12-22T09:16:58.126598+0000","last_became_peered":"2023-12-22T09:16:58.126598+0000","last_unstale":"2023-12-22T09:17:12.506577+0000","last_undegraded":"2023-12-22T09:17:12.506577+0000","last_fullsized":"2023-12-22T09:17:12.506577+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:57.174680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039920+0000","last_change":"2023-12-22T09:16:57.643354+0000","last_active":"2023-12-22T09:17:10.039920+0000","last_peered":"2023-12-22T09:17:10.039920+0000","last_clean":"2023-12-22T09:17:10.039920+0000","last_became_active":"2023-12-22T09:16:57.643102+0000","last_became_peered":"2023-12-22T09:16:57.643102+0000","last_unstale":"2023-12-22T09:17:10.039920+0000","last_undegraded":"2023-12-22T09:17:10.039920+0000","last_fullsized":"2023-12-22T09:17:10.039920+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519260+0000","last_change":"2023-12-22T09:17:12.526768+0000","last_active":"2023-12-22T09:17:13.519260+0000","last_peered":"2023-12-22T09:17:13.519260+0000","last_clean":"2023-12-22T09:17:13.519260+0000","last_became_active":"2023-12-22T09:17:12.526405+0000","last_became_peered":"2023-12-22T09:17:12.526405+0000","last_unstale":"2023-12-22T09:17:13.519260+0000","last_undegraded":"2023-12-22T09:17:13.519260+0000","last_fullsized":"2023-12-22T09:17:13.519260+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:14:28.665216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.018018+0000","last_change":"2023-12-22T09:17:11.018018+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.018018+0000","last_undegraded":"2023-12-22T09:17:11.018018+0000","last_fullsized":"2023-12-22T09:17:11.018018+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:53.836251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987345+0000","last_change":"2023-12-22T09:16:58.146073+0000","last_active":"2023-12-22T09:17:09.987345+0000","last_peered":"2023-12-22T09:17:09.987345+0000","last_clean":"2023-12-22T09:17:09.987345+0000","last_became_active":"2023-12-22T09:16:58.145780+0000","last_became_peered":"2023-12-22T09:16:58.145780+0000","last_unstale":"2023-12-22T09:17:09.987345+0000","last_undegraded":"2023-12-22T09:17:09.987345+0000","last_fullsized":"2023-12-22T09:17:09.987345+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":21,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.990883+0000","last_change":"2023-12-22T09:16:57.651320+0000","last_active":"2023-12-22T09:17:09.990883+0000","last_peered":"2023-12-22T09:17:09.990883+0000","last_clean":"2023-12-22T09:17:09.990883+0000","last_became_active":"2023-12-22T09:16:57.651060+0000","last_became_peered":"2023-12-22T09:16:57.651060+0000","last_unstale":"2023-12-22T09:17:09.990883+0000","last_undegraded":"2023-12-22T09:17:09.990883+0000","last_fullsized":"2023-12-22T09:17:09.990883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:19:59.812662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.016192+0000","last_change":"2023-12-22T09:17:11.016192+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.016192+0000","last_undegraded":"2023-12-22T09:17:11.016192+0000","last_fullsized":"2023-12-22T09:17:11.016192+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:56.005441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040622+0000","last_change":"2023-12-22T09:16:58.148310+0000","last_active":"2023-12-22T09:17:10.040622+0000","last_peered":"2023-12-22T09:17:10.040622+0000","last_clean":"2023-12-22T09:17:10.040622+0000","last_became_active":"2023-12-22T09:16:58.147993+0000","last_became_peered":"2023-12-22T09:16:58.147993+0000","last_unstale":"2023-12-22T09:17:10.040622+0000","last_undegraded":"2023-12-22T09:17:10.040622+0000","last_fullsized":"2023-12-22T09:17:10.040622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033871+0000","last_change":"2023-12-22T09:16:57.654251+0000","last_active":"2023-12-22T09:17:10.033871+0000","last_peered":"2023-12-22T09:17:10.033871+0000","last_clean":"2023-12-22T09:17:10.033871+0000","last_became_active":"2023-12-22T09:16:57.653954+0000","last_became_peered":"2023-12-22T09:16:57.653954+0000","last_unstale":"2023-12-22T09:17:10.033871+0000","last_undegraded":"2023-12-22T09:17:10.033871+0000","last_fullsized":"2023-12-22T09:17:10.033871+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.011904+0000","last_change":"2023-12-22T09:17:11.011904+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.011904+0000","last_undegraded":"2023-12-22T09:17:11.011904+0000","last_fullsized":"2023-12-22T09:17:11.011904+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:34:22.106083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514253+0000","last_change":"2023-12-22T09:16:58.152892+0000","last_active":"2023-12-22T09:17:12.514253+0000","last_peered":"2023-12-22T09:17:12.514253+0000","last_clean":"2023-12-22T09:17:12.514253+0000","last_became_active":"2023-12-22T09:16:58.152538+0000","last_became_peered":"2023-12-22T09:16:58.152538+0000","last_unstale":"2023-12-22T09:17:12.514253+0000","last_undegraded":"2023-12-22T09:17:12.514253+0000","last_fullsized":"2023-12-22T09:17:12.514253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:12:00.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041640+0000","last_change":"2023-12-22T09:16:57.659614+0000","last_active":"2023-12-22T09:17:10.041640+0000","last_peered":"2023-12-22T09:17:10.041640+0000","last_clean":"2023-12-22T09:17:10.041640+0000","last_became_active":"2023-12-22T09:16:57.659211+0000","last_became_peered":"2023-12-22T09:16:57.659211+0000","last_unstale":"2023-12-22T09:17:10.041640+0000","last_undegraded":"2023-12-22T09:17:10.041640+0000","last_fullsized":"2023-12-22T09:17:10.041640+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.019465+0000","last_change":"2023-12-22T09:17:11.019465+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.019465+0000","last_undegraded":"2023-12-22T09:17:11.019465+0000","last_fullsized":"2023-12-22T09:17:11.019465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:27.519985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.992697+0000","last_change":"2023-12-22T09:16:58.144680+0000","last_active":"2023-12-22T09:17:09.992697+0000","last_peered":"2023-12-22T09:17:09.992697+0000","last_clean":"2023-12-22T09:17:09.992697+0000","last_became_active":"2023-12-22T09:16:58.144401+0000","last_became_peered":"2023-12-22T09:16:58.144401+0000","last_unstale":"2023-12-22T09:17:09.992697+0000","last_undegraded":"2023-12-22T09:17:09.992697+0000","last_fullsized":"2023-12-22T09:17:09.992697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:43.213252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040763+0000","last_change":"2023-12-22T09:16:57.651659+0000","last_active":"2023-12-22T09:17:10.040763+0000","last_peered":"2023-12-22T09:17:10.040763+0000","last_clean":"2023-12-22T09:17:10.040763+0000","last_became_active":"2023-12-22T09:16:57.650353+0000","last_became_peered":"2023-12-22T09:16:57.650353+0000","last_unstale":"2023-12-22T09:17:10.040763+0000","last_undegraded":"2023-12-22T09:17:10.040763+0000","last_fullsized":"2023-12-22T09:17:10.040763+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:15.191139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.014785+0000","last_change":"2023-12-22T09:17:11.014785+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.014785+0000","last_undegraded":"2023-12-22T09:17:11.014785+0000","last_fullsized":"2023-12-22T09:17:11.014785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:47.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509106+0000","last_change":"2023-12-22T09:16:58.139368+0000","last_active":"2023-12-22T09:17:12.509106+0000","last_peered":"2023-12-22T09:17:12.509106+0000","last_clean":"2023-12-22T09:17:12.509106+0000","last_became_active":"2023-12-22T09:16:58.134697+0000","last_became_peered":"2023-12-22T09:16:58.134697+0000","last_unstale":"2023-12-22T09:17:12.509106+0000","last_undegraded":"2023-12-22T09:17:12.509106+0000","last_fullsized":"2023-12-22T09:17:12.509106+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:40.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.999081+0000","last_change":"2023-12-22T09:16:57.659460+0000","last_active":"2023-12-22T09:17:09.999081+0000","last_peered":"2023-12-22T09:17:09.999081+0000","last_clean":"2023-12-22T09:17:09.999081+0000","last_became_active":"2023-12-22T09:16:57.659124+0000","last_became_peered":"2023-12-22T09:16:57.659124+0000","last_unstale":"2023-12-22T09:17:09.999081+0000","last_undegraded":"2023-12-22T09:17:09.999081+0000","last_fullsized":"2023-12-22T09:17:09.999081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:00.331386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.006940+0000","last_change":"2023-12-22T09:17:11.006940+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.006940+0000","last_undegraded":"2023-12-22T09:17:11.006940+0000","last_fullsized":"2023-12-22T09:17:11.006940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:22:18.487717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001788+0000","last_change":"2023-12-22T09:16:58.122054+0000","last_active":"2023-12-22T09:17:10.001788+0000","last_peered":"2023-12-22T09:17:10.001788+0000","last_clean":"2023-12-22T09:17:10.001788+0000","last_became_active":"2023-12-22T09:16:58.121132+0000","last_became_peered":"2023-12-22T09:16:58.121132+0000","last_unstale":"2023-12-22T09:17:10.001788+0000","last_undegraded":"2023-12-22T09:17:10.001788+0000","last_fullsized":"2023-12-22T09:17:10.001788+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.000887+0000","last_change":"2023-12-22T09:16:57.643365+0000","last_active":"2023-12-22T09:17:10.000887+0000","last_peered":"2023-12-22T09:17:10.000887+0000","last_clean":"2023-12-22T09:17:10.000887+0000","last_became_active":"2023-12-22T09:16:57.642191+0000","last_became_peered":"2023-12-22T09:16:57.642191+0000","last_unstale":"2023-12-22T09:17:10.000887+0000","last_undegraded":"2023-12-22T09:17:10.000887+0000","last_fullsized":"2023-12-22T09:17:10.000887+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:42.294395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520118+0000","last_change":"2023-12-22T09:17:12.533494+0000","last_active":"2023-12-22T09:17:13.520118+0000","last_peered":"2023-12-22T09:17:13.520118+0000","last_clean":"2023-12-22T09:17:13.520118+0000","last_became_active":"2023-12-22T09:17:12.532982+0000","last_became_peered":"2023-12-22T09:17:12.532982+0000","last_unstale":"2023-12-22T09:17:13.520118+0000","last_undegraded":"2023-12-22T09:17:13.520118+0000","last_fullsized":"2023-12-22T09:17:13.520118+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:31.400736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.006508+0000","last_change":"2023-12-22T09:17:11.006508+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.006508+0000","last_undegraded":"2023-12-22T09:17:11.006508+0000","last_fullsized":"2023-12-22T09:17:11.006508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:18.691505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033143+0000","last_change":"2023-12-22T09:16:58.139882+0000","last_active":"2023-12-22T09:17:10.033143+0000","last_peered":"2023-12-22T09:17:10.033143+0000","last_clean":"2023-12-22T09:17:10.033143+0000","last_became_active":"2023-12-22T09:16:58.139602+0000","last_became_peered":"2023-12-22T09:16:58.139602+0000","last_unstale":"2023-12-22T09:17:10.033143+0000","last_undegraded":"2023-12-22T09:17:10.033143+0000","last_fullsized":"2023-12-22T09:17:10.033143+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033447+0000","last_change":"2023-12-22T09:16:57.651581+0000","last_active":"2023-12-22T09:17:10.033447+0000","last_peered":"2023-12-22T09:17:10.033447+0000","last_clean":"2023-12-22T09:17:10.033447+0000","last_became_active":"2023-12-22T09:16:57.651050+0000","last_became_peered":"2023-12-22T09:16:57.651050+0000","last_unstale":"2023-12-22T09:17:10.033447+0000","last_undegraded":"2023-12-22T09:17:10.033447+0000","last_fullsized":"2023-12-22T09:17:10.033447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.007077+0000","last_change":"2023-12-22T09:17:11.007077+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.007077+0000","last_undegraded":"2023-12-22T09:17:11.007077+0000","last_fullsized":"2023-12-22T09:17:11.007077+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:24.280048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506960+0000","last_change":"2023-12-22T09:16:58.127943+0000","last_active":"2023-12-22T09:17:12.506960+0000","last_peered":"2023-12-22T09:17:12.506960+0000","last_clean":"2023-12-22T09:17:12.506960+0000","last_became_active":"2023-12-22T09:16:58.127679+0000","last_became_peered":"2023-12-22T09:16:58.127679+0000","last_unstale":"2023-12-22T09:17:12.506960+0000","last_undegraded":"2023-12-22T09:17:12.506960+0000","last_fullsized":"2023-12-22T09:17:12.506960+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:34.212746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.000775+0000","last_change":"2023-12-22T09:16:57.643620+0000","last_active":"2023-12-22T09:17:10.000775+0000","last_peered":"2023-12-22T09:17:10.000775+0000","last_clean":"2023-12-22T09:17:10.000775+0000","last_became_active":"2023-12-22T09:16:57.643322+0000","last_became_peered":"2023-12-22T09:16:57.643322+0000","last_unstale":"2023-12-22T09:17:10.000775+0000","last_undegraded":"2023-12-22T09:17:10.000775+0000","last_fullsized":"2023-12-22T09:17:10.000775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:13.807363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.017956+0000","last_change":"2023-12-22T09:17:11.017956+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.017956+0000","last_undegraded":"2023-12-22T09:17:11.017956+0000","last_fullsized":"2023-12-22T09:17:11.017956+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.002214+0000","last_change":"2023-12-22T09:16:58.147612+0000","last_active":"2023-12-22T09:17:10.002214+0000","last_peered":"2023-12-22T09:17:10.002214+0000","last_clean":"2023-12-22T09:17:10.002214+0000","last_became_active":"2023-12-22T09:16:58.147333+0000","last_became_peered":"2023-12-22T09:16:58.147333+0000","last_unstale":"2023-12-22T09:17:10.002214+0000","last_undegraded":"2023-12-22T09:17:10.002214+0000","last_fullsized":"2023-12-22T09:17:10.002214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:55.463677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":27,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.042027+0000","last_change":"2023-12-22T09:17:11.042027+0000","last_active":"2023-12-22T09:17:11.042027+0000","last_peered":"2023-12-22T09:17:11.042027+0000","last_clean":"2023-12-22T09:17:11.042027+0000","last_became_active":"2023-12-22T09:17:11.038601+0000","last_became_peered":"2023-12-22T09:17:11.038601+0000","last_unstale":"2023-12-22T09:17:11.042027+0000","last_undegraded":"2023-12-22T09:17:11.042027+0000","last_fullsized":"2023-12-22T09:17:11.042027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:48.928040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.017577+0000","last_change":"2023-12-22T09:17:11.017577+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.017577+0000","last_undegraded":"2023-12-22T09:17:11.017577+0000","last_fullsized":"2023-12-22T09:17:11.017577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:10:15.433618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037631+0000","last_change":"2023-12-22T09:16:58.122982+0000","last_active":"2023-12-22T09:17:10.037631+0000","last_peered":"2023-12-22T09:17:10.037631+0000","last_clean":"2023-12-22T09:17:10.037631+0000","last_became_active":"2023-12-22T09:16:58.122683+0000","last_became_peered":"2023-12-22T09:16:58.122683+0000","last_unstale":"2023-12-22T09:17:10.037631+0000","last_undegraded":"2023-12-22T09:17:10.037631+0000","last_fullsized":"2023-12-22T09:17:10.037631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:03:37.012223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033926+0000","last_change":"2023-12-22T09:16:57.652367+0000","last_active":"2023-12-22T09:17:10.033926+0000","last_peered":"2023-12-22T09:17:10.033926+0000","last_clean":"2023-12-22T09:17:10.033926+0000","last_became_active":"2023-12-22T09:16:57.651997+0000","last_became_peered":"2023-12-22T09:16:57.651997+0000","last_unstale":"2023-12-22T09:17:10.033926+0000","last_undegraded":"2023-12-22T09:17:10.033926+0000","last_fullsized":"2023-12-22T09:17:10.033926+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.023744+0000","last_change":"2023-12-22T09:17:11.023744+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.023744+0000","last_undegraded":"2023-12-22T09:17:11.023744+0000","last_fullsized":"2023-12-22T09:17:11.023744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:00.845862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033649+0000","last_change":"2023-12-22T09:16:58.134298+0000","last_active":"2023-12-22T09:17:10.033649+0000","last_peered":"2023-12-22T09:17:10.033649+0000","last_clean":"2023-12-22T09:17:10.033649+0000","last_became_active":"2023-12-22T09:16:58.134027+0000","last_became_peered":"2023-12-22T09:16:58.134027+0000","last_unstale":"2023-12-22T09:17:10.033649+0000","last_undegraded":"2023-12-22T09:17:10.033649+0000","last_fullsized":"2023-12-22T09:17:10.033649+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001315+0000","last_change":"2023-12-22T09:16:57.651565+0000","last_active":"2023-12-22T09:17:10.001315+0000","last_peered":"2023-12-22T09:17:10.001315+0000","last_clean":"2023-12-22T09:17:10.001315+0000","last_became_active":"2023-12-22T09:16:57.651295+0000","last_became_peered":"2023-12-22T09:16:57.651295+0000","last_unstale":"2023-12-22T09:17:10.001315+0000","last_undegraded":"2023-12-22T09:17:10.001315+0000","last_fullsized":"2023-12-22T09:17:10.001315+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:18.179171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516601+0000","last_change":"2023-12-22T09:17:12.523916+0000","last_active":"2023-12-22T09:17:13.516601+0000","last_peered":"2023-12-22T09:17:13.516601+0000","last_clean":"2023-12-22T09:17:13.516601+0000","last_became_active":"2023-12-22T09:17:12.519420+0000","last_became_peered":"2023-12-22T09:17:12.519420+0000","last_unstale":"2023-12-22T09:17:13.516601+0000","last_undegraded":"2023-12-22T09:17:13.516601+0000","last_fullsized":"2023-12-22T09:17:13.516601+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:27:28.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.031752+0000","last_change":"2023-12-22T09:17:11.031752+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.031752+0000","last_undegraded":"2023-12-22T09:17:11.031752+0000","last_fullsized":"2023-12-22T09:17:11.031752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:28:17.921536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509202+0000","last_change":"2023-12-22T09:16:58.142640+0000","last_active":"2023-12-22T09:17:12.509202+0000","last_peered":"2023-12-22T09:17:12.509202+0000","last_clean":"2023-12-22T09:17:12.509202+0000","last_became_active":"2023-12-22T09:16:58.142334+0000","last_became_peered":"2023-12-22T09:16:58.142334+0000","last_unstale":"2023-12-22T09:17:12.509202+0000","last_undegraded":"2023-12-22T09:17:12.509202+0000","last_fullsized":"2023-12-22T09:17:12.509202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:35:36.019628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.988250+0000","last_change":"2023-12-22T09:16:57.655954+0000","last_active":"2023-12-22T09:17:09.988250+0000","last_peered":"2023-12-22T09:17:09.988250+0000","last_clean":"2023-12-22T09:17:09.988250+0000","last_became_active":"2023-12-22T09:16:57.655335+0000","last_became_peered":"2023-12-22T09:16:57.655335+0000","last_unstale":"2023-12-22T09:17:09.988250+0000","last_undegraded":"2023-12-22T09:17:09.988250+0000","last_fullsized":"2023-12-22T09:17:09.988250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509527+0000","last_change":"2023-12-22T09:17:12.034651+0000","last_active":"2023-12-22T09:17:12.509527+0000","last_peered":"2023-12-22T09:17:12.509527+0000","last_clean":"2023-12-22T09:17:12.509527+0000","last_became_active":"2023-12-22T09:17:12.034345+0000","last_became_peered":"2023-12-22T09:17:12.034345+0000","last_unstale":"2023-12-22T09:17:12.509527+0000","last_undegraded":"2023-12-22T09:17:12.509527+0000","last_fullsized":"2023-12-22T09:17:12.509527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:57:00.962453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510462+0000","last_change":"2023-12-22T09:16:58.121917+0000","last_active":"2023-12-22T09:17:12.510462+0000","last_peered":"2023-12-22T09:17:12.510462+0000","last_clean":"2023-12-22T09:17:12.510462+0000","last_became_active":"2023-12-22T09:16:58.118511+0000","last_became_peered":"2023-12-22T09:16:58.118511+0000","last_unstale":"2023-12-22T09:17:12.510462+0000","last_undegraded":"2023-12-22T09:17:12.510462+0000","last_fullsized":"2023-12-22T09:17:12.510462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:33:40.126107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040397+0000","last_change":"2023-12-22T09:16:57.647202+0000","last_active":"2023-12-22T09:17:10.040397+0000","last_peered":"2023-12-22T09:17:10.040397+0000","last_clean":"2023-12-22T09:17:10.040397+0000","last_became_active":"2023-12-22T09:16:57.646930+0000","last_became_peered":"2023-12-22T09:16:57.646930+0000","last_unstale":"2023-12-22T09:17:10.040397+0000","last_undegraded":"2023-12-22T09:17:10.040397+0000","last_fullsized":"2023-12-22T09:17:10.040397+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:40.073052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.011644+0000","last_change":"2023-12-22T09:17:11.011644+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.011644+0000","last_undegraded":"2023-12-22T09:17:11.011644+0000","last_fullsized":"2023-12-22T09:17:11.011644+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:44.983134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991009+0000","last_change":"2023-12-22T09:16:58.139737+0000","last_active":"2023-12-22T09:17:09.991009+0000","last_peered":"2023-12-22T09:17:09.991009+0000","last_clean":"2023-12-22T09:17:09.991009+0000","last_became_active":"2023-12-22T09:16:58.139455+0000","last_became_peered":"2023-12-22T09:16:58.139455+0000","last_unstale":"2023-12-22T09:17:09.991009+0000","last_undegraded":"2023-12-22T09:17:09.991009+0000","last_fullsized":"2023-12-22T09:17:09.991009+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:21.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998540+0000","last_change":"2023-12-22T09:16:57.640845+0000","last_active":"2023-12-22T09:17:09.998540+0000","last_peered":"2023-12-22T09:17:09.998540+0000","last_clean":"2023-12-22T09:17:09.998540+0000","last_became_active":"2023-12-22T09:16:57.640523+0000","last_became_peered":"2023-12-22T09:16:57.640523+0000","last_unstale":"2023-12-22T09:17:09.998540+0000","last_undegraded":"2023-12-22T09:17:09.998540+0000","last_fullsized":"2023-12-22T09:17:09.998540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:11.216158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519019+0000","last_change":"2023-12-22T09:17:12.534422+0000","last_active":"2023-12-22T09:17:13.519019+0000","last_peered":"2023-12-22T09:17:13.519019+0000","last_clean":"2023-12-22T09:17:13.519019+0000","last_became_active":"2023-12-22T09:17:12.534170+0000","last_became_peered":"2023-12-22T09:17:12.534170+0000","last_unstale":"2023-12-22T09:17:13.519019+0000","last_undegraded":"2023-12-22T09:17:13.519019+0000","last_fullsized":"2023-12-22T09:17:13.519019+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:14:37.881358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506696+0000","last_change":"2023-12-22T09:17:12.041999+0000","last_active":"2023-12-22T09:17:12.506696+0000","last_peered":"2023-12-22T09:17:12.506696+0000","last_clean":"2023-12-22T09:17:12.506696+0000","last_became_active":"2023-12-22T09:17:12.041632+0000","last_became_peered":"2023-12-22T09:17:12.041632+0000","last_unstale":"2023-12-22T09:17:12.506696+0000","last_undegraded":"2023-12-22T09:17:12.506696+0000","last_fullsized":"2023-12-22T09:17:12.506696+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:24.728438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.988051+0000","last_change":"2023-12-22T09:16:58.136215+0000","last_active":"2023-12-22T09:17:09.988051+0000","last_peered":"2023-12-22T09:17:09.988051+0000","last_clean":"2023-12-22T09:17:09.988051+0000","last_became_active":"2023-12-22T09:16:58.135936+0000","last_became_peered":"2023-12-22T09:16:58.135936+0000","last_unstale":"2023-12-22T09:17:09.988051+0000","last_undegraded":"2023-12-22T09:17:09.988051+0000","last_fullsized":"2023-12-22T09:17:09.988051+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998273+0000","last_change":"2023-12-22T09:16:57.641987+0000","last_active":"2023-12-22T09:17:09.998273+0000","last_peered":"2023-12-22T09:17:09.998273+0000","last_clean":"2023-12-22T09:17:09.998273+0000","last_became_active":"2023-12-22T09:16:57.641712+0000","last_became_peered":"2023-12-22T09:16:57.641712+0000","last_unstale":"2023-12-22T09:17:09.998273+0000","last_undegraded":"2023-12-22T09:17:09.998273+0000","last_fullsized":"2023-12-22T09:17:09.998273+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:33.101510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519359+0000","last_change":"2023-12-22T09:17:12.537866+0000","last_active":"2023-12-22T09:17:13.519359+0000","last_peered":"2023-12-22T09:17:13.519359+0000","last_clean":"2023-12-22T09:17:13.519359+0000","last_became_active":"2023-12-22T09:17:12.537136+0000","last_became_peered":"2023-12-22T09:17:12.537136+0000","last_unstale":"2023-12-22T09:17:13.519359+0000","last_undegraded":"2023-12-22T09:17:13.519359+0000","last_fullsized":"2023-12-22T09:17:13.519359+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:14.639137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.017533+0000","last_change":"2023-12-22T09:17:11.017533+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.017533+0000","last_undegraded":"2023-12-22T09:17:11.017533+0000","last_fullsized":"2023-12-22T09:17:11.017533+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:15.941299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037566+0000","last_change":"2023-12-22T09:16:58.150323+0000","last_active":"2023-12-22T09:17:10.037566+0000","last_peered":"2023-12-22T09:17:10.037566+0000","last_clean":"2023-12-22T09:17:10.037566+0000","last_became_active":"2023-12-22T09:16:58.150063+0000","last_became_peered":"2023-12-22T09:16:58.150063+0000","last_unstale":"2023-12-22T09:17:10.037566+0000","last_undegraded":"2023-12-22T09:17:10.037566+0000","last_fullsized":"2023-12-22T09:17:10.037566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:25.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987349+0000","last_change":"2023-12-22T09:16:57.643219+0000","last_active":"2023-12-22T09:17:09.987349+0000","last_peered":"2023-12-22T09:17:09.987349+0000","last_clean":"2023-12-22T09:17:09.987349+0000","last_became_active":"2023-12-22T09:16:57.642986+0000","last_became_peered":"2023-12-22T09:16:57.642986+0000","last_unstale":"2023-12-22T09:17:09.987349+0000","last_undegraded":"2023-12-22T09:17:09.987349+0000","last_fullsized":"2023-12-22T09:17:09.987349+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.007014+0000","last_change":"2023-12-22T09:17:11.007014+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.007014+0000","last_undegraded":"2023-12-22T09:17:11.007014+0000","last_fullsized":"2023-12-22T09:17:11.007014+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:33:46.996428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507919+0000","last_change":"2023-12-22T09:16:58.125951+0000","last_active":"2023-12-22T09:17:12.507919+0000","last_peered":"2023-12-22T09:17:12.507919+0000","last_clean":"2023-12-22T09:17:12.507919+0000","last_became_active":"2023-12-22T09:16:58.125435+0000","last_became_peered":"2023-12-22T09:16:58.125435+0000","last_unstale":"2023-12-22T09:17:12.507919+0000","last_undegraded":"2023-12-22T09:17:12.507919+0000","last_fullsized":"2023-12-22T09:17:12.507919+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:30:10.376413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998060+0000","last_change":"2023-12-22T09:16:57.639438+0000","last_active":"2023-12-22T09:17:09.998060+0000","last_peered":"2023-12-22T09:17:09.998060+0000","last_clean":"2023-12-22T09:17:09.998060+0000","last_became_active":"2023-12-22T09:16:57.639148+0000","last_became_peered":"2023-12-22T09:16:57.639148+0000","last_unstale":"2023-12-22T09:17:09.998060+0000","last_undegraded":"2023-12-22T09:17:09.998060+0000","last_fullsized":"2023-12-22T09:17:09.998060+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:36.593161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039687+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:17:10.039687+0000","last_peered":"2023-12-22T09:17:10.039687+0000","last_clean":"2023-12-22T09:17:10.039687+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:17:10.039687+0000","last_undegraded":"2023-12-22T09:17:10.039687+0000","last_fullsized":"2023-12-22T09:17:10.039687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3857,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1343488,"data_stored":926207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.173,"15min":1.1870000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1060000000000001,"15min":1.129},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.409,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1910000000000001,"15min":1.1990000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.2769999999999999,"15min":1.3220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.339,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1539999999999999,"15min":1.1739999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.3799999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":0.94499999999999995}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.24,"15min":1.256},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.427,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3600000000000001,"15min":1.3720000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.268,"15min":1.2809999999999999},"min":{"1min":0.81399999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":1.038,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.6319999999999999,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.458,"15min":1.427},"min":{"1min":0.91400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":8.1620000000000008,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.476,"15min":1.504},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.6220000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.5649999999999999,"15min":1.5740000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.393,"5min":1.554,"15min":1.581},"min":{"1min":1.127,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.655,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.57799999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":359889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.1100000000000001,"15min":1.1319999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.085,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4810000000000001,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":1.111}]},{"osd":1,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.978,"15min":1.978},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5189999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.661,"5min":1.915,"15min":1.915},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.268,"15min":1.282},"min":{"1min":0.74099999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.194}]},{"osd":3,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4950000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3580000000000001,"15min":1.3740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.736,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.29}]},{"osd":4,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.494,"15min":1.52},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.5549999999999999,"15min":1.585},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.722,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.5329999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.5760000000000001,"15min":1.6060000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.74,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.732},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.671,"15min":1.6970000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.952,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.583}]},{"osd":7,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.6379999999999999,"15min":1.6619999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.859,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.6240000000000001,"15min":1.637},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":2.0459999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3380000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":335085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":0.97099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3240000000000001,"5min":1.677,"15min":1.677},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4650000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0129999999999999}]},{"osd":1,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.107,"15min":1.1180000000000001},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.48,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.24,"15min":1.26},"min":{"1min":0.73499999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.802,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.3500000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5449999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.502},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.159,"15min":1.169},"min":{"1min":0.748,"5min":0.629,"15min":0.629},"max":{"1min":1.4419999999999999,"5min":1.762,"15min":1.762},"last":1.1619999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.256,"15min":1.264},"min":{"1min":0.88,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5640000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.284,"15min":1.306},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8089999999999999,"5min":2.431,"15min":2.431},"last":1.627}]},{"osd":4,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.304,"15min":1.3120000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5629999999999999,"5min":1.889,"15min":1.889},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4870000000000001,"15min":1.5},"min":{"1min":0.874,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.996}]},{"osd":6,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4099999999999999,"15min":1.4299999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.982,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4179999999999999,"15min":1.4359999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7889999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.77}]},{"osd":7,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.464,"15min":1.48},"min":{"1min":0.97499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.8540000000000001,"5min":3.298,"15min":3.298},"last":1.9259999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.504,"15min":1.5249999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.0899999999999999,"5min":2.589,"15min":2.589},"last":1.867}]}]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":338122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3320000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.115,"15min":1.121},"min":{"1min":0.70399999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5409999999999999,"5min":2.25,"15min":2.25},"last":1.23}]},{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.113,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.345,"5min":1.782,"15min":1.782},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.425,"5min":1.494,"15min":1.494},"last":1.0920000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4890000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.446},{"interface":"front","average":{"1min":1.147,"5min":1.2130000000000001,"15min":1.224},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7749999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.97499999999999998}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.1319999999999999,"15min":1.149},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.542,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.2929999999999999,"15min":1.3149999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.4690000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1579999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3320000000000001,"15min":1.3520000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.909,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.268,"15min":1.286},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.679,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.419}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4950000000000001,"5min":2.052,"15min":2.052},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.5069999999999999,"15min":1.5329999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.373}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.4079999999999999,"15min":1.4350000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7470000000000001,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.198},{"interface":"front","average":{"1min":1.339,"5min":1.512,"15min":1.5409999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.629,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.5309999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":733184,"data_stored":335063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88500000000000001,"15min":0.89700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.627,"5min":1.716,"15min":1.716},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4430000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.503},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.65500000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.093,"15min":1.105},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1719999999999999,"15min":1.1899999999999999},"min":{"1min":0.66700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4019999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.244,"15min":1.25},"min":{"1min":0.90900000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.722,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.92200000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.571,"5min":2.508,"15min":2.508},"last":0.84499999999999997}]},{"osd":5,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":2.0030000000000001,"15min":2.1219999999999999},"min":{"1min":0.86299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6519999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.258,"5min":2.254,"15min":2.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.6739999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":2.423,"15min":2.6219999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.752,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.056},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.1970000000000001,"15min":2.339},"min":{"1min":0.98999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.722,"5min":27.181999999999999,"15min":27.181999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2,"15min":2.121},"min":{"1min":1.016,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5069999999999999,"5min":22.715,"15min":22.715},"last":1.071},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.3860000000000001,"15min":2.5619999999999998},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.643,"5min":30.108000000000001,"15min":30.108000000000001},"last":0.81599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":335063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.85599999999999998,"15min":0.88},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.395,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.097},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.95699999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.381,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":1.0069999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.357,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.98899999999999999,"15min":1.002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5489999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0049999999999999,"15min":1.016},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5289999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.173,"15min":1.1910000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6279999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.94599999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.377,"15min":1.4179999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6160000000000001,"5min":2.802,"15min":2.802},"last":1.256},{"interface":"front","average":{"1min":1.276,"5min":1.4139999999999999,"15min":1.4370000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.758,"5min":2.46,"15min":2.46},"last":1.1379999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2889999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.595,"5min":3.327,"15min":3.327},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.371,"15min":1.399},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":1.2010000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4279999999999999,"15min":1.452},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9950000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.228},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.369,"15min":1.3999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.554,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":1.5629999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.4870000000000001,"15min":1.516},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.823,"5min":2.867,"15min":2.867},"last":1.302},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4670000000000001,"15min":1.4950000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.724,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":1.609}]}]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":761856,"data_stored":338886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.879,"15min":0.90700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.262,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.083},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3260000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.90600000000000003,"15min":0.92800000000000005},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.218,"5min":1.504,"15min":1.504},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.103,"15min":1.143},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.282,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.224}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.0409999999999999,"15min":1.0700000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.54,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.266,"15min":1.3069999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4430000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.3460000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.68799999999999994,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4330000000000001,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.3129999999999999,"15min":1.3500000000000001},"min":{"1min":0.77200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6599999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.177}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.4019999999999999,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.1720000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.534,"15min":1.5880000000000001},"min":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.649,"5min":4.524,"15min":4.524},"last":1.7909999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.5349999999999999,"15min":1.581},"min":{"1min":0.80900000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.9139999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3879999999999999,"15min":1.4139999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.881,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.1339999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.474,"15min":1.5089999999999999},"min":{"1min":0.79800000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.29,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.421},{"interface":"front","average":{"1min":1.319,"5min":1.52,"15min":1.554},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.766,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":1.8600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1327104,"data_stored":925431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.89600000000000002}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.0229999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2689999999999999,"5min":1.548,"15min":1.548},"last":1.3380000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.98099999999999998,"15min":1.0129999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.242,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.216}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.1930000000000001,"15min":1.238},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6120000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.0900000000000001,"15min":1.1319999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3939999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1799999999999999,"15min":1.1990000000000001},"min":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.601,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.357,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":3.589,"15min":3.589},"last":1.24}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5920000000000001,"5min":1.748,"15min":1.748},"last":1.133},{"interface":"front","average":{"1min":1.167,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.72599999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.49,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.0700000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.268,"15min":1.282},"min":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.611,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.3069999999999999,"15min":1.333},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.96199999999999997}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.365,"15min":1.3879999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8109999999999999,"5min":2.157,"15min":2.157},"last":1.377},{"interface":"front","average":{"1min":1.22,"5min":1.419,"15min":1.452},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6439999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.304}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:17:17.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:17:17.565 INFO:tasks.ceph.mds.a.smithi106.stderr:2023-12-22T09:17:17.564+0000 7fc2a8a75640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T09:17:17.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.699+0000 7fdb6ac17640 1 Processor -- start 2023-12-22T09:17:17.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.699+0000 7fdb6ac17640 1 -- start start 2023-12-22T09:17:17.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.701+0000 7fdb6ac17640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb64069e60 0x7fdb6414a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.701+0000 7fdb6ac17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb6414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.701+0000 7fdb6ac17640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb640bfce0 con 0x7fdb64071ea0 2023-12-22T09:17:17.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.701+0000 7fdb6ac17640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb640c0960 con 0x7fdb64069e60 2023-12-22T09:17:17.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.701+0000 7fdb6ac17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6406aba0 con 0x7fdb64150a80 2023-12-22T09:17:17.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.702+0000 7fdb689b3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb64069e60 0x7fdb6414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:17.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.702+0000 7fdb63fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb6414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:17.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.702+0000 7fdb689b3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb64069e60 0x7fdb6414a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.106:44526/0 (socket says 172.21.15.106:44526) 2023-12-22T09:17:17.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.702+0000 7fdb689b3640 1 -- 172.21.15.106:0/4148857542 learned_addr learned my addr 172.21.15.106:0/4148857542 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:17.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.702+0000 7fdb689b3640 1 -- 172.21.15.106:0/4148857542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 msgr2=0x7fdb6414abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:17.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.702+0000 7fdb689b3640 1 --2- 172.21.15.106:0/4148857542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb6414abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.702+0000 7fdb689b3640 1 -- 172.21.15.106:0/4148857542 >> v1:172.21.15.132:6789/0 conn(0x7fdb64071ea0 legacy=0x7fdb64151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.702+0000 7fdb689b3640 1 -- 172.21.15.106:0/4148857542 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640bffc0 con 0x7fdb64069e60 2023-12-22T09:17:17.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.702+0000 7fdb63fff640 1 --2- 172.21.15.106:0/4148857542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb6414abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T09:17:17.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.704+0000 7fdb689b3640 1 --2- 172.21.15.106:0/4148857542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb64069e60 0x7fdb6414a670 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009880 tx=0x7fdb5802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8252de0a13959e1d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:17.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.704+0000 7fdb637fe640 1 -- 172.21.15.106:0/4148857542 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5802e070 con 0x7fdb64069e60 2023-12-22T09:17:17.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.704+0000 7fdb637fe640 1 -- 172.21.15.106:0/4148857542 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb58004030 con 0x7fdb64069e60 2023-12-22T09:17:17.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.704+0000 7fdb637fe640 1 -- 172.21.15.106:0/4148857542 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58004420 con 0x7fdb64069e60 2023-12-22T09:17:17.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.705+0000 7fdb6ac17640 1 -- 172.21.15.106:0/4148857542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb64069e60 msgr2=0x7fdb6414a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.705+0000 7fdb6ac17640 1 --2- 172.21.15.106:0/4148857542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb64069e60 0x7fdb6414a670 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009880 tx=0x7fdb5802b840 comp rx=0 tx=0).stop 2023-12-22T09:17:17.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.705+0000 7fdb6ac17640 1 -- 172.21.15.106:0/4148857542 shutdown_connections 2023-12-22T09:17:17.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.705+0000 7fdb6ac17640 1 --2- 172.21.15.106:0/4148857542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb6414abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.705+0000 7fdb6ac17640 1 --2- 172.21.15.106:0/4148857542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb64069e60 0x7fdb6414a670 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.705+0000 7fdb6ac17640 1 -- 172.21.15.106:0/4148857542 >> 172.21.15.106:0/4148857542 conn(0x7fdb640c5360 msgr2=0x7fdb640c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:17.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.705+0000 7fdb6ac17640 1 -- 172.21.15.106:0/4148857542 shutdown_connections 2023-12-22T09:17:17.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.705+0000 7fdb6ac17640 1 -- 172.21.15.106:0/4148857542 wait complete. 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.707+0000 7fdb6ac17640 1 Processor -- start 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.707+0000 7fdb6ac17640 1 -- start start 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.708+0000 7fdb6ac17640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb64069e60 0x7fdb64149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.708+0000 7fdb6ac17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb64071ea0 0x7fdb641e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.708+0000 7fdb6ac17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb641e9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.708+0000 7fdb6ac17640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb641eaf50 con 0x7fdb64069e60 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.708+0000 7fdb6ac17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb641e7660 con 0x7fdb64071ea0 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.708+0000 7fdb6ac17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64147960 con 0x7fdb64150a80 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.708+0000 7fdb689b3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb64069e60 0x7fdb64149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.708+0000 7fdb689b3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb64069e60 0x7fdb64149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40436/0 (socket says 172.21.15.106:40436) 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.708+0000 7fdb689b3640 1 -- 172.21.15.106:0/1544816041 learned_addr learned my addr 172.21.15.106:0/1544816041 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:17.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb691b4640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb641e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb63fff640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb64071ea0 0x7fdb641e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb689b3640 1 -- 172.21.15.106:0/1544816041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 msgr2=0x7fdb641e9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb689b3640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb641e9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb689b3640 1 -- 172.21.15.106:0/1544816041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb64071ea0 msgr2=0x7fdb641e8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb689b3640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb64071ea0 0x7fdb641e8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb689b3640 1 -- 172.21.15.106:0/1544816041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009400 con 0x7fdb64069e60 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb691b4640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb641e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb689b3640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb64069e60 0x7fdb64149a00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdb580099a0 tx=0x7fdb580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb617fa640 1 -- 172.21.15.106:0/1544816041 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58003960 con 0x7fdb64069e60 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb617fa640 1 -- 172.21.15.106:0/1544816041 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb58003ae0 con 0x7fdb64069e60 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb617fa640 1 -- 172.21.15.106:0/1544816041 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58003e90 con 0x7fdb64069e60 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.709+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58009460 con 0x7fdb64069e60 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.710+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb641eac70 con 0x7fdb64069e60 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.711+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb64073f10 con 0x7fdb64069e60 2023-12-22T09:17:17.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.712+0000 7fdb617fa640 1 -- 172.21.15.106:0/1544816041 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb58039070 con 0x7fdb64069e60 2023-12-22T09:17:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.713+0000 7fdb617fa640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb4806a430 0x7fdb4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.713+0000 7fdb617fa640 1 -- 172.21.15.106:0/1544816041 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fdb580aa4a0 con 0x7fdb64069e60 2023-12-22T09:17:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.713+0000 7fdb63fff640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb4806a430 0x7fdb4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:17.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.714+0000 7fdb63fff640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb4806a430 0x7fdb4806c8f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb641e54a0 tx=0x7fdb50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:17.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.717+0000 7fdb617fa640 1 -- 172.21.15.106:0/1544816041 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdb58075570 con 0x7fdb64069e60 2023-12-22T09:17:17.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.906+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb640c02a0 con 0x7fdb4806a430 2023-12-22T09:17:17.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.943+0000 7fdb617fa640 1 -- 172.21.15.106:0/1544816041 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+516381 (secure 0 0 0) 0x7fdb50010900 con 0x7fdb4806a430 2023-12-22T09:17:17.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:17.955 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb4806a430 msgr2=0x7fdb4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb4806a430 0x7fdb4806c8f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb641e54a0 tx=0x7fdb50008040 comp rx=0 tx=0).stop 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb64069e60 msgr2=0x7fdb64149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb64069e60 0x7fdb64149a00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdb580099a0 tx=0x7fdb580046c0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 shutdown_connections 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fdb4806a430 0x7fdb4806c8f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb64150a80 0x7fdb641e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb64071ea0 0x7fdb641e8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 --2- 172.21.15.106:0/1544816041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb64069e60 0x7fdb64149a00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.950+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 >> 172.21.15.106:0/1544816041 conn(0x7fdb640c5360 msgr2=0x7fdb6414a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:17.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.951+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 shutdown_connections 2023-12-22T09:17:17.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:17.951+0000 7fdb6ac17640 1 -- 172.21.15.106:0/1544816041 wait complete. 2023-12-22T09:17:17.971 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-12-22T09:17:16.751885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595789,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":276,"acting":276,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234904,"kb_used_data":7000,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754739816,"statfs":{"total":773094113280,"available":772853571584,"internally_reserved":0,"allocated":7168000,"data_stored":3893746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2805,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.753534"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516357+0000","last_change":"2023-12-22T09:17:12.540063+0000","last_active":"2023-12-22T09:17:13.516357+0000","last_peered":"2023-12-22T09:17:13.516357+0000","last_clean":"2023-12-22T09:17:13.516357+0000","last_became_active":"2023-12-22T09:17:12.538574+0000","last_became_peered":"2023-12-22T09:17:12.538574+0000","last_unstale":"2023-12-22T09:17:13.516357+0000","last_undegraded":"2023-12-22T09:17:13.516357+0000","last_fullsized":"2023-12-22T09:17:13.516357+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:47.737577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987813+0000","last_change":"2023-12-22T09:16:58.138391+0000","last_active":"2023-12-22T09:17:09.987813+0000","last_peered":"2023-12-22T09:17:09.987813+0000","last_clean":"2023-12-22T09:17:09.987813+0000","last_became_active":"2023-12-22T09:16:58.138138+0000","last_became_peered":"2023-12-22T09:16:58.138138+0000","last_unstale":"2023-12-22T09:17:09.987813+0000","last_undegraded":"2023-12-22T09:17:09.987813+0000","last_fullsized":"2023-12-22T09:17:09.987813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987928+0000","last_change":"2023-12-22T09:16:58.122537+0000","last_active":"2023-12-22T09:17:09.987928+0000","last_peered":"2023-12-22T09:17:09.987928+0000","last_clean":"2023-12-22T09:17:09.987928+0000","last_became_active":"2023-12-22T09:16:58.122285+0000","last_became_peered":"2023-12-22T09:16:58.122285+0000","last_unstale":"2023-12-22T09:17:09.987928+0000","last_undegraded":"2023-12-22T09:17:09.987928+0000","last_fullsized":"2023-12-22T09:17:09.987928+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040549+0000","last_change":"2023-12-22T09:16:58.155070+0000","last_active":"2023-12-22T09:17:10.040549+0000","last_peered":"2023-12-22T09:17:10.040549+0000","last_clean":"2023-12-22T09:17:10.040549+0000","last_became_active":"2023-12-22T09:16:58.154786+0000","last_became_peered":"2023-12-22T09:16:58.154786+0000","last_unstale":"2023-12-22T09:17:10.040549+0000","last_undegraded":"2023-12-22T09:17:10.040549+0000","last_fullsized":"2023-12-22T09:17:10.040549+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.038550+0000","last_change":"2023-12-22T09:17:11.034865+0000","last_active":"2023-12-22T09:17:11.038550+0000","last_peered":"2023-12-22T09:17:11.038550+0000","last_clean":"2023-12-22T09:17:11.038550+0000","last_became_active":"2023-12-22T09:17:11.034194+0000","last_became_peered":"2023-12-22T09:17:11.034194+0000","last_unstale":"2023-12-22T09:17:11.038550+0000","last_undegraded":"2023-12-22T09:17:11.038550+0000","last_fullsized":"2023-12-22T09:17:11.038550+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:09:17.505510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507609+0000","last_change":"2023-12-22T09:16:58.143885+0000","last_active":"2023-12-22T09:17:12.507609+0000","last_peered":"2023-12-22T09:17:12.507609+0000","last_clean":"2023-12-22T09:17:12.507609+0000","last_became_active":"2023-12-22T09:16:58.143627+0000","last_became_peered":"2023-12-22T09:16:58.143627+0000","last_unstale":"2023-12-22T09:17:12.507609+0000","last_undegraded":"2023-12-22T09:17:12.507609+0000","last_fullsized":"2023-12-22T09:17:12.507609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:50:47.328724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001302+0000","last_change":"2023-12-22T09:16:58.140402+0000","last_active":"2023-12-22T09:17:10.001302+0000","last_peered":"2023-12-22T09:17:10.001302+0000","last_clean":"2023-12-22T09:17:10.001302+0000","last_became_active":"2023-12-22T09:16:58.140117+0000","last_became_peered":"2023-12-22T09:16:58.140117+0000","last_unstale":"2023-12-22T09:17:10.001302+0000","last_undegraded":"2023-12-22T09:17:10.001302+0000","last_fullsized":"2023-12-22T09:17:10.001302+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:25:20.515272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037504+0000","last_change":"2023-12-22T09:16:58.138038+0000","last_active":"2023-12-22T09:17:10.037504+0000","last_peered":"2023-12-22T09:17:10.037504+0000","last_clean":"2023-12-22T09:17:10.037504+0000","last_became_active":"2023-12-22T09:16:58.137394+0000","last_became_peered":"2023-12-22T09:16:58.137394+0000","last_unstale":"2023-12-22T09:17:10.037504+0000","last_undegraded":"2023-12-22T09:17:10.037504+0000","last_fullsized":"2023-12-22T09:17:10.037504+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:53.435793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.032949+0000","last_change":"2023-12-22T09:16:58.139475+0000","last_active":"2023-12-22T09:17:10.032949+0000","last_peered":"2023-12-22T09:17:10.032949+0000","last_clean":"2023-12-22T09:17:10.032949+0000","last_became_active":"2023-12-22T09:16:58.139166+0000","last_became_peered":"2023-12-22T09:16:58.139166+0000","last_unstale":"2023-12-22T09:17:10.032949+0000","last_undegraded":"2023-12-22T09:17:10.032949+0000","last_fullsized":"2023-12-22T09:17:10.032949+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041199+0000","last_change":"2023-12-22T09:16:58.153587+0000","last_active":"2023-12-22T09:17:10.041199+0000","last_peered":"2023-12-22T09:17:10.041199+0000","last_clean":"2023-12-22T09:17:10.041199+0000","last_became_active":"2023-12-22T09:16:58.153215+0000","last_became_peered":"2023-12-22T09:16:58.153215+0000","last_unstale":"2023-12-22T09:17:10.041199+0000","last_undegraded":"2023-12-22T09:17:10.041199+0000","last_fullsized":"2023-12-22T09:17:10.041199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041616+0000","last_change":"2023-12-22T09:16:58.146315+0000","last_active":"2023-12-22T09:17:10.041616+0000","last_peered":"2023-12-22T09:17:10.041616+0000","last_clean":"2023-12-22T09:17:10.041616+0000","last_became_active":"2023-12-22T09:16:58.143702+0000","last_became_peered":"2023-12-22T09:16:58.143702+0000","last_unstale":"2023-12-22T09:17:10.041616+0000","last_undegraded":"2023-12-22T09:17:10.041616+0000","last_fullsized":"2023-12-22T09:17:10.041616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991685+0000","last_change":"2023-12-22T09:16:58.144346+0000","last_active":"2023-12-22T09:17:09.991685+0000","last_peered":"2023-12-22T09:17:09.991685+0000","last_clean":"2023-12-22T09:17:09.991685+0000","last_became_active":"2023-12-22T09:16:58.144068+0000","last_became_peered":"2023-12-22T09:16:58.144068+0000","last_unstale":"2023-12-22T09:17:09.991685+0000","last_undegraded":"2023-12-22T09:17:09.991685+0000","last_fullsized":"2023-12-22T09:17:09.991685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.035380+0000","last_change":"2023-12-22T09:17:11.035380+0000","last_active":"2023-12-22T09:17:11.035380+0000","last_peered":"2023-12-22T09:17:11.035380+0000","last_clean":"2023-12-22T09:17:11.035380+0000","last_became_active":"2023-12-22T09:17:11.035022+0000","last_became_peered":"2023-12-22T09:17:11.035022+0000","last_unstale":"2023-12-22T09:17:11.035380+0000","last_undegraded":"2023-12-22T09:17:11.035380+0000","last_fullsized":"2023-12-22T09:17:11.035380+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:30.877521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033317+0000","last_change":"2023-12-22T09:16:58.149202+0000","last_active":"2023-12-22T09:17:10.033317+0000","last_peered":"2023-12-22T09:17:10.033317+0000","last_clean":"2023-12-22T09:17:10.033317+0000","last_became_active":"2023-12-22T09:16:58.148243+0000","last_became_peered":"2023-12-22T09:16:58.148243+0000","last_unstale":"2023-12-22T09:17:10.033317+0000","last_undegraded":"2023-12-22T09:17:10.033317+0000","last_fullsized":"2023-12-22T09:17:10.033317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040061+0000","last_change":"2023-12-22T09:16:58.156229+0000","last_active":"2023-12-22T09:17:10.040061+0000","last_peered":"2023-12-22T09:17:10.040061+0000","last_clean":"2023-12-22T09:17:10.040061+0000","last_became_active":"2023-12-22T09:16:58.154667+0000","last_became_peered":"2023-12-22T09:16:58.154667+0000","last_unstale":"2023-12-22T09:17:10.040061+0000","last_undegraded":"2023-12-22T09:17:10.040061+0000","last_fullsized":"2023-12-22T09:17:10.040061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039631+0000","last_change":"2023-12-22T09:16:58.144597+0000","last_active":"2023-12-22T09:17:10.039631+0000","last_peered":"2023-12-22T09:17:10.039631+0000","last_clean":"2023-12-22T09:17:10.039631+0000","last_became_active":"2023-12-22T09:16:58.144358+0000","last_became_peered":"2023-12-22T09:16:58.144358+0000","last_unstale":"2023-12-22T09:17:10.039631+0000","last_undegraded":"2023-12-22T09:17:10.039631+0000","last_fullsized":"2023-12-22T09:17:10.039631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037564+0000","last_change":"2023-12-22T09:16:58.139134+0000","last_active":"2023-12-22T09:17:10.037564+0000","last_peered":"2023-12-22T09:17:10.037564+0000","last_clean":"2023-12-22T09:17:10.037564+0000","last_became_active":"2023-12-22T09:16:58.138883+0000","last_became_peered":"2023-12-22T09:16:58.138883+0000","last_unstale":"2023-12-22T09:17:10.037564+0000","last_undegraded":"2023-12-22T09:17:10.037564+0000","last_fullsized":"2023-12-22T09:17:10.037564+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.662952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987920+0000","last_change":"2023-12-22T09:16:58.139935+0000","last_active":"2023-12-22T09:17:09.987920+0000","last_peered":"2023-12-22T09:17:09.987920+0000","last_clean":"2023-12-22T09:17:09.987920+0000","last_became_active":"2023-12-22T09:16:58.139665+0000","last_became_peered":"2023-12-22T09:16:58.139665+0000","last_unstale":"2023-12-22T09:17:09.987920+0000","last_undegraded":"2023-12-22T09:17:09.987920+0000","last_fullsized":"2023-12-22T09:17:09.987920+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991829+0000","last_change":"2023-12-22T09:16:58.135060+0000","last_active":"2023-12-22T09:17:09.991829+0000","last_peered":"2023-12-22T09:17:09.991829+0000","last_clean":"2023-12-22T09:17:09.991829+0000","last_became_active":"2023-12-22T09:16:58.134796+0000","last_became_peered":"2023-12-22T09:16:58.134796+0000","last_unstale":"2023-12-22T09:17:09.991829+0000","last_undegraded":"2023-12-22T09:17:09.991829+0000","last_fullsized":"2023-12-22T09:17:09.991829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:56:40.950128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514119+0000","last_change":"2023-12-22T09:16:58.133014+0000","last_active":"2023-12-22T09:17:12.514119+0000","last_peered":"2023-12-22T09:17:12.514119+0000","last_clean":"2023-12-22T09:17:12.514119+0000","last_became_active":"2023-12-22T09:16:58.132669+0000","last_became_peered":"2023-12-22T09:16:58.132669+0000","last_unstale":"2023-12-22T09:17:12.514119+0000","last_undegraded":"2023-12-22T09:17:12.514119+0000","last_fullsized":"2023-12-22T09:17:12.514119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:59:55.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998957+0000","last_change":"2023-12-22T09:16:58.139698+0000","last_active":"2023-12-22T09:17:09.998957+0000","last_peered":"2023-12-22T09:17:09.998957+0000","last_clean":"2023-12-22T09:17:09.998957+0000","last_became_active":"2023-12-22T09:16:58.139450+0000","last_became_peered":"2023-12-22T09:16:58.139450+0000","last_unstale":"2023-12-22T09:17:09.998957+0000","last_undegraded":"2023-12-22T09:17:09.998957+0000","last_fullsized":"2023-12-22T09:17:09.998957+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:40.452271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033355+0000","last_change":"2023-12-22T09:16:58.138002+0000","last_active":"2023-12-22T09:17:10.033355+0000","last_peered":"2023-12-22T09:17:10.033355+0000","last_clean":"2023-12-22T09:17:10.033355+0000","last_became_active":"2023-12-22T09:16:58.137587+0000","last_became_peered":"2023-12-22T09:16:58.137587+0000","last_unstale":"2023-12-22T09:17:10.033355+0000","last_undegraded":"2023-12-22T09:17:10.033355+0000","last_fullsized":"2023-12-22T09:17:10.033355+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998044+0000","last_change":"2023-12-22T09:16:58.143017+0000","last_active":"2023-12-22T09:17:09.998044+0000","last_peered":"2023-12-22T09:17:09.998044+0000","last_clean":"2023-12-22T09:17:09.998044+0000","last_became_active":"2023-12-22T09:16:58.142609+0000","last_became_peered":"2023-12-22T09:16:58.142609+0000","last_unstale":"2023-12-22T09:17:09.998044+0000","last_undegraded":"2023-12-22T09:17:09.998044+0000","last_fullsized":"2023-12-22T09:17:09.998044+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:22.037240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998160+0000","last_change":"2023-12-22T09:16:58.137672+0000","last_active":"2023-12-22T09:17:09.998160+0000","last_peered":"2023-12-22T09:17:09.998160+0000","last_clean":"2023-12-22T09:17:09.998160+0000","last_became_active":"2023-12-22T09:16:58.137418+0000","last_became_peered":"2023-12-22T09:16:58.137418+0000","last_unstale":"2023-12-22T09:17:09.998160+0000","last_undegraded":"2023-12-22T09:17:09.998160+0000","last_fullsized":"2023-12-22T09:17:09.998160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:11.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039381+0000","last_change":"2023-12-22T09:16:58.151378+0000","last_active":"2023-12-22T09:17:10.039381+0000","last_peered":"2023-12-22T09:17:10.039381+0000","last_clean":"2023-12-22T09:17:10.039381+0000","last_became_active":"2023-12-22T09:16:58.148696+0000","last_became_peered":"2023-12-22T09:16:58.148696+0000","last_unstale":"2023-12-22T09:17:10.039381+0000","last_undegraded":"2023-12-22T09:17:10.039381+0000","last_fullsized":"2023-12-22T09:17:10.039381+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033782+0000","last_change":"2023-12-22T09:16:58.134012+0000","last_active":"2023-12-22T09:17:10.033782+0000","last_peered":"2023-12-22T09:17:10.033782+0000","last_clean":"2023-12-22T09:17:10.033782+0000","last_became_active":"2023-12-22T09:16:58.133668+0000","last_became_peered":"2023-12-22T09:16:58.133668+0000","last_unstale":"2023-12-22T09:17:10.033782+0000","last_undegraded":"2023-12-22T09:17:10.033782+0000","last_fullsized":"2023-12-22T09:17:10.033782+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:57:16.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033615+0000","last_change":"2023-12-22T09:16:58.138808+0000","last_active":"2023-12-22T09:17:10.033615+0000","last_peered":"2023-12-22T09:17:10.033615+0000","last_clean":"2023-12-22T09:17:10.033615+0000","last_became_active":"2023-12-22T09:16:58.138287+0000","last_became_peered":"2023-12-22T09:16:58.138287+0000","last_unstale":"2023-12-22T09:17:10.033615+0000","last_undegraded":"2023-12-22T09:17:10.033615+0000","last_fullsized":"2023-12-22T09:17:10.033615+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:36.638731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991852+0000","last_change":"2023-12-22T09:16:58.148258+0000","last_active":"2023-12-22T09:17:09.991852+0000","last_peered":"2023-12-22T09:17:09.991852+0000","last_clean":"2023-12-22T09:17:09.991852+0000","last_became_active":"2023-12-22T09:16:58.148003+0000","last_became_peered":"2023-12-22T09:16:58.148003+0000","last_unstale":"2023-12-22T09:17:09.991852+0000","last_undegraded":"2023-12-22T09:17:09.991852+0000","last_fullsized":"2023-12-22T09:17:09.991852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:42.621461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987618+0000","last_change":"2023-12-22T09:16:58.133892+0000","last_active":"2023-12-22T09:17:09.987618+0000","last_peered":"2023-12-22T09:17:09.987618+0000","last_clean":"2023-12-22T09:17:09.987618+0000","last_became_active":"2023-12-22T09:16:58.133436+0000","last_became_peered":"2023-12-22T09:16:58.133436+0000","last_unstale":"2023-12-22T09:17:09.987618+0000","last_undegraded":"2023-12-22T09:17:09.987618+0000","last_fullsized":"2023-12-22T09:17:09.987618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039949+0000","last_change":"2023-12-22T09:16:58.149316+0000","last_active":"2023-12-22T09:17:10.039949+0000","last_peered":"2023-12-22T09:17:10.039949+0000","last_clean":"2023-12-22T09:17:10.039949+0000","last_became_active":"2023-12-22T09:16:58.148642+0000","last_became_peered":"2023-12-22T09:16:58.148642+0000","last_unstale":"2023-12-22T09:17:10.039949+0000","last_undegraded":"2023-12-22T09:17:10.039949+0000","last_fullsized":"2023-12-22T09:17:10.039949+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033121+0000","last_change":"2023-12-22T09:16:58.155683+0000","last_active":"2023-12-22T09:17:10.033121+0000","last_peered":"2023-12-22T09:17:10.033121+0000","last_clean":"2023-12-22T09:17:10.033121+0000","last_became_active":"2023-12-22T09:16:58.155388+0000","last_became_peered":"2023-12-22T09:16:58.155388+0000","last_unstale":"2023-12-22T09:17:10.033121+0000","last_undegraded":"2023-12-22T09:17:10.033121+0000","last_fullsized":"2023-12-22T09:17:10.033121+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.990889+0000","last_change":"2023-12-22T09:16:58.147756+0000","last_active":"2023-12-22T09:17:09.990889+0000","last_peered":"2023-12-22T09:17:09.990889+0000","last_clean":"2023-12-22T09:17:09.990889+0000","last_became_active":"2023-12-22T09:16:58.146595+0000","last_became_peered":"2023-12-22T09:16:58.146595+0000","last_unstale":"2023-12-22T09:17:09.990889+0000","last_undegraded":"2023-12-22T09:17:09.990889+0000","last_fullsized":"2023-12-22T09:17:09.990889+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:20:04.358268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001557+0000","last_change":"2023-12-22T09:16:58.125759+0000","last_active":"2023-12-22T09:17:10.001557+0000","last_peered":"2023-12-22T09:17:10.001557+0000","last_clean":"2023-12-22T09:17:10.001557+0000","last_became_active":"2023-12-22T09:16:58.125192+0000","last_became_peered":"2023-12-22T09:16:58.125192+0000","last_unstale":"2023-12-22T09:17:10.001557+0000","last_undegraded":"2023-12-22T09:17:10.001557+0000","last_fullsized":"2023-12-22T09:17:10.001557+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:11.972408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.024204+0000","last_change":"2023-12-22T09:17:11.024204+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.024204+0000","last_undegraded":"2023-12-22T09:17:11.024204+0000","last_fullsized":"2023-12-22T09:17:11.024204+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508856+0000","last_change":"2023-12-22T09:16:58.132380+0000","last_active":"2023-12-22T09:17:12.508856+0000","last_peered":"2023-12-22T09:17:12.508856+0000","last_clean":"2023-12-22T09:17:12.508856+0000","last_became_active":"2023-12-22T09:16:58.131960+0000","last_became_peered":"2023-12-22T09:16:58.131960+0000","last_unstale":"2023-12-22T09:17:12.508856+0000","last_undegraded":"2023-12-22T09:17:12.508856+0000","last_fullsized":"2023-12-22T09:17:12.508856+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:39:55.787513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987907+0000","last_change":"2023-12-22T09:16:57.644639+0000","last_active":"2023-12-22T09:17:09.987907+0000","last_peered":"2023-12-22T09:17:09.987907+0000","last_clean":"2023-12-22T09:17:09.987907+0000","last_became_active":"2023-12-22T09:16:57.641016+0000","last_became_peered":"2023-12-22T09:16:57.641016+0000","last_unstale":"2023-12-22T09:17:09.987907+0000","last_undegraded":"2023-12-22T09:17:09.987907+0000","last_fullsized":"2023-12-22T09:17:09.987907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.533990+0000","last_change":"2023-12-22T09:17:12.042696+0000","last_active":"2023-12-22T09:17:12.533990+0000","last_peered":"2023-12-22T09:17:12.533990+0000","last_clean":"2023-12-22T09:17:12.533990+0000","last_became_active":"2023-12-22T09:17:12.042328+0000","last_became_peered":"2023-12-22T09:17:12.042328+0000","last_unstale":"2023-12-22T09:17:12.533990+0000","last_undegraded":"2023-12-22T09:17:12.533990+0000","last_fullsized":"2023-12-22T09:17:12.533990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:05:59.153455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.018807+0000","last_change":"2023-12-22T09:17:11.012714+0000","last_active":"2023-12-22T09:17:11.018807+0000","last_peered":"2023-12-22T09:17:11.018807+0000","last_clean":"2023-12-22T09:17:11.018807+0000","last_became_active":"2023-12-22T09:17:11.011762+0000","last_became_peered":"2023-12-22T09:17:11.011762+0000","last_unstale":"2023-12-22T09:17:11.018807+0000","last_undegraded":"2023-12-22T09:17:11.018807+0000","last_fullsized":"2023-12-22T09:17:11.018807+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:53:32.651627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001619+0000","last_change":"2023-12-22T09:16:57.643725+0000","last_active":"2023-12-22T09:17:10.001619+0000","last_peered":"2023-12-22T09:17:10.001619+0000","last_clean":"2023-12-22T09:17:10.001619+0000","last_became_active":"2023-12-22T09:16:57.642742+0000","last_became_peered":"2023-12-22T09:16:57.642742+0000","last_unstale":"2023-12-22T09:17:10.001619+0000","last_undegraded":"2023-12-22T09:17:10.001619+0000","last_fullsized":"2023-12-22T09:17:10.001619+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:42.697488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.015046+0000","last_change":"2023-12-22T09:17:11.015046+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.015046+0000","last_undegraded":"2023-12-22T09:17:11.015046+0000","last_fullsized":"2023-12-22T09:17:11.015046+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:27.752298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001410+0000","last_change":"2023-12-22T09:16:58.124625+0000","last_active":"2023-12-22T09:17:10.001410+0000","last_peered":"2023-12-22T09:17:10.001410+0000","last_clean":"2023-12-22T09:17:10.001410+0000","last_became_active":"2023-12-22T09:16:58.124353+0000","last_became_peered":"2023-12-22T09:16:58.124353+0000","last_unstale":"2023-12-22T09:17:10.001410+0000","last_undegraded":"2023-12-22T09:17:10.001410+0000","last_fullsized":"2023-12-22T09:17:10.001410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:30:35.111753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001121+0000","last_change":"2023-12-22T09:16:57.655128+0000","last_active":"2023-12-22T09:17:10.001121+0000","last_peered":"2023-12-22T09:17:10.001121+0000","last_clean":"2023-12-22T09:17:10.001121+0000","last_became_active":"2023-12-22T09:16:57.654793+0000","last_became_peered":"2023-12-22T09:16:57.654793+0000","last_unstale":"2023-12-22T09:17:10.001121+0000","last_undegraded":"2023-12-22T09:17:10.001121+0000","last_fullsized":"2023-12-22T09:17:10.001121+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:38.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.019124+0000","last_change":"2023-12-22T09:17:11.019124+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.019124+0000","last_undegraded":"2023-12-22T09:17:11.019124+0000","last_fullsized":"2023-12-22T09:17:11.019124+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:03.329046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041177+0000","last_change":"2023-12-22T09:16:58.153226+0000","last_active":"2023-12-22T09:17:10.041177+0000","last_peered":"2023-12-22T09:17:10.041177+0000","last_clean":"2023-12-22T09:17:10.041177+0000","last_became_active":"2023-12-22T09:16:58.151970+0000","last_became_peered":"2023-12-22T09:16:58.151970+0000","last_unstale":"2023-12-22T09:17:10.041177+0000","last_undegraded":"2023-12-22T09:17:10.041177+0000","last_fullsized":"2023-12-22T09:17:10.041177+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.002324+0000","last_change":"2023-12-22T09:16:57.635854+0000","last_active":"2023-12-22T09:17:10.002324+0000","last_peered":"2023-12-22T09:17:10.002324+0000","last_clean":"2023-12-22T09:17:10.002324+0000","last_became_active":"2023-12-22T09:16:57.635365+0000","last_became_peered":"2023-12-22T09:16:57.635365+0000","last_unstale":"2023-12-22T09:17:10.002324+0000","last_undegraded":"2023-12-22T09:17:10.002324+0000","last_fullsized":"2023-12-22T09:17:10.002324+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:55.506978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.031825+0000","last_change":"2023-12-22T09:17:11.031825+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.031825+0000","last_undegraded":"2023-12-22T09:17:11.031825+0000","last_fullsized":"2023-12-22T09:17:11.031825+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037660+0000","last_change":"2023-12-22T09:16:58.111968+0000","last_active":"2023-12-22T09:17:10.037660+0000","last_peered":"2023-12-22T09:17:10.037660+0000","last_clean":"2023-12-22T09:17:10.037660+0000","last_became_active":"2023-12-22T09:16:58.111712+0000","last_became_peered":"2023-12-22T09:16:58.111712+0000","last_unstale":"2023-12-22T09:17:10.037660+0000","last_undegraded":"2023-12-22T09:17:10.037660+0000","last_fullsized":"2023-12-22T09:17:10.037660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:31:26.301820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998752+0000","last_change":"2023-12-22T09:16:57.646140+0000","last_active":"2023-12-22T09:17:09.998752+0000","last_peered":"2023-12-22T09:17:09.998752+0000","last_clean":"2023-12-22T09:17:09.998752+0000","last_became_active":"2023-12-22T09:16:57.645839+0000","last_became_peered":"2023-12-22T09:16:57.645839+0000","last_unstale":"2023-12-22T09:17:09.998752+0000","last_undegraded":"2023-12-22T09:17:09.998752+0000","last_fullsized":"2023-12-22T09:17:09.998752+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:15.308735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519978+0000","last_change":"2023-12-22T09:17:12.538499+0000","last_active":"2023-12-22T09:17:13.519978+0000","last_peered":"2023-12-22T09:17:13.519978+0000","last_clean":"2023-12-22T09:17:13.519978+0000","last_became_active":"2023-12-22T09:17:12.537198+0000","last_became_peered":"2023-12-22T09:17:12.537198+0000","last_unstale":"2023-12-22T09:17:13.519978+0000","last_undegraded":"2023-12-22T09:17:13.519978+0000","last_fullsized":"2023-12-22T09:17:13.519978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:33:56.242812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.015535+0000","last_change":"2023-12-22T09:17:11.015535+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.015535+0000","last_undegraded":"2023-12-22T09:17:11.015535+0000","last_fullsized":"2023-12-22T09:17:11.015535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:23.589301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987213+0000","last_change":"2023-12-22T09:16:58.148277+0000","last_active":"2023-12-22T09:17:09.987213+0000","last_peered":"2023-12-22T09:17:09.987213+0000","last_clean":"2023-12-22T09:17:09.987213+0000","last_became_active":"2023-12-22T09:16:58.147042+0000","last_became_peered":"2023-12-22T09:16:58.147042+0000","last_unstale":"2023-12-22T09:17:09.987213+0000","last_undegraded":"2023-12-22T09:17:09.987213+0000","last_fullsized":"2023-12-22T09:17:09.987213+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998289+0000","last_change":"2023-12-22T09:16:57.641319+0000","last_active":"2023-12-22T09:17:09.998289+0000","last_peered":"2023-12-22T09:17:09.998289+0000","last_clean":"2023-12-22T09:17:09.998289+0000","last_became_active":"2023-12-22T09:16:57.641031+0000","last_became_peered":"2023-12-22T09:16:57.641031+0000","last_unstale":"2023-12-22T09:17:09.998289+0000","last_undegraded":"2023-12-22T09:17:09.998289+0000","last_fullsized":"2023-12-22T09:17:09.998289+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:10.350226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.014643+0000","last_change":"2023-12-22T09:17:11.014643+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.014643+0000","last_undegraded":"2023-12-22T09:17:11.014643+0000","last_fullsized":"2023-12-22T09:17:11.014643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:29.709741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506322+0000","last_change":"2023-12-22T09:16:58.130875+0000","last_active":"2023-12-22T09:17:12.506322+0000","last_peered":"2023-12-22T09:17:12.506322+0000","last_clean":"2023-12-22T09:17:12.506322+0000","last_became_active":"2023-12-22T09:16:58.130606+0000","last_became_peered":"2023-12-22T09:16:58.130606+0000","last_unstale":"2023-12-22T09:17:12.506322+0000","last_undegraded":"2023-12-22T09:17:12.506322+0000","last_fullsized":"2023-12-22T09:17:12.506322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:30.649529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998331+0000","last_change":"2023-12-22T09:16:57.642097+0000","last_active":"2023-12-22T09:17:09.998331+0000","last_peered":"2023-12-22T09:17:09.998331+0000","last_clean":"2023-12-22T09:17:09.998331+0000","last_became_active":"2023-12-22T09:16:57.641830+0000","last_became_peered":"2023-12-22T09:16:57.641830+0000","last_unstale":"2023-12-22T09:17:09.998331+0000","last_undegraded":"2023-12-22T09:17:09.998331+0000","last_fullsized":"2023-12-22T09:17:09.998331+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:37:23.822669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.024975+0000","last_change":"2023-12-22T09:17:11.024975+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.024975+0000","last_undegraded":"2023-12-22T09:17:11.024975+0000","last_fullsized":"2023-12-22T09:17:11.024975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:57:47.077419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998660+0000","last_change":"2023-12-22T09:16:58.147991+0000","last_active":"2023-12-22T09:17:09.998660+0000","last_peered":"2023-12-22T09:17:09.998660+0000","last_clean":"2023-12-22T09:17:09.998660+0000","last_became_active":"2023-12-22T09:16:58.147595+0000","last_became_peered":"2023-12-22T09:16:58.147595+0000","last_unstale":"2023-12-22T09:17:09.998660+0000","last_undegraded":"2023-12-22T09:17:09.998660+0000","last_fullsized":"2023-12-22T09:17:09.998660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:14.136005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510671+0000","last_change":"2023-12-22T09:16:57.647073+0000","last_active":"2023-12-22T09:17:12.510671+0000","last_peered":"2023-12-22T09:17:12.510671+0000","last_clean":"2023-12-22T09:17:12.510671+0000","last_became_active":"2023-12-22T09:16:57.646655+0000","last_became_peered":"2023-12-22T09:16:57.646655+0000","last_unstale":"2023-12-22T09:17:12.510671+0000","last_undegraded":"2023-12-22T09:17:12.510671+0000","last_fullsized":"2023-12-22T09:17:12.510671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:52.036721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.016758+0000","last_change":"2023-12-22T09:17:11.016758+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.016758+0000","last_undegraded":"2023-12-22T09:17:11.016758+0000","last_fullsized":"2023-12-22T09:17:11.016758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:28.077725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987998+0000","last_change":"2023-12-22T09:16:58.112827+0000","last_active":"2023-12-22T09:17:09.987998+0000","last_peered":"2023-12-22T09:17:09.987998+0000","last_clean":"2023-12-22T09:17:09.987998+0000","last_became_active":"2023-12-22T09:16:58.112533+0000","last_became_peered":"2023-12-22T09:16:58.112533+0000","last_unstale":"2023-12-22T09:17:09.987998+0000","last_undegraded":"2023-12-22T09:17:09.987998+0000","last_fullsized":"2023-12-22T09:17:09.987998+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041476+0000","last_change":"2023-12-22T09:16:57.653443+0000","last_active":"2023-12-22T09:17:10.041476+0000","last_peered":"2023-12-22T09:17:10.041476+0000","last_clean":"2023-12-22T09:17:10.041476+0000","last_became_active":"2023-12-22T09:16:57.653141+0000","last_became_peered":"2023-12-22T09:16:57.653141+0000","last_unstale":"2023-12-22T09:17:10.041476+0000","last_undegraded":"2023-12-22T09:17:10.041476+0000","last_fullsized":"2023-12-22T09:17:10.041476+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"63'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.552653+0000","last_change":"2023-12-22T09:17:12.045401+0000","last_active":"2023-12-22T09:17:12.552653+0000","last_peered":"2023-12-22T09:17:12.552653+0000","last_clean":"2023-12-22T09:17:12.552653+0000","last_became_active":"2023-12-22T09:17:12.044219+0000","last_became_peered":"2023-12-22T09:17:12.044219+0000","last_unstale":"2023-12-22T09:17:12.552653+0000","last_undegraded":"2023-12-22T09:17:12.552653+0000","last_fullsized":"2023-12-22T09:17:12.552653+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:44.256814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.999418+0000","last_change":"2023-12-22T09:16:58.138339+0000","last_active":"2023-12-22T09:17:09.999418+0000","last_peered":"2023-12-22T09:17:09.999418+0000","last_clean":"2023-12-22T09:17:09.999418+0000","last_became_active":"2023-12-22T09:16:58.137859+0000","last_became_peered":"2023-12-22T09:16:58.137859+0000","last_unstale":"2023-12-22T09:17:09.999418+0000","last_undegraded":"2023-12-22T09:17:09.999418+0000","last_fullsized":"2023-12-22T09:17:09.999418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:20.962415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.993307+0000","last_change":"2023-12-22T09:16:57.655164+0000","last_active":"2023-12-22T09:17:09.993307+0000","last_peered":"2023-12-22T09:17:09.993307+0000","last_clean":"2023-12-22T09:17:09.993307+0000","last_became_active":"2023-12-22T09:16:57.654845+0000","last_became_peered":"2023-12-22T09:16:57.654845+0000","last_unstale":"2023-12-22T09:17:09.993307+0000","last_undegraded":"2023-12-22T09:17:09.993307+0000","last_fullsized":"2023-12-22T09:17:09.993307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:48.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.020619+0000","last_change":"2023-12-22T09:17:11.020619+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.020619+0000","last_undegraded":"2023-12-22T09:17:11.020619+0000","last_fullsized":"2023-12-22T09:17:11.020619+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:44.261501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509885+0000","last_change":"2023-12-22T09:16:58.140359+0000","last_active":"2023-12-22T09:17:12.509885+0000","last_peered":"2023-12-22T09:17:12.509885+0000","last_clean":"2023-12-22T09:17:12.509885+0000","last_became_active":"2023-12-22T09:16:58.140013+0000","last_became_peered":"2023-12-22T09:16:58.140013+0000","last_unstale":"2023-12-22T09:17:12.509885+0000","last_undegraded":"2023-12-22T09:17:12.509885+0000","last_fullsized":"2023-12-22T09:17:12.509885+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:10:45.503921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040698+0000","last_change":"2023-12-22T09:16:57.649245+0000","last_active":"2023-12-22T09:17:10.040698+0000","last_peered":"2023-12-22T09:17:10.040698+0000","last_clean":"2023-12-22T09:17:10.040698+0000","last_became_active":"2023-12-22T09:16:57.648941+0000","last_became_peered":"2023-12-22T09:16:57.648941+0000","last_unstale":"2023-12-22T09:17:10.040698+0000","last_undegraded":"2023-12-22T09:17:10.040698+0000","last_fullsized":"2023-12-22T09:17:10.040698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:41:54.745043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.024241+0000","last_change":"2023-12-22T09:17:11.024241+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.024241+0000","last_undegraded":"2023-12-22T09:17:11.024241+0000","last_fullsized":"2023-12-22T09:17:11.024241+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:49:30.159981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.993833+0000","last_change":"2023-12-22T09:16:58.136583+0000","last_active":"2023-12-22T09:17:09.993833+0000","last_peered":"2023-12-22T09:17:09.993833+0000","last_clean":"2023-12-22T09:17:09.993833+0000","last_became_active":"2023-12-22T09:16:58.136313+0000","last_became_peered":"2023-12-22T09:16:58.136313+0000","last_unstale":"2023-12-22T09:17:09.993833+0000","last_undegraded":"2023-12-22T09:17:09.993833+0000","last_fullsized":"2023-12-22T09:17:09.993833+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:04.972480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"59'9","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.988216+0000","last_change":"2023-12-22T09:16:57.656118+0000","last_active":"2023-12-22T09:17:09.988216+0000","last_peered":"2023-12-22T09:17:09.988216+0000","last_clean":"2023-12-22T09:17:09.988216+0000","last_became_active":"2023-12-22T09:16:57.655712+0000","last_became_peered":"2023-12-22T09:16:57.655712+0000","last_unstale":"2023-12-22T09:17:09.988216+0000","last_undegraded":"2023-12-22T09:17:09.988216+0000","last_fullsized":"2023-12-22T09:17:09.988216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519856+0000","last_change":"2023-12-22T09:17:12.541565+0000","last_active":"2023-12-22T09:17:13.519856+0000","last_peered":"2023-12-22T09:17:13.519856+0000","last_clean":"2023-12-22T09:17:13.519856+0000","last_became_active":"2023-12-22T09:17:12.540916+0000","last_became_peered":"2023-12-22T09:17:12.540916+0000","last_unstale":"2023-12-22T09:17:13.519856+0000","last_undegraded":"2023-12-22T09:17:13.519856+0000","last_fullsized":"2023-12-22T09:17:13.519856+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:48.901354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.015119+0000","last_change":"2023-12-22T09:17:11.015119+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.015119+0000","last_undegraded":"2023-12-22T09:17:11.015119+0000","last_fullsized":"2023-12-22T09:17:11.015119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:43:07.491118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.990860+0000","last_change":"2023-12-22T09:16:58.146066+0000","last_active":"2023-12-22T09:17:09.990860+0000","last_peered":"2023-12-22T09:17:09.990860+0000","last_clean":"2023-12-22T09:17:09.990860+0000","last_became_active":"2023-12-22T09:16:58.145703+0000","last_became_peered":"2023-12-22T09:16:58.145703+0000","last_unstale":"2023-12-22T09:17:09.990860+0000","last_undegraded":"2023-12-22T09:17:09.990860+0000","last_fullsized":"2023-12-22T09:17:09.990860+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:02.557319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040178+0000","last_change":"2023-12-22T09:16:57.649967+0000","last_active":"2023-12-22T09:17:10.040178+0000","last_peered":"2023-12-22T09:17:10.040178+0000","last_clean":"2023-12-22T09:17:10.040178+0000","last_became_active":"2023-12-22T09:16:57.649500+0000","last_became_peered":"2023-12-22T09:16:57.649500+0000","last_unstale":"2023-12-22T09:17:10.040178+0000","last_undegraded":"2023-12-22T09:17:10.040178+0000","last_fullsized":"2023-12-22T09:17:10.040178+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520037+0000","last_change":"2023-12-22T09:17:12.524836+0000","last_active":"2023-12-22T09:17:13.520037+0000","last_peered":"2023-12-22T09:17:13.520037+0000","last_clean":"2023-12-22T09:17:13.520037+0000","last_became_active":"2023-12-22T09:17:12.524505+0000","last_became_peered":"2023-12-22T09:17:12.524505+0000","last_unstale":"2023-12-22T09:17:13.520037+0000","last_undegraded":"2023-12-22T09:17:13.520037+0000","last_fullsized":"2023-12-22T09:17:13.520037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:11:58.590168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.031397+0000","last_change":"2023-12-22T09:17:11.031397+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.031397+0000","last_undegraded":"2023-12-22T09:17:11.031397+0000","last_fullsized":"2023-12-22T09:17:11.031397+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.032956+0000","last_change":"2023-12-22T09:16:58.134889+0000","last_active":"2023-12-22T09:17:10.032956+0000","last_peered":"2023-12-22T09:17:10.032956+0000","last_clean":"2023-12-22T09:17:10.032956+0000","last_became_active":"2023-12-22T09:16:58.134552+0000","last_became_peered":"2023-12-22T09:16:58.134552+0000","last_unstale":"2023-12-22T09:17:10.032956+0000","last_undegraded":"2023-12-22T09:17:10.032956+0000","last_fullsized":"2023-12-22T09:17:10.032956+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033118+0000","last_change":"2023-12-22T09:16:57.651390+0000","last_active":"2023-12-22T09:17:10.033118+0000","last_peered":"2023-12-22T09:17:10.033118+0000","last_clean":"2023-12-22T09:17:10.033118+0000","last_became_active":"2023-12-22T09:16:57.650566+0000","last_became_peered":"2023-12-22T09:16:57.650566+0000","last_unstale":"2023-12-22T09:17:10.033118+0000","last_undegraded":"2023-12-22T09:17:10.033118+0000","last_fullsized":"2023-12-22T09:17:10.033118+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:53.090112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.023927+0000","last_change":"2023-12-22T09:17:11.023927+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.023927+0000","last_undegraded":"2023-12-22T09:17:11.023927+0000","last_fullsized":"2023-12-22T09:17:11.023927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:56:30.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506577+0000","last_change":"2023-12-22T09:16:58.127084+0000","last_active":"2023-12-22T09:17:12.506577+0000","last_peered":"2023-12-22T09:17:12.506577+0000","last_clean":"2023-12-22T09:17:12.506577+0000","last_became_active":"2023-12-22T09:16:58.126598+0000","last_became_peered":"2023-12-22T09:16:58.126598+0000","last_unstale":"2023-12-22T09:17:12.506577+0000","last_undegraded":"2023-12-22T09:17:12.506577+0000","last_fullsized":"2023-12-22T09:17:12.506577+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:57.174680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039920+0000","last_change":"2023-12-22T09:16:57.643354+0000","last_active":"2023-12-22T09:17:10.039920+0000","last_peered":"2023-12-22T09:17:10.039920+0000","last_clean":"2023-12-22T09:17:10.039920+0000","last_became_active":"2023-12-22T09:16:57.643102+0000","last_became_peered":"2023-12-22T09:16:57.643102+0000","last_unstale":"2023-12-22T09:17:10.039920+0000","last_undegraded":"2023-12-22T09:17:10.039920+0000","last_fullsized":"2023-12-22T09:17:10.039920+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519260+0000","last_change":"2023-12-22T09:17:12.526768+0000","last_active":"2023-12-22T09:17:13.519260+0000","last_peered":"2023-12-22T09:17:13.519260+0000","last_clean":"2023-12-22T09:17:13.519260+0000","last_became_active":"2023-12-22T09:17:12.526405+0000","last_became_peered":"2023-12-22T09:17:12.526405+0000","last_unstale":"2023-12-22T09:17:13.519260+0000","last_undegraded":"2023-12-22T09:17:13.519260+0000","last_fullsized":"2023-12-22T09:17:13.519260+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:14:28.665216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.018018+0000","last_change":"2023-12-22T09:17:11.018018+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.018018+0000","last_undegraded":"2023-12-22T09:17:11.018018+0000","last_fullsized":"2023-12-22T09:17:11.018018+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:53.836251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987345+0000","last_change":"2023-12-22T09:16:58.146073+0000","last_active":"2023-12-22T09:17:09.987345+0000","last_peered":"2023-12-22T09:17:09.987345+0000","last_clean":"2023-12-22T09:17:09.987345+0000","last_became_active":"2023-12-22T09:16:58.145780+0000","last_became_peered":"2023-12-22T09:16:58.145780+0000","last_unstale":"2023-12-22T09:17:09.987345+0000","last_undegraded":"2023-12-22T09:17:09.987345+0000","last_fullsized":"2023-12-22T09:17:09.987345+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":21,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.990883+0000","last_change":"2023-12-22T09:16:57.651320+0000","last_active":"2023-12-22T09:17:09.990883+0000","last_peered":"2023-12-22T09:17:09.990883+0000","last_clean":"2023-12-22T09:17:09.990883+0000","last_became_active":"2023-12-22T09:16:57.651060+0000","last_became_peered":"2023-12-22T09:16:57.651060+0000","last_unstale":"2023-12-22T09:17:09.990883+0000","last_undegraded":"2023-12-22T09:17:09.990883+0000","last_fullsized":"2023-12-22T09:17:09.990883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:19:59.812662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.016192+0000","last_change":"2023-12-22T09:17:11.016192+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.016192+0000","last_undegraded":"2023-12-22T09:17:11.016192+0000","last_fullsized":"2023-12-22T09:17:11.016192+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:56.005441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040622+0000","last_change":"2023-12-22T09:16:58.148310+0000","last_active":"2023-12-22T09:17:10.040622+0000","last_peered":"2023-12-22T09:17:10.040622+0000","last_clean":"2023-12-22T09:17:10.040622+0000","last_became_active":"2023-12-22T09:16:58.147993+0000","last_became_peered":"2023-12-22T09:16:58.147993+0000","last_unstale":"2023-12-22T09:17:10.040622+0000","last_undegraded":"2023-12-22T09:17:10.040622+0000","last_fullsized":"2023-12-22T09:17:10.040622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033871+0000","last_change":"2023-12-22T09:16:57.654251+0000","last_active":"2023-12-22T09:17:10.033871+0000","last_peered":"2023-12-22T09:17:10.033871+0000","last_clean":"2023-12-22T09:17:10.033871+0000","last_became_active":"2023-12-22T09:16:57.653954+0000","last_became_peered":"2023-12-22T09:16:57.653954+0000","last_unstale":"2023-12-22T09:17:10.033871+0000","last_undegraded":"2023-12-22T09:17:10.033871+0000","last_fullsized":"2023-12-22T09:17:10.033871+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.011904+0000","last_change":"2023-12-22T09:17:11.011904+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.011904+0000","last_undegraded":"2023-12-22T09:17:11.011904+0000","last_fullsized":"2023-12-22T09:17:11.011904+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:34:22.106083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514253+0000","last_change":"2023-12-22T09:16:58.152892+0000","last_active":"2023-12-22T09:17:12.514253+0000","last_peered":"2023-12-22T09:17:12.514253+0000","last_clean":"2023-12-22T09:17:12.514253+0000","last_became_active":"2023-12-22T09:16:58.152538+0000","last_became_peered":"2023-12-22T09:16:58.152538+0000","last_unstale":"2023-12-22T09:17:12.514253+0000","last_undegraded":"2023-12-22T09:17:12.514253+0000","last_fullsized":"2023-12-22T09:17:12.514253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:12:00.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.041640+0000","last_change":"2023-12-22T09:16:57.659614+0000","last_active":"2023-12-22T09:17:10.041640+0000","last_peered":"2023-12-22T09:17:10.041640+0000","last_clean":"2023-12-22T09:17:10.041640+0000","last_became_active":"2023-12-22T09:16:57.659211+0000","last_became_peered":"2023-12-22T09:16:57.659211+0000","last_unstale":"2023-12-22T09:17:10.041640+0000","last_undegraded":"2023-12-22T09:17:10.041640+0000","last_fullsized":"2023-12-22T09:17:10.041640+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.019465+0000","last_change":"2023-12-22T09:17:11.019465+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.019465+0000","last_undegraded":"2023-12-22T09:17:11.019465+0000","last_fullsized":"2023-12-22T09:17:11.019465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:27.519985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.992697+0000","last_change":"2023-12-22T09:16:58.144680+0000","last_active":"2023-12-22T09:17:09.992697+0000","last_peered":"2023-12-22T09:17:09.992697+0000","last_clean":"2023-12-22T09:17:09.992697+0000","last_became_active":"2023-12-22T09:16:58.144401+0000","last_became_peered":"2023-12-22T09:16:58.144401+0000","last_unstale":"2023-12-22T09:17:09.992697+0000","last_undegraded":"2023-12-22T09:17:09.992697+0000","last_fullsized":"2023-12-22T09:17:09.992697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:43.213252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040763+0000","last_change":"2023-12-22T09:16:57.651659+0000","last_active":"2023-12-22T09:17:10.040763+0000","last_peered":"2023-12-22T09:17:10.040763+0000","last_clean":"2023-12-22T09:17:10.040763+0000","last_became_active":"2023-12-22T09:16:57.650353+0000","last_became_peered":"2023-12-22T09:16:57.650353+0000","last_unstale":"2023-12-22T09:17:10.040763+0000","last_undegraded":"2023-12-22T09:17:10.040763+0000","last_fullsized":"2023-12-22T09:17:10.040763+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:15.191139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.014785+0000","last_change":"2023-12-22T09:17:11.014785+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.014785+0000","last_undegraded":"2023-12-22T09:17:11.014785+0000","last_fullsized":"2023-12-22T09:17:11.014785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:47.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509106+0000","last_change":"2023-12-22T09:16:58.139368+0000","last_active":"2023-12-22T09:17:12.509106+0000","last_peered":"2023-12-22T09:17:12.509106+0000","last_clean":"2023-12-22T09:17:12.509106+0000","last_became_active":"2023-12-22T09:16:58.134697+0000","last_became_peered":"2023-12-22T09:16:58.134697+0000","last_unstale":"2023-12-22T09:17:12.509106+0000","last_undegraded":"2023-12-22T09:17:12.509106+0000","last_fullsized":"2023-12-22T09:17:12.509106+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:40.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.999081+0000","last_change":"2023-12-22T09:16:57.659460+0000","last_active":"2023-12-22T09:17:09.999081+0000","last_peered":"2023-12-22T09:17:09.999081+0000","last_clean":"2023-12-22T09:17:09.999081+0000","last_became_active":"2023-12-22T09:16:57.659124+0000","last_became_peered":"2023-12-22T09:16:57.659124+0000","last_unstale":"2023-12-22T09:17:09.999081+0000","last_undegraded":"2023-12-22T09:17:09.999081+0000","last_fullsized":"2023-12-22T09:17:09.999081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:00.331386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.006940+0000","last_change":"2023-12-22T09:17:11.006940+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.006940+0000","last_undegraded":"2023-12-22T09:17:11.006940+0000","last_fullsized":"2023-12-22T09:17:11.006940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:22:18.487717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001788+0000","last_change":"2023-12-22T09:16:58.122054+0000","last_active":"2023-12-22T09:17:10.001788+0000","last_peered":"2023-12-22T09:17:10.001788+0000","last_clean":"2023-12-22T09:17:10.001788+0000","last_became_active":"2023-12-22T09:16:58.121132+0000","last_became_peered":"2023-12-22T09:16:58.121132+0000","last_unstale":"2023-12-22T09:17:10.001788+0000","last_undegraded":"2023-12-22T09:17:10.001788+0000","last_fullsized":"2023-12-22T09:17:10.001788+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.000887+0000","last_change":"2023-12-22T09:16:57.643365+0000","last_active":"2023-12-22T09:17:10.000887+0000","last_peered":"2023-12-22T09:17:10.000887+0000","last_clean":"2023-12-22T09:17:10.000887+0000","last_became_active":"2023-12-22T09:16:57.642191+0000","last_became_peered":"2023-12-22T09:16:57.642191+0000","last_unstale":"2023-12-22T09:17:10.000887+0000","last_undegraded":"2023-12-22T09:17:10.000887+0000","last_fullsized":"2023-12-22T09:17:10.000887+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:42.294395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520118+0000","last_change":"2023-12-22T09:17:12.533494+0000","last_active":"2023-12-22T09:17:13.520118+0000","last_peered":"2023-12-22T09:17:13.520118+0000","last_clean":"2023-12-22T09:17:13.520118+0000","last_became_active":"2023-12-22T09:17:12.532982+0000","last_became_peered":"2023-12-22T09:17:12.532982+0000","last_unstale":"2023-12-22T09:17:13.520118+0000","last_undegraded":"2023-12-22T09:17:13.520118+0000","last_fullsized":"2023-12-22T09:17:13.520118+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:31.400736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.006508+0000","last_change":"2023-12-22T09:17:11.006508+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.006508+0000","last_undegraded":"2023-12-22T09:17:11.006508+0000","last_fullsized":"2023-12-22T09:17:11.006508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:18.691505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033143+0000","last_change":"2023-12-22T09:16:58.139882+0000","last_active":"2023-12-22T09:17:10.033143+0000","last_peered":"2023-12-22T09:17:10.033143+0000","last_clean":"2023-12-22T09:17:10.033143+0000","last_became_active":"2023-12-22T09:16:58.139602+0000","last_became_peered":"2023-12-22T09:16:58.139602+0000","last_unstale":"2023-12-22T09:17:10.033143+0000","last_undegraded":"2023-12-22T09:17:10.033143+0000","last_fullsized":"2023-12-22T09:17:10.033143+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033447+0000","last_change":"2023-12-22T09:16:57.651581+0000","last_active":"2023-12-22T09:17:10.033447+0000","last_peered":"2023-12-22T09:17:10.033447+0000","last_clean":"2023-12-22T09:17:10.033447+0000","last_became_active":"2023-12-22T09:16:57.651050+0000","last_became_peered":"2023-12-22T09:16:57.651050+0000","last_unstale":"2023-12-22T09:17:10.033447+0000","last_undegraded":"2023-12-22T09:17:10.033447+0000","last_fullsized":"2023-12-22T09:17:10.033447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.007077+0000","last_change":"2023-12-22T09:17:11.007077+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.007077+0000","last_undegraded":"2023-12-22T09:17:11.007077+0000","last_fullsized":"2023-12-22T09:17:11.007077+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:24.280048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506960+0000","last_change":"2023-12-22T09:16:58.127943+0000","last_active":"2023-12-22T09:17:12.506960+0000","last_peered":"2023-12-22T09:17:12.506960+0000","last_clean":"2023-12-22T09:17:12.506960+0000","last_became_active":"2023-12-22T09:16:58.127679+0000","last_became_peered":"2023-12-22T09:16:58.127679+0000","last_unstale":"2023-12-22T09:17:12.506960+0000","last_undegraded":"2023-12-22T09:17:12.506960+0000","last_fullsized":"2023-12-22T09:17:12.506960+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:34.212746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.000775+0000","last_change":"2023-12-22T09:16:57.643620+0000","last_active":"2023-12-22T09:17:10.000775+0000","last_peered":"2023-12-22T09:17:10.000775+0000","last_clean":"2023-12-22T09:17:10.000775+0000","last_became_active":"2023-12-22T09:16:57.643322+0000","last_became_peered":"2023-12-22T09:16:57.643322+0000","last_unstale":"2023-12-22T09:17:10.000775+0000","last_undegraded":"2023-12-22T09:17:10.000775+0000","last_fullsized":"2023-12-22T09:17:10.000775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:13.807363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.017956+0000","last_change":"2023-12-22T09:17:11.017956+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.017956+0000","last_undegraded":"2023-12-22T09:17:11.017956+0000","last_fullsized":"2023-12-22T09:17:11.017956+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.002214+0000","last_change":"2023-12-22T09:16:58.147612+0000","last_active":"2023-12-22T09:17:10.002214+0000","last_peered":"2023-12-22T09:17:10.002214+0000","last_clean":"2023-12-22T09:17:10.002214+0000","last_became_active":"2023-12-22T09:16:58.147333+0000","last_became_peered":"2023-12-22T09:16:58.147333+0000","last_unstale":"2023-12-22T09:17:10.002214+0000","last_undegraded":"2023-12-22T09:17:10.002214+0000","last_fullsized":"2023-12-22T09:17:10.002214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:55.463677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":27,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-22T09:17:11.042027+0000","last_change":"2023-12-22T09:17:11.042027+0000","last_active":"2023-12-22T09:17:11.042027+0000","last_peered":"2023-12-22T09:17:11.042027+0000","last_clean":"2023-12-22T09:17:11.042027+0000","last_became_active":"2023-12-22T09:17:11.038601+0000","last_became_peered":"2023-12-22T09:17:11.038601+0000","last_unstale":"2023-12-22T09:17:11.042027+0000","last_undegraded":"2023-12-22T09:17:11.042027+0000","last_fullsized":"2023-12-22T09:17:11.042027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:48.928040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.017577+0000","last_change":"2023-12-22T09:17:11.017577+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.017577+0000","last_undegraded":"2023-12-22T09:17:11.017577+0000","last_fullsized":"2023-12-22T09:17:11.017577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:10:15.433618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037631+0000","last_change":"2023-12-22T09:16:58.122982+0000","last_active":"2023-12-22T09:17:10.037631+0000","last_peered":"2023-12-22T09:17:10.037631+0000","last_clean":"2023-12-22T09:17:10.037631+0000","last_became_active":"2023-12-22T09:16:58.122683+0000","last_became_peered":"2023-12-22T09:16:58.122683+0000","last_unstale":"2023-12-22T09:17:10.037631+0000","last_undegraded":"2023-12-22T09:17:10.037631+0000","last_fullsized":"2023-12-22T09:17:10.037631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:03:37.012223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033926+0000","last_change":"2023-12-22T09:16:57.652367+0000","last_active":"2023-12-22T09:17:10.033926+0000","last_peered":"2023-12-22T09:17:10.033926+0000","last_clean":"2023-12-22T09:17:10.033926+0000","last_became_active":"2023-12-22T09:16:57.651997+0000","last_became_peered":"2023-12-22T09:16:57.651997+0000","last_unstale":"2023-12-22T09:17:10.033926+0000","last_undegraded":"2023-12-22T09:17:10.033926+0000","last_fullsized":"2023-12-22T09:17:10.033926+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.023744+0000","last_change":"2023-12-22T09:17:11.023744+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.023744+0000","last_undegraded":"2023-12-22T09:17:11.023744+0000","last_fullsized":"2023-12-22T09:17:11.023744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:00.845862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.033649+0000","last_change":"2023-12-22T09:16:58.134298+0000","last_active":"2023-12-22T09:17:10.033649+0000","last_peered":"2023-12-22T09:17:10.033649+0000","last_clean":"2023-12-22T09:17:10.033649+0000","last_became_active":"2023-12-22T09:16:58.134027+0000","last_became_peered":"2023-12-22T09:16:58.134027+0000","last_unstale":"2023-12-22T09:17:10.033649+0000","last_undegraded":"2023-12-22T09:17:10.033649+0000","last_fullsized":"2023-12-22T09:17:10.033649+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.001315+0000","last_change":"2023-12-22T09:16:57.651565+0000","last_active":"2023-12-22T09:17:10.001315+0000","last_peered":"2023-12-22T09:17:10.001315+0000","last_clean":"2023-12-22T09:17:10.001315+0000","last_became_active":"2023-12-22T09:16:57.651295+0000","last_became_peered":"2023-12-22T09:16:57.651295+0000","last_unstale":"2023-12-22T09:17:10.001315+0000","last_undegraded":"2023-12-22T09:17:10.001315+0000","last_fullsized":"2023-12-22T09:17:10.001315+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:18.179171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516601+0000","last_change":"2023-12-22T09:17:12.523916+0000","last_active":"2023-12-22T09:17:13.516601+0000","last_peered":"2023-12-22T09:17:13.516601+0000","last_clean":"2023-12-22T09:17:13.516601+0000","last_became_active":"2023-12-22T09:17:12.519420+0000","last_became_peered":"2023-12-22T09:17:12.519420+0000","last_unstale":"2023-12-22T09:17:13.516601+0000","last_undegraded":"2023-12-22T09:17:13.516601+0000","last_fullsized":"2023-12-22T09:17:13.516601+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:27:28.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.031752+0000","last_change":"2023-12-22T09:17:11.031752+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.031752+0000","last_undegraded":"2023-12-22T09:17:11.031752+0000","last_fullsized":"2023-12-22T09:17:11.031752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:28:17.921536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509202+0000","last_change":"2023-12-22T09:16:58.142640+0000","last_active":"2023-12-22T09:17:12.509202+0000","last_peered":"2023-12-22T09:17:12.509202+0000","last_clean":"2023-12-22T09:17:12.509202+0000","last_became_active":"2023-12-22T09:16:58.142334+0000","last_became_peered":"2023-12-22T09:16:58.142334+0000","last_unstale":"2023-12-22T09:17:12.509202+0000","last_undegraded":"2023-12-22T09:17:12.509202+0000","last_fullsized":"2023-12-22T09:17:12.509202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:35:36.019628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.988250+0000","last_change":"2023-12-22T09:16:57.655954+0000","last_active":"2023-12-22T09:17:09.988250+0000","last_peered":"2023-12-22T09:17:09.988250+0000","last_clean":"2023-12-22T09:17:09.988250+0000","last_became_active":"2023-12-22T09:16:57.655335+0000","last_became_peered":"2023-12-22T09:16:57.655335+0000","last_unstale":"2023-12-22T09:17:09.988250+0000","last_undegraded":"2023-12-22T09:17:09.988250+0000","last_fullsized":"2023-12-22T09:17:09.988250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509527+0000","last_change":"2023-12-22T09:17:12.034651+0000","last_active":"2023-12-22T09:17:12.509527+0000","last_peered":"2023-12-22T09:17:12.509527+0000","last_clean":"2023-12-22T09:17:12.509527+0000","last_became_active":"2023-12-22T09:17:12.034345+0000","last_became_peered":"2023-12-22T09:17:12.034345+0000","last_unstale":"2023-12-22T09:17:12.509527+0000","last_undegraded":"2023-12-22T09:17:12.509527+0000","last_fullsized":"2023-12-22T09:17:12.509527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:57:00.962453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510462+0000","last_change":"2023-12-22T09:16:58.121917+0000","last_active":"2023-12-22T09:17:12.510462+0000","last_peered":"2023-12-22T09:17:12.510462+0000","last_clean":"2023-12-22T09:17:12.510462+0000","last_became_active":"2023-12-22T09:16:58.118511+0000","last_became_peered":"2023-12-22T09:16:58.118511+0000","last_unstale":"2023-12-22T09:17:12.510462+0000","last_undegraded":"2023-12-22T09:17:12.510462+0000","last_fullsized":"2023-12-22T09:17:12.510462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:33:40.126107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.040397+0000","last_change":"2023-12-22T09:16:57.647202+0000","last_active":"2023-12-22T09:17:10.040397+0000","last_peered":"2023-12-22T09:17:10.040397+0000","last_clean":"2023-12-22T09:17:10.040397+0000","last_became_active":"2023-12-22T09:16:57.646930+0000","last_became_peered":"2023-12-22T09:16:57.646930+0000","last_unstale":"2023-12-22T09:17:10.040397+0000","last_undegraded":"2023-12-22T09:17:10.040397+0000","last_fullsized":"2023-12-22T09:17:10.040397+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:40.073052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.011644+0000","last_change":"2023-12-22T09:17:11.011644+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.011644+0000","last_undegraded":"2023-12-22T09:17:11.011644+0000","last_fullsized":"2023-12-22T09:17:11.011644+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:44.983134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.991009+0000","last_change":"2023-12-22T09:16:58.139737+0000","last_active":"2023-12-22T09:17:09.991009+0000","last_peered":"2023-12-22T09:17:09.991009+0000","last_clean":"2023-12-22T09:17:09.991009+0000","last_became_active":"2023-12-22T09:16:58.139455+0000","last_became_peered":"2023-12-22T09:16:58.139455+0000","last_unstale":"2023-12-22T09:17:09.991009+0000","last_undegraded":"2023-12-22T09:17:09.991009+0000","last_fullsized":"2023-12-22T09:17:09.991009+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:21.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998540+0000","last_change":"2023-12-22T09:16:57.640845+0000","last_active":"2023-12-22T09:17:09.998540+0000","last_peered":"2023-12-22T09:17:09.998540+0000","last_clean":"2023-12-22T09:17:09.998540+0000","last_became_active":"2023-12-22T09:16:57.640523+0000","last_became_peered":"2023-12-22T09:16:57.640523+0000","last_unstale":"2023-12-22T09:17:09.998540+0000","last_undegraded":"2023-12-22T09:17:09.998540+0000","last_fullsized":"2023-12-22T09:17:09.998540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:11.216158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519019+0000","last_change":"2023-12-22T09:17:12.534422+0000","last_active":"2023-12-22T09:17:13.519019+0000","last_peered":"2023-12-22T09:17:13.519019+0000","last_clean":"2023-12-22T09:17:13.519019+0000","last_became_active":"2023-12-22T09:17:12.534170+0000","last_became_peered":"2023-12-22T09:17:12.534170+0000","last_unstale":"2023-12-22T09:17:13.519019+0000","last_undegraded":"2023-12-22T09:17:13.519019+0000","last_fullsized":"2023-12-22T09:17:13.519019+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:14:37.881358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506696+0000","last_change":"2023-12-22T09:17:12.041999+0000","last_active":"2023-12-22T09:17:12.506696+0000","last_peered":"2023-12-22T09:17:12.506696+0000","last_clean":"2023-12-22T09:17:12.506696+0000","last_became_active":"2023-12-22T09:17:12.041632+0000","last_became_peered":"2023-12-22T09:17:12.041632+0000","last_unstale":"2023-12-22T09:17:12.506696+0000","last_undegraded":"2023-12-22T09:17:12.506696+0000","last_fullsized":"2023-12-22T09:17:12.506696+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:24.728438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.988051+0000","last_change":"2023-12-22T09:16:58.136215+0000","last_active":"2023-12-22T09:17:09.988051+0000","last_peered":"2023-12-22T09:17:09.988051+0000","last_clean":"2023-12-22T09:17:09.988051+0000","last_became_active":"2023-12-22T09:16:58.135936+0000","last_became_peered":"2023-12-22T09:16:58.135936+0000","last_unstale":"2023-12-22T09:17:09.988051+0000","last_undegraded":"2023-12-22T09:17:09.988051+0000","last_fullsized":"2023-12-22T09:17:09.988051+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998273+0000","last_change":"2023-12-22T09:16:57.641987+0000","last_active":"2023-12-22T09:17:09.998273+0000","last_peered":"2023-12-22T09:17:09.998273+0000","last_clean":"2023-12-22T09:17:09.998273+0000","last_became_active":"2023-12-22T09:16:57.641712+0000","last_became_peered":"2023-12-22T09:16:57.641712+0000","last_unstale":"2023-12-22T09:17:09.998273+0000","last_undegraded":"2023-12-22T09:17:09.998273+0000","last_fullsized":"2023-12-22T09:17:09.998273+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:33.101510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519359+0000","last_change":"2023-12-22T09:17:12.537866+0000","last_active":"2023-12-22T09:17:13.519359+0000","last_peered":"2023-12-22T09:17:13.519359+0000","last_clean":"2023-12-22T09:17:13.519359+0000","last_became_active":"2023-12-22T09:17:12.537136+0000","last_became_peered":"2023-12-22T09:17:12.537136+0000","last_unstale":"2023-12-22T09:17:13.519359+0000","last_undegraded":"2023-12-22T09:17:13.519359+0000","last_fullsized":"2023-12-22T09:17:13.519359+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:14.639137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.017533+0000","last_change":"2023-12-22T09:17:11.017533+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.017533+0000","last_undegraded":"2023-12-22T09:17:11.017533+0000","last_fullsized":"2023-12-22T09:17:11.017533+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:15.941299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.037566+0000","last_change":"2023-12-22T09:16:58.150323+0000","last_active":"2023-12-22T09:17:10.037566+0000","last_peered":"2023-12-22T09:17:10.037566+0000","last_clean":"2023-12-22T09:17:10.037566+0000","last_became_active":"2023-12-22T09:16:58.150063+0000","last_became_peered":"2023-12-22T09:16:58.150063+0000","last_unstale":"2023-12-22T09:17:10.037566+0000","last_undegraded":"2023-12-22T09:17:10.037566+0000","last_fullsized":"2023-12-22T09:17:10.037566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:25.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.987349+0000","last_change":"2023-12-22T09:16:57.643219+0000","last_active":"2023-12-22T09:17:09.987349+0000","last_peered":"2023-12-22T09:17:09.987349+0000","last_clean":"2023-12-22T09:17:09.987349+0000","last_became_active":"2023-12-22T09:16:57.642986+0000","last_became_peered":"2023-12-22T09:16:57.642986+0000","last_unstale":"2023-12-22T09:17:09.987349+0000","last_undegraded":"2023-12-22T09:17:09.987349+0000","last_fullsized":"2023-12-22T09:17:09.987349+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T09:17:11.997050+0000","last_change":"2023-12-22T09:17:11.997050+0000","last_active":"2023-12-22T09:17:11.997050+0000","last_peered":"2023-12-22T09:17:11.997050+0000","last_clean":"2023-12-22T09:17:11.997050+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.997050+0000","last_undegraded":"2023-12-22T09:17:11.997050+0000","last_fullsized":"2023-12-22T09:17:11.997050+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-12-22T09:17:11.007014+0000","last_change":"2023-12-22T09:17:11.007014+0000","last_active":"2023-12-22T09:17:10.982789+0000","last_peered":"2023-12-22T09:17:10.982789+0000","last_clean":"2023-12-22T09:17:10.982789+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T09:17:11.007014+0000","last_undegraded":"2023-12-22T09:17:11.007014+0000","last_fullsized":"2023-12-22T09:17:11.007014+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:33:46.996428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507919+0000","last_change":"2023-12-22T09:16:58.125951+0000","last_active":"2023-12-22T09:17:12.507919+0000","last_peered":"2023-12-22T09:17:12.507919+0000","last_clean":"2023-12-22T09:17:12.507919+0000","last_became_active":"2023-12-22T09:16:58.125435+0000","last_became_peered":"2023-12-22T09:16:58.125435+0000","last_unstale":"2023-12-22T09:17:12.507919+0000","last_undegraded":"2023-12-22T09:17:12.507919+0000","last_fullsized":"2023-12-22T09:17:12.507919+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:30:10.376413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:09.998060+0000","last_change":"2023-12-22T09:16:57.639438+0000","last_active":"2023-12-22T09:17:09.998060+0000","last_peered":"2023-12-22T09:17:09.998060+0000","last_clean":"2023-12-22T09:17:09.998060+0000","last_became_active":"2023-12-22T09:16:57.639148+0000","last_became_peered":"2023-12-22T09:16:57.639148+0000","last_unstale":"2023-12-22T09:17:09.998060+0000","last_undegraded":"2023-12-22T09:17:09.998060+0000","last_fullsized":"2023-12-22T09:17:09.998060+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:36.593161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-22T09:17:10.039687+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:17:10.039687+0000","last_peered":"2023-12-22T09:17:10.039687+0000","last_clean":"2023-12-22T09:17:10.039687+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:17:10.039687+0000","last_undegraded":"2023-12-22T09:17:10.039687+0000","last_fullsized":"2023-12-22T09:17:10.039687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3857,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1343488,"data_stored":926207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.173,"15min":1.1870000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1060000000000001,"15min":1.129},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.409,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1910000000000001,"15min":1.1990000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.2769999999999999,"15min":1.3220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.339,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1539999999999999,"15min":1.1739999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.3799999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":0.94499999999999995}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.24,"15min":1.256},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.427,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3600000000000001,"15min":1.3720000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.268,"15min":1.2809999999999999},"min":{"1min":0.81399999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":1.038,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.6319999999999999,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.458,"15min":1.427},"min":{"1min":0.91400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":8.1620000000000008,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.476,"15min":1.504},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.6220000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.5649999999999999,"15min":1.5740000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.393,"5min":1.554,"15min":1.581},"min":{"1min":1.127,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.655,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.57799999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":359889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.1100000000000001,"15min":1.1319999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.085,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4810000000000001,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":1.111}]},{"osd":1,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.978,"15min":1.978},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5189999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.661,"5min":1.915,"15min":1.915},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.268,"15min":1.282},"min":{"1min":0.74099999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.194}]},{"osd":3,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4950000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3580000000000001,"15min":1.3740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.736,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.29}]},{"osd":4,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.494,"15min":1.52},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.5549999999999999,"15min":1.585},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.722,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.5329999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.5760000000000001,"15min":1.6060000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.74,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.732},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.671,"15min":1.6970000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.952,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.583}]},{"osd":7,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.6379999999999999,"15min":1.6619999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.859,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.6240000000000001,"15min":1.637},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":2.0459999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3380000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":335085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":0.97099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3240000000000001,"5min":1.677,"15min":1.677},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4650000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0129999999999999}]},{"osd":1,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.107,"15min":1.1180000000000001},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.48,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.24,"15min":1.26},"min":{"1min":0.73499999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.802,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.3500000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5449999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.502},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.159,"15min":1.169},"min":{"1min":0.748,"5min":0.629,"15min":0.629},"max":{"1min":1.4419999999999999,"5min":1.762,"15min":1.762},"last":1.1619999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.256,"15min":1.264},"min":{"1min":0.88,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5640000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.284,"15min":1.306},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8089999999999999,"5min":2.431,"15min":2.431},"last":1.627}]},{"osd":4,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.304,"15min":1.3120000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5629999999999999,"5min":1.889,"15min":1.889},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4870000000000001,"15min":1.5},"min":{"1min":0.874,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.996}]},{"osd":6,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4099999999999999,"15min":1.4299999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.982,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4179999999999999,"15min":1.4359999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7889999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.77}]},{"osd":7,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.464,"15min":1.48},"min":{"1min":0.97499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.8540000000000001,"5min":3.298,"15min":3.298},"last":1.9259999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.504,"15min":1.5249999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.0899999999999999,"5min":2.589,"15min":2.589},"last":1.867}]}]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":338122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3320000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.115,"15min":1.121},"min":{"1min":0.70399999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5409999999999999,"5min":2.25,"15min":2.25},"last":1.23}]},{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.113,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.345,"5min":1.782,"15min":1.782},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.425,"5min":1.494,"15min":1.494},"last":1.0920000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4890000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.446},{"interface":"front","average":{"1min":1.147,"5min":1.2130000000000001,"15min":1.224},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7749999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.97499999999999998}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.1319999999999999,"15min":1.149},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.542,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.2929999999999999,"15min":1.3149999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.4690000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1579999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3320000000000001,"15min":1.3520000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.909,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.268,"15min":1.286},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.679,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.419}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4950000000000001,"5min":2.052,"15min":2.052},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.5069999999999999,"15min":1.5329999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.373}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.4079999999999999,"15min":1.4350000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7470000000000001,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.198},{"interface":"front","average":{"1min":1.339,"5min":1.512,"15min":1.5409999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.629,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.5309999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":733184,"data_stored":335063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88500000000000001,"15min":0.89700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.627,"5min":1.716,"15min":1.716},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4430000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.503},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.65500000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.093,"15min":1.105},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1719999999999999,"15min":1.1899999999999999},"min":{"1min":0.66700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4019999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.244,"15min":1.25},"min":{"1min":0.90900000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.722,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.92200000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.571,"5min":2.508,"15min":2.508},"last":0.84499999999999997}]},{"osd":5,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":2.0030000000000001,"15min":2.1219999999999999},"min":{"1min":0.86299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6519999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.258,"5min":2.254,"15min":2.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.6739999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":2.423,"15min":2.6219999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.752,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.056},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.1970000000000001,"15min":2.339},"min":{"1min":0.98999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.722,"5min":27.181999999999999,"15min":27.181999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2,"15min":2.121},"min":{"1min":1.016,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5069999999999999,"5min":22.715,"15min":22.715},"last":1.071},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.3860000000000001,"15min":2.5619999999999998},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.643,"5min":30.108000000000001,"15min":30.108000000000001},"last":0.81599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":335063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.85599999999999998,"15min":0.88},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.395,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.097},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.95699999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.381,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":1.0069999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.357,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.98899999999999999,"15min":1.002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5489999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.88800000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0049999999999999,"15min":1.016},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5289999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.173,"15min":1.1910000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6279999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.94599999999999995}]},{"osd":4,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.377,"15min":1.4179999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6160000000000001,"5min":2.802,"15min":2.802},"last":1.256},{"interface":"front","average":{"1min":1.276,"5min":1.4139999999999999,"15min":1.4370000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.758,"5min":2.46,"15min":2.46},"last":1.1379999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2889999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.595,"5min":3.327,"15min":3.327},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.371,"15min":1.399},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":1.2010000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4279999999999999,"15min":1.452},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9950000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.228},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.369,"15min":1.3999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.554,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":1.5629999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.4870000000000001,"15min":1.516},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.823,"5min":2.867,"15min":2.867},"last":1.302},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4670000000000001,"15min":1.4950000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.724,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":1.609}]}]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":761856,"data_stored":338886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.879,"15min":0.90700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.262,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.083},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3260000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.94199999999999995}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.90600000000000003,"15min":0.92800000000000005},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.218,"5min":1.504,"15min":1.504},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.103,"15min":1.143},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.282,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.224}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.0409999999999999,"15min":1.0700000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.54,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.266,"15min":1.3069999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4430000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":1.3460000000000001}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.68799999999999994,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4330000000000001,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.3129999999999999,"15min":1.3500000000000001},"min":{"1min":0.77200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6599999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.177}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.4019999999999999,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.1720000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.534,"15min":1.5880000000000001},"min":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.649,"5min":4.524,"15min":4.524},"last":1.7909999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.5349999999999999,"15min":1.581},"min":{"1min":0.80900000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.9139999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3879999999999999,"15min":1.4139999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.881,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.1339999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.474,"15min":1.5089999999999999},"min":{"1min":0.79800000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.29,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":1.421},{"interface":"front","average":{"1min":1.319,"5min":1.52,"15min":1.554},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.766,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":1.8600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1327104,"data_stored":925431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.89600000000000002}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.0229999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2689999999999999,"5min":1.548,"15min":1.548},"last":1.3380000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.98099999999999998,"15min":1.0129999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.242,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.216}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.1930000000000001,"15min":1.238},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6120000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.0900000000000001,"15min":1.1319999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3939999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1799999999999999,"15min":1.1990000000000001},"min":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.601,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.357,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":3.589,"15min":3.589},"last":1.24}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5920000000000001,"5min":1.748,"15min":1.748},"last":1.133},{"interface":"front","average":{"1min":1.167,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.72599999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.49,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.0700000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.268,"15min":1.282},"min":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.611,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.3069999999999999,"15min":1.333},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.96199999999999997}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.365,"15min":1.3879999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8109999999999999,"5min":2.157,"15min":2.157},"last":1.377},{"interface":"front","average":{"1min":1.22,"5min":1.419,"15min":1.452},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6439999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.304}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:17:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-12-22T09:17:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-12-22T09:17:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-12-22T09:17:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-12-22T09:17:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-12-22T09:17:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.024204+0000', 'last_change': '2023-12-22T09:17:11.024204+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.024204+0000', 'last_undegraded': '2023-12-22T09:17:11.024204+0000', 'last_fullsized': '2023-12-22T09:17:11.024204+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T09:17:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.015046+0000', 'last_change': '2023-12-22T09:17:11.015046+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.015046+0000', 'last_undegraded': '2023-12-22T09:17:11.015046+0000', 'last_fullsized': '2023-12-22T09:17:11.015046+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T11:06:27.752298+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.019124+0000', 'last_change': '2023-12-22T09:17:11.019124+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.019124+0000', 'last_undegraded': '2023-12-22T09:17:11.019124+0000', 'last_fullsized': '2023-12-22T09:17:11.019124+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T13:30:03.329046+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-12-22T09:17:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-12-22T09:17:17.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.031825+0000', 'last_change': '2023-12-22T09:17:11.031825+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.031825+0000', 'last_undegraded': '2023-12-22T09:17:11.031825+0000', 'last_fullsized': '2023-12-22T09:17:11.031825+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-22T09:17:17.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.015535+0000', 'last_change': '2023-12-22T09:17:11.015535+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.015535+0000', 'last_undegraded': '2023-12-22T09:17:11.015535+0000', 'last_fullsized': '2023-12-22T09:17:11.015535+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T14:17:23.589301+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.014643+0000', 'last_change': '2023-12-22T09:17:11.014643+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.014643+0000', 'last_undegraded': '2023-12-22T09:17:11.014643+0000', 'last_fullsized': '2023-12-22T09:17:11.014643+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T11:00:29.709741+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.024975+0000', 'last_change': '2023-12-22T09:17:11.024975+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.024975+0000', 'last_undegraded': '2023-12-22T09:17:11.024975+0000', 'last_fullsized': '2023-12-22T09:17:11.024975+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T11:57:47.077419+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-12-22T09:17:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.016758+0000', 'last_change': '2023-12-22T09:17:11.016758+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.016758+0000', 'last_undegraded': '2023-12-22T09:17:11.016758+0000', 'last_fullsized': '2023-12-22T09:17:11.016758+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T18:56:28.077725+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.020619+0000', 'last_change': '2023-12-22T09:17:11.020619+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.020619+0000', 'last_undegraded': '2023-12-22T09:17:11.020619+0000', 'last_fullsized': '2023-12-22T09:17:11.020619+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T13:45:44.261501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-12-22T09:17:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.024241+0000', 'last_change': '2023-12-22T09:17:11.024241+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.024241+0000', 'last_undegraded': '2023-12-22T09:17:11.024241+0000', 'last_fullsized': '2023-12-22T09:17:11.024241+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T09:49:30.159981+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.015119+0000', 'last_change': '2023-12-22T09:17:11.015119+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.015119+0000', 'last_undegraded': '2023-12-22T09:17:11.015119+0000', 'last_fullsized': '2023-12-22T09:17:11.015119+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T13:43:07.491118+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.031397+0000', 'last_change': '2023-12-22T09:17:11.031397+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.031397+0000', 'last_undegraded': '2023-12-22T09:17:11.031397+0000', 'last_fullsized': '2023-12-22T09:17:11.031397+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.023927+0000', 'last_change': '2023-12-22T09:17:11.023927+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.023927+0000', 'last_undegraded': '2023-12-22T09:17:11.023927+0000', 'last_fullsized': '2023-12-22T09:17:11.023927+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T16:56:30.038651+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.018018+0000', 'last_change': '2023-12-22T09:17:11.018018+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.018018+0000', 'last_undegraded': '2023-12-22T09:17:11.018018+0000', 'last_fullsized': '2023-12-22T09:17:11.018018+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T18:32:53.836251+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T09:17:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.016192+0000', 'last_change': '2023-12-22T09:17:11.016192+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.016192+0000', 'last_undegraded': '2023-12-22T09:17:11.016192+0000', 'last_fullsized': '2023-12-22T09:17:11.016192+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T12:12:56.005441+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.011904+0000', 'last_change': '2023-12-22T09:17:11.011904+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.011904+0000', 'last_undegraded': '2023-12-22T09:17:11.011904+0000', 'last_fullsized': '2023-12-22T09:17:11.011904+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T16:34:22.106083+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-12-22T09:17:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.019465+0000', 'last_change': '2023-12-22T09:17:11.019465+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.019465+0000', 'last_undegraded': '2023-12-22T09:17:11.019465+0000', 'last_fullsized': '2023-12-22T09:17:11.019465+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T13:58:27.519985+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.014785+0000', 'last_change': '2023-12-22T09:17:11.014785+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.014785+0000', 'last_undegraded': '2023-12-22T09:17:11.014785+0000', 'last_fullsized': '2023-12-22T09:17:11.014785+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T18:30:47.502516+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.006940+0000', 'last_change': '2023-12-22T09:17:11.006940+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.006940+0000', 'last_undegraded': '2023-12-22T09:17:11.006940+0000', 'last_fullsized': '2023-12-22T09:17:11.006940+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T11:22:18.487717+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.006508+0000', 'last_change': '2023-12-22T09:17:11.006508+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.006508+0000', 'last_undegraded': '2023-12-22T09:17:11.006508+0000', 'last_fullsized': '2023-12-22T09:17:11.006508+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T15:35:18.691505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-12-22T09:17:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.007077+0000', 'last_change': '2023-12-22T09:17:11.007077+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.007077+0000', 'last_undegraded': '2023-12-22T09:17:11.007077+0000', 'last_fullsized': '2023-12-22T09:17:11.007077+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T13:19:24.280048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.017956+0000', 'last_change': '2023-12-22T09:17:11.017956+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.017956+0000', 'last_undegraded': '2023-12-22T09:17:11.017956+0000', 'last_fullsized': '2023-12-22T09:17:11.017956+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.017577+0000', 'last_change': '2023-12-22T09:17:11.017577+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.017577+0000', 'last_undegraded': '2023-12-22T09:17:11.017577+0000', 'last_fullsized': '2023-12-22T09:17:11.017577+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T13:10:15.433618+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-12-22T09:17:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-12-22T09:17:17.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.023744+0000', 'last_change': '2023-12-22T09:17:11.023744+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.023744+0000', 'last_undegraded': '2023-12-22T09:17:11.023744+0000', 'last_fullsized': '2023-12-22T09:17:11.023744+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T12:49:00.845862+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-22T09:17:17.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-12-22T09:17:17.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.031752+0000', 'last_change': '2023-12-22T09:17:11.031752+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.031752+0000', 'last_undegraded': '2023-12-22T09:17:11.031752+0000', 'last_fullsized': '2023-12-22T09:17:11.031752+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T16:28:17.921536+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-22T09:17:17.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-12-22T09:17:17.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.011644+0000', 'last_change': '2023-12-22T09:17:11.011644+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.011644+0000', 'last_undegraded': '2023-12-22T09:17:11.011644+0000', 'last_fullsized': '2023-12-22T09:17:11.011644+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T17:40:44.983134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.017533+0000', 'last_change': '2023-12-22T09:17:11.017533+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.017533+0000', 'last_undegraded': '2023-12-22T09:17:11.017533+0000', 'last_fullsized': '2023-12-22T09:17:11.017533+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T10:09:15.941299+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T09:17:11.997050+0000', 'last_change': '2023-12-22T09:17:11.997050+0000', 'last_active': '2023-12-22T09:17:11.997050+0000', 'last_peered': '2023-12-22T09:17:11.997050+0000', 'last_clean': '2023-12-22T09:17:11.997050+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.997050+0000', 'last_undegraded': '2023-12-22T09:17:11.997050+0000', 'last_fullsized': '2023-12-22T09:17:11.997050+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:11.997050+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-12-22T09:17:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-12-22T09:17:11.007014+0000', 'last_change': '2023-12-22T09:17:11.007014+0000', 'last_active': '2023-12-22T09:17:10.982789+0000', 'last_peered': '2023-12-22T09:17:10.982789+0000', 'last_clean': '2023-12-22T09:17:10.982789+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T09:17:11.007014+0000', 'last_undegraded': '2023-12-22T09:17:11.007014+0000', 'last_fullsized': '2023-12-22T09:17:11.007014+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'last_clean_scrub_stamp': '2023-12-22T09:17:10.982789+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T15:33:46.996428+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-22T09:17:17.997 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-22T09:17:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.224+0000 7fb72535c640 1 Processor -- start 2023-12-22T09:17:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.225+0000 7fb72535c640 1 -- start start 2023-12-22T09:17:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.226+0000 7fb72535c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb7201551c0 0x7fb720069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.226+0000 7fb72535c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb72006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.226+0000 7fb72535c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72006c510 con 0x7fb72014f370 2023-12-22T09:17:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.226+0000 7fb72535c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72006c1e0 con 0x7fb7201551c0 2023-12-22T09:17:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.226+0000 7fb72535c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb720071a30 con 0x7fb72006a130 2023-12-22T09:17:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb71effd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb72014f370 0x7fb720071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49634/0 (socket says 172.21.15.106:49634) 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb71effd640 1 -- 172.21.15.106:0/1184630343 learned_addr learned my addr 172.21.15.106:0/1184630343 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb7167fc640 1 --2- 172.21.15.106:0/1184630343 >> v2:172.21.15.106:3300/0 conn(0x7fb7201551c0 0x7fb720069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb71e7fc640 1 -- 172.21.15.106:0/1184630343 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945766776 0 0) 0x7fb72006c510 con 0x7fb72014f370 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb71e7fc640 1 -- 172.21.15.106:0/1184630343 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70c003520 con 0x7fb72014f370 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb71f7fe640 1 --2- 172.21.15.106:0/1184630343 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb72006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb7167fc640 1 -- 172.21.15.106:0/1184630343 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 msgr2=0x7fb72006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb7167fc640 1 --2- 172.21.15.106:0/1184630343 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb72006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb7167fc640 1 -- 172.21.15.106:0/1184630343 >> v1:172.21.15.106:6789/0 conn(0x7fb72014f370 legacy=0x7fb720071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb7167fc640 1 -- 172.21.15.106:0/1184630343 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720071d10 con 0x7fb7201551c0 2023-12-22T09:17:18.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.227+0000 7fb71f7fe640 1 --2- 172.21.15.106:0/1184630343 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb72006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.228+0000 7fb7167fc640 1 --2- 172.21.15.106:0/1184630343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7201551c0 0x7fb720069bf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097a0 tx=0x7fb70802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d11c5adbf529b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb71e7fc640 1 -- 172.21.15.106:0/1184630343 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70802d040 con 0x7fb7201551c0 2023-12-22T09:17:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb71e7fc640 1 -- 172.21.15.106:0/1184630343 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708031810 con 0x7fb7201551c0 2023-12-22T09:17:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb71e7fc640 1 -- 172.21.15.106:0/1184630343 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708031ba0 con 0x7fb7201551c0 2023-12-22T09:17:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb72535c640 1 -- 172.21.15.106:0/1184630343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7201551c0 msgr2=0x7fb720069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb72535c640 1 --2- 172.21.15.106:0/1184630343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7201551c0 0x7fb720069bf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097a0 tx=0x7fb70802b8b0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb72535c640 1 -- 172.21.15.106:0/1184630343 shutdown_connections 2023-12-22T09:17:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb72535c640 1 --2- 172.21.15.106:0/1184630343 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb72006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb72535c640 1 --2- 172.21.15.106:0/1184630343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7201551c0 0x7fb720069bf0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb72535c640 1 -- 172.21.15.106:0/1184630343 >> 172.21.15.106:0/1184630343 conn(0x7fb7200c1db0 msgr2=0x7fb7200c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb72535c640 1 -- 172.21.15.106:0/1184630343 shutdown_connections 2023-12-22T09:17:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.229+0000 7fb72535c640 1 -- 172.21.15.106:0/1184630343 wait complete. 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.231+0000 7fb72535c640 1 Processor -- start 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.231+0000 7fb72535c640 1 -- start start 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.232+0000 7fb72535c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb7200c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.232+0000 7fb72535c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb72014f370 0x7fb72014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.232+0000 7fb72535c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7201551c0 0x7fb7201504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.232+0000 7fb72535c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201eb1a0 con 0x7fb72014f370 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.232+0000 7fb72535c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201dd0c0 con 0x7fb7201551c0 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.232+0000 7fb72535c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201eb6d0 con 0x7fb72006a130 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.232+0000 7fb7167fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb72014f370 0x7fb72014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.232+0000 7fb7167fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb72014f370 0x7fb72014ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40446/0 (socket says 172.21.15.106:40446) 2023-12-22T09:17:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.232+0000 7fb7167fc640 1 -- 172.21.15.106:0/3110575315 learned_addr learned my addr 172.21.15.106:0/3110575315 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb71f7fe640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7201551c0 0x7fb7201504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb7167fc640 1 -- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 msgr2=0x7fb7200c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb71effd640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb7200c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb7167fc640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb7200c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb7167fc640 1 -- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7201551c0 msgr2=0x7fb7201504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb7167fc640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7201551c0 0x7fb7201504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb7167fc640 1 -- 172.21.15.106:0/3110575315 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708009400 con 0x7fb72014f370 2023-12-22T09:17:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb71f7fe640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7201551c0 0x7fb7201504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb71effd640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb7200c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb7167fc640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb72014f370 0x7fb72014ffb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb708000c00 tx=0x7fb7080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb717fff640 1 -- 172.21.15.106:0/3110575315 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708006e10 con 0x7fb72014f370 2023-12-22T09:17:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb717fff640 1 -- 172.21.15.106:0/3110575315 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70803ad60 con 0x7fb72014f370 2023-12-22T09:17:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb717fff640 1 -- 172.21.15.106:0/3110575315 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708044630 con 0x7fb72014f370 2023-12-22T09:17:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7201eb3f0 con 0x7fb72014f370 2023-12-22T09:17:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.233+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7201dcd50 con 0x7fb72014f370 2023-12-22T09:17:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.235+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72004e080 con 0x7fb72014f370 2023-12-22T09:17:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.235+0000 7fb717fff640 1 -- 172.21.15.106:0/3110575315 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb70804d450 con 0x7fb72014f370 2023-12-22T09:17:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.237+0000 7fb717fff640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb70006a430 0x7fb70006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.237+0000 7fb717fff640 1 -- 172.21.15.106:0/3110575315 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fb7080ab120 con 0x7fb72014f370 2023-12-22T09:17:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.237+0000 7fb71effd640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb70006a430 0x7fb70006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.238+0000 7fb71effd640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb70006a430 0x7fb70006c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb710007fd0 tx=0x7fb710009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.241+0000 7fb717fff640 1 -- 172.21.15.106:0/3110575315 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb708076160 con 0x7fb72014f370 2023-12-22T09:17:18.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.481+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb7200734a0 con 0x7fb72014f370 2023-12-22T09:17:18.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.482+0000 7fb717fff640 1 -- 172.21.15.106:0/3110575315 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1727 (secure 0 0 0) 0x7fb708079780 con 0x7fb72014f370 2023-12-22T09:17:18.483 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:18.483 INFO:teuthology.orchestra.run.smithi106.stdout:{"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":194,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":64,"num_osds":8,"num_up_osds":8,"osd_up_since":1703236455,"num_in_osds":8,"osd_in_since":1703236447,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":110},{"state_name":"unknown","count":55},{"state_name":"creating+peering","count":28}],"num_pgs":193,"num_pools":5,"num_objects":29,"data_bytes":595789,"bytes_used":240541696,"bytes_avail":772853571584,"bytes_total":773094113280,"unknown_pgs_ratio":0.28497409820556641,"inactive_pgs_ratio":0.14507772028446198,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"write_bytes_sec":889,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":35,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":5182},{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5185}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-12-22T09:16:48.743588+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-22T09:17:18.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb70006a430 msgr2=0x7fb70006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb70006a430 0x7fb70006c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb710007fd0 tx=0x7fb710009040 comp rx=0 tx=0).stop 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb72014f370 msgr2=0x7fb72014ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb72014f370 0x7fb72014ffb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb708000c00 tx=0x7fb7080046c0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 shutdown_connections 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fb70006a430 0x7fb70006c8f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7201551c0 0x7fb7201504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb72014f370 0x7fb72014ffb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 --2- 172.21.15.106:0/3110575315 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb72006a130 0x7fb7200c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.484+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 >> 172.21.15.106:0/3110575315 conn(0x7fb7200c1db0 msgr2=0x7fb72006c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.485+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 shutdown_connections 2023-12-22T09:17:18.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.485+0000 7fb72535c640 1 -- 172.21.15.106:0/3110575315 wait complete. 2023-12-22T09:17:18.503 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-22T09:17:18.503 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:17:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.709+0000 7f2255ffd640 1 Processor -- start 2023-12-22T09:17:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.710+0000 7f2255ffd640 1 -- start start 2023-12-22T09:17:18.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.711+0000 7f2255ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22501514b0 0x7f22500c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.711+0000 7f2255ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f22500c4130 0x7f2250154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.711+0000 7f2255ffd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500c4660 con 0x7f2250154a80 2023-12-22T09:17:18.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.711+0000 7f2255ffd640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2250153d60 con 0x7f22500c4130 2023-12-22T09:17:18.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.711+0000 7f2255ffd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225006b250 con 0x7f22501514b0 2023-12-22T09:17:18.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.711+0000 7f224ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2250154a80 0x7f22500c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49650/0 (socket says 172.21.15.106:49650) 2023-12-22T09:17:18.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.711+0000 7f224ffff640 1 -- 172.21.15.106:0/1454200865 learned_addr learned my addr 172.21.15.106:0/1454200865 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:18.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.711+0000 7f224effd640 1 --2- 172.21.15.106:0/1454200865 >> v2:172.21.15.106:3300/0 conn(0x7f22500c4130 0x7f2250154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.711+0000 7f224f7fe640 1 --2- 172.21.15.106:0/1454200865 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22501514b0 0x7f22500c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.712+0000 7f224effd640 1 -- 172.21.15.106:0/1454200865 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22501514b0 msgr2=0x7f22500c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:18.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.712+0000 7f224effd640 1 --2- 172.21.15.106:0/1454200865 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22501514b0 0x7f22500c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.712+0000 7f224effd640 1 -- 172.21.15.106:0/1454200865 >> v1:172.21.15.106:6789/0 conn(0x7f2250154a80 legacy=0x7f22500c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.712+0000 7f224effd640 1 -- 172.21.15.106:0/1454200865 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225006b530 con 0x7f22500c4130 2023-12-22T09:17:18.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.712+0000 7f224e7fc640 1 -- 172.21.15.106:0/1454200865 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188143396 0 0) 0x7f22500c4660 con 0x7f2250154a80 2023-12-22T09:17:18.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.713+0000 7f224effd640 1 --2- 172.21.15.106:0/1454200865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22500c4130 0x7f2250154540 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f22380097a0 tx=0x7f223802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2a05de9b28960b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.713+0000 7f224e7fc640 1 -- 172.21.15.106:0/1454200865 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223802e070 con 0x7f22500c4130 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.713+0000 7f224e7fc640 1 -- 172.21.15.106:0/1454200865 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22380315a0 con 0x7f22500c4130 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.713+0000 7f224e7fc640 1 -- 172.21.15.106:0/1454200865 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238031930 con 0x7f22500c4130 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.714+0000 7f2255ffd640 1 -- 172.21.15.106:0/1454200865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22500c4130 msgr2=0x7f2250154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.714+0000 7f2255ffd640 1 --2- 172.21.15.106:0/1454200865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22500c4130 0x7f2250154540 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f22380097a0 tx=0x7f223802b840 comp rx=0 tx=0).stop 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.714+0000 7f2255ffd640 1 -- 172.21.15.106:0/1454200865 shutdown_connections 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.714+0000 7f2255ffd640 1 --2- 172.21.15.106:0/1454200865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22500c4130 0x7f2250154540 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.714+0000 7f2255ffd640 1 --2- 172.21.15.106:0/1454200865 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22501514b0 0x7f22500c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.714+0000 7f2255ffd640 1 -- 172.21.15.106:0/1454200865 >> 172.21.15.106:0/1454200865 conn(0x7f22500ab1a0 msgr2=0x7f22500ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:18.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.714+0000 7f2255ffd640 1 -- 172.21.15.106:0/1454200865 shutdown_connections 2023-12-22T09:17:18.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.714+0000 7f2255ffd640 1 -- 172.21.15.106:0/1454200865 wait complete. 2023-12-22T09:17:18.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.716+0000 7f2255ffd640 1 Processor -- start 2023-12-22T09:17:18.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.716+0000 7f2255ffd640 1 -- start start 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f2255ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22500c4130 0x7f22500aa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f2255ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22501514b0 0x7f22501ec800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f2255ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22501dafa0 0x7f225014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f2255ffd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2250146b00 con 0x7f22501dafa0 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f2255ffd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22501e9a80 con 0x7f22500c4130 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f2255ffd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22501db710 con 0x7f22501514b0 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f224ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22501dafa0 0x7f225014cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f224ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22501dafa0 0x7f225014cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40458/0 (socket says 172.21.15.106:40458) 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f224ffff640 1 -- 172.21.15.106:0/3341799184 learned_addr learned my addr 172.21.15.106:0/3341799184 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f224ffff640 1 -- 172.21.15.106:0/3341799184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22501514b0 msgr2=0x7f22501ec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f224f7fe640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22500c4130 0x7f22500aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f224ffff640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22501514b0 0x7f22501ec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f224ffff640 1 -- 172.21.15.106:0/3341799184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22500c4130 msgr2=0x7f22500aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f224ffff640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22500c4130 0x7f22500aa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.717+0000 7f224ffff640 1 -- 172.21.15.106:0/3341799184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2238009400 con 0x7f22501dafa0 2023-12-22T09:17:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.718+0000 7f224ffff640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22501dafa0 0x7f225014cb30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f224800c440 tx=0x7f224800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.718+0000 7f2247fff640 1 -- 172.21.15.106:0/3341799184 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480074e0 con 0x7f22501dafa0 2023-12-22T09:17:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.718+0000 7f2247fff640 1 -- 172.21.15.106:0/3341799184 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2248007660 con 0x7f22501dafa0 2023-12-22T09:17:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.718+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22500c78b0 con 0x7f22501dafa0 2023-12-22T09:17:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.718+0000 7f2247fff640 1 -- 172.21.15.106:0/3341799184 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248004a20 con 0x7f22501dafa0 2023-12-22T09:17:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.718+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22501e9430 con 0x7f22501dafa0 2023-12-22T09:17:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.719+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22501e9290 con 0x7f22501dafa0 2023-12-22T09:17:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.720+0000 7f2247fff640 1 -- 172.21.15.106:0/3341799184 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2248004b80 con 0x7f22501dafa0 2023-12-22T09:17:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.721+0000 7f2247fff640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f223006a460 0x7f223006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.721+0000 7f2247fff640 1 -- 172.21.15.106:0/3341799184 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f2248088c00 con 0x7f22501dafa0 2023-12-22T09:17:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.721+0000 7f224f7fe640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f223006a460 0x7f223006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.722+0000 7f224f7fe640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f223006a460 0x7f223006c920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f22500c04a0 tx=0x7f224000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.725+0000 7f2247fff640 1 -- 172.21.15.106:0/3341799184 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22501e9290 con 0x7f22501dafa0 2023-12-22T09:17:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.911+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2250154020 con 0x7f223006a460 2023-12-22T09:17:18.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.945+0000 7f2247fff640 1 -- 172.21.15.106:0/3341799184 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525516 (secure 0 0 0) 0x7f2240009690 con 0x7f223006a460 2023-12-22T09:17:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:18.959 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:17:18.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f223006a460 msgr2=0x7f223006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f223006a460 0x7f223006c920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f22500c04a0 tx=0x7f224000b040 comp rx=0 tx=0).stop 2023-12-22T09:17:18.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22501dafa0 msgr2=0x7f225014cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:18.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22501dafa0 0x7f225014cb30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f224800c440 tx=0x7f224800c900 comp rx=0 tx=0).stop 2023-12-22T09:17:18.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 shutdown_connections 2023-12-22T09:17:18.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f223006a460 0x7f223006c920 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22501dafa0 0x7f225014cb30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f22501514b0 0x7f22501ec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 --2- 172.21.15.106:0/3341799184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22500c4130 0x7f22500aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:18.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 >> 172.21.15.106:0/3341799184 conn(0x7f22500ab1a0 msgr2=0x7f225014abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:18.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 shutdown_connections 2023-12-22T09:17:18.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:18.955+0000 7f2255ffd640 1 -- 172.21.15.106:0/3341799184 wait complete. 2023-12-22T09:17:18.976 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-12-22T09:17:18.752370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596587,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235208,"kb_used_data":7304,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754739512,"statfs":{"total":773094113280,"available":772853260288,"internally_reserved":0,"allocated":7479296,"data_stored":4059502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.747322"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516357+0000","last_change":"2023-12-22T09:17:12.540063+0000","last_active":"2023-12-22T09:17:13.516357+0000","last_peered":"2023-12-22T09:17:13.516357+0000","last_clean":"2023-12-22T09:17:13.516357+0000","last_became_active":"2023-12-22T09:17:12.538574+0000","last_became_peered":"2023-12-22T09:17:12.538574+0000","last_unstale":"2023-12-22T09:17:13.516357+0000","last_undegraded":"2023-12-22T09:17:13.516357+0000","last_fullsized":"2023-12-22T09:17:13.516357+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:47.737577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501134+0000","last_change":"2023-12-22T09:16:58.138391+0000","last_active":"2023-12-22T09:17:12.501134+0000","last_peered":"2023-12-22T09:17:12.501134+0000","last_clean":"2023-12-22T09:17:12.501134+0000","last_became_active":"2023-12-22T09:16:58.138138+0000","last_became_peered":"2023-12-22T09:16:58.138138+0000","last_unstale":"2023-12-22T09:17:12.501134+0000","last_undegraded":"2023-12-22T09:17:12.501134+0000","last_fullsized":"2023-12-22T09:17:12.501134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.671885+0000","last_change":"2023-12-22T09:17:12.531701+0000","last_active":"2023-12-22T09:17:13.671885+0000","last_peered":"2023-12-22T09:17:13.671885+0000","last_clean":"2023-12-22T09:17:13.671885+0000","last_became_active":"2023-12-22T09:17:12.531394+0000","last_became_peered":"2023-12-22T09:17:12.531394+0000","last_unstale":"2023-12-22T09:17:13.671885+0000","last_undegraded":"2023-12-22T09:17:13.671885+0000","last_fullsized":"2023-12-22T09:17:13.671885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:40.824932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.504206+0000","last_change":"2023-12-22T09:16:58.122537+0000","last_active":"2023-12-22T09:17:12.504206+0000","last_peered":"2023-12-22T09:17:12.504206+0000","last_clean":"2023-12-22T09:17:12.504206+0000","last_became_active":"2023-12-22T09:16:58.122285+0000","last_became_peered":"2023-12-22T09:16:58.122285+0000","last_unstale":"2023-12-22T09:17:12.504206+0000","last_undegraded":"2023-12-22T09:17:12.504206+0000","last_fullsized":"2023-12-22T09:17:12.504206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672554+0000","last_change":"2023-12-22T09:17:12.540485+0000","last_active":"2023-12-22T09:17:13.672554+0000","last_peered":"2023-12-22T09:17:13.672554+0000","last_clean":"2023-12-22T09:17:13.672554+0000","last_became_active":"2023-12-22T09:17:12.539787+0000","last_became_peered":"2023-12-22T09:17:12.539787+0000","last_unstale":"2023-12-22T09:17:13.672554+0000","last_undegraded":"2023-12-22T09:17:13.672554+0000","last_fullsized":"2023-12-22T09:17:13.672554+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:57:30.900658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.524314+0000","last_change":"2023-12-22T09:16:58.155070+0000","last_active":"2023-12-22T09:17:12.524314+0000","last_peered":"2023-12-22T09:17:12.524314+0000","last_clean":"2023-12-22T09:17:12.524314+0000","last_became_active":"2023-12-22T09:16:58.154786+0000","last_became_peered":"2023-12-22T09:16:58.154786+0000","last_unstale":"2023-12-22T09:17:12.524314+0000","last_undegraded":"2023-12-22T09:17:12.524314+0000","last_fullsized":"2023-12-22T09:17:12.524314+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512658+0000","last_change":"2023-12-22T09:17:12.541546+0000","last_active":"2023-12-22T09:17:13.512658+0000","last_peered":"2023-12-22T09:17:13.512658+0000","last_clean":"2023-12-22T09:17:13.512658+0000","last_became_active":"2023-12-22T09:17:12.541240+0000","last_became_peered":"2023-12-22T09:17:12.541240+0000","last_unstale":"2023-12-22T09:17:13.512658+0000","last_undegraded":"2023-12-22T09:17:13.512658+0000","last_fullsized":"2023-12-22T09:17:13.512658+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:11:26.005625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509433+0000","last_change":"2023-12-22T09:17:11.034865+0000","last_active":"2023-12-22T09:17:12.509433+0000","last_peered":"2023-12-22T09:17:12.509433+0000","last_clean":"2023-12-22T09:17:12.509433+0000","last_became_active":"2023-12-22T09:17:11.034194+0000","last_became_peered":"2023-12-22T09:17:11.034194+0000","last_unstale":"2023-12-22T09:17:12.509433+0000","last_undegraded":"2023-12-22T09:17:12.509433+0000","last_fullsized":"2023-12-22T09:17:12.509433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:09:17.505510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.785711+0000","last_change":"2023-12-22T09:17:12.534295+0000","last_active":"2023-12-22T09:17:13.785711+0000","last_peered":"2023-12-22T09:17:13.785711+0000","last_clean":"2023-12-22T09:17:13.785711+0000","last_became_active":"2023-12-22T09:17:12.534061+0000","last_became_peered":"2023-12-22T09:17:12.534061+0000","last_unstale":"2023-12-22T09:17:13.785711+0000","last_undegraded":"2023-12-22T09:17:13.785711+0000","last_fullsized":"2023-12-22T09:17:13.785711+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:45.275761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507609+0000","last_change":"2023-12-22T09:16:58.143885+0000","last_active":"2023-12-22T09:17:12.507609+0000","last_peered":"2023-12-22T09:17:12.507609+0000","last_clean":"2023-12-22T09:17:12.507609+0000","last_became_active":"2023-12-22T09:16:58.143627+0000","last_became_peered":"2023-12-22T09:16:58.143627+0000","last_unstale":"2023-12-22T09:17:12.507609+0000","last_undegraded":"2023-12-22T09:17:12.507609+0000","last_fullsized":"2023-12-22T09:17:12.507609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:50:47.328724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787613+0000","last_change":"2023-12-22T09:17:12.542357+0000","last_active":"2023-12-22T09:17:13.787613+0000","last_peered":"2023-12-22T09:17:13.787613+0000","last_clean":"2023-12-22T09:17:13.787613+0000","last_became_active":"2023-12-22T09:17:12.540751+0000","last_became_peered":"2023-12-22T09:17:12.540751+0000","last_unstale":"2023-12-22T09:17:13.787613+0000","last_undegraded":"2023-12-22T09:17:13.787613+0000","last_fullsized":"2023-12-22T09:17:13.787613+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:56.342160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511426+0000","last_change":"2023-12-22T09:16:58.140402+0000","last_active":"2023-12-22T09:17:12.511426+0000","last_peered":"2023-12-22T09:17:12.511426+0000","last_clean":"2023-12-22T09:17:12.511426+0000","last_became_active":"2023-12-22T09:16:58.140117+0000","last_became_peered":"2023-12-22T09:16:58.140117+0000","last_unstale":"2023-12-22T09:17:12.511426+0000","last_undegraded":"2023-12-22T09:17:12.511426+0000","last_fullsized":"2023-12-22T09:17:12.511426+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:25:20.515272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.518207+0000","last_change":"2023-12-22T09:17:12.544744+0000","last_active":"2023-12-22T09:17:13.518207+0000","last_peered":"2023-12-22T09:17:13.518207+0000","last_clean":"2023-12-22T09:17:13.518207+0000","last_became_active":"2023-12-22T09:17:12.544447+0000","last_became_peered":"2023-12-22T09:17:12.544447+0000","last_unstale":"2023-12-22T09:17:13.518207+0000","last_undegraded":"2023-12-22T09:17:13.518207+0000","last_fullsized":"2023-12-22T09:17:13.518207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:47.584016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.517459+0000","last_change":"2023-12-22T09:16:58.138038+0000","last_active":"2023-12-22T09:17:12.517459+0000","last_peered":"2023-12-22T09:17:12.517459+0000","last_clean":"2023-12-22T09:17:12.517459+0000","last_became_active":"2023-12-22T09:16:58.137394+0000","last_became_peered":"2023-12-22T09:16:58.137394+0000","last_unstale":"2023-12-22T09:17:12.517459+0000","last_undegraded":"2023-12-22T09:17:12.517459+0000","last_fullsized":"2023-12-22T09:17:12.517459+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:53.435793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.655888+0000","last_change":"2023-12-22T09:17:12.547616+0000","last_active":"2023-12-22T09:17:13.655888+0000","last_peered":"2023-12-22T09:17:13.655888+0000","last_clean":"2023-12-22T09:17:13.655888+0000","last_became_active":"2023-12-22T09:17:12.547326+0000","last_became_peered":"2023-12-22T09:17:12.547326+0000","last_unstale":"2023-12-22T09:17:13.655888+0000","last_undegraded":"2023-12-22T09:17:13.655888+0000","last_fullsized":"2023-12-22T09:17:13.655888+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:22:19.501977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514434+0000","last_change":"2023-12-22T09:16:58.139475+0000","last_active":"2023-12-22T09:17:12.514434+0000","last_peered":"2023-12-22T09:17:12.514434+0000","last_clean":"2023-12-22T09:17:12.514434+0000","last_became_active":"2023-12-22T09:16:58.139166+0000","last_became_peered":"2023-12-22T09:16:58.139166+0000","last_unstale":"2023-12-22T09:17:12.514434+0000","last_undegraded":"2023-12-22T09:17:12.514434+0000","last_fullsized":"2023-12-22T09:17:12.514434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.655150+0000","last_change":"2023-12-22T09:17:12.528519+0000","last_active":"2023-12-22T09:17:13.655150+0000","last_peered":"2023-12-22T09:17:13.655150+0000","last_clean":"2023-12-22T09:17:13.655150+0000","last_became_active":"2023-12-22T09:17:12.528254+0000","last_became_peered":"2023-12-22T09:17:12.528254+0000","last_unstale":"2023-12-22T09:17:13.655150+0000","last_undegraded":"2023-12-22T09:17:13.655150+0000","last_fullsized":"2023-12-22T09:17:13.655150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:33:48.010688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530753+0000","last_change":"2023-12-22T09:16:58.153587+0000","last_active":"2023-12-22T09:17:12.530753+0000","last_peered":"2023-12-22T09:17:12.530753+0000","last_clean":"2023-12-22T09:17:12.530753+0000","last_became_active":"2023-12-22T09:16:58.153215+0000","last_became_peered":"2023-12-22T09:16:58.153215+0000","last_unstale":"2023-12-22T09:17:12.530753+0000","last_undegraded":"2023-12-22T09:17:12.530753+0000","last_fullsized":"2023-12-22T09:17:12.530753+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516686+0000","last_change":"2023-12-22T09:17:12.536828+0000","last_active":"2023-12-22T09:17:13.516686+0000","last_peered":"2023-12-22T09:17:13.516686+0000","last_clean":"2023-12-22T09:17:13.516686+0000","last_became_active":"2023-12-22T09:17:12.536521+0000","last_became_peered":"2023-12-22T09:17:12.536521+0000","last_unstale":"2023-12-22T09:17:13.516686+0000","last_undegraded":"2023-12-22T09:17:13.516686+0000","last_fullsized":"2023-12-22T09:17:13.516686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:11.064289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523519+0000","last_change":"2023-12-22T09:16:58.146315+0000","last_active":"2023-12-22T09:17:12.523519+0000","last_peered":"2023-12-22T09:17:12.523519+0000","last_clean":"2023-12-22T09:17:12.523519+0000","last_became_active":"2023-12-22T09:16:58.143702+0000","last_became_peered":"2023-12-22T09:16:58.143702+0000","last_unstale":"2023-12-22T09:17:12.523519+0000","last_undegraded":"2023-12-22T09:17:12.523519+0000","last_fullsized":"2023-12-22T09:17:12.523519+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672852+0000","last_change":"2023-12-22T09:17:12.531254+0000","last_active":"2023-12-22T09:17:13.672852+0000","last_peered":"2023-12-22T09:17:13.672852+0000","last_clean":"2023-12-22T09:17:13.672852+0000","last_became_active":"2023-12-22T09:17:12.530971+0000","last_became_peered":"2023-12-22T09:17:12.530971+0000","last_unstale":"2023-12-22T09:17:13.672852+0000","last_undegraded":"2023-12-22T09:17:13.672852+0000","last_fullsized":"2023-12-22T09:17:13.672852+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:33.594438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531400+0000","last_change":"2023-12-22T09:16:58.144346+0000","last_active":"2023-12-22T09:17:12.531400+0000","last_peered":"2023-12-22T09:17:12.531400+0000","last_clean":"2023-12-22T09:17:12.531400+0000","last_became_active":"2023-12-22T09:16:58.144068+0000","last_became_peered":"2023-12-22T09:16:58.144068+0000","last_unstale":"2023-12-22T09:17:12.531400+0000","last_undegraded":"2023-12-22T09:17:12.531400+0000","last_fullsized":"2023-12-22T09:17:12.531400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512910+0000","last_change":"2023-12-22T09:17:12.542888+0000","last_active":"2023-12-22T09:17:13.512910+0000","last_peered":"2023-12-22T09:17:13.512910+0000","last_clean":"2023-12-22T09:17:13.512910+0000","last_became_active":"2023-12-22T09:17:12.541905+0000","last_became_peered":"2023-12-22T09:17:12.541905+0000","last_unstale":"2023-12-22T09:17:13.512910+0000","last_undegraded":"2023-12-22T09:17:13.512910+0000","last_fullsized":"2023-12-22T09:17:13.512910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:29.511755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.515028+0000","last_change":"2023-12-22T09:17:11.035380+0000","last_active":"2023-12-22T09:17:12.515028+0000","last_peered":"2023-12-22T09:17:12.515028+0000","last_clean":"2023-12-22T09:17:12.515028+0000","last_became_active":"2023-12-22T09:17:11.035022+0000","last_became_peered":"2023-12-22T09:17:11.035022+0000","last_unstale":"2023-12-22T09:17:12.515028+0000","last_undegraded":"2023-12-22T09:17:12.515028+0000","last_fullsized":"2023-12-22T09:17:12.515028+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:30.877521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654996+0000","last_change":"2023-12-22T09:17:12.539217+0000","last_active":"2023-12-22T09:17:13.654996+0000","last_peered":"2023-12-22T09:17:13.654996+0000","last_clean":"2023-12-22T09:17:13.654996+0000","last_became_active":"2023-12-22T09:17:12.538987+0000","last_became_peered":"2023-12-22T09:17:12.538987+0000","last_unstale":"2023-12-22T09:17:13.654996+0000","last_undegraded":"2023-12-22T09:17:13.654996+0000","last_fullsized":"2023-12-22T09:17:13.654996+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:25.294308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514265+0000","last_change":"2023-12-22T09:16:58.149202+0000","last_active":"2023-12-22T09:17:12.514265+0000","last_peered":"2023-12-22T09:17:12.514265+0000","last_clean":"2023-12-22T09:17:12.514265+0000","last_became_active":"2023-12-22T09:16:58.148243+0000","last_became_peered":"2023-12-22T09:16:58.148243+0000","last_unstale":"2023-12-22T09:17:12.514265+0000","last_undegraded":"2023-12-22T09:17:12.514265+0000","last_fullsized":"2023-12-22T09:17:12.514265+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787769+0000","last_change":"2023-12-22T09:17:12.536059+0000","last_active":"2023-12-22T09:17:13.787769+0000","last_peered":"2023-12-22T09:17:13.787769+0000","last_clean":"2023-12-22T09:17:13.787769+0000","last_became_active":"2023-12-22T09:17:12.534896+0000","last_became_peered":"2023-12-22T09:17:12.534896+0000","last_unstale":"2023-12-22T09:17:13.787769+0000","last_undegraded":"2023-12-22T09:17:13.787769+0000","last_fullsized":"2023-12-22T09:17:13.787769+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:09:31.903749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.525431+0000","last_change":"2023-12-22T09:16:58.156229+0000","last_active":"2023-12-22T09:17:12.525431+0000","last_peered":"2023-12-22T09:17:12.525431+0000","last_clean":"2023-12-22T09:17:12.525431+0000","last_became_active":"2023-12-22T09:16:58.154667+0000","last_became_peered":"2023-12-22T09:16:58.154667+0000","last_unstale":"2023-12-22T09:17:12.525431+0000","last_undegraded":"2023-12-22T09:17:12.525431+0000","last_fullsized":"2023-12-22T09:17:12.525431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.789247+0000","last_change":"2023-12-22T09:17:12.539349+0000","last_active":"2023-12-22T09:17:13.789247+0000","last_peered":"2023-12-22T09:17:13.789247+0000","last_clean":"2023-12-22T09:17:13.789247+0000","last_became_active":"2023-12-22T09:17:12.539000+0000","last_became_peered":"2023-12-22T09:17:12.539000+0000","last_unstale":"2023-12-22T09:17:13.789247+0000","last_undegraded":"2023-12-22T09:17:13.789247+0000","last_fullsized":"2023-12-22T09:17:13.789247+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:28.534245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523414+0000","last_change":"2023-12-22T09:16:58.144597+0000","last_active":"2023-12-22T09:17:12.523414+0000","last_peered":"2023-12-22T09:17:12.523414+0000","last_clean":"2023-12-22T09:17:12.523414+0000","last_became_active":"2023-12-22T09:16:58.144358+0000","last_became_peered":"2023-12-22T09:16:58.144358+0000","last_unstale":"2023-12-22T09:17:12.523414+0000","last_undegraded":"2023-12-22T09:17:12.523414+0000","last_fullsized":"2023-12-22T09:17:12.523414+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.788742+0000","last_change":"2023-12-22T09:17:12.530514+0000","last_active":"2023-12-22T09:17:13.788742+0000","last_peered":"2023-12-22T09:17:13.788742+0000","last_clean":"2023-12-22T09:17:13.788742+0000","last_became_active":"2023-12-22T09:17:12.529088+0000","last_became_peered":"2023-12-22T09:17:12.529088+0000","last_unstale":"2023-12-22T09:17:13.788742+0000","last_undegraded":"2023-12-22T09:17:13.788742+0000","last_fullsized":"2023-12-22T09:17:13.788742+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:35.459971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511233+0000","last_change":"2023-12-22T09:16:58.139134+0000","last_active":"2023-12-22T09:17:12.511233+0000","last_peered":"2023-12-22T09:17:12.511233+0000","last_clean":"2023-12-22T09:17:12.511233+0000","last_became_active":"2023-12-22T09:16:58.138883+0000","last_became_peered":"2023-12-22T09:16:58.138883+0000","last_unstale":"2023-12-22T09:17:12.511233+0000","last_undegraded":"2023-12-22T09:17:12.511233+0000","last_fullsized":"2023-12-22T09:17:12.511233+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.662952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787744+0000","last_change":"2023-12-22T09:17:12.540039+0000","last_active":"2023-12-22T09:17:13.787744+0000","last_peered":"2023-12-22T09:17:13.787744+0000","last_clean":"2023-12-22T09:17:13.787744+0000","last_became_active":"2023-12-22T09:17:12.539700+0000","last_became_peered":"2023-12-22T09:17:12.539700+0000","last_unstale":"2023-12-22T09:17:13.787744+0000","last_undegraded":"2023-12-22T09:17:13.787744+0000","last_fullsized":"2023-12-22T09:17:13.787744+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:45.275761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501356+0000","last_change":"2023-12-22T09:16:58.139935+0000","last_active":"2023-12-22T09:17:12.501356+0000","last_peered":"2023-12-22T09:17:12.501356+0000","last_clean":"2023-12-22T09:17:12.501356+0000","last_became_active":"2023-12-22T09:16:58.139665+0000","last_became_peered":"2023-12-22T09:16:58.139665+0000","last_unstale":"2023-12-22T09:17:12.501356+0000","last_undegraded":"2023-12-22T09:17:12.501356+0000","last_fullsized":"2023-12-22T09:17:12.501356+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654068+0000","last_change":"2023-12-22T09:17:12.519604+0000","last_active":"2023-12-22T09:17:13.654068+0000","last_peered":"2023-12-22T09:17:13.654068+0000","last_clean":"2023-12-22T09:17:13.654068+0000","last_became_active":"2023-12-22T09:17:12.519364+0000","last_became_peered":"2023-12-22T09:17:12.519364+0000","last_unstale":"2023-12-22T09:17:13.654068+0000","last_undegraded":"2023-12-22T09:17:13.654068+0000","last_fullsized":"2023-12-22T09:17:13.654068+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:49:31.174241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531846+0000","last_change":"2023-12-22T09:16:58.135060+0000","last_active":"2023-12-22T09:17:12.531846+0000","last_peered":"2023-12-22T09:17:12.531846+0000","last_clean":"2023-12-22T09:17:12.531846+0000","last_became_active":"2023-12-22T09:16:58.134796+0000","last_became_peered":"2023-12-22T09:16:58.134796+0000","last_unstale":"2023-12-22T09:17:12.531846+0000","last_undegraded":"2023-12-22T09:17:12.531846+0000","last_fullsized":"2023-12-22T09:17:12.531846+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:56:40.950128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787442+0000","last_change":"2023-12-22T09:17:12.534608+0000","last_active":"2023-12-22T09:17:13.787442+0000","last_peered":"2023-12-22T09:17:13.787442+0000","last_clean":"2023-12-22T09:17:13.787442+0000","last_became_active":"2023-12-22T09:17:12.534118+0000","last_became_peered":"2023-12-22T09:17:12.534118+0000","last_unstale":"2023-12-22T09:17:13.787442+0000","last_undegraded":"2023-12-22T09:17:13.787442+0000","last_fullsized":"2023-12-22T09:17:13.787442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:04.343307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514119+0000","last_change":"2023-12-22T09:16:58.133014+0000","last_active":"2023-12-22T09:17:12.514119+0000","last_peered":"2023-12-22T09:17:12.514119+0000","last_clean":"2023-12-22T09:17:12.514119+0000","last_became_active":"2023-12-22T09:16:58.132669+0000","last_became_peered":"2023-12-22T09:16:58.132669+0000","last_unstale":"2023-12-22T09:17:12.514119+0000","last_undegraded":"2023-12-22T09:17:12.514119+0000","last_fullsized":"2023-12-22T09:17:12.514119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:59:55.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672535+0000","last_change":"2023-12-22T09:17:12.528718+0000","last_active":"2023-12-22T09:17:13.672535+0000","last_peered":"2023-12-22T09:17:13.672535+0000","last_clean":"2023-12-22T09:17:13.672535+0000","last_became_active":"2023-12-22T09:17:12.528287+0000","last_became_peered":"2023-12-22T09:17:12.528287+0000","last_unstale":"2023-12-22T09:17:13.672535+0000","last_undegraded":"2023-12-22T09:17:13.672535+0000","last_fullsized":"2023-12-22T09:17:13.672535+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:54.221987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511580+0000","last_change":"2023-12-22T09:16:58.139698+0000","last_active":"2023-12-22T09:17:12.511580+0000","last_peered":"2023-12-22T09:17:12.511580+0000","last_clean":"2023-12-22T09:17:12.511580+0000","last_became_active":"2023-12-22T09:16:58.139450+0000","last_became_peered":"2023-12-22T09:16:58.139450+0000","last_unstale":"2023-12-22T09:17:12.511580+0000","last_undegraded":"2023-12-22T09:17:12.511580+0000","last_fullsized":"2023-12-22T09:17:12.511580+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:40.452271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512949+0000","last_change":"2023-12-22T09:17:12.537889+0000","last_active":"2023-12-22T09:17:13.512949+0000","last_peered":"2023-12-22T09:17:13.512949+0000","last_clean":"2023-12-22T09:17:13.512949+0000","last_became_active":"2023-12-22T09:17:12.536919+0000","last_became_peered":"2023-12-22T09:17:12.536919+0000","last_unstale":"2023-12-22T09:17:13.512949+0000","last_undegraded":"2023-12-22T09:17:13.512949+0000","last_fullsized":"2023-12-22T09:17:13.512949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:39.648682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514488+0000","last_change":"2023-12-22T09:16:58.138002+0000","last_active":"2023-12-22T09:17:12.514488+0000","last_peered":"2023-12-22T09:17:12.514488+0000","last_clean":"2023-12-22T09:17:12.514488+0000","last_became_active":"2023-12-22T09:16:58.137587+0000","last_became_peered":"2023-12-22T09:16:58.137587+0000","last_unstale":"2023-12-22T09:17:12.514488+0000","last_undegraded":"2023-12-22T09:17:12.514488+0000","last_fullsized":"2023-12-22T09:17:12.514488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672918+0000","last_change":"2023-12-22T09:17:12.527963+0000","last_active":"2023-12-22T09:17:13.672918+0000","last_peered":"2023-12-22T09:17:13.672918+0000","last_clean":"2023-12-22T09:17:13.672918+0000","last_became_active":"2023-12-22T09:17:12.527349+0000","last_became_peered":"2023-12-22T09:17:12.527349+0000","last_unstale":"2023-12-22T09:17:13.672918+0000","last_undegraded":"2023-12-22T09:17:13.672918+0000","last_fullsized":"2023-12-22T09:17:13.672918+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:59:45.657065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510905+0000","last_change":"2023-12-22T09:16:58.143017+0000","last_active":"2023-12-22T09:17:12.510905+0000","last_peered":"2023-12-22T09:17:12.510905+0000","last_clean":"2023-12-22T09:17:12.510905+0000","last_became_active":"2023-12-22T09:16:58.142609+0000","last_became_peered":"2023-12-22T09:16:58.142609+0000","last_unstale":"2023-12-22T09:17:12.510905+0000","last_undegraded":"2023-12-22T09:17:12.510905+0000","last_fullsized":"2023-12-22T09:17:12.510905+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:22.037240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.673422+0000","last_change":"2023-12-22T09:17:12.537661+0000","last_active":"2023-12-22T09:17:13.673422+0000","last_peered":"2023-12-22T09:17:13.673422+0000","last_clean":"2023-12-22T09:17:13.673422+0000","last_became_active":"2023-12-22T09:17:12.537388+0000","last_became_peered":"2023-12-22T09:17:12.537388+0000","last_unstale":"2023-12-22T09:17:13.673422+0000","last_undegraded":"2023-12-22T09:17:13.673422+0000","last_fullsized":"2023-12-22T09:17:13.673422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:47.806111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508783+0000","last_change":"2023-12-22T09:16:58.137672+0000","last_active":"2023-12-22T09:17:12.508783+0000","last_peered":"2023-12-22T09:17:12.508783+0000","last_clean":"2023-12-22T09:17:12.508783+0000","last_became_active":"2023-12-22T09:16:58.137418+0000","last_became_peered":"2023-12-22T09:16:58.137418+0000","last_unstale":"2023-12-22T09:17:12.508783+0000","last_undegraded":"2023-12-22T09:17:12.508783+0000","last_fullsized":"2023-12-22T09:17:12.508783+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:11.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.785991+0000","last_change":"2023-12-22T09:17:12.540349+0000","last_active":"2023-12-22T09:17:13.785991+0000","last_peered":"2023-12-22T09:17:13.785991+0000","last_clean":"2023-12-22T09:17:13.785991+0000","last_became_active":"2023-12-22T09:17:12.540027+0000","last_became_peered":"2023-12-22T09:17:12.540027+0000","last_unstale":"2023-12-22T09:17:13.785991+0000","last_undegraded":"2023-12-22T09:17:13.785991+0000","last_fullsized":"2023-12-22T09:17:13.785991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:28:18.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.527324+0000","last_change":"2023-12-22T09:16:58.151378+0000","last_active":"2023-12-22T09:17:12.527324+0000","last_peered":"2023-12-22T09:17:12.527324+0000","last_clean":"2023-12-22T09:17:12.527324+0000","last_became_active":"2023-12-22T09:16:58.148696+0000","last_became_peered":"2023-12-22T09:16:58.148696+0000","last_unstale":"2023-12-22T09:17:12.527324+0000","last_undegraded":"2023-12-22T09:17:12.527324+0000","last_fullsized":"2023-12-22T09:17:12.527324+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.784981+0000","last_change":"2023-12-22T09:17:12.531462+0000","last_active":"2023-12-22T09:17:13.784981+0000","last_peered":"2023-12-22T09:17:13.784981+0000","last_clean":"2023-12-22T09:17:13.784981+0000","last_became_active":"2023-12-22T09:17:12.531226+0000","last_became_peered":"2023-12-22T09:17:12.531226+0000","last_unstale":"2023-12-22T09:17:13.784981+0000","last_undegraded":"2023-12-22T09:17:13.784981+0000","last_fullsized":"2023-12-22T09:17:13.784981+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:10:16.447879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.516335+0000","last_change":"2023-12-22T09:16:58.134012+0000","last_active":"2023-12-22T09:17:12.516335+0000","last_peered":"2023-12-22T09:17:12.516335+0000","last_clean":"2023-12-22T09:17:12.516335+0000","last_became_active":"2023-12-22T09:16:58.133668+0000","last_became_peered":"2023-12-22T09:16:58.133668+0000","last_unstale":"2023-12-22T09:17:12.516335+0000","last_undegraded":"2023-12-22T09:17:12.516335+0000","last_fullsized":"2023-12-22T09:17:12.516335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:57:16.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.515813+0000","last_change":"2023-12-22T09:17:12.543029+0000","last_active":"2023-12-22T09:17:13.515813+0000","last_peered":"2023-12-22T09:17:13.515813+0000","last_clean":"2023-12-22T09:17:13.515813+0000","last_became_active":"2023-12-22T09:17:12.542728+0000","last_became_peered":"2023-12-22T09:17:12.542728+0000","last_unstale":"2023-12-22T09:17:13.515813+0000","last_undegraded":"2023-12-22T09:17:13.515813+0000","last_fullsized":"2023-12-22T09:17:13.515813+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:57:48.091679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.518440+0000","last_change":"2023-12-22T09:16:58.138808+0000","last_active":"2023-12-22T09:17:12.518440+0000","last_peered":"2023-12-22T09:17:12.518440+0000","last_clean":"2023-12-22T09:17:12.518440+0000","last_became_active":"2023-12-22T09:16:58.138287+0000","last_became_peered":"2023-12-22T09:16:58.138287+0000","last_unstale":"2023-12-22T09:17:12.518440+0000","last_undegraded":"2023-12-22T09:17:12.518440+0000","last_fullsized":"2023-12-22T09:17:12.518440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:36.638731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654676+0000","last_change":"2023-12-22T09:17:12.534186+0000","last_active":"2023-12-22T09:17:13.654676+0000","last_peered":"2023-12-22T09:17:13.654676+0000","last_clean":"2023-12-22T09:17:13.654676+0000","last_became_active":"2023-12-22T09:17:12.533903+0000","last_became_peered":"2023-12-22T09:17:12.533903+0000","last_unstale":"2023-12-22T09:17:13.654676+0000","last_undegraded":"2023-12-22T09:17:13.654676+0000","last_fullsized":"2023-12-22T09:17:13.654676+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:09:31.903749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531123+0000","last_change":"2023-12-22T09:16:58.148258+0000","last_active":"2023-12-22T09:17:12.531123+0000","last_peered":"2023-12-22T09:17:12.531123+0000","last_clean":"2023-12-22T09:17:12.531123+0000","last_became_active":"2023-12-22T09:16:58.148003+0000","last_became_peered":"2023-12-22T09:16:58.148003+0000","last_unstale":"2023-12-22T09:17:12.531123+0000","last_undegraded":"2023-12-22T09:17:12.531123+0000","last_fullsized":"2023-12-22T09:17:12.531123+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:42.621461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516494+0000","last_change":"2023-12-22T09:17:12.544737+0000","last_active":"2023-12-22T09:17:13.516494+0000","last_peered":"2023-12-22T09:17:13.516494+0000","last_clean":"2023-12-22T09:17:13.516494+0000","last_became_active":"2023-12-22T09:17:12.543923+0000","last_became_peered":"2023-12-22T09:17:12.543923+0000","last_unstale":"2023-12-22T09:17:13.516494+0000","last_undegraded":"2023-12-22T09:17:13.516494+0000","last_fullsized":"2023-12-22T09:17:13.516494+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:32:20.587094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501261+0000","last_change":"2023-12-22T09:16:58.133892+0000","last_active":"2023-12-22T09:17:12.501261+0000","last_peered":"2023-12-22T09:17:12.501261+0000","last_clean":"2023-12-22T09:17:12.501261+0000","last_became_active":"2023-12-22T09:16:58.133436+0000","last_became_peered":"2023-12-22T09:16:58.133436+0000","last_unstale":"2023-12-22T09:17:12.501261+0000","last_undegraded":"2023-12-22T09:17:12.501261+0000","last_fullsized":"2023-12-22T09:17:12.501261+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.517872+0000","last_change":"2023-12-22T09:17:12.539001+0000","last_active":"2023-12-22T09:17:13.517872+0000","last_peered":"2023-12-22T09:17:13.517872+0000","last_clean":"2023-12-22T09:17:13.517872+0000","last_became_active":"2023-12-22T09:17:12.538125+0000","last_became_peered":"2023-12-22T09:17:12.538125+0000","last_unstale":"2023-12-22T09:17:13.517872+0000","last_undegraded":"2023-12-22T09:17:13.517872+0000","last_fullsized":"2023-12-22T09:17:13.517872+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:09:45.808636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530306+0000","last_change":"2023-12-22T09:16:58.149316+0000","last_active":"2023-12-22T09:17:12.530306+0000","last_peered":"2023-12-22T09:17:12.530306+0000","last_clean":"2023-12-22T09:17:12.530306+0000","last_became_active":"2023-12-22T09:16:58.148642+0000","last_became_peered":"2023-12-22T09:16:58.148642+0000","last_unstale":"2023-12-22T09:17:12.530306+0000","last_undegraded":"2023-12-22T09:17:12.530306+0000","last_fullsized":"2023-12-22T09:17:12.530306+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672850+0000","last_change":"2023-12-22T09:17:12.528134+0000","last_active":"2023-12-22T09:17:13.672850+0000","last_peered":"2023-12-22T09:17:13.672850+0000","last_clean":"2023-12-22T09:17:13.672850+0000","last_became_active":"2023-12-22T09:17:12.527708+0000","last_became_peered":"2023-12-22T09:17:12.527708+0000","last_unstale":"2023-12-22T09:17:13.672850+0000","last_undegraded":"2023-12-22T09:17:13.672850+0000","last_fullsized":"2023-12-22T09:17:13.672850+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:46.086605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.513854+0000","last_change":"2023-12-22T09:16:58.155683+0000","last_active":"2023-12-22T09:17:12.513854+0000","last_peered":"2023-12-22T09:17:12.513854+0000","last_clean":"2023-12-22T09:17:12.513854+0000","last_became_active":"2023-12-22T09:16:58.155388+0000","last_became_peered":"2023-12-22T09:16:58.155388+0000","last_unstale":"2023-12-22T09:17:12.513854+0000","last_undegraded":"2023-12-22T09:17:12.513854+0000","last_fullsized":"2023-12-22T09:17:12.513854+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.656677+0000","last_change":"2023-12-22T09:17:12.531084+0000","last_active":"2023-12-22T09:17:13.656677+0000","last_peered":"2023-12-22T09:17:13.656677+0000","last_clean":"2023-12-22T09:17:13.656677+0000","last_became_active":"2023-12-22T09:17:12.530856+0000","last_became_peered":"2023-12-22T09:17:12.530856+0000","last_unstale":"2023-12-22T09:17:13.656677+0000","last_undegraded":"2023-12-22T09:17:13.656677+0000","last_fullsized":"2023-12-22T09:17:13.656677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:11:24.336698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523366+0000","last_change":"2023-12-22T09:16:58.147756+0000","last_active":"2023-12-22T09:17:12.523366+0000","last_peered":"2023-12-22T09:17:12.523366+0000","last_clean":"2023-12-22T09:17:12.523366+0000","last_became_active":"2023-12-22T09:16:58.146595+0000","last_became_peered":"2023-12-22T09:16:58.146595+0000","last_unstale":"2023-12-22T09:17:12.523366+0000","last_undegraded":"2023-12-22T09:17:12.523366+0000","last_fullsized":"2023-12-22T09:17:12.523366+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:20:04.358268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.788831+0000","last_change":"2023-12-22T09:17:12.545644+0000","last_active":"2023-12-22T09:17:13.788831+0000","last_peered":"2023-12-22T09:17:13.788831+0000","last_clean":"2023-12-22T09:17:13.788831+0000","last_became_active":"2023-12-22T09:17:12.544926+0000","last_became_peered":"2023-12-22T09:17:12.544926+0000","last_unstale":"2023-12-22T09:17:13.788831+0000","last_undegraded":"2023-12-22T09:17:13.788831+0000","last_fullsized":"2023-12-22T09:17:13.788831+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:00.648890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.513367+0000","last_change":"2023-12-22T09:16:58.125759+0000","last_active":"2023-12-22T09:17:12.513367+0000","last_peered":"2023-12-22T09:17:12.513367+0000","last_clean":"2023-12-22T09:17:12.513367+0000","last_became_active":"2023-12-22T09:16:58.125192+0000","last_became_peered":"2023-12-22T09:16:58.125192+0000","last_unstale":"2023-12-22T09:17:12.513367+0000","last_undegraded":"2023-12-22T09:17:12.513367+0000","last_fullsized":"2023-12-22T09:17:12.513367+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:11.972408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786294+0000","last_change":"2023-12-22T09:17:12.540519+0000","last_active":"2023-12-22T09:17:13.786294+0000","last_peered":"2023-12-22T09:17:13.786294+0000","last_clean":"2023-12-22T09:17:13.786294+0000","last_became_active":"2023-12-22T09:17:12.540249+0000","last_became_peered":"2023-12-22T09:17:12.540249+0000","last_unstale":"2023-12-22T09:17:13.786294+0000","last_undegraded":"2023-12-22T09:17:13.786294+0000","last_fullsized":"2023-12-22T09:17:13.786294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:35.360655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.544182+0000","last_change":"2023-12-22T09:17:12.051198+0000","last_active":"2023-12-22T09:17:12.544182+0000","last_peered":"2023-12-22T09:17:12.544182+0000","last_clean":"2023-12-22T09:17:12.544182+0000","last_became_active":"2023-12-22T09:17:12.050824+0000","last_became_peered":"2023-12-22T09:17:12.050824+0000","last_unstale":"2023-12-22T09:17:12.544182+0000","last_undegraded":"2023-12-22T09:17:12.544182+0000","last_fullsized":"2023-12-22T09:17:12.544182+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508856+0000","last_change":"2023-12-22T09:16:58.132380+0000","last_active":"2023-12-22T09:17:12.508856+0000","last_peered":"2023-12-22T09:17:12.508856+0000","last_clean":"2023-12-22T09:17:12.508856+0000","last_became_active":"2023-12-22T09:16:58.131960+0000","last_became_peered":"2023-12-22T09:16:58.131960+0000","last_unstale":"2023-12-22T09:17:12.508856+0000","last_undegraded":"2023-12-22T09:17:12.508856+0000","last_fullsized":"2023-12-22T09:17:12.508856+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:39:55.787513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501456+0000","last_change":"2023-12-22T09:16:57.644639+0000","last_active":"2023-12-22T09:17:12.501456+0000","last_peered":"2023-12-22T09:17:12.501456+0000","last_clean":"2023-12-22T09:17:12.501456+0000","last_became_active":"2023-12-22T09:16:57.641016+0000","last_became_peered":"2023-12-22T09:16:57.641016+0000","last_unstale":"2023-12-22T09:17:12.501456+0000","last_undegraded":"2023-12-22T09:17:12.501456+0000","last_fullsized":"2023-12-22T09:17:12.501456+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.788449+0000","last_change":"2023-12-22T09:17:12.534374+0000","last_active":"2023-12-22T09:17:13.788449+0000","last_peered":"2023-12-22T09:17:13.788449+0000","last_clean":"2023-12-22T09:17:13.788449+0000","last_became_active":"2023-12-22T09:17:12.533828+0000","last_became_peered":"2023-12-22T09:17:12.533828+0000","last_unstale":"2023-12-22T09:17:13.788449+0000","last_undegraded":"2023-12-22T09:17:13.788449+0000","last_fullsized":"2023-12-22T09:17:13.788449+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:01:17.585593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.533990+0000","last_change":"2023-12-22T09:17:12.042696+0000","last_active":"2023-12-22T09:17:12.533990+0000","last_peered":"2023-12-22T09:17:12.533990+0000","last_clean":"2023-12-22T09:17:12.533990+0000","last_became_active":"2023-12-22T09:17:12.042328+0000","last_became_peered":"2023-12-22T09:17:12.042328+0000","last_unstale":"2023-12-22T09:17:12.533990+0000","last_undegraded":"2023-12-22T09:17:12.533990+0000","last_fullsized":"2023-12-22T09:17:12.533990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:05:59.153455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511579+0000","last_change":"2023-12-22T09:17:11.012714+0000","last_active":"2023-12-22T09:17:12.511579+0000","last_peered":"2023-12-22T09:17:12.511579+0000","last_clean":"2023-12-22T09:17:12.511579+0000","last_became_active":"2023-12-22T09:17:11.011762+0000","last_became_peered":"2023-12-22T09:17:11.011762+0000","last_unstale":"2023-12-22T09:17:12.511579+0000","last_undegraded":"2023-12-22T09:17:12.511579+0000","last_fullsized":"2023-12-22T09:17:12.511579+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:53:32.651627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.528281+0000","last_change":"2023-12-22T09:16:57.643725+0000","last_active":"2023-12-22T09:17:12.528281+0000","last_peered":"2023-12-22T09:17:12.528281+0000","last_clean":"2023-12-22T09:17:12.528281+0000","last_became_active":"2023-12-22T09:16:57.642742+0000","last_became_peered":"2023-12-22T09:16:57.642742+0000","last_unstale":"2023-12-22T09:17:12.528281+0000","last_undegraded":"2023-12-22T09:17:12.528281+0000","last_fullsized":"2023-12-22T09:17:12.528281+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:42.697488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.784437+0000","last_change":"2023-12-22T09:17:12.535531+0000","last_active":"2023-12-22T09:17:13.784437+0000","last_peered":"2023-12-22T09:17:13.784437+0000","last_clean":"2023-12-22T09:17:13.784437+0000","last_became_active":"2023-12-22T09:17:12.535243+0000","last_became_peered":"2023-12-22T09:17:12.535243+0000","last_unstale":"2023-12-22T09:17:13.784437+0000","last_undegraded":"2023-12-22T09:17:13.784437+0000","last_fullsized":"2023-12-22T09:17:13.784437+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:04.343307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"63'4","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.546908+0000","last_change":"2023-12-22T09:17:12.029107+0000","last_active":"2023-12-22T09:17:12.546908+0000","last_peered":"2023-12-22T09:17:12.546908+0000","last_clean":"2023-12-22T09:17:12.546908+0000","last_became_active":"2023-12-22T09:17:12.028772+0000","last_became_peered":"2023-12-22T09:17:12.028772+0000","last_unstale":"2023-12-22T09:17:12.546908+0000","last_undegraded":"2023-12-22T09:17:12.546908+0000","last_fullsized":"2023-12-22T09:17:12.546908+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:27.752298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.528127+0000","last_change":"2023-12-22T09:16:58.124625+0000","last_active":"2023-12-22T09:17:12.528127+0000","last_peered":"2023-12-22T09:17:12.528127+0000","last_clean":"2023-12-22T09:17:12.528127+0000","last_became_active":"2023-12-22T09:16:58.124353+0000","last_became_peered":"2023-12-22T09:16:58.124353+0000","last_unstale":"2023-12-22T09:17:12.528127+0000","last_undegraded":"2023-12-22T09:17:12.528127+0000","last_fullsized":"2023-12-22T09:17:12.528127+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:30:35.111753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.525401+0000","last_change":"2023-12-22T09:16:57.655128+0000","last_active":"2023-12-22T09:17:12.525401+0000","last_peered":"2023-12-22T09:17:12.525401+0000","last_clean":"2023-12-22T09:17:12.525401+0000","last_became_active":"2023-12-22T09:16:57.654793+0000","last_became_peered":"2023-12-22T09:16:57.654793+0000","last_unstale":"2023-12-22T09:17:12.525401+0000","last_undegraded":"2023-12-22T09:17:12.525401+0000","last_fullsized":"2023-12-22T09:17:12.525401+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:38.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.655210+0000","last_change":"2023-12-22T09:17:12.524624+0000","last_active":"2023-12-22T09:17:13.655210+0000","last_peered":"2023-12-22T09:17:13.655210+0000","last_clean":"2023-12-22T09:17:13.655210+0000","last_became_active":"2023-12-22T09:17:12.524258+0000","last_became_peered":"2023-12-22T09:17:12.524258+0000","last_unstale":"2023-12-22T09:17:13.655210+0000","last_undegraded":"2023-12-22T09:17:13.655210+0000","last_fullsized":"2023-12-22T09:17:13.655210+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:15.051168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.541013+0000","last_change":"2023-12-22T09:17:12.049173+0000","last_active":"2023-12-22T09:17:12.541013+0000","last_peered":"2023-12-22T09:17:12.541013+0000","last_clean":"2023-12-22T09:17:12.541013+0000","last_became_active":"2023-12-22T09:17:12.048864+0000","last_became_peered":"2023-12-22T09:17:12.048864+0000","last_unstale":"2023-12-22T09:17:12.541013+0000","last_undegraded":"2023-12-22T09:17:12.541013+0000","last_fullsized":"2023-12-22T09:17:12.541013+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:03.329046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530735+0000","last_change":"2023-12-22T09:16:58.153226+0000","last_active":"2023-12-22T09:17:12.530735+0000","last_peered":"2023-12-22T09:17:12.530735+0000","last_clean":"2023-12-22T09:17:12.530735+0000","last_became_active":"2023-12-22T09:16:58.151970+0000","last_became_peered":"2023-12-22T09:16:58.151970+0000","last_unstale":"2023-12-22T09:17:12.530735+0000","last_undegraded":"2023-12-22T09:17:12.530735+0000","last_fullsized":"2023-12-22T09:17:12.530735+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.522035+0000","last_change":"2023-12-22T09:16:57.635854+0000","last_active":"2023-12-22T09:17:12.522035+0000","last_peered":"2023-12-22T09:17:12.522035+0000","last_clean":"2023-12-22T09:17:12.522035+0000","last_became_active":"2023-12-22T09:16:57.635365+0000","last_became_peered":"2023-12-22T09:16:57.635365+0000","last_unstale":"2023-12-22T09:17:12.522035+0000","last_undegraded":"2023-12-22T09:17:12.522035+0000","last_fullsized":"2023-12-22T09:17:12.522035+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:55.506978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.789409+0000","last_change":"2023-12-22T09:17:12.541470+0000","last_active":"2023-12-22T09:17:13.789409+0000","last_peered":"2023-12-22T09:17:13.789409+0000","last_clean":"2023-12-22T09:17:13.789409+0000","last_became_active":"2023-12-22T09:17:12.539038+0000","last_became_peered":"2023-12-22T09:17:12.539038+0000","last_unstale":"2023-12-22T09:17:13.789409+0000","last_undegraded":"2023-12-22T09:17:13.789409+0000","last_fullsized":"2023-12-22T09:17:13.789409+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:10:16.447879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514793+0000","last_change":"2023-12-22T09:17:12.041343+0000","last_active":"2023-12-22T09:17:12.514793+0000","last_peered":"2023-12-22T09:17:12.514793+0000","last_clean":"2023-12-22T09:17:12.514793+0000","last_became_active":"2023-12-22T09:17:12.040893+0000","last_became_peered":"2023-12-22T09:17:12.040893+0000","last_unstale":"2023-12-22T09:17:12.514793+0000","last_undegraded":"2023-12-22T09:17:12.514793+0000","last_fullsized":"2023-12-22T09:17:12.514793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511317+0000","last_change":"2023-12-22T09:16:58.111968+0000","last_active":"2023-12-22T09:17:12.511317+0000","last_peered":"2023-12-22T09:17:12.511317+0000","last_clean":"2023-12-22T09:17:12.511317+0000","last_became_active":"2023-12-22T09:16:58.111712+0000","last_became_peered":"2023-12-22T09:16:58.111712+0000","last_unstale":"2023-12-22T09:17:12.511317+0000","last_undegraded":"2023-12-22T09:17:12.511317+0000","last_fullsized":"2023-12-22T09:17:12.511317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:31:26.301820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510900+0000","last_change":"2023-12-22T09:16:57.646140+0000","last_active":"2023-12-22T09:17:12.510900+0000","last_peered":"2023-12-22T09:17:12.510900+0000","last_clean":"2023-12-22T09:17:12.510900+0000","last_became_active":"2023-12-22T09:16:57.645839+0000","last_became_peered":"2023-12-22T09:16:57.645839+0000","last_unstale":"2023-12-22T09:17:12.510900+0000","last_undegraded":"2023-12-22T09:17:12.510900+0000","last_fullsized":"2023-12-22T09:17:12.510900+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:15.308735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519978+0000","last_change":"2023-12-22T09:17:12.538499+0000","last_active":"2023-12-22T09:17:13.519978+0000","last_peered":"2023-12-22T09:17:13.519978+0000","last_clean":"2023-12-22T09:17:13.519978+0000","last_became_active":"2023-12-22T09:17:12.537198+0000","last_became_peered":"2023-12-22T09:17:12.537198+0000","last_unstale":"2023-12-22T09:17:13.519978+0000","last_undegraded":"2023-12-22T09:17:13.519978+0000","last_fullsized":"2023-12-22T09:17:13.519978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:33:56.242812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511233+0000","last_change":"2023-12-22T09:17:12.042593+0000","last_active":"2023-12-22T09:17:12.511233+0000","last_peered":"2023-12-22T09:17:12.511233+0000","last_clean":"2023-12-22T09:17:12.511233+0000","last_became_active":"2023-12-22T09:17:12.042025+0000","last_became_peered":"2023-12-22T09:17:12.042025+0000","last_unstale":"2023-12-22T09:17:12.511233+0000","last_undegraded":"2023-12-22T09:17:12.511233+0000","last_fullsized":"2023-12-22T09:17:12.511233+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:23.589301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.500631+0000","last_change":"2023-12-22T09:16:58.148277+0000","last_active":"2023-12-22T09:17:12.500631+0000","last_peered":"2023-12-22T09:17:12.500631+0000","last_clean":"2023-12-22T09:17:12.500631+0000","last_became_active":"2023-12-22T09:16:58.147042+0000","last_became_peered":"2023-12-22T09:16:58.147042+0000","last_unstale":"2023-12-22T09:17:12.500631+0000","last_undegraded":"2023-12-22T09:17:12.500631+0000","last_fullsized":"2023-12-22T09:17:12.500631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510989+0000","last_change":"2023-12-22T09:16:57.641319+0000","last_active":"2023-12-22T09:17:12.510989+0000","last_peered":"2023-12-22T09:17:12.510989+0000","last_clean":"2023-12-22T09:17:12.510989+0000","last_became_active":"2023-12-22T09:16:57.641031+0000","last_became_peered":"2023-12-22T09:16:57.641031+0000","last_unstale":"2023-12-22T09:17:12.510989+0000","last_undegraded":"2023-12-22T09:17:12.510989+0000","last_fullsized":"2023-12-22T09:17:12.510989+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:10.350226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654739+0000","last_change":"2023-12-22T09:17:12.538075+0000","last_active":"2023-12-22T09:17:13.654739+0000","last_peered":"2023-12-22T09:17:13.654739+0000","last_clean":"2023-12-22T09:17:13.654739+0000","last_became_active":"2023-12-22T09:17:12.537810+0000","last_became_peered":"2023-12-22T09:17:12.537810+0000","last_unstale":"2023-12-22T09:17:13.654739+0000","last_undegraded":"2023-12-22T09:17:13.654739+0000","last_fullsized":"2023-12-22T09:17:13.654739+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:56.342160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.540158+0000","last_change":"2023-12-22T09:17:12.048461+0000","last_active":"2023-12-22T09:17:12.540158+0000","last_peered":"2023-12-22T09:17:12.540158+0000","last_clean":"2023-12-22T09:17:12.540158+0000","last_became_active":"2023-12-22T09:17:12.047895+0000","last_became_peered":"2023-12-22T09:17:12.047895+0000","last_unstale":"2023-12-22T09:17:12.540158+0000","last_undegraded":"2023-12-22T09:17:12.540158+0000","last_fullsized":"2023-12-22T09:17:12.540158+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:29.709741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506322+0000","last_change":"2023-12-22T09:16:58.130875+0000","last_active":"2023-12-22T09:17:12.506322+0000","last_peered":"2023-12-22T09:17:12.506322+0000","last_clean":"2023-12-22T09:17:12.506322+0000","last_became_active":"2023-12-22T09:16:58.130606+0000","last_became_peered":"2023-12-22T09:16:58.130606+0000","last_unstale":"2023-12-22T09:17:12.506322+0000","last_undegraded":"2023-12-22T09:17:12.506322+0000","last_fullsized":"2023-12-22T09:17:12.506322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:30.649529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508857+0000","last_change":"2023-12-22T09:16:57.642097+0000","last_active":"2023-12-22T09:17:12.508857+0000","last_peered":"2023-12-22T09:17:12.508857+0000","last_clean":"2023-12-22T09:17:12.508857+0000","last_became_active":"2023-12-22T09:16:57.641830+0000","last_became_peered":"2023-12-22T09:16:57.641830+0000","last_unstale":"2023-12-22T09:17:12.508857+0000","last_undegraded":"2023-12-22T09:17:12.508857+0000","last_fullsized":"2023-12-22T09:17:12.508857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:37:23.822669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.655149+0000","last_change":"2023-12-22T09:17:12.540055+0000","last_active":"2023-12-22T09:17:13.655149+0000","last_peered":"2023-12-22T09:17:13.655149+0000","last_clean":"2023-12-22T09:17:13.655149+0000","last_became_active":"2023-12-22T09:17:12.538538+0000","last_became_peered":"2023-12-22T09:17:12.538538+0000","last_unstale":"2023-12-22T09:17:13.655149+0000","last_undegraded":"2023-12-22T09:17:13.655149+0000","last_fullsized":"2023-12-22T09:17:13.655149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:32.197707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.535927+0000","last_change":"2023-12-22T09:17:12.039872+0000","last_active":"2023-12-22T09:17:12.535927+0000","last_peered":"2023-12-22T09:17:12.535927+0000","last_clean":"2023-12-22T09:17:12.535927+0000","last_became_active":"2023-12-22T09:17:12.039547+0000","last_became_peered":"2023-12-22T09:17:12.039547+0000","last_unstale":"2023-12-22T09:17:12.535927+0000","last_undegraded":"2023-12-22T09:17:12.535927+0000","last_fullsized":"2023-12-22T09:17:12.535927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:57:47.077419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510813+0000","last_change":"2023-12-22T09:16:58.147991+0000","last_active":"2023-12-22T09:17:12.510813+0000","last_peered":"2023-12-22T09:17:12.510813+0000","last_clean":"2023-12-22T09:17:12.510813+0000","last_became_active":"2023-12-22T09:16:58.147595+0000","last_became_peered":"2023-12-22T09:16:58.147595+0000","last_unstale":"2023-12-22T09:17:12.510813+0000","last_undegraded":"2023-12-22T09:17:12.510813+0000","last_fullsized":"2023-12-22T09:17:12.510813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:14.136005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510671+0000","last_change":"2023-12-22T09:16:57.647073+0000","last_active":"2023-12-22T09:17:12.510671+0000","last_peered":"2023-12-22T09:17:12.510671+0000","last_clean":"2023-12-22T09:17:12.510671+0000","last_became_active":"2023-12-22T09:16:57.646655+0000","last_became_peered":"2023-12-22T09:16:57.646655+0000","last_unstale":"2023-12-22T09:17:12.510671+0000","last_undegraded":"2023-12-22T09:17:12.510671+0000","last_fullsized":"2023-12-22T09:17:12.510671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:52.036721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.513231+0000","last_change":"2023-12-22T09:17:12.518504+0000","last_active":"2023-12-22T09:17:13.513231+0000","last_peered":"2023-12-22T09:17:13.513231+0000","last_clean":"2023-12-22T09:17:13.513231+0000","last_became_active":"2023-12-22T09:17:12.516641+0000","last_became_peered":"2023-12-22T09:17:12.516641+0000","last_unstale":"2023-12-22T09:17:13.513231+0000","last_undegraded":"2023-12-22T09:17:13.513231+0000","last_fullsized":"2023-12-22T09:17:13.513231+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:03:21.031760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"63'3","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.536686+0000","last_change":"2023-12-22T09:17:12.042844+0000","last_active":"2023-12-22T09:17:12.536686+0000","last_peered":"2023-12-22T09:17:12.536686+0000","last_clean":"2023-12-22T09:17:12.536686+0000","last_became_active":"2023-12-22T09:17:12.042579+0000","last_became_peered":"2023-12-22T09:17:12.042579+0000","last_unstale":"2023-12-22T09:17:12.536686+0000","last_undegraded":"2023-12-22T09:17:12.536686+0000","last_fullsized":"2023-12-22T09:17:12.536686+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:28.077725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501712+0000","last_change":"2023-12-22T09:16:58.112827+0000","last_active":"2023-12-22T09:17:12.501712+0000","last_peered":"2023-12-22T09:17:12.501712+0000","last_clean":"2023-12-22T09:17:12.501712+0000","last_became_active":"2023-12-22T09:16:58.112533+0000","last_became_peered":"2023-12-22T09:16:58.112533+0000","last_unstale":"2023-12-22T09:17:12.501712+0000","last_undegraded":"2023-12-22T09:17:12.501712+0000","last_fullsized":"2023-12-22T09:17:12.501712+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530940+0000","last_change":"2023-12-22T09:16:57.653443+0000","last_active":"2023-12-22T09:17:12.530940+0000","last_peered":"2023-12-22T09:17:12.530940+0000","last_clean":"2023-12-22T09:17:12.530940+0000","last_became_active":"2023-12-22T09:16:57.653141+0000","last_became_peered":"2023-12-22T09:16:57.653141+0000","last_unstale":"2023-12-22T09:17:12.530940+0000","last_undegraded":"2023-12-22T09:17:12.530940+0000","last_fullsized":"2023-12-22T09:17:12.530940+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.785009+0000","last_change":"2023-12-22T09:17:12.519197+0000","last_active":"2023-12-22T09:17:13.785009+0000","last_peered":"2023-12-22T09:17:13.785009+0000","last_clean":"2023-12-22T09:17:13.785009+0000","last_became_active":"2023-12-22T09:17:12.518938+0000","last_became_peered":"2023-12-22T09:17:12.518938+0000","last_unstale":"2023-12-22T09:17:13.785009+0000","last_undegraded":"2023-12-22T09:17:13.785009+0000","last_fullsized":"2023-12-22T09:17:13.785009+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:51.675128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"63'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.552653+0000","last_change":"2023-12-22T09:17:12.045401+0000","last_active":"2023-12-22T09:17:12.552653+0000","last_peered":"2023-12-22T09:17:12.552653+0000","last_clean":"2023-12-22T09:17:12.552653+0000","last_became_active":"2023-12-22T09:17:12.044219+0000","last_became_peered":"2023-12-22T09:17:12.044219+0000","last_unstale":"2023-12-22T09:17:12.552653+0000","last_undegraded":"2023-12-22T09:17:12.552653+0000","last_fullsized":"2023-12-22T09:17:12.552653+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:44.256814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511748+0000","last_change":"2023-12-22T09:16:58.138339+0000","last_active":"2023-12-22T09:17:12.511748+0000","last_peered":"2023-12-22T09:17:12.511748+0000","last_clean":"2023-12-22T09:17:12.511748+0000","last_became_active":"2023-12-22T09:16:58.137859+0000","last_became_peered":"2023-12-22T09:16:58.137859+0000","last_unstale":"2023-12-22T09:17:12.511748+0000","last_undegraded":"2023-12-22T09:17:12.511748+0000","last_fullsized":"2023-12-22T09:17:12.511748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:20.962415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.532026+0000","last_change":"2023-12-22T09:16:57.655164+0000","last_active":"2023-12-22T09:17:12.532026+0000","last_peered":"2023-12-22T09:17:12.532026+0000","last_clean":"2023-12-22T09:17:12.532026+0000","last_became_active":"2023-12-22T09:16:57.654845+0000","last_became_peered":"2023-12-22T09:16:57.654845+0000","last_unstale":"2023-12-22T09:17:12.532026+0000","last_undegraded":"2023-12-22T09:17:12.532026+0000","last_fullsized":"2023-12-22T09:17:12.532026+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:48.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654348+0000","last_change":"2023-12-22T09:17:12.533123+0000","last_active":"2023-12-22T09:17:13.654348+0000","last_peered":"2023-12-22T09:17:13.654348+0000","last_clean":"2023-12-22T09:17:13.654348+0000","last_became_active":"2023-12-22T09:17:12.532863+0000","last_became_peered":"2023-12-22T09:17:12.532863+0000","last_unstale":"2023-12-22T09:17:13.654348+0000","last_undegraded":"2023-12-22T09:17:13.654348+0000","last_fullsized":"2023-12-22T09:17:13.654348+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:19.705765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530622+0000","last_change":"2023-12-22T09:17:12.051582+0000","last_active":"2023-12-22T09:17:12.530622+0000","last_peered":"2023-12-22T09:17:12.530622+0000","last_clean":"2023-12-22T09:17:12.530622+0000","last_became_active":"2023-12-22T09:17:12.051335+0000","last_became_peered":"2023-12-22T09:17:12.051335+0000","last_unstale":"2023-12-22T09:17:12.530622+0000","last_undegraded":"2023-12-22T09:17:12.530622+0000","last_fullsized":"2023-12-22T09:17:12.530622+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:44.261501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509885+0000","last_change":"2023-12-22T09:16:58.140359+0000","last_active":"2023-12-22T09:17:12.509885+0000","last_peered":"2023-12-22T09:17:12.509885+0000","last_clean":"2023-12-22T09:17:12.509885+0000","last_became_active":"2023-12-22T09:16:58.140013+0000","last_became_peered":"2023-12-22T09:16:58.140013+0000","last_unstale":"2023-12-22T09:17:12.509885+0000","last_undegraded":"2023-12-22T09:17:12.509885+0000","last_fullsized":"2023-12-22T09:17:12.509885+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:10:45.503921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.524534+0000","last_change":"2023-12-22T09:16:57.649245+0000","last_active":"2023-12-22T09:17:12.524534+0000","last_peered":"2023-12-22T09:17:12.524534+0000","last_clean":"2023-12-22T09:17:12.524534+0000","last_became_active":"2023-12-22T09:16:57.648941+0000","last_became_peered":"2023-12-22T09:16:57.648941+0000","last_unstale":"2023-12-22T09:17:12.524534+0000","last_undegraded":"2023-12-22T09:17:12.524534+0000","last_fullsized":"2023-12-22T09:17:12.524534+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:41:54.745043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786500+0000","last_change":"2023-12-22T09:17:12.541809+0000","last_active":"2023-12-22T09:17:13.786500+0000","last_peered":"2023-12-22T09:17:13.786500+0000","last_clean":"2023-12-22T09:17:13.786500+0000","last_became_active":"2023-12-22T09:17:12.541337+0000","last_became_peered":"2023-12-22T09:17:12.541337+0000","last_unstale":"2023-12-22T09:17:13.786500+0000","last_undegraded":"2023-12-22T09:17:13.786500+0000","last_fullsized":"2023-12-22T09:17:13.786500+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:32.197707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.518282+0000","last_change":"2023-12-22T09:17:12.044813+0000","last_active":"2023-12-22T09:17:12.518282+0000","last_peered":"2023-12-22T09:17:12.518282+0000","last_clean":"2023-12-22T09:17:12.518282+0000","last_became_active":"2023-12-22T09:17:12.044493+0000","last_became_peered":"2023-12-22T09:17:12.044493+0000","last_unstale":"2023-12-22T09:17:12.518282+0000","last_undegraded":"2023-12-22T09:17:12.518282+0000","last_fullsized":"2023-12-22T09:17:12.518282+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:49:30.159981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531860+0000","last_change":"2023-12-22T09:16:58.136583+0000","last_active":"2023-12-22T09:17:12.531860+0000","last_peered":"2023-12-22T09:17:12.531860+0000","last_clean":"2023-12-22T09:17:12.531860+0000","last_became_active":"2023-12-22T09:16:58.136313+0000","last_became_peered":"2023-12-22T09:16:58.136313+0000","last_unstale":"2023-12-22T09:17:12.531860+0000","last_undegraded":"2023-12-22T09:17:12.531860+0000","last_fullsized":"2023-12-22T09:17:12.531860+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:04.972480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"59'9","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501925+0000","last_change":"2023-12-22T09:16:57.656118+0000","last_active":"2023-12-22T09:17:12.501925+0000","last_peered":"2023-12-22T09:17:12.501925+0000","last_clean":"2023-12-22T09:17:12.501925+0000","last_became_active":"2023-12-22T09:16:57.655712+0000","last_became_peered":"2023-12-22T09:16:57.655712+0000","last_unstale":"2023-12-22T09:17:12.501925+0000","last_undegraded":"2023-12-22T09:17:12.501925+0000","last_fullsized":"2023-12-22T09:17:12.501925+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519856+0000","last_change":"2023-12-22T09:17:12.541565+0000","last_active":"2023-12-22T09:17:13.519856+0000","last_peered":"2023-12-22T09:17:13.519856+0000","last_clean":"2023-12-22T09:17:13.519856+0000","last_became_active":"2023-12-22T09:17:12.540916+0000","last_became_peered":"2023-12-22T09:17:12.540916+0000","last_unstale":"2023-12-22T09:17:13.519856+0000","last_undegraded":"2023-12-22T09:17:13.519856+0000","last_fullsized":"2023-12-22T09:17:13.519856+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:48.901354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.517343+0000","last_change":"2023-12-22T09:17:12.033057+0000","last_active":"2023-12-22T09:17:12.517343+0000","last_peered":"2023-12-22T09:17:12.517343+0000","last_clean":"2023-12-22T09:17:12.517343+0000","last_became_active":"2023-12-22T09:17:12.031614+0000","last_became_peered":"2023-12-22T09:17:12.031614+0000","last_unstale":"2023-12-22T09:17:12.517343+0000","last_undegraded":"2023-12-22T09:17:12.517343+0000","last_fullsized":"2023-12-22T09:17:12.517343+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:43:07.491118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523277+0000","last_change":"2023-12-22T09:16:58.146066+0000","last_active":"2023-12-22T09:17:12.523277+0000","last_peered":"2023-12-22T09:17:12.523277+0000","last_clean":"2023-12-22T09:17:12.523277+0000","last_became_active":"2023-12-22T09:16:58.145703+0000","last_became_peered":"2023-12-22T09:16:58.145703+0000","last_unstale":"2023-12-22T09:17:12.523277+0000","last_undegraded":"2023-12-22T09:17:12.523277+0000","last_fullsized":"2023-12-22T09:17:12.523277+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:02.557319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530402+0000","last_change":"2023-12-22T09:16:57.649967+0000","last_active":"2023-12-22T09:17:12.530402+0000","last_peered":"2023-12-22T09:17:12.530402+0000","last_clean":"2023-12-22T09:17:12.530402+0000","last_became_active":"2023-12-22T09:16:57.649500+0000","last_became_peered":"2023-12-22T09:16:57.649500+0000","last_unstale":"2023-12-22T09:17:12.530402+0000","last_undegraded":"2023-12-22T09:17:12.530402+0000","last_fullsized":"2023-12-22T09:17:12.530402+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520037+0000","last_change":"2023-12-22T09:17:12.524836+0000","last_active":"2023-12-22T09:17:13.520037+0000","last_peered":"2023-12-22T09:17:13.520037+0000","last_clean":"2023-12-22T09:17:13.520037+0000","last_became_active":"2023-12-22T09:17:12.524505+0000","last_became_peered":"2023-12-22T09:17:12.524505+0000","last_unstale":"2023-12-22T09:17:13.520037+0000","last_undegraded":"2023-12-22T09:17:13.520037+0000","last_fullsized":"2023-12-22T09:17:13.520037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:11:58.590168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"63'8","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.545045+0000","last_change":"2023-12-22T09:17:12.033674+0000","last_active":"2023-12-22T09:17:12.545045+0000","last_peered":"2023-12-22T09:17:12.545045+0000","last_clean":"2023-12-22T09:17:12.545045+0000","last_became_active":"2023-12-22T09:17:12.033414+0000","last_became_peered":"2023-12-22T09:17:12.033414+0000","last_unstale":"2023-12-22T09:17:12.545045+0000","last_undegraded":"2023-12-22T09:17:12.545045+0000","last_fullsized":"2023-12-22T09:17:12.545045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511945+0000","last_change":"2023-12-22T09:16:58.134889+0000","last_active":"2023-12-22T09:17:12.511945+0000","last_peered":"2023-12-22T09:17:12.511945+0000","last_clean":"2023-12-22T09:17:12.511945+0000","last_became_active":"2023-12-22T09:16:58.134552+0000","last_became_peered":"2023-12-22T09:16:58.134552+0000","last_unstale":"2023-12-22T09:17:12.511945+0000","last_undegraded":"2023-12-22T09:17:12.511945+0000","last_fullsized":"2023-12-22T09:17:12.511945+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514020+0000","last_change":"2023-12-22T09:16:57.651390+0000","last_active":"2023-12-22T09:17:12.514020+0000","last_peered":"2023-12-22T09:17:12.514020+0000","last_clean":"2023-12-22T09:17:12.514020+0000","last_became_active":"2023-12-22T09:16:57.650566+0000","last_became_peered":"2023-12-22T09:16:57.650566+0000","last_unstale":"2023-12-22T09:17:12.514020+0000","last_undegraded":"2023-12-22T09:17:12.514020+0000","last_fullsized":"2023-12-22T09:17:12.514020+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:53.090112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787882+0000","last_change":"2023-12-22T09:17:12.527859+0000","last_active":"2023-12-22T09:17:13.787882+0000","last_peered":"2023-12-22T09:17:13.787882+0000","last_clean":"2023-12-22T09:17:13.787882+0000","last_became_active":"2023-12-22T09:17:12.527492+0000","last_became_peered":"2023-12-22T09:17:12.527492+0000","last_unstale":"2023-12-22T09:17:13.787882+0000","last_undegraded":"2023-12-22T09:17:13.787882+0000","last_fullsized":"2023-12-22T09:17:13.787882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:53:47.049867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.542091+0000","last_change":"2023-12-22T09:17:12.051972+0000","last_active":"2023-12-22T09:17:12.542091+0000","last_peered":"2023-12-22T09:17:12.542091+0000","last_clean":"2023-12-22T09:17:12.542091+0000","last_became_active":"2023-12-22T09:17:12.051625+0000","last_became_peered":"2023-12-22T09:17:12.051625+0000","last_unstale":"2023-12-22T09:17:12.542091+0000","last_undegraded":"2023-12-22T09:17:12.542091+0000","last_fullsized":"2023-12-22T09:17:12.542091+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:56:30.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506577+0000","last_change":"2023-12-22T09:16:58.127084+0000","last_active":"2023-12-22T09:17:12.506577+0000","last_peered":"2023-12-22T09:17:12.506577+0000","last_clean":"2023-12-22T09:17:12.506577+0000","last_became_active":"2023-12-22T09:16:58.126598+0000","last_became_peered":"2023-12-22T09:16:58.126598+0000","last_unstale":"2023-12-22T09:17:12.506577+0000","last_undegraded":"2023-12-22T09:17:12.506577+0000","last_fullsized":"2023-12-22T09:17:12.506577+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:57.174680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523748+0000","last_change":"2023-12-22T09:16:57.643354+0000","last_active":"2023-12-22T09:17:12.523748+0000","last_peered":"2023-12-22T09:17:12.523748+0000","last_clean":"2023-12-22T09:17:12.523748+0000","last_became_active":"2023-12-22T09:16:57.643102+0000","last_became_peered":"2023-12-22T09:16:57.643102+0000","last_unstale":"2023-12-22T09:17:12.523748+0000","last_undegraded":"2023-12-22T09:17:12.523748+0000","last_fullsized":"2023-12-22T09:17:12.523748+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519260+0000","last_change":"2023-12-22T09:17:12.526768+0000","last_active":"2023-12-22T09:17:13.519260+0000","last_peered":"2023-12-22T09:17:13.519260+0000","last_clean":"2023-12-22T09:17:13.519260+0000","last_became_active":"2023-12-22T09:17:12.526405+0000","last_became_peered":"2023-12-22T09:17:12.526405+0000","last_unstale":"2023-12-22T09:17:13.519260+0000","last_undegraded":"2023-12-22T09:17:13.519260+0000","last_fullsized":"2023-12-22T09:17:13.519260+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:14:28.665216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.525171+0000","last_change":"2023-12-22T09:17:12.049210+0000","last_active":"2023-12-22T09:17:12.525171+0000","last_peered":"2023-12-22T09:17:12.525171+0000","last_clean":"2023-12-22T09:17:12.525171+0000","last_became_active":"2023-12-22T09:17:12.048873+0000","last_became_peered":"2023-12-22T09:17:12.048873+0000","last_unstale":"2023-12-22T09:17:12.525171+0000","last_undegraded":"2023-12-22T09:17:12.525171+0000","last_fullsized":"2023-12-22T09:17:12.525171+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:53.836251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.503160+0000","last_change":"2023-12-22T09:16:58.146073+0000","last_active":"2023-12-22T09:17:12.503160+0000","last_peered":"2023-12-22T09:17:12.503160+0000","last_clean":"2023-12-22T09:17:12.503160+0000","last_became_active":"2023-12-22T09:16:58.145780+0000","last_became_peered":"2023-12-22T09:16:58.145780+0000","last_unstale":"2023-12-22T09:17:12.503160+0000","last_undegraded":"2023-12-22T09:17:12.503160+0000","last_fullsized":"2023-12-22T09:17:12.503160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":24,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523398+0000","last_change":"2023-12-22T09:16:57.651320+0000","last_active":"2023-12-22T09:17:12.523398+0000","last_peered":"2023-12-22T09:17:12.523398+0000","last_clean":"2023-12-22T09:17:12.523398+0000","last_became_active":"2023-12-22T09:16:57.651060+0000","last_became_peered":"2023-12-22T09:16:57.651060+0000","last_unstale":"2023-12-22T09:17:12.523398+0000","last_undegraded":"2023-12-22T09:17:12.523398+0000","last_fullsized":"2023-12-22T09:17:12.523398+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:19:59.812662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672849+0000","last_change":"2023-12-22T09:17:12.528567+0000","last_active":"2023-12-22T09:17:13.672849+0000","last_peered":"2023-12-22T09:17:13.672849+0000","last_clean":"2023-12-22T09:17:13.672849+0000","last_became_active":"2023-12-22T09:17:12.528002+0000","last_became_peered":"2023-12-22T09:17:12.528002+0000","last_unstale":"2023-12-22T09:17:13.672849+0000","last_undegraded":"2023-12-22T09:17:13.672849+0000","last_fullsized":"2023-12-22T09:17:13.672849+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:51.036971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.541699+0000","last_change":"2023-12-22T09:17:12.033505+0000","last_active":"2023-12-22T09:17:12.541699+0000","last_peered":"2023-12-22T09:17:12.541699+0000","last_clean":"2023-12-22T09:17:12.541699+0000","last_became_active":"2023-12-22T09:17:12.033215+0000","last_became_peered":"2023-12-22T09:17:12.033215+0000","last_unstale":"2023-12-22T09:17:12.541699+0000","last_undegraded":"2023-12-22T09:17:12.541699+0000","last_fullsized":"2023-12-22T09:17:12.541699+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:56.005441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.526085+0000","last_change":"2023-12-22T09:16:58.148310+0000","last_active":"2023-12-22T09:17:12.526085+0000","last_peered":"2023-12-22T09:17:12.526085+0000","last_clean":"2023-12-22T09:17:12.526085+0000","last_became_active":"2023-12-22T09:16:58.147993+0000","last_became_peered":"2023-12-22T09:16:58.147993+0000","last_unstale":"2023-12-22T09:17:12.526085+0000","last_undegraded":"2023-12-22T09:17:12.526085+0000","last_fullsized":"2023-12-22T09:17:12.526085+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.516449+0000","last_change":"2023-12-22T09:16:57.654251+0000","last_active":"2023-12-22T09:17:12.516449+0000","last_peered":"2023-12-22T09:17:12.516449+0000","last_clean":"2023-12-22T09:17:12.516449+0000","last_became_active":"2023-12-22T09:16:57.653954+0000","last_became_peered":"2023-12-22T09:16:57.653954+0000","last_unstale":"2023-12-22T09:17:12.516449+0000","last_undegraded":"2023-12-22T09:17:12.516449+0000","last_fullsized":"2023-12-22T09:17:12.516449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512606+0000","last_change":"2023-12-22T09:17:12.530578+0000","last_active":"2023-12-22T09:17:13.512606+0000","last_peered":"2023-12-22T09:17:13.512606+0000","last_clean":"2023-12-22T09:17:13.512606+0000","last_became_active":"2023-12-22T09:17:12.530253+0000","last_became_peered":"2023-12-22T09:17:12.530253+0000","last_unstale":"2023-12-22T09:17:13.512606+0000","last_undegraded":"2023-12-22T09:17:13.512606+0000","last_fullsized":"2023-12-22T09:17:13.512606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:35:40.208972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501023+0000","last_change":"2023-12-22T09:17:12.044418+0000","last_active":"2023-12-22T09:17:12.501023+0000","last_peered":"2023-12-22T09:17:12.501023+0000","last_clean":"2023-12-22T09:17:12.501023+0000","last_became_active":"2023-12-22T09:17:12.041736+0000","last_became_peered":"2023-12-22T09:17:12.041736+0000","last_unstale":"2023-12-22T09:17:12.501023+0000","last_undegraded":"2023-12-22T09:17:12.501023+0000","last_fullsized":"2023-12-22T09:17:12.501023+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:34:22.106083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514253+0000","last_change":"2023-12-22T09:16:58.152892+0000","last_active":"2023-12-22T09:17:12.514253+0000","last_peered":"2023-12-22T09:17:12.514253+0000","last_clean":"2023-12-22T09:17:12.514253+0000","last_became_active":"2023-12-22T09:16:58.152538+0000","last_became_peered":"2023-12-22T09:16:58.152538+0000","last_unstale":"2023-12-22T09:17:12.514253+0000","last_undegraded":"2023-12-22T09:17:12.514253+0000","last_fullsized":"2023-12-22T09:17:12.514253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:12:00.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523612+0000","last_change":"2023-12-22T09:16:57.659614+0000","last_active":"2023-12-22T09:17:12.523612+0000","last_peered":"2023-12-22T09:17:12.523612+0000","last_clean":"2023-12-22T09:17:12.523612+0000","last_became_active":"2023-12-22T09:16:57.659211+0000","last_became_peered":"2023-12-22T09:16:57.659211+0000","last_unstale":"2023-12-22T09:17:12.523612+0000","last_undegraded":"2023-12-22T09:17:12.523612+0000","last_fullsized":"2023-12-22T09:17:12.523612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512450+0000","last_change":"2023-12-22T09:17:12.530610+0000","last_active":"2023-12-22T09:17:13.512450+0000","last_peered":"2023-12-22T09:17:13.512450+0000","last_clean":"2023-12-22T09:17:13.512450+0000","last_became_active":"2023-12-22T09:17:12.530321+0000","last_became_peered":"2023-12-22T09:17:12.530321+0000","last_unstale":"2023-12-22T09:17:13.512450+0000","last_undegraded":"2023-12-22T09:17:13.512450+0000","last_fullsized":"2023-12-22T09:17:13.512450+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:05:07.882503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.543725+0000","last_change":"2023-12-22T09:17:12.053568+0000","last_active":"2023-12-22T09:17:12.543725+0000","last_peered":"2023-12-22T09:17:12.543725+0000","last_clean":"2023-12-22T09:17:12.543725+0000","last_became_active":"2023-12-22T09:17:12.053300+0000","last_became_peered":"2023-12-22T09:17:12.053300+0000","last_unstale":"2023-12-22T09:17:12.543725+0000","last_undegraded":"2023-12-22T09:17:12.543725+0000","last_fullsized":"2023-12-22T09:17:12.543725+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:27.519985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531709+0000","last_change":"2023-12-22T09:16:58.144680+0000","last_active":"2023-12-22T09:17:12.531709+0000","last_peered":"2023-12-22T09:17:12.531709+0000","last_clean":"2023-12-22T09:17:12.531709+0000","last_became_active":"2023-12-22T09:16:58.144401+0000","last_became_peered":"2023-12-22T09:16:58.144401+0000","last_unstale":"2023-12-22T09:17:12.531709+0000","last_undegraded":"2023-12-22T09:17:12.531709+0000","last_fullsized":"2023-12-22T09:17:12.531709+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:43.213252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.524628+0000","last_change":"2023-12-22T09:16:57.651659+0000","last_active":"2023-12-22T09:17:12.524628+0000","last_peered":"2023-12-22T09:17:12.524628+0000","last_clean":"2023-12-22T09:17:12.524628+0000","last_became_active":"2023-12-22T09:16:57.650353+0000","last_became_peered":"2023-12-22T09:16:57.650353+0000","last_unstale":"2023-12-22T09:17:12.524628+0000","last_undegraded":"2023-12-22T09:17:12.524628+0000","last_fullsized":"2023-12-22T09:17:12.524628+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:15.191139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672043+0000","last_change":"2023-12-22T09:17:12.532001+0000","last_active":"2023-12-22T09:17:13.672043+0000","last_peered":"2023-12-22T09:17:13.672043+0000","last_clean":"2023-12-22T09:17:13.672043+0000","last_became_active":"2023-12-22T09:17:12.531752+0000","last_became_peered":"2023-12-22T09:17:12.531752+0000","last_unstale":"2023-12-22T09:17:13.672043+0000","last_undegraded":"2023-12-22T09:17:13.672043+0000","last_fullsized":"2023-12-22T09:17:13.672043+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:57.709662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.543808+0000","last_change":"2023-12-22T09:17:12.046797+0000","last_active":"2023-12-22T09:17:12.543808+0000","last_peered":"2023-12-22T09:17:12.543808+0000","last_clean":"2023-12-22T09:17:12.543808+0000","last_became_active":"2023-12-22T09:17:12.046525+0000","last_became_peered":"2023-12-22T09:17:12.046525+0000","last_unstale":"2023-12-22T09:17:12.543808+0000","last_undegraded":"2023-12-22T09:17:12.543808+0000","last_fullsized":"2023-12-22T09:17:12.543808+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:47.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509106+0000","last_change":"2023-12-22T09:16:58.139368+0000","last_active":"2023-12-22T09:17:12.509106+0000","last_peered":"2023-12-22T09:17:12.509106+0000","last_clean":"2023-12-22T09:17:12.509106+0000","last_became_active":"2023-12-22T09:16:58.134697+0000","last_became_peered":"2023-12-22T09:16:58.134697+0000","last_unstale":"2023-12-22T09:17:12.509106+0000","last_undegraded":"2023-12-22T09:17:12.509106+0000","last_fullsized":"2023-12-22T09:17:12.509106+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:40.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511659+0000","last_change":"2023-12-22T09:16:57.659460+0000","last_active":"2023-12-22T09:17:12.511659+0000","last_peered":"2023-12-22T09:17:12.511659+0000","last_clean":"2023-12-22T09:17:12.511659+0000","last_became_active":"2023-12-22T09:16:57.659124+0000","last_became_peered":"2023-12-22T09:16:57.659124+0000","last_unstale":"2023-12-22T09:17:12.511659+0000","last_undegraded":"2023-12-22T09:17:12.511659+0000","last_fullsized":"2023-12-22T09:17:12.511659+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:00.331386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.656111+0000","last_change":"2023-12-22T09:17:12.544913+0000","last_active":"2023-12-22T09:17:13.656111+0000","last_peered":"2023-12-22T09:17:13.656111+0000","last_clean":"2023-12-22T09:17:13.656111+0000","last_became_active":"2023-12-22T09:17:12.544666+0000","last_became_peered":"2023-12-22T09:17:12.544666+0000","last_unstale":"2023-12-22T09:17:13.656111+0000","last_undegraded":"2023-12-22T09:17:13.656111+0000","last_fullsized":"2023-12-22T09:17:13.656111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:00.648890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508653+0000","last_change":"2023-12-22T09:17:12.026554+0000","last_active":"2023-12-22T09:17:12.508653+0000","last_peered":"2023-12-22T09:17:12.508653+0000","last_clean":"2023-12-22T09:17:12.508653+0000","last_became_active":"2023-12-22T09:17:12.026169+0000","last_became_peered":"2023-12-22T09:17:12.026169+0000","last_unstale":"2023-12-22T09:17:12.508653+0000","last_undegraded":"2023-12-22T09:17:12.508653+0000","last_fullsized":"2023-12-22T09:17:12.508653+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:22:18.487717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.513517+0000","last_change":"2023-12-22T09:16:58.122054+0000","last_active":"2023-12-22T09:17:12.513517+0000","last_peered":"2023-12-22T09:17:12.513517+0000","last_clean":"2023-12-22T09:17:12.513517+0000","last_became_active":"2023-12-22T09:16:58.121132+0000","last_became_peered":"2023-12-22T09:16:58.121132+0000","last_unstale":"2023-12-22T09:17:12.513517+0000","last_undegraded":"2023-12-22T09:17:12.513517+0000","last_fullsized":"2023-12-22T09:17:12.513517+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.513127+0000","last_change":"2023-12-22T09:16:57.643365+0000","last_active":"2023-12-22T09:17:12.513127+0000","last_peered":"2023-12-22T09:17:12.513127+0000","last_clean":"2023-12-22T09:17:12.513127+0000","last_became_active":"2023-12-22T09:16:57.642191+0000","last_became_peered":"2023-12-22T09:16:57.642191+0000","last_unstale":"2023-12-22T09:17:12.513127+0000","last_undegraded":"2023-12-22T09:17:12.513127+0000","last_fullsized":"2023-12-22T09:17:12.513127+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:42.294395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520118+0000","last_change":"2023-12-22T09:17:12.533494+0000","last_active":"2023-12-22T09:17:13.520118+0000","last_peered":"2023-12-22T09:17:13.520118+0000","last_clean":"2023-12-22T09:17:13.520118+0000","last_became_active":"2023-12-22T09:17:12.532982+0000","last_became_peered":"2023-12-22T09:17:12.532982+0000","last_unstale":"2023-12-22T09:17:13.520118+0000","last_undegraded":"2023-12-22T09:17:13.520118+0000","last_fullsized":"2023-12-22T09:17:13.520118+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:31.400736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509800+0000","last_change":"2023-12-22T09:17:12.028752+0000","last_active":"2023-12-22T09:17:12.509800+0000","last_peered":"2023-12-22T09:17:12.509800+0000","last_clean":"2023-12-22T09:17:12.509800+0000","last_became_active":"2023-12-22T09:17:12.024880+0000","last_became_peered":"2023-12-22T09:17:12.024880+0000","last_unstale":"2023-12-22T09:17:12.509800+0000","last_undegraded":"2023-12-22T09:17:12.509800+0000","last_fullsized":"2023-12-22T09:17:12.509800+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:18.691505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.512171+0000","last_change":"2023-12-22T09:16:58.139882+0000","last_active":"2023-12-22T09:17:12.512171+0000","last_peered":"2023-12-22T09:17:12.512171+0000","last_clean":"2023-12-22T09:17:12.512171+0000","last_became_active":"2023-12-22T09:16:58.139602+0000","last_became_peered":"2023-12-22T09:16:58.139602+0000","last_unstale":"2023-12-22T09:17:12.512171+0000","last_undegraded":"2023-12-22T09:17:12.512171+0000","last_fullsized":"2023-12-22T09:17:12.512171+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514161+0000","last_change":"2023-12-22T09:16:57.651581+0000","last_active":"2023-12-22T09:17:12.514161+0000","last_peered":"2023-12-22T09:17:12.514161+0000","last_clean":"2023-12-22T09:17:12.514161+0000","last_became_active":"2023-12-22T09:16:57.651050+0000","last_became_peered":"2023-12-22T09:16:57.651050+0000","last_unstale":"2023-12-22T09:17:12.514161+0000","last_undegraded":"2023-12-22T09:17:12.514161+0000","last_fullsized":"2023-12-22T09:17:12.514161+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654707+0000","last_change":"2023-12-22T09:17:12.533788+0000","last_active":"2023-12-22T09:17:13.654707+0000","last_peered":"2023-12-22T09:17:13.654707+0000","last_clean":"2023-12-22T09:17:13.654707+0000","last_became_active":"2023-12-22T09:17:12.533557+0000","last_became_peered":"2023-12-22T09:17:12.533557+0000","last_unstale":"2023-12-22T09:17:13.654707+0000","last_undegraded":"2023-12-22T09:17:13.654707+0000","last_fullsized":"2023-12-22T09:17:13.654707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:52:31.473473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530636+0000","last_change":"2023-12-22T09:17:12.045811+0000","last_active":"2023-12-22T09:17:12.530636+0000","last_peered":"2023-12-22T09:17:12.530636+0000","last_clean":"2023-12-22T09:17:12.530636+0000","last_became_active":"2023-12-22T09:17:12.045487+0000","last_became_peered":"2023-12-22T09:17:12.045487+0000","last_unstale":"2023-12-22T09:17:12.530636+0000","last_undegraded":"2023-12-22T09:17:12.530636+0000","last_fullsized":"2023-12-22T09:17:12.530636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:24.280048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506960+0000","last_change":"2023-12-22T09:16:58.127943+0000","last_active":"2023-12-22T09:17:12.506960+0000","last_peered":"2023-12-22T09:17:12.506960+0000","last_clean":"2023-12-22T09:17:12.506960+0000","last_became_active":"2023-12-22T09:16:58.127679+0000","last_became_peered":"2023-12-22T09:16:58.127679+0000","last_unstale":"2023-12-22T09:17:12.506960+0000","last_undegraded":"2023-12-22T09:17:12.506960+0000","last_fullsized":"2023-12-22T09:17:12.506960+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:34.212746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514933+0000","last_change":"2023-12-22T09:16:57.643620+0000","last_active":"2023-12-22T09:17:12.514933+0000","last_peered":"2023-12-22T09:17:12.514933+0000","last_clean":"2023-12-22T09:17:12.514933+0000","last_became_active":"2023-12-22T09:16:57.643322+0000","last_became_peered":"2023-12-22T09:16:57.643322+0000","last_unstale":"2023-12-22T09:17:12.514933+0000","last_undegraded":"2023-12-22T09:17:12.514933+0000","last_fullsized":"2023-12-22T09:17:12.514933+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:13.807363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786525+0000","last_change":"2023-12-22T09:17:12.537393+0000","last_active":"2023-12-22T09:17:13.786525+0000","last_peered":"2023-12-22T09:17:13.786525+0000","last_clean":"2023-12-22T09:17:13.786525+0000","last_became_active":"2023-12-22T09:17:12.537068+0000","last_became_peered":"2023-12-22T09:17:12.537068+0000","last_unstale":"2023-12-22T09:17:13.786525+0000","last_undegraded":"2023-12-22T09:17:13.786525+0000","last_fullsized":"2023-12-22T09:17:13.786525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:42.821653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.524227+0000","last_change":"2023-12-22T09:17:12.050090+0000","last_active":"2023-12-22T09:17:12.524227+0000","last_peered":"2023-12-22T09:17:12.524227+0000","last_clean":"2023-12-22T09:17:12.524227+0000","last_became_active":"2023-12-22T09:17:12.049825+0000","last_became_peered":"2023-12-22T09:17:12.049825+0000","last_unstale":"2023-12-22T09:17:12.524227+0000","last_undegraded":"2023-12-22T09:17:12.524227+0000","last_fullsized":"2023-12-22T09:17:12.524227+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.521873+0000","last_change":"2023-12-22T09:16:58.147612+0000","last_active":"2023-12-22T09:17:12.521873+0000","last_peered":"2023-12-22T09:17:12.521873+0000","last_clean":"2023-12-22T09:17:12.521873+0000","last_became_active":"2023-12-22T09:16:58.147333+0000","last_became_peered":"2023-12-22T09:16:58.147333+0000","last_unstale":"2023-12-22T09:17:12.521873+0000","last_undegraded":"2023-12-22T09:17:12.521873+0000","last_fullsized":"2023-12-22T09:17:12.521873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:55.463677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.522232+0000","last_change":"2023-12-22T09:17:11.042027+0000","last_active":"2023-12-22T09:17:12.522232+0000","last_peered":"2023-12-22T09:17:12.522232+0000","last_clean":"2023-12-22T09:17:12.522232+0000","last_became_active":"2023-12-22T09:17:11.038601+0000","last_became_peered":"2023-12-22T09:17:11.038601+0000","last_unstale":"2023-12-22T09:17:12.522232+0000","last_undegraded":"2023-12-22T09:17:12.522232+0000","last_fullsized":"2023-12-22T09:17:12.522232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:48.928040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654978+0000","last_change":"2023-12-22T09:17:12.533590+0000","last_active":"2023-12-22T09:17:13.654978+0000","last_peered":"2023-12-22T09:17:13.654978+0000","last_clean":"2023-12-22T09:17:13.654978+0000","last_became_active":"2023-12-22T09:17:12.533150+0000","last_became_peered":"2023-12-22T09:17:12.533150+0000","last_unstale":"2023-12-22T09:17:13.654978+0000","last_undegraded":"2023-12-22T09:17:13.654978+0000","last_fullsized":"2023-12-22T09:17:13.654978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:46:40.356945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.525921+0000","last_change":"2023-12-22T09:17:12.056793+0000","last_active":"2023-12-22T09:17:12.525921+0000","last_peered":"2023-12-22T09:17:12.525921+0000","last_clean":"2023-12-22T09:17:12.525921+0000","last_became_active":"2023-12-22T09:17:12.056485+0000","last_became_peered":"2023-12-22T09:17:12.056485+0000","last_unstale":"2023-12-22T09:17:12.525921+0000","last_undegraded":"2023-12-22T09:17:12.525921+0000","last_fullsized":"2023-12-22T09:17:12.525921+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:10:15.433618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.520080+0000","last_change":"2023-12-22T09:16:58.122982+0000","last_active":"2023-12-22T09:17:12.520080+0000","last_peered":"2023-12-22T09:17:12.520080+0000","last_clean":"2023-12-22T09:17:12.520080+0000","last_became_active":"2023-12-22T09:16:58.122683+0000","last_became_peered":"2023-12-22T09:16:58.122683+0000","last_unstale":"2023-12-22T09:17:12.520080+0000","last_undegraded":"2023-12-22T09:17:12.520080+0000","last_fullsized":"2023-12-22T09:17:12.520080+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:03:37.012223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.518891+0000","last_change":"2023-12-22T09:16:57.652367+0000","last_active":"2023-12-22T09:17:12.518891+0000","last_peered":"2023-12-22T09:17:12.518891+0000","last_clean":"2023-12-22T09:17:12.518891+0000","last_became_active":"2023-12-22T09:16:57.651997+0000","last_became_peered":"2023-12-22T09:16:57.651997+0000","last_unstale":"2023-12-22T09:17:12.518891+0000","last_undegraded":"2023-12-22T09:17:12.518891+0000","last_fullsized":"2023-12-22T09:17:12.518891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786227+0000","last_change":"2023-12-22T09:17:12.540652+0000","last_active":"2023-12-22T09:17:13.786227+0000","last_peered":"2023-12-22T09:17:13.786227+0000","last_clean":"2023-12-22T09:17:13.786227+0000","last_became_active":"2023-12-22T09:17:12.540378+0000","last_became_peered":"2023-12-22T09:17:12.540378+0000","last_unstale":"2023-12-22T09:17:13.786227+0000","last_undegraded":"2023-12-22T09:17:13.786227+0000","last_fullsized":"2023-12-22T09:17:13.786227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:08.734786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.533334+0000","last_change":"2023-12-22T09:17:12.045827+0000","last_active":"2023-12-22T09:17:12.533334+0000","last_peered":"2023-12-22T09:17:12.533334+0000","last_clean":"2023-12-22T09:17:12.533334+0000","last_became_active":"2023-12-22T09:17:12.045562+0000","last_became_peered":"2023-12-22T09:17:12.045562+0000","last_unstale":"2023-12-22T09:17:12.533334+0000","last_undegraded":"2023-12-22T09:17:12.533334+0000","last_fullsized":"2023-12-22T09:17:12.533334+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:00.845862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.518595+0000","last_change":"2023-12-22T09:16:58.134298+0000","last_active":"2023-12-22T09:17:12.518595+0000","last_peered":"2023-12-22T09:17:12.518595+0000","last_clean":"2023-12-22T09:17:12.518595+0000","last_became_active":"2023-12-22T09:16:58.134027+0000","last_became_peered":"2023-12-22T09:16:58.134027+0000","last_unstale":"2023-12-22T09:17:12.518595+0000","last_undegraded":"2023-12-22T09:17:12.518595+0000","last_fullsized":"2023-12-22T09:17:12.518595+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.517237+0000","last_change":"2023-12-22T09:16:57.651565+0000","last_active":"2023-12-22T09:17:12.517237+0000","last_peered":"2023-12-22T09:17:12.517237+0000","last_clean":"2023-12-22T09:17:12.517237+0000","last_became_active":"2023-12-22T09:16:57.651295+0000","last_became_peered":"2023-12-22T09:16:57.651295+0000","last_unstale":"2023-12-22T09:17:12.517237+0000","last_undegraded":"2023-12-22T09:17:12.517237+0000","last_fullsized":"2023-12-22T09:17:12.517237+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:18.179171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516601+0000","last_change":"2023-12-22T09:17:12.523916+0000","last_active":"2023-12-22T09:17:13.516601+0000","last_peered":"2023-12-22T09:17:13.516601+0000","last_clean":"2023-12-22T09:17:13.516601+0000","last_became_active":"2023-12-22T09:17:12.519420+0000","last_became_peered":"2023-12-22T09:17:12.519420+0000","last_unstale":"2023-12-22T09:17:13.516601+0000","last_undegraded":"2023-12-22T09:17:13.516601+0000","last_fullsized":"2023-12-22T09:17:13.516601+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:27:28.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.527996+0000","last_change":"2023-12-22T09:17:12.045851+0000","last_active":"2023-12-22T09:17:12.527996+0000","last_peered":"2023-12-22T09:17:12.527996+0000","last_clean":"2023-12-22T09:17:12.527996+0000","last_became_active":"2023-12-22T09:17:12.045148+0000","last_became_peered":"2023-12-22T09:17:12.045148+0000","last_unstale":"2023-12-22T09:17:12.527996+0000","last_undegraded":"2023-12-22T09:17:12.527996+0000","last_fullsized":"2023-12-22T09:17:12.527996+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:28:17.921536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509202+0000","last_change":"2023-12-22T09:16:58.142640+0000","last_active":"2023-12-22T09:17:12.509202+0000","last_peered":"2023-12-22T09:17:12.509202+0000","last_clean":"2023-12-22T09:17:12.509202+0000","last_became_active":"2023-12-22T09:16:58.142334+0000","last_became_peered":"2023-12-22T09:16:58.142334+0000","last_unstale":"2023-12-22T09:17:12.509202+0000","last_undegraded":"2023-12-22T09:17:12.509202+0000","last_fullsized":"2023-12-22T09:17:12.509202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:35:36.019628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.502123+0000","last_change":"2023-12-22T09:16:57.655954+0000","last_active":"2023-12-22T09:17:12.502123+0000","last_peered":"2023-12-22T09:17:12.502123+0000","last_clean":"2023-12-22T09:17:12.502123+0000","last_became_active":"2023-12-22T09:16:57.655335+0000","last_became_peered":"2023-12-22T09:16:57.655335+0000","last_unstale":"2023-12-22T09:17:12.502123+0000","last_undegraded":"2023-12-22T09:17:12.502123+0000","last_fullsized":"2023-12-22T09:17:12.502123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.785992+0000","last_change":"2023-12-22T09:17:12.542507+0000","last_active":"2023-12-22T09:17:13.785992+0000","last_peered":"2023-12-22T09:17:13.785992+0000","last_clean":"2023-12-22T09:17:13.785992+0000","last_became_active":"2023-12-22T09:17:12.542174+0000","last_became_peered":"2023-12-22T09:17:12.542174+0000","last_unstale":"2023-12-22T09:17:13.785992+0000","last_undegraded":"2023-12-22T09:17:13.785992+0000","last_fullsized":"2023-12-22T09:17:13.785992+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:01:17.585593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509527+0000","last_change":"2023-12-22T09:17:12.034651+0000","last_active":"2023-12-22T09:17:12.509527+0000","last_peered":"2023-12-22T09:17:12.509527+0000","last_clean":"2023-12-22T09:17:12.509527+0000","last_became_active":"2023-12-22T09:17:12.034345+0000","last_became_peered":"2023-12-22T09:17:12.034345+0000","last_unstale":"2023-12-22T09:17:12.509527+0000","last_undegraded":"2023-12-22T09:17:12.509527+0000","last_fullsized":"2023-12-22T09:17:12.509527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:57:00.962453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510462+0000","last_change":"2023-12-22T09:16:58.121917+0000","last_active":"2023-12-22T09:17:12.510462+0000","last_peered":"2023-12-22T09:17:12.510462+0000","last_clean":"2023-12-22T09:17:12.510462+0000","last_became_active":"2023-12-22T09:16:58.118511+0000","last_became_peered":"2023-12-22T09:16:58.118511+0000","last_unstale":"2023-12-22T09:17:12.510462+0000","last_undegraded":"2023-12-22T09:17:12.510462+0000","last_fullsized":"2023-12-22T09:17:12.510462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:33:40.126107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530416+0000","last_change":"2023-12-22T09:16:57.647202+0000","last_active":"2023-12-22T09:17:12.530416+0000","last_peered":"2023-12-22T09:17:12.530416+0000","last_clean":"2023-12-22T09:17:12.530416+0000","last_became_active":"2023-12-22T09:16:57.646930+0000","last_became_peered":"2023-12-22T09:16:57.646930+0000","last_unstale":"2023-12-22T09:17:12.530416+0000","last_undegraded":"2023-12-22T09:17:12.530416+0000","last_fullsized":"2023-12-22T09:17:12.530416+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:40.073052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786282+0000","last_change":"2023-12-22T09:17:12.541669+0000","last_active":"2023-12-22T09:17:13.786282+0000","last_peered":"2023-12-22T09:17:13.786282+0000","last_clean":"2023-12-22T09:17:13.786282+0000","last_became_active":"2023-12-22T09:17:12.541434+0000","last_became_peered":"2023-12-22T09:17:12.541434+0000","last_unstale":"2023-12-22T09:17:13.786282+0000","last_undegraded":"2023-12-22T09:17:13.786282+0000","last_fullsized":"2023-12-22T09:17:13.786282+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:43.383228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.500227+0000","last_change":"2023-12-22T09:17:12.041706+0000","last_active":"2023-12-22T09:17:12.500227+0000","last_peered":"2023-12-22T09:17:12.500227+0000","last_clean":"2023-12-22T09:17:12.500227+0000","last_became_active":"2023-12-22T09:17:12.041413+0000","last_became_peered":"2023-12-22T09:17:12.041413+0000","last_unstale":"2023-12-22T09:17:12.500227+0000","last_undegraded":"2023-12-22T09:17:12.500227+0000","last_fullsized":"2023-12-22T09:17:12.500227+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:44.983134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.528209+0000","last_change":"2023-12-22T09:16:58.139737+0000","last_active":"2023-12-22T09:17:12.528209+0000","last_peered":"2023-12-22T09:17:12.528209+0000","last_clean":"2023-12-22T09:17:12.528209+0000","last_became_active":"2023-12-22T09:16:58.139455+0000","last_became_peered":"2023-12-22T09:16:58.139455+0000","last_unstale":"2023-12-22T09:17:12.528209+0000","last_undegraded":"2023-12-22T09:17:12.528209+0000","last_fullsized":"2023-12-22T09:17:12.528209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:21.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511076+0000","last_change":"2023-12-22T09:16:57.640845+0000","last_active":"2023-12-22T09:17:12.511076+0000","last_peered":"2023-12-22T09:17:12.511076+0000","last_clean":"2023-12-22T09:17:12.511076+0000","last_became_active":"2023-12-22T09:16:57.640523+0000","last_became_peered":"2023-12-22T09:16:57.640523+0000","last_unstale":"2023-12-22T09:17:12.511076+0000","last_undegraded":"2023-12-22T09:17:12.511076+0000","last_fullsized":"2023-12-22T09:17:12.511076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:11.216158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519019+0000","last_change":"2023-12-22T09:17:12.534422+0000","last_active":"2023-12-22T09:17:13.519019+0000","last_peered":"2023-12-22T09:17:13.519019+0000","last_clean":"2023-12-22T09:17:13.519019+0000","last_became_active":"2023-12-22T09:17:12.534170+0000","last_became_peered":"2023-12-22T09:17:12.534170+0000","last_unstale":"2023-12-22T09:17:13.519019+0000","last_undegraded":"2023-12-22T09:17:13.519019+0000","last_fullsized":"2023-12-22T09:17:13.519019+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:14:37.881358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506696+0000","last_change":"2023-12-22T09:17:12.041999+0000","last_active":"2023-12-22T09:17:12.506696+0000","last_peered":"2023-12-22T09:17:12.506696+0000","last_clean":"2023-12-22T09:17:12.506696+0000","last_became_active":"2023-12-22T09:17:12.041632+0000","last_became_peered":"2023-12-22T09:17:12.041632+0000","last_unstale":"2023-12-22T09:17:12.506696+0000","last_undegraded":"2023-12-22T09:17:12.506696+0000","last_fullsized":"2023-12-22T09:17:12.506696+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:24.728438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.502590+0000","last_change":"2023-12-22T09:16:58.136215+0000","last_active":"2023-12-22T09:17:12.502590+0000","last_peered":"2023-12-22T09:17:12.502590+0000","last_clean":"2023-12-22T09:17:12.502590+0000","last_became_active":"2023-12-22T09:16:58.135936+0000","last_became_peered":"2023-12-22T09:16:58.135936+0000","last_unstale":"2023-12-22T09:17:12.502590+0000","last_undegraded":"2023-12-22T09:17:12.502590+0000","last_fullsized":"2023-12-22T09:17:12.502590+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508952+0000","last_change":"2023-12-22T09:16:57.641987+0000","last_active":"2023-12-22T09:17:12.508952+0000","last_peered":"2023-12-22T09:17:12.508952+0000","last_clean":"2023-12-22T09:17:12.508952+0000","last_became_active":"2023-12-22T09:16:57.641712+0000","last_became_peered":"2023-12-22T09:16:57.641712+0000","last_unstale":"2023-12-22T09:17:12.508952+0000","last_undegraded":"2023-12-22T09:17:12.508952+0000","last_fullsized":"2023-12-22T09:17:12.508952+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:33.101510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519359+0000","last_change":"2023-12-22T09:17:12.537866+0000","last_active":"2023-12-22T09:17:13.519359+0000","last_peered":"2023-12-22T09:17:13.519359+0000","last_clean":"2023-12-22T09:17:13.519359+0000","last_became_active":"2023-12-22T09:17:12.537136+0000","last_became_peered":"2023-12-22T09:17:12.537136+0000","last_unstale":"2023-12-22T09:17:13.519359+0000","last_undegraded":"2023-12-22T09:17:13.519359+0000","last_fullsized":"2023-12-22T09:17:13.519359+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:14.639137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.516654+0000","last_change":"2023-12-22T09:17:12.031115+0000","last_active":"2023-12-22T09:17:12.516654+0000","last_peered":"2023-12-22T09:17:12.516654+0000","last_clean":"2023-12-22T09:17:12.516654+0000","last_became_active":"2023-12-22T09:17:12.030513+0000","last_became_peered":"2023-12-22T09:17:12.030513+0000","last_unstale":"2023-12-22T09:17:12.516654+0000","last_undegraded":"2023-12-22T09:17:12.516654+0000","last_fullsized":"2023-12-22T09:17:12.516654+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:15.941299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.516678+0000","last_change":"2023-12-22T09:16:58.150323+0000","last_active":"2023-12-22T09:17:12.516678+0000","last_peered":"2023-12-22T09:17:12.516678+0000","last_clean":"2023-12-22T09:17:12.516678+0000","last_became_active":"2023-12-22T09:16:58.150063+0000","last_became_peered":"2023-12-22T09:16:58.150063+0000","last_unstale":"2023-12-22T09:17:12.516678+0000","last_undegraded":"2023-12-22T09:17:12.516678+0000","last_fullsized":"2023-12-22T09:17:12.516678+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:25.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.500501+0000","last_change":"2023-12-22T09:16:57.643219+0000","last_active":"2023-12-22T09:17:12.500501+0000","last_peered":"2023-12-22T09:17:12.500501+0000","last_clean":"2023-12-22T09:17:12.500501+0000","last_became_active":"2023-12-22T09:16:57.642986+0000","last_became_peered":"2023-12-22T09:16:57.642986+0000","last_unstale":"2023-12-22T09:17:12.500501+0000","last_undegraded":"2023-12-22T09:17:12.500501+0000","last_fullsized":"2023-12-22T09:17:12.500501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.517474+0000","last_change":"2023-12-22T09:17:12.536234+0000","last_active":"2023-12-22T09:17:13.517474+0000","last_peered":"2023-12-22T09:17:13.517474+0000","last_clean":"2023-12-22T09:17:13.517474+0000","last_became_active":"2023-12-22T09:17:12.535964+0000","last_became_peered":"2023-12-22T09:17:12.535964+0000","last_unstale":"2023-12-22T09:17:13.517474+0000","last_undegraded":"2023-12-22T09:17:13.517474+0000","last_fullsized":"2023-12-22T09:17:13.517474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:13.049502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510821+0000","last_change":"2023-12-22T09:17:12.028656+0000","last_active":"2023-12-22T09:17:12.510821+0000","last_peered":"2023-12-22T09:17:12.510821+0000","last_clean":"2023-12-22T09:17:12.510821+0000","last_became_active":"2023-12-22T09:17:12.028097+0000","last_became_peered":"2023-12-22T09:17:12.028097+0000","last_unstale":"2023-12-22T09:17:12.510821+0000","last_undegraded":"2023-12-22T09:17:12.510821+0000","last_fullsized":"2023-12-22T09:17:12.510821+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:33:46.996428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507919+0000","last_change":"2023-12-22T09:16:58.125951+0000","last_active":"2023-12-22T09:17:12.507919+0000","last_peered":"2023-12-22T09:17:12.507919+0000","last_clean":"2023-12-22T09:17:12.507919+0000","last_became_active":"2023-12-22T09:16:58.125435+0000","last_became_peered":"2023-12-22T09:16:58.125435+0000","last_unstale":"2023-12-22T09:17:12.507919+0000","last_undegraded":"2023-12-22T09:17:12.507919+0000","last_fullsized":"2023-12-22T09:17:12.507919+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:30:10.376413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509882+0000","last_change":"2023-12-22T09:16:57.639438+0000","last_active":"2023-12-22T09:17:12.509882+0000","last_peered":"2023-12-22T09:17:12.509882+0000","last_clean":"2023-12-22T09:17:12.509882+0000","last_became_active":"2023-12-22T09:16:57.639148+0000","last_became_peered":"2023-12-22T09:16:57.639148+0000","last_unstale":"2023-12-22T09:17:12.509882+0000","last_undegraded":"2023-12-22T09:17:12.509882+0000","last_fullsized":"2023-12-22T09:17:12.509882+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:36.593161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.527491+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:17:12.527491+0000","last_peered":"2023-12-22T09:17:12.527491+0000","last_clean":"2023-12-22T09:17:12.527491+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:17:12.527491+0000","last_undegraded":"2023-12-22T09:17:12.527491+0000","last_fullsized":"2023-12-22T09:17:12.527491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3857,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1384448,"data_stored":949457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.173,"15min":1.1870000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1060000000000001,"15min":1.129},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.409,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.95999999999999996}]},{"osd":1,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1910000000000001,"15min":1.1990000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.006,"5min":1.2769999999999999,"15min":1.3220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.339,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.0580000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1539999999999999,"15min":1.1739999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.3799999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":1.365}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.24,"15min":1.256},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.427,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.109},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3600000000000001,"15min":1.3720000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.79600000000000004}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.268,"15min":1.2809999999999999},"min":{"1min":0.81399999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":1.038,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.6319999999999999,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.0229999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.458,"15min":1.427},"min":{"1min":0.91400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":8.1620000000000008,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":1.508},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.476,"15min":1.504},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.6220000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.5649999999999999,"15min":1.5740000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.554,"15min":1.581},"min":{"1min":1.127,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.655,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.1930000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":359889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.1100000000000001,"15min":1.1319999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.085,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4810000000000001,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":1.111}]},{"osd":1,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.978,"15min":1.978},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5189999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.661,"5min":1.915,"15min":1.915},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.268,"15min":1.282},"min":{"1min":0.74099999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.194}]},{"osd":3,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4950000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3580000000000001,"15min":1.3740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.736,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.29}]},{"osd":4,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.494,"15min":1.52},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.5549999999999999,"15min":1.585},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.722,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.5329999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.5760000000000001,"15min":1.6060000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.74,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.732},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.671,"15min":1.6970000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.952,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.583}]},{"osd":7,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.6379999999999999,"15min":1.6619999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.859,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.6240000000000001,"15min":1.637},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":2.0459999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3380000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":778240,"data_stored":358347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":0.97099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3240000000000001,"5min":1.677,"15min":1.677},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4650000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.92800000000000005}]},{"osd":1,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.107,"15min":1.1180000000000001},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.48,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.24,"15min":1.26},"min":{"1min":0.73499999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.802,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.381}]},{"osd":2,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5449999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.159,"15min":1.169},"min":{"1min":0.748,"5min":0.629,"15min":0.629},"max":{"1min":1.4419999999999999,"5min":1.762,"15min":1.762},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.256,"15min":1.264},"min":{"1min":0.88,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5640000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.284},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.284,"15min":1.306},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8089999999999999,"5min":2.431,"15min":2.431},"last":1.228}]},{"osd":4,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.304,"15min":1.3120000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5629999999999999,"5min":1.889,"15min":1.889},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4870000000000001,"15min":1.5},"min":{"1min":0.874,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.4890000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4099999999999999,"15min":1.4299999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.982,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.53},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4179999999999999,"15min":1.4359999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7889999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.7629999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.464,"15min":1.48},"min":{"1min":0.97499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.8540000000000001,"5min":3.298,"15min":3.298},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.504,"15min":1.5249999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.0899999999999999,"5min":2.589,"15min":2.589},"last":1.877}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":363018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3320000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.292},{"interface":"front","average":{"1min":1.083,"5min":1.115,"15min":1.121},"min":{"1min":0.70399999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5409999999999999,"5min":2.25,"15min":2.25},"last":1.016}]},{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.113,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.345,"5min":1.782,"15min":1.782},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.425,"5min":1.494,"15min":1.494},"last":1.1080000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4890000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.2130000000000001,"15min":1.224},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7749999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.2490000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.1319999999999999,"15min":1.149},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.542,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.508},{"interface":"front","average":{"1min":1.161,"5min":1.2929999999999999,"15min":1.3149999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.4690000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.6060000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3320000000000001,"15min":1.3520000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.909,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.139},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.268,"15min":1.286},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.679,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.1950000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4950000000000001,"5min":2.052,"15min":2.052},"last":1.546},{"interface":"front","average":{"1min":1.355,"5min":1.5069999999999999,"15min":1.5329999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.4079999999999999,"15min":1.4350000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7470000000000001,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.375},{"interface":"front","average":{"1min":1.339,"5min":1.512,"15min":1.5409999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.629,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.655}]}]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":774144,"data_stored":358873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88500000000000001,"15min":0.89700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.627,"5min":1.716,"15min":1.716},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4430000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.65500000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.028}]},{"osd":2,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.093,"15min":1.105},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1719999999999999,"15min":1.1899999999999999},"min":{"1min":0.66700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4019999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.26}]},{"osd":4,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.244,"15min":1.25},"min":{"1min":0.90900000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.722,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.115},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.92200000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.571,"5min":2.508,"15min":2.508},"last":1.2969999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":2.0030000000000001,"15min":2.1219999999999999},"min":{"1min":0.86299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6519999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":1.647},{"interface":"front","average":{"1min":1.258,"5min":2.254,"15min":2.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.6739999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":1.5229999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":2.423,"15min":2.6219999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.752,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.468},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.1970000000000001,"15min":2.339},"min":{"1min":0.98999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.722,"5min":27.181999999999999,"15min":27.181999999999999},"last":1.5880000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2,"15min":2.121},"min":{"1min":1.016,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5069999999999999,"5min":22.715,"15min":22.715},"last":1.633},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.3860000000000001,"15min":2.5619999999999998},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.643,"5min":30.108000000000001,"15min":30.108000000000001},"last":1.663}]}]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":782336,"data_stored":359033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.85599999999999998,"15min":0.88},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.395,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.95699999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.381,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":1.0069999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.357,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.98899999999999999,"15min":1.002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5489999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.75}]},{"osd":3,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0049999999999999,"15min":1.016},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5289999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.173,"15min":1.1910000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6279999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.96099999999999997}]},{"osd":4,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.377,"15min":1.4179999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6160000000000001,"5min":2.802,"15min":2.802},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.276,"5min":1.4139999999999999,"15min":1.4370000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.758,"5min":2.46,"15min":2.46},"last":1.093}]},{"osd":5,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2889999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.595,"5min":3.327,"15min":3.327},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.371,"15min":1.399},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4279999999999999,"15min":1.452},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9950000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.429},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.369,"15min":1.3999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.554,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":1.542}]},{"osd":7,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.4870000000000001,"15min":1.516},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.823,"5min":2.867,"15min":2.867},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4670000000000001,"15min":1.4950000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.724,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":1.4830000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":362226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.879,"15min":0.90700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.262,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3260000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.90600000000000003,"15min":0.92800000000000005},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.218,"5min":1.504,"15min":1.504},"last":0.874},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.103,"15min":1.143},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.282,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.0409999999999999,"15min":1.0700000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.54,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.266,"15min":1.3069999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4430000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.68799999999999994,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4330000000000001,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.3129999999999999,"15min":1.3500000000000001},"min":{"1min":0.77200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6599999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.4019999999999999,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.1720000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.214,"5min":1.534,"15min":1.5880000000000001},"min":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.649,"5min":4.524,"15min":4.524},"last":0.86199999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.5349999999999999,"15min":1.581},"min":{"1min":0.80900000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3879999999999999,"15min":1.4139999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.881,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.90100000000000002}]},{"osd":7,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.474,"15min":1.5089999999999999},"min":{"1min":0.79800000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.29,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.998},{"interface":"front","average":{"1min":1.319,"5min":1.52,"15min":1.554},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.766,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.80400000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":948659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.0229999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2689999999999999,"5min":1.548,"15min":1.548},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.98099999999999998,"15min":1.0129999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.242,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.1930000000000001,"15min":1.238},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6120000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.0900000000000001,"15min":1.1319999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3939999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1799999999999999,"15min":1.1990000000000001},"min":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.601,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.093,"5min":1.357,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":3.589,"15min":3.589},"last":1.129}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5920000000000001,"5min":1.748,"15min":1.748},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.72599999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.49,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.048}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.268,"15min":1.282},"min":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.611,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.155},{"interface":"front","average":{"1min":1.155,"5min":1.3069999999999999,"15min":1.333},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.365,"15min":1.3879999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8109999999999999,"5min":2.157,"15min":2.157},"last":1.103},{"interface":"front","average":{"1min":1.22,"5min":1.419,"15min":1.452},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6439999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.84699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:17:20.720 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:17:20.729 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:17:21.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T09:17:22.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.210+0000 7f02434f7640 1 Processor -- start 2023-12-22T09:17:22.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.210+0000 7f02434f7640 1 -- start start 2023-12-22T09:17:22.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.211+0000 7f02434f7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f023c069e60 0x7f023c1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.212+0000 7f02434f7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c06fe60 con 0x7f023c15c070 2023-12-22T09:17:22.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.212+0000 7f02434f7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c070140 con 0x7f023c070480 2023-12-22T09:17:22.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.212+0000 7f02434f7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c15c5e0 con 0x7f023c069e60 2023-12-22T09:17:22.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.212+0000 7f0240a92640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f023c15c070 0x7f023c155730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:49660/0 (socket says 172.21.15.106:49660) 2023-12-22T09:17:22.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.212+0000 7f0240a92640 1 -- 172.21.15.106:0/3456372209 learned_addr learned my addr 172.21.15.106:0/3456372209 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:22.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.212+0000 7f0241293640 1 --2- 172.21.15.106:0/3456372209 >> v2:172.21.15.132:3300/0 conn(0x7f023c069e60 0x7f023c1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.212+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077613037 0 0) 0x7f023c06fe60 con 0x7f023c15c070 2023-12-22T09:17:22.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.212+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0228003520 con 0x7f023c15c070 2023-12-22T09:17:22.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1030225780 0 0) 0x7f0228003520 con 0x7f023c15c070 2023-12-22T09:17:22.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 >> v2:172.21.15.132:3300/0 conn(0x7f023c069e60 msgr2=0x7f023c1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:22.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 --2- 172.21.15.106:0/3456372209 >> v2:172.21.15.132:3300/0 conn(0x7f023c069e60 0x7f023c1551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 >> v1:172.21.15.132:6789/0 conn(0x7f023c070480 legacy=0x7f023c0bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c0c1440 con 0x7f023c15c070 2023-12-22T09:17:22.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f022c001670 con 0x7f023c15c070 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 >> v1:172.21.15.106:6789/0 conn(0x7f023c15c070 legacy=0x7f023c155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0228003970 0x7f0228003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02280047c0 0x7f0228004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0228005180 0x7f022800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c15c5e0 con 0x7f0228005180 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022800c020 con 0x7f02280047c0 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022800c1e0 con 0x7f0228003970 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.213+0000 7f0241a94640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0228005180 0x7f022800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.214+0000 7f0241293640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0228003970 0x7f0228003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.214+0000 7f0240a92640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02280047c0 0x7f0228004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.214+0000 7f0241a94640 1 -- 172.21.15.106:0/3456372209 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0228003970 msgr2=0x7f0228003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:22.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.214+0000 7f0241a94640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0228003970 0x7f0228003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.214+0000 7f0241a94640 1 -- 172.21.15.106:0/3456372209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02280047c0 msgr2=0x7f0228004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:22.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.214+0000 7f0241a94640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02280047c0 0x7f0228004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.214+0000 7f0241a94640 1 -- 172.21.15.106:0/3456372209 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228003520 con 0x7f0228005180 2023-12-22T09:17:22.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.215+0000 7f0241a94640 1 -- 172.21.15.106:0/3456372209 reap_dead start 2023-12-22T09:17:22.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.215+0000 7f0241a94640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0228005180 0x7f022800b980 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0234001e50 tx=0x7f02280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5622277e604ca0e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.215+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234003b70 con 0x7f0228005180 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.215+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234003d10 con 0x7f0228005180 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.215+0000 7f0233fff640 1 -- 172.21.15.106:0/3456372209 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234005310 con 0x7f0228005180 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.216+0000 7f02434f7640 1 -- 172.21.15.106:0/3456372209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0228005180 msgr2=0x7f022800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.216+0000 7f02434f7640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0228005180 0x7f022800b980 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0234001e50 tx=0x7f02280057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.216+0000 7f02434f7640 1 -- 172.21.15.106:0/3456372209 shutdown_connections 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.216+0000 7f02434f7640 1 --2- 172.21.15.106:0/3456372209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0228005180 0x7f022800b980 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.216+0000 7f02434f7640 1 -- 172.21.15.106:0/3456372209 >> 172.21.15.106:0/3456372209 conn(0x7f023c0c5360 msgr2=0x7f023c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.216+0000 7f02434f7640 1 -- 172.21.15.106:0/3456372209 shutdown_connections 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.216+0000 7f02434f7640 1 -- 172.21.15.106:0/3456372209 wait complete. 2023-12-22T09:17:22.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.217+0000 7f02434f7640 1 Processor -- start 2023-12-22T09:17:22.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.218+0000 7f02434f7640 1 -- start start 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.218+0000 7f02434f7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0228005180 0x7f023c150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.218+0000 7f02434f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f023c147e90 0x7f023c147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.218+0000 7f02434f7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f023c147950 0x7f023c1ece90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.218+0000 7f02434f7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c0c4f60 con 0x7f023c147950 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.218+0000 7f02434f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c15ab00 con 0x7f023c147e90 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.218+0000 7f02434f7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1eaab0 con 0x7f0228005180 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241a94640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f023c147950 0x7f023c1ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241a94640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f023c147950 0x7f023c1ece90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40462/0 (socket says 172.21.15.106:40462) 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241a94640 1 -- 172.21.15.106:0/1111792163 learned_addr learned my addr 172.21.15.106:0/1111792163 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241293640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0228005180 0x7f023c150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241a94640 1 -- 172.21.15.106:0/1111792163 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0228005180 msgr2=0x7f023c150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241a94640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0228005180 0x7f023c150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241a94640 1 -- 172.21.15.106:0/1111792163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f023c147e90 msgr2=0x7f023c147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241a94640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f023c147e90 0x7f023c147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241a94640 1 -- 172.21.15.106:0/1111792163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c0c4c80 con 0x7f023c147950 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.219+0000 7f0241a94640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f023c147950 0x7f023c1ece90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0234001f70 tx=0x7f02340014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.220+0000 7f0231ffb640 1 -- 172.21.15.106:0/1111792163 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234006d50 con 0x7f023c147950 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.220+0000 7f0231ffb640 1 -- 172.21.15.106:0/1111792163 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234007030 con 0x7f023c147950 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.220+0000 7f0231ffb640 1 -- 172.21.15.106:0/1111792163 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234007420 con 0x7f023c147950 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.220+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c15ad10 con 0x7f023c147950 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.220+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c15b2d0 con 0x7f023c147950 2023-12-22T09:17:22.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.221+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023c073f10 con 0x7f023c147950 2023-12-22T09:17:22.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.222+0000 7f0231ffb640 1 -- 172.21.15.106:0/1111792163 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0234007580 con 0x7f023c147950 2023-12-22T09:17:22.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.223+0000 7f0231ffb640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f022006a430 0x7f022006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.223+0000 7f0231ffb640 1 -- 172.21.15.106:0/1111792163 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f02340aa8d0 con 0x7f023c147950 2023-12-22T09:17:22.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.223+0000 7f0241293640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f022006a430 0x7f022006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.224+0000 7f0241293640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f022006a430 0x7f022006c8f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f02380098c0 tx=0x7f0238008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:22.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.228+0000 7f0231ffb640 1 -- 172.21.15.106:0/1111792163 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02340759a0 con 0x7f023c147950 2023-12-22T09:17:22.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.415+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 --> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f023c0c1720 con 0x7f022006a430 2023-12-22T09:17:22.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.433+0000 7f0231ffb640 1 -- 172.21.15.106:0/1111792163 <== mgr.4101 v2:172.21.15.106:6832/88400 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525516 (secure 0 0 0) 0x7f0238009e40 con 0x7f022006a430 2023-12-22T09:17:22.441 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:22.445 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-12-22T09:17:22.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f022006a430 msgr2=0x7f022006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f022006a430 0x7f022006c8f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f02380098c0 tx=0x7f0238008040 comp rx=0 tx=0).stop 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f023c147950 msgr2=0x7f023c1ece90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f023c147950 0x7f023c1ece90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0234001f70 tx=0x7f02340014a0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 shutdown_connections 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f022006a430 0x7f022006c8f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f023c147950 0x7f023c1ece90 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f023c147e90 0x7f023c147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 --2- 172.21.15.106:0/1111792163 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0228005180 0x7f023c150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 >> 172.21.15.106:0/1111792163 conn(0x7f023c0c5360 msgr2=0x7f023c14ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 shutdown_connections 2023-12-22T09:17:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.440+0000 7f02434f7640 1 -- 172.21.15.106:0/1111792163 wait complete. 2023-12-22T09:17:22.461 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-12-22T09:17:20.753266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596587,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235208,"kb_used_data":7304,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754739512,"statfs":{"total":773094113280,"available":772853260288,"internally_reserved":0,"allocated":7479296,"data_stored":4059502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.255992"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516357+0000","last_change":"2023-12-22T09:17:12.540063+0000","last_active":"2023-12-22T09:17:13.516357+0000","last_peered":"2023-12-22T09:17:13.516357+0000","last_clean":"2023-12-22T09:17:13.516357+0000","last_became_active":"2023-12-22T09:17:12.538574+0000","last_became_peered":"2023-12-22T09:17:12.538574+0000","last_unstale":"2023-12-22T09:17:13.516357+0000","last_undegraded":"2023-12-22T09:17:13.516357+0000","last_fullsized":"2023-12-22T09:17:13.516357+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:47.737577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501134+0000","last_change":"2023-12-22T09:16:58.138391+0000","last_active":"2023-12-22T09:17:12.501134+0000","last_peered":"2023-12-22T09:17:12.501134+0000","last_clean":"2023-12-22T09:17:12.501134+0000","last_became_active":"2023-12-22T09:16:58.138138+0000","last_became_peered":"2023-12-22T09:16:58.138138+0000","last_unstale":"2023-12-22T09:17:12.501134+0000","last_undegraded":"2023-12-22T09:17:12.501134+0000","last_fullsized":"2023-12-22T09:17:12.501134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.671885+0000","last_change":"2023-12-22T09:17:12.531701+0000","last_active":"2023-12-22T09:17:13.671885+0000","last_peered":"2023-12-22T09:17:13.671885+0000","last_clean":"2023-12-22T09:17:13.671885+0000","last_became_active":"2023-12-22T09:17:12.531394+0000","last_became_peered":"2023-12-22T09:17:12.531394+0000","last_unstale":"2023-12-22T09:17:13.671885+0000","last_undegraded":"2023-12-22T09:17:13.671885+0000","last_fullsized":"2023-12-22T09:17:13.671885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:40.824932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.504206+0000","last_change":"2023-12-22T09:16:58.122537+0000","last_active":"2023-12-22T09:17:12.504206+0000","last_peered":"2023-12-22T09:17:12.504206+0000","last_clean":"2023-12-22T09:17:12.504206+0000","last_became_active":"2023-12-22T09:16:58.122285+0000","last_became_peered":"2023-12-22T09:16:58.122285+0000","last_unstale":"2023-12-22T09:17:12.504206+0000","last_undegraded":"2023-12-22T09:17:12.504206+0000","last_fullsized":"2023-12-22T09:17:12.504206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672554+0000","last_change":"2023-12-22T09:17:12.540485+0000","last_active":"2023-12-22T09:17:13.672554+0000","last_peered":"2023-12-22T09:17:13.672554+0000","last_clean":"2023-12-22T09:17:13.672554+0000","last_became_active":"2023-12-22T09:17:12.539787+0000","last_became_peered":"2023-12-22T09:17:12.539787+0000","last_unstale":"2023-12-22T09:17:13.672554+0000","last_undegraded":"2023-12-22T09:17:13.672554+0000","last_fullsized":"2023-12-22T09:17:13.672554+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:57:30.900658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.524314+0000","last_change":"2023-12-22T09:16:58.155070+0000","last_active":"2023-12-22T09:17:12.524314+0000","last_peered":"2023-12-22T09:17:12.524314+0000","last_clean":"2023-12-22T09:17:12.524314+0000","last_became_active":"2023-12-22T09:16:58.154786+0000","last_became_peered":"2023-12-22T09:16:58.154786+0000","last_unstale":"2023-12-22T09:17:12.524314+0000","last_undegraded":"2023-12-22T09:17:12.524314+0000","last_fullsized":"2023-12-22T09:17:12.524314+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512658+0000","last_change":"2023-12-22T09:17:12.541546+0000","last_active":"2023-12-22T09:17:13.512658+0000","last_peered":"2023-12-22T09:17:13.512658+0000","last_clean":"2023-12-22T09:17:13.512658+0000","last_became_active":"2023-12-22T09:17:12.541240+0000","last_became_peered":"2023-12-22T09:17:12.541240+0000","last_unstale":"2023-12-22T09:17:13.512658+0000","last_undegraded":"2023-12-22T09:17:13.512658+0000","last_fullsized":"2023-12-22T09:17:13.512658+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:11:26.005625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509433+0000","last_change":"2023-12-22T09:17:11.034865+0000","last_active":"2023-12-22T09:17:12.509433+0000","last_peered":"2023-12-22T09:17:12.509433+0000","last_clean":"2023-12-22T09:17:12.509433+0000","last_became_active":"2023-12-22T09:17:11.034194+0000","last_became_peered":"2023-12-22T09:17:11.034194+0000","last_unstale":"2023-12-22T09:17:12.509433+0000","last_undegraded":"2023-12-22T09:17:12.509433+0000","last_fullsized":"2023-12-22T09:17:12.509433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:09:17.505510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.785711+0000","last_change":"2023-12-22T09:17:12.534295+0000","last_active":"2023-12-22T09:17:13.785711+0000","last_peered":"2023-12-22T09:17:13.785711+0000","last_clean":"2023-12-22T09:17:13.785711+0000","last_became_active":"2023-12-22T09:17:12.534061+0000","last_became_peered":"2023-12-22T09:17:12.534061+0000","last_unstale":"2023-12-22T09:17:13.785711+0000","last_undegraded":"2023-12-22T09:17:13.785711+0000","last_fullsized":"2023-12-22T09:17:13.785711+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:45.275761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507609+0000","last_change":"2023-12-22T09:16:58.143885+0000","last_active":"2023-12-22T09:17:12.507609+0000","last_peered":"2023-12-22T09:17:12.507609+0000","last_clean":"2023-12-22T09:17:12.507609+0000","last_became_active":"2023-12-22T09:16:58.143627+0000","last_became_peered":"2023-12-22T09:16:58.143627+0000","last_unstale":"2023-12-22T09:17:12.507609+0000","last_undegraded":"2023-12-22T09:17:12.507609+0000","last_fullsized":"2023-12-22T09:17:12.507609+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:50:47.328724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787613+0000","last_change":"2023-12-22T09:17:12.542357+0000","last_active":"2023-12-22T09:17:13.787613+0000","last_peered":"2023-12-22T09:17:13.787613+0000","last_clean":"2023-12-22T09:17:13.787613+0000","last_became_active":"2023-12-22T09:17:12.540751+0000","last_became_peered":"2023-12-22T09:17:12.540751+0000","last_unstale":"2023-12-22T09:17:13.787613+0000","last_undegraded":"2023-12-22T09:17:13.787613+0000","last_fullsized":"2023-12-22T09:17:13.787613+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:56.342160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511426+0000","last_change":"2023-12-22T09:16:58.140402+0000","last_active":"2023-12-22T09:17:12.511426+0000","last_peered":"2023-12-22T09:17:12.511426+0000","last_clean":"2023-12-22T09:17:12.511426+0000","last_became_active":"2023-12-22T09:16:58.140117+0000","last_became_peered":"2023-12-22T09:16:58.140117+0000","last_unstale":"2023-12-22T09:17:12.511426+0000","last_undegraded":"2023-12-22T09:17:12.511426+0000","last_fullsized":"2023-12-22T09:17:12.511426+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:25:20.515272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.518207+0000","last_change":"2023-12-22T09:17:12.544744+0000","last_active":"2023-12-22T09:17:13.518207+0000","last_peered":"2023-12-22T09:17:13.518207+0000","last_clean":"2023-12-22T09:17:13.518207+0000","last_became_active":"2023-12-22T09:17:12.544447+0000","last_became_peered":"2023-12-22T09:17:12.544447+0000","last_unstale":"2023-12-22T09:17:13.518207+0000","last_undegraded":"2023-12-22T09:17:13.518207+0000","last_fullsized":"2023-12-22T09:17:13.518207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:47.584016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.517459+0000","last_change":"2023-12-22T09:16:58.138038+0000","last_active":"2023-12-22T09:17:12.517459+0000","last_peered":"2023-12-22T09:17:12.517459+0000","last_clean":"2023-12-22T09:17:12.517459+0000","last_became_active":"2023-12-22T09:16:58.137394+0000","last_became_peered":"2023-12-22T09:16:58.137394+0000","last_unstale":"2023-12-22T09:17:12.517459+0000","last_undegraded":"2023-12-22T09:17:12.517459+0000","last_fullsized":"2023-12-22T09:17:12.517459+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:53.435793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.655888+0000","last_change":"2023-12-22T09:17:12.547616+0000","last_active":"2023-12-22T09:17:13.655888+0000","last_peered":"2023-12-22T09:17:13.655888+0000","last_clean":"2023-12-22T09:17:13.655888+0000","last_became_active":"2023-12-22T09:17:12.547326+0000","last_became_peered":"2023-12-22T09:17:12.547326+0000","last_unstale":"2023-12-22T09:17:13.655888+0000","last_undegraded":"2023-12-22T09:17:13.655888+0000","last_fullsized":"2023-12-22T09:17:13.655888+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:22:19.501977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514434+0000","last_change":"2023-12-22T09:16:58.139475+0000","last_active":"2023-12-22T09:17:12.514434+0000","last_peered":"2023-12-22T09:17:12.514434+0000","last_clean":"2023-12-22T09:17:12.514434+0000","last_became_active":"2023-12-22T09:16:58.139166+0000","last_became_peered":"2023-12-22T09:16:58.139166+0000","last_unstale":"2023-12-22T09:17:12.514434+0000","last_undegraded":"2023-12-22T09:17:12.514434+0000","last_fullsized":"2023-12-22T09:17:12.514434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.655150+0000","last_change":"2023-12-22T09:17:12.528519+0000","last_active":"2023-12-22T09:17:13.655150+0000","last_peered":"2023-12-22T09:17:13.655150+0000","last_clean":"2023-12-22T09:17:13.655150+0000","last_became_active":"2023-12-22T09:17:12.528254+0000","last_became_peered":"2023-12-22T09:17:12.528254+0000","last_unstale":"2023-12-22T09:17:13.655150+0000","last_undegraded":"2023-12-22T09:17:13.655150+0000","last_fullsized":"2023-12-22T09:17:13.655150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:33:48.010688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530753+0000","last_change":"2023-12-22T09:16:58.153587+0000","last_active":"2023-12-22T09:17:12.530753+0000","last_peered":"2023-12-22T09:17:12.530753+0000","last_clean":"2023-12-22T09:17:12.530753+0000","last_became_active":"2023-12-22T09:16:58.153215+0000","last_became_peered":"2023-12-22T09:16:58.153215+0000","last_unstale":"2023-12-22T09:17:12.530753+0000","last_undegraded":"2023-12-22T09:17:12.530753+0000","last_fullsized":"2023-12-22T09:17:12.530753+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516686+0000","last_change":"2023-12-22T09:17:12.536828+0000","last_active":"2023-12-22T09:17:13.516686+0000","last_peered":"2023-12-22T09:17:13.516686+0000","last_clean":"2023-12-22T09:17:13.516686+0000","last_became_active":"2023-12-22T09:17:12.536521+0000","last_became_peered":"2023-12-22T09:17:12.536521+0000","last_unstale":"2023-12-22T09:17:13.516686+0000","last_undegraded":"2023-12-22T09:17:13.516686+0000","last_fullsized":"2023-12-22T09:17:13.516686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:11.064289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523519+0000","last_change":"2023-12-22T09:16:58.146315+0000","last_active":"2023-12-22T09:17:12.523519+0000","last_peered":"2023-12-22T09:17:12.523519+0000","last_clean":"2023-12-22T09:17:12.523519+0000","last_became_active":"2023-12-22T09:16:58.143702+0000","last_became_peered":"2023-12-22T09:16:58.143702+0000","last_unstale":"2023-12-22T09:17:12.523519+0000","last_undegraded":"2023-12-22T09:17:12.523519+0000","last_fullsized":"2023-12-22T09:17:12.523519+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672852+0000","last_change":"2023-12-22T09:17:12.531254+0000","last_active":"2023-12-22T09:17:13.672852+0000","last_peered":"2023-12-22T09:17:13.672852+0000","last_clean":"2023-12-22T09:17:13.672852+0000","last_became_active":"2023-12-22T09:17:12.530971+0000","last_became_peered":"2023-12-22T09:17:12.530971+0000","last_unstale":"2023-12-22T09:17:13.672852+0000","last_undegraded":"2023-12-22T09:17:13.672852+0000","last_fullsized":"2023-12-22T09:17:13.672852+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:33.594438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531400+0000","last_change":"2023-12-22T09:16:58.144346+0000","last_active":"2023-12-22T09:17:12.531400+0000","last_peered":"2023-12-22T09:17:12.531400+0000","last_clean":"2023-12-22T09:17:12.531400+0000","last_became_active":"2023-12-22T09:16:58.144068+0000","last_became_peered":"2023-12-22T09:16:58.144068+0000","last_unstale":"2023-12-22T09:17:12.531400+0000","last_undegraded":"2023-12-22T09:17:12.531400+0000","last_fullsized":"2023-12-22T09:17:12.531400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512910+0000","last_change":"2023-12-22T09:17:12.542888+0000","last_active":"2023-12-22T09:17:13.512910+0000","last_peered":"2023-12-22T09:17:13.512910+0000","last_clean":"2023-12-22T09:17:13.512910+0000","last_became_active":"2023-12-22T09:17:12.541905+0000","last_became_peered":"2023-12-22T09:17:12.541905+0000","last_unstale":"2023-12-22T09:17:13.512910+0000","last_undegraded":"2023-12-22T09:17:13.512910+0000","last_fullsized":"2023-12-22T09:17:13.512910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:29.511755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.515028+0000","last_change":"2023-12-22T09:17:11.035380+0000","last_active":"2023-12-22T09:17:12.515028+0000","last_peered":"2023-12-22T09:17:12.515028+0000","last_clean":"2023-12-22T09:17:12.515028+0000","last_became_active":"2023-12-22T09:17:11.035022+0000","last_became_peered":"2023-12-22T09:17:11.035022+0000","last_unstale":"2023-12-22T09:17:12.515028+0000","last_undegraded":"2023-12-22T09:17:12.515028+0000","last_fullsized":"2023-12-22T09:17:12.515028+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:30.877521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654996+0000","last_change":"2023-12-22T09:17:12.539217+0000","last_active":"2023-12-22T09:17:13.654996+0000","last_peered":"2023-12-22T09:17:13.654996+0000","last_clean":"2023-12-22T09:17:13.654996+0000","last_became_active":"2023-12-22T09:17:12.538987+0000","last_became_peered":"2023-12-22T09:17:12.538987+0000","last_unstale":"2023-12-22T09:17:13.654996+0000","last_undegraded":"2023-12-22T09:17:13.654996+0000","last_fullsized":"2023-12-22T09:17:13.654996+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:25.294308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514265+0000","last_change":"2023-12-22T09:16:58.149202+0000","last_active":"2023-12-22T09:17:12.514265+0000","last_peered":"2023-12-22T09:17:12.514265+0000","last_clean":"2023-12-22T09:17:12.514265+0000","last_became_active":"2023-12-22T09:16:58.148243+0000","last_became_peered":"2023-12-22T09:16:58.148243+0000","last_unstale":"2023-12-22T09:17:12.514265+0000","last_undegraded":"2023-12-22T09:17:12.514265+0000","last_fullsized":"2023-12-22T09:17:12.514265+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787769+0000","last_change":"2023-12-22T09:17:12.536059+0000","last_active":"2023-12-22T09:17:13.787769+0000","last_peered":"2023-12-22T09:17:13.787769+0000","last_clean":"2023-12-22T09:17:13.787769+0000","last_became_active":"2023-12-22T09:17:12.534896+0000","last_became_peered":"2023-12-22T09:17:12.534896+0000","last_unstale":"2023-12-22T09:17:13.787769+0000","last_undegraded":"2023-12-22T09:17:13.787769+0000","last_fullsized":"2023-12-22T09:17:13.787769+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:09:31.903749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.525431+0000","last_change":"2023-12-22T09:16:58.156229+0000","last_active":"2023-12-22T09:17:12.525431+0000","last_peered":"2023-12-22T09:17:12.525431+0000","last_clean":"2023-12-22T09:17:12.525431+0000","last_became_active":"2023-12-22T09:16:58.154667+0000","last_became_peered":"2023-12-22T09:16:58.154667+0000","last_unstale":"2023-12-22T09:17:12.525431+0000","last_undegraded":"2023-12-22T09:17:12.525431+0000","last_fullsized":"2023-12-22T09:17:12.525431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.789247+0000","last_change":"2023-12-22T09:17:12.539349+0000","last_active":"2023-12-22T09:17:13.789247+0000","last_peered":"2023-12-22T09:17:13.789247+0000","last_clean":"2023-12-22T09:17:13.789247+0000","last_became_active":"2023-12-22T09:17:12.539000+0000","last_became_peered":"2023-12-22T09:17:12.539000+0000","last_unstale":"2023-12-22T09:17:13.789247+0000","last_undegraded":"2023-12-22T09:17:13.789247+0000","last_fullsized":"2023-12-22T09:17:13.789247+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:28.534245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523414+0000","last_change":"2023-12-22T09:16:58.144597+0000","last_active":"2023-12-22T09:17:12.523414+0000","last_peered":"2023-12-22T09:17:12.523414+0000","last_clean":"2023-12-22T09:17:12.523414+0000","last_became_active":"2023-12-22T09:16:58.144358+0000","last_became_peered":"2023-12-22T09:16:58.144358+0000","last_unstale":"2023-12-22T09:17:12.523414+0000","last_undegraded":"2023-12-22T09:17:12.523414+0000","last_fullsized":"2023-12-22T09:17:12.523414+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.788742+0000","last_change":"2023-12-22T09:17:12.530514+0000","last_active":"2023-12-22T09:17:13.788742+0000","last_peered":"2023-12-22T09:17:13.788742+0000","last_clean":"2023-12-22T09:17:13.788742+0000","last_became_active":"2023-12-22T09:17:12.529088+0000","last_became_peered":"2023-12-22T09:17:12.529088+0000","last_unstale":"2023-12-22T09:17:13.788742+0000","last_undegraded":"2023-12-22T09:17:13.788742+0000","last_fullsized":"2023-12-22T09:17:13.788742+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:35.459971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511233+0000","last_change":"2023-12-22T09:16:58.139134+0000","last_active":"2023-12-22T09:17:12.511233+0000","last_peered":"2023-12-22T09:17:12.511233+0000","last_clean":"2023-12-22T09:17:12.511233+0000","last_became_active":"2023-12-22T09:16:58.138883+0000","last_became_peered":"2023-12-22T09:16:58.138883+0000","last_unstale":"2023-12-22T09:17:12.511233+0000","last_undegraded":"2023-12-22T09:17:12.511233+0000","last_fullsized":"2023-12-22T09:17:12.511233+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.662952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787744+0000","last_change":"2023-12-22T09:17:12.540039+0000","last_active":"2023-12-22T09:17:13.787744+0000","last_peered":"2023-12-22T09:17:13.787744+0000","last_clean":"2023-12-22T09:17:13.787744+0000","last_became_active":"2023-12-22T09:17:12.539700+0000","last_became_peered":"2023-12-22T09:17:12.539700+0000","last_unstale":"2023-12-22T09:17:13.787744+0000","last_undegraded":"2023-12-22T09:17:13.787744+0000","last_fullsized":"2023-12-22T09:17:13.787744+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:45.275761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501356+0000","last_change":"2023-12-22T09:16:58.139935+0000","last_active":"2023-12-22T09:17:12.501356+0000","last_peered":"2023-12-22T09:17:12.501356+0000","last_clean":"2023-12-22T09:17:12.501356+0000","last_became_active":"2023-12-22T09:16:58.139665+0000","last_became_peered":"2023-12-22T09:16:58.139665+0000","last_unstale":"2023-12-22T09:17:12.501356+0000","last_undegraded":"2023-12-22T09:17:12.501356+0000","last_fullsized":"2023-12-22T09:17:12.501356+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:33.407872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654068+0000","last_change":"2023-12-22T09:17:12.519604+0000","last_active":"2023-12-22T09:17:13.654068+0000","last_peered":"2023-12-22T09:17:13.654068+0000","last_clean":"2023-12-22T09:17:13.654068+0000","last_became_active":"2023-12-22T09:17:12.519364+0000","last_became_peered":"2023-12-22T09:17:12.519364+0000","last_unstale":"2023-12-22T09:17:13.654068+0000","last_undegraded":"2023-12-22T09:17:13.654068+0000","last_fullsized":"2023-12-22T09:17:13.654068+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:49:31.174241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531846+0000","last_change":"2023-12-22T09:16:58.135060+0000","last_active":"2023-12-22T09:17:12.531846+0000","last_peered":"2023-12-22T09:17:12.531846+0000","last_clean":"2023-12-22T09:17:12.531846+0000","last_became_active":"2023-12-22T09:16:58.134796+0000","last_became_peered":"2023-12-22T09:16:58.134796+0000","last_unstale":"2023-12-22T09:17:12.531846+0000","last_undegraded":"2023-12-22T09:17:12.531846+0000","last_fullsized":"2023-12-22T09:17:12.531846+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:56:40.950128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787442+0000","last_change":"2023-12-22T09:17:12.534608+0000","last_active":"2023-12-22T09:17:13.787442+0000","last_peered":"2023-12-22T09:17:13.787442+0000","last_clean":"2023-12-22T09:17:13.787442+0000","last_became_active":"2023-12-22T09:17:12.534118+0000","last_became_peered":"2023-12-22T09:17:12.534118+0000","last_unstale":"2023-12-22T09:17:13.787442+0000","last_undegraded":"2023-12-22T09:17:13.787442+0000","last_fullsized":"2023-12-22T09:17:13.787442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:04.343307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514119+0000","last_change":"2023-12-22T09:16:58.133014+0000","last_active":"2023-12-22T09:17:12.514119+0000","last_peered":"2023-12-22T09:17:12.514119+0000","last_clean":"2023-12-22T09:17:12.514119+0000","last_became_active":"2023-12-22T09:16:58.132669+0000","last_became_peered":"2023-12-22T09:16:58.132669+0000","last_unstale":"2023-12-22T09:17:12.514119+0000","last_undegraded":"2023-12-22T09:17:12.514119+0000","last_fullsized":"2023-12-22T09:17:12.514119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:59:55.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672535+0000","last_change":"2023-12-22T09:17:12.528718+0000","last_active":"2023-12-22T09:17:13.672535+0000","last_peered":"2023-12-22T09:17:13.672535+0000","last_clean":"2023-12-22T09:17:13.672535+0000","last_became_active":"2023-12-22T09:17:12.528287+0000","last_became_peered":"2023-12-22T09:17:12.528287+0000","last_unstale":"2023-12-22T09:17:13.672535+0000","last_undegraded":"2023-12-22T09:17:13.672535+0000","last_fullsized":"2023-12-22T09:17:13.672535+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:54.221987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511580+0000","last_change":"2023-12-22T09:16:58.139698+0000","last_active":"2023-12-22T09:17:12.511580+0000","last_peered":"2023-12-22T09:17:12.511580+0000","last_clean":"2023-12-22T09:17:12.511580+0000","last_became_active":"2023-12-22T09:16:58.139450+0000","last_became_peered":"2023-12-22T09:16:58.139450+0000","last_unstale":"2023-12-22T09:17:12.511580+0000","last_undegraded":"2023-12-22T09:17:12.511580+0000","last_fullsized":"2023-12-22T09:17:12.511580+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:40.452271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512949+0000","last_change":"2023-12-22T09:17:12.537889+0000","last_active":"2023-12-22T09:17:13.512949+0000","last_peered":"2023-12-22T09:17:13.512949+0000","last_clean":"2023-12-22T09:17:13.512949+0000","last_became_active":"2023-12-22T09:17:12.536919+0000","last_became_peered":"2023-12-22T09:17:12.536919+0000","last_unstale":"2023-12-22T09:17:13.512949+0000","last_undegraded":"2023-12-22T09:17:13.512949+0000","last_fullsized":"2023-12-22T09:17:13.512949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:39.648682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514488+0000","last_change":"2023-12-22T09:16:58.138002+0000","last_active":"2023-12-22T09:17:12.514488+0000","last_peered":"2023-12-22T09:17:12.514488+0000","last_clean":"2023-12-22T09:17:12.514488+0000","last_became_active":"2023-12-22T09:16:58.137587+0000","last_became_peered":"2023-12-22T09:16:58.137587+0000","last_unstale":"2023-12-22T09:17:12.514488+0000","last_undegraded":"2023-12-22T09:17:12.514488+0000","last_fullsized":"2023-12-22T09:17:12.514488+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:26.426693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672918+0000","last_change":"2023-12-22T09:17:12.527963+0000","last_active":"2023-12-22T09:17:13.672918+0000","last_peered":"2023-12-22T09:17:13.672918+0000","last_clean":"2023-12-22T09:17:13.672918+0000","last_became_active":"2023-12-22T09:17:12.527349+0000","last_became_peered":"2023-12-22T09:17:12.527349+0000","last_unstale":"2023-12-22T09:17:13.672918+0000","last_undegraded":"2023-12-22T09:17:13.672918+0000","last_fullsized":"2023-12-22T09:17:13.672918+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:59:45.657065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510905+0000","last_change":"2023-12-22T09:16:58.143017+0000","last_active":"2023-12-22T09:17:12.510905+0000","last_peered":"2023-12-22T09:17:12.510905+0000","last_clean":"2023-12-22T09:17:12.510905+0000","last_became_active":"2023-12-22T09:16:58.142609+0000","last_became_peered":"2023-12-22T09:16:58.142609+0000","last_unstale":"2023-12-22T09:17:12.510905+0000","last_undegraded":"2023-12-22T09:17:12.510905+0000","last_fullsized":"2023-12-22T09:17:12.510905+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:04:22.037240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.673422+0000","last_change":"2023-12-22T09:17:12.537661+0000","last_active":"2023-12-22T09:17:13.673422+0000","last_peered":"2023-12-22T09:17:13.673422+0000","last_clean":"2023-12-22T09:17:13.673422+0000","last_became_active":"2023-12-22T09:17:12.537388+0000","last_became_peered":"2023-12-22T09:17:12.537388+0000","last_unstale":"2023-12-22T09:17:13.673422+0000","last_undegraded":"2023-12-22T09:17:13.673422+0000","last_fullsized":"2023-12-22T09:17:13.673422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:48:47.806111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508783+0000","last_change":"2023-12-22T09:16:58.137672+0000","last_active":"2023-12-22T09:17:12.508783+0000","last_peered":"2023-12-22T09:17:12.508783+0000","last_clean":"2023-12-22T09:17:12.508783+0000","last_became_active":"2023-12-22T09:16:58.137418+0000","last_became_peered":"2023-12-22T09:16:58.137418+0000","last_unstale":"2023-12-22T09:17:12.508783+0000","last_undegraded":"2023-12-22T09:17:12.508783+0000","last_fullsized":"2023-12-22T09:17:12.508783+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:11.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.785991+0000","last_change":"2023-12-22T09:17:12.540349+0000","last_active":"2023-12-22T09:17:13.785991+0000","last_peered":"2023-12-22T09:17:13.785991+0000","last_clean":"2023-12-22T09:17:13.785991+0000","last_became_active":"2023-12-22T09:17:12.540027+0000","last_became_peered":"2023-12-22T09:17:12.540027+0000","last_unstale":"2023-12-22T09:17:13.785991+0000","last_undegraded":"2023-12-22T09:17:13.785991+0000","last_fullsized":"2023-12-22T09:17:13.785991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:28:18.935797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.527324+0000","last_change":"2023-12-22T09:16:58.151378+0000","last_active":"2023-12-22T09:17:12.527324+0000","last_peered":"2023-12-22T09:17:12.527324+0000","last_clean":"2023-12-22T09:17:12.527324+0000","last_became_active":"2023-12-22T09:16:58.148696+0000","last_became_peered":"2023-12-22T09:16:58.148696+0000","last_unstale":"2023-12-22T09:17:12.527324+0000","last_undegraded":"2023-12-22T09:17:12.527324+0000","last_fullsized":"2023-12-22T09:17:12.527324+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:19.196198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.784981+0000","last_change":"2023-12-22T09:17:12.531462+0000","last_active":"2023-12-22T09:17:13.784981+0000","last_peered":"2023-12-22T09:17:13.784981+0000","last_clean":"2023-12-22T09:17:13.784981+0000","last_became_active":"2023-12-22T09:17:12.531226+0000","last_became_peered":"2023-12-22T09:17:12.531226+0000","last_unstale":"2023-12-22T09:17:13.784981+0000","last_undegraded":"2023-12-22T09:17:13.784981+0000","last_fullsized":"2023-12-22T09:17:13.784981+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:10:16.447879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.516335+0000","last_change":"2023-12-22T09:16:58.134012+0000","last_active":"2023-12-22T09:17:12.516335+0000","last_peered":"2023-12-22T09:17:12.516335+0000","last_clean":"2023-12-22T09:17:12.516335+0000","last_became_active":"2023-12-22T09:16:58.133668+0000","last_became_peered":"2023-12-22T09:16:58.133668+0000","last_unstale":"2023-12-22T09:17:12.516335+0000","last_undegraded":"2023-12-22T09:17:12.516335+0000","last_fullsized":"2023-12-22T09:17:12.516335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:57:16.502418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.515813+0000","last_change":"2023-12-22T09:17:12.543029+0000","last_active":"2023-12-22T09:17:13.515813+0000","last_peered":"2023-12-22T09:17:13.515813+0000","last_clean":"2023-12-22T09:17:13.515813+0000","last_became_active":"2023-12-22T09:17:12.542728+0000","last_became_peered":"2023-12-22T09:17:12.542728+0000","last_unstale":"2023-12-22T09:17:13.515813+0000","last_undegraded":"2023-12-22T09:17:13.515813+0000","last_fullsized":"2023-12-22T09:17:13.515813+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:57:48.091679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.518440+0000","last_change":"2023-12-22T09:16:58.138808+0000","last_active":"2023-12-22T09:17:12.518440+0000","last_peered":"2023-12-22T09:17:12.518440+0000","last_clean":"2023-12-22T09:17:12.518440+0000","last_became_active":"2023-12-22T09:16:58.138287+0000","last_became_peered":"2023-12-22T09:16:58.138287+0000","last_unstale":"2023-12-22T09:17:12.518440+0000","last_undegraded":"2023-12-22T09:17:12.518440+0000","last_fullsized":"2023-12-22T09:17:12.518440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:36.638731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654676+0000","last_change":"2023-12-22T09:17:12.534186+0000","last_active":"2023-12-22T09:17:13.654676+0000","last_peered":"2023-12-22T09:17:13.654676+0000","last_clean":"2023-12-22T09:17:13.654676+0000","last_became_active":"2023-12-22T09:17:12.533903+0000","last_became_peered":"2023-12-22T09:17:12.533903+0000","last_unstale":"2023-12-22T09:17:13.654676+0000","last_undegraded":"2023-12-22T09:17:13.654676+0000","last_fullsized":"2023-12-22T09:17:13.654676+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:09:31.903749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531123+0000","last_change":"2023-12-22T09:16:58.148258+0000","last_active":"2023-12-22T09:17:12.531123+0000","last_peered":"2023-12-22T09:17:12.531123+0000","last_clean":"2023-12-22T09:17:12.531123+0000","last_became_active":"2023-12-22T09:16:58.148003+0000","last_became_peered":"2023-12-22T09:16:58.148003+0000","last_unstale":"2023-12-22T09:17:12.531123+0000","last_undegraded":"2023-12-22T09:17:12.531123+0000","last_fullsized":"2023-12-22T09:17:12.531123+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:42.621461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516494+0000","last_change":"2023-12-22T09:17:12.544737+0000","last_active":"2023-12-22T09:17:13.516494+0000","last_peered":"2023-12-22T09:17:13.516494+0000","last_clean":"2023-12-22T09:17:13.516494+0000","last_became_active":"2023-12-22T09:17:12.543923+0000","last_became_peered":"2023-12-22T09:17:12.543923+0000","last_unstale":"2023-12-22T09:17:13.516494+0000","last_undegraded":"2023-12-22T09:17:13.516494+0000","last_fullsized":"2023-12-22T09:17:13.516494+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:32:20.587094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501261+0000","last_change":"2023-12-22T09:16:58.133892+0000","last_active":"2023-12-22T09:17:12.501261+0000","last_peered":"2023-12-22T09:17:12.501261+0000","last_clean":"2023-12-22T09:17:12.501261+0000","last_became_active":"2023-12-22T09:16:58.133436+0000","last_became_peered":"2023-12-22T09:16:58.133436+0000","last_unstale":"2023-12-22T09:17:12.501261+0000","last_undegraded":"2023-12-22T09:17:12.501261+0000","last_fullsized":"2023-12-22T09:17:12.501261+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:43.714515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.517872+0000","last_change":"2023-12-22T09:17:12.539001+0000","last_active":"2023-12-22T09:17:13.517872+0000","last_peered":"2023-12-22T09:17:13.517872+0000","last_clean":"2023-12-22T09:17:13.517872+0000","last_became_active":"2023-12-22T09:17:12.538125+0000","last_became_peered":"2023-12-22T09:17:12.538125+0000","last_unstale":"2023-12-22T09:17:13.517872+0000","last_undegraded":"2023-12-22T09:17:13.517872+0000","last_fullsized":"2023-12-22T09:17:13.517872+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:09:45.808636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530306+0000","last_change":"2023-12-22T09:16:58.149316+0000","last_active":"2023-12-22T09:17:12.530306+0000","last_peered":"2023-12-22T09:17:12.530306+0000","last_clean":"2023-12-22T09:17:12.530306+0000","last_became_active":"2023-12-22T09:16:58.148642+0000","last_became_peered":"2023-12-22T09:16:58.148642+0000","last_unstale":"2023-12-22T09:17:12.530306+0000","last_undegraded":"2023-12-22T09:17:12.530306+0000","last_fullsized":"2023-12-22T09:17:12.530306+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:14.824390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672850+0000","last_change":"2023-12-22T09:17:12.528134+0000","last_active":"2023-12-22T09:17:13.672850+0000","last_peered":"2023-12-22T09:17:13.672850+0000","last_clean":"2023-12-22T09:17:13.672850+0000","last_became_active":"2023-12-22T09:17:12.527708+0000","last_became_peered":"2023-12-22T09:17:12.527708+0000","last_unstale":"2023-12-22T09:17:13.672850+0000","last_undegraded":"2023-12-22T09:17:13.672850+0000","last_fullsized":"2023-12-22T09:17:13.672850+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:46.086605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.513854+0000","last_change":"2023-12-22T09:16:58.155683+0000","last_active":"2023-12-22T09:17:12.513854+0000","last_peered":"2023-12-22T09:17:12.513854+0000","last_clean":"2023-12-22T09:17:12.513854+0000","last_became_active":"2023-12-22T09:16:58.155388+0000","last_became_peered":"2023-12-22T09:16:58.155388+0000","last_unstale":"2023-12-22T09:17:12.513854+0000","last_undegraded":"2023-12-22T09:17:12.513854+0000","last_fullsized":"2023-12-22T09:17:12.513854+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.656677+0000","last_change":"2023-12-22T09:17:12.531084+0000","last_active":"2023-12-22T09:17:13.656677+0000","last_peered":"2023-12-22T09:17:13.656677+0000","last_clean":"2023-12-22T09:17:13.656677+0000","last_became_active":"2023-12-22T09:17:12.530856+0000","last_became_peered":"2023-12-22T09:17:12.530856+0000","last_unstale":"2023-12-22T09:17:13.656677+0000","last_undegraded":"2023-12-22T09:17:13.656677+0000","last_fullsized":"2023-12-22T09:17:13.656677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:11:24.336698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523366+0000","last_change":"2023-12-22T09:16:58.147756+0000","last_active":"2023-12-22T09:17:12.523366+0000","last_peered":"2023-12-22T09:17:12.523366+0000","last_clean":"2023-12-22T09:17:12.523366+0000","last_became_active":"2023-12-22T09:16:58.146595+0000","last_became_peered":"2023-12-22T09:16:58.146595+0000","last_unstale":"2023-12-22T09:17:12.523366+0000","last_undegraded":"2023-12-22T09:17:12.523366+0000","last_fullsized":"2023-12-22T09:17:12.523366+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:20:04.358268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.788831+0000","last_change":"2023-12-22T09:17:12.545644+0000","last_active":"2023-12-22T09:17:13.788831+0000","last_peered":"2023-12-22T09:17:13.788831+0000","last_clean":"2023-12-22T09:17:13.788831+0000","last_became_active":"2023-12-22T09:17:12.544926+0000","last_became_peered":"2023-12-22T09:17:12.544926+0000","last_unstale":"2023-12-22T09:17:13.788831+0000","last_undegraded":"2023-12-22T09:17:13.788831+0000","last_fullsized":"2023-12-22T09:17:13.788831+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:00.648890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.513367+0000","last_change":"2023-12-22T09:16:58.125759+0000","last_active":"2023-12-22T09:17:12.513367+0000","last_peered":"2023-12-22T09:17:12.513367+0000","last_clean":"2023-12-22T09:17:12.513367+0000","last_became_active":"2023-12-22T09:16:58.125192+0000","last_became_peered":"2023-12-22T09:16:58.125192+0000","last_unstale":"2023-12-22T09:17:12.513367+0000","last_undegraded":"2023-12-22T09:17:12.513367+0000","last_fullsized":"2023-12-22T09:17:12.513367+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:11.972408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786294+0000","last_change":"2023-12-22T09:17:12.540519+0000","last_active":"2023-12-22T09:17:13.786294+0000","last_peered":"2023-12-22T09:17:13.786294+0000","last_clean":"2023-12-22T09:17:13.786294+0000","last_became_active":"2023-12-22T09:17:12.540249+0000","last_became_peered":"2023-12-22T09:17:12.540249+0000","last_unstale":"2023-12-22T09:17:13.786294+0000","last_undegraded":"2023-12-22T09:17:13.786294+0000","last_fullsized":"2023-12-22T09:17:13.786294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:35.360655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.544182+0000","last_change":"2023-12-22T09:17:12.051198+0000","last_active":"2023-12-22T09:17:12.544182+0000","last_peered":"2023-12-22T09:17:12.544182+0000","last_clean":"2023-12-22T09:17:12.544182+0000","last_became_active":"2023-12-22T09:17:12.050824+0000","last_became_peered":"2023-12-22T09:17:12.050824+0000","last_unstale":"2023-12-22T09:17:12.544182+0000","last_undegraded":"2023-12-22T09:17:12.544182+0000","last_fullsized":"2023-12-22T09:17:12.544182+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508856+0000","last_change":"2023-12-22T09:16:58.132380+0000","last_active":"2023-12-22T09:17:12.508856+0000","last_peered":"2023-12-22T09:17:12.508856+0000","last_clean":"2023-12-22T09:17:12.508856+0000","last_became_active":"2023-12-22T09:16:58.131960+0000","last_became_peered":"2023-12-22T09:16:58.131960+0000","last_unstale":"2023-12-22T09:17:12.508856+0000","last_undegraded":"2023-12-22T09:17:12.508856+0000","last_fullsized":"2023-12-22T09:17:12.508856+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:39:55.787513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501456+0000","last_change":"2023-12-22T09:16:57.644639+0000","last_active":"2023-12-22T09:17:12.501456+0000","last_peered":"2023-12-22T09:17:12.501456+0000","last_clean":"2023-12-22T09:17:12.501456+0000","last_became_active":"2023-12-22T09:16:57.641016+0000","last_became_peered":"2023-12-22T09:16:57.641016+0000","last_unstale":"2023-12-22T09:17:12.501456+0000","last_undegraded":"2023-12-22T09:17:12.501456+0000","last_fullsized":"2023-12-22T09:17:12.501456+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.788449+0000","last_change":"2023-12-22T09:17:12.534374+0000","last_active":"2023-12-22T09:17:13.788449+0000","last_peered":"2023-12-22T09:17:13.788449+0000","last_clean":"2023-12-22T09:17:13.788449+0000","last_became_active":"2023-12-22T09:17:12.533828+0000","last_became_peered":"2023-12-22T09:17:12.533828+0000","last_unstale":"2023-12-22T09:17:13.788449+0000","last_undegraded":"2023-12-22T09:17:13.788449+0000","last_fullsized":"2023-12-22T09:17:13.788449+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:01:17.585593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.533990+0000","last_change":"2023-12-22T09:17:12.042696+0000","last_active":"2023-12-22T09:17:12.533990+0000","last_peered":"2023-12-22T09:17:12.533990+0000","last_clean":"2023-12-22T09:17:12.533990+0000","last_became_active":"2023-12-22T09:17:12.042328+0000","last_became_peered":"2023-12-22T09:17:12.042328+0000","last_unstale":"2023-12-22T09:17:12.533990+0000","last_undegraded":"2023-12-22T09:17:12.533990+0000","last_fullsized":"2023-12-22T09:17:12.533990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:05:59.153455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511579+0000","last_change":"2023-12-22T09:17:11.012714+0000","last_active":"2023-12-22T09:17:12.511579+0000","last_peered":"2023-12-22T09:17:12.511579+0000","last_clean":"2023-12-22T09:17:12.511579+0000","last_became_active":"2023-12-22T09:17:11.011762+0000","last_became_peered":"2023-12-22T09:17:11.011762+0000","last_unstale":"2023-12-22T09:17:12.511579+0000","last_undegraded":"2023-12-22T09:17:12.511579+0000","last_fullsized":"2023-12-22T09:17:12.511579+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:53:32.651627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.528281+0000","last_change":"2023-12-22T09:16:57.643725+0000","last_active":"2023-12-22T09:17:12.528281+0000","last_peered":"2023-12-22T09:17:12.528281+0000","last_clean":"2023-12-22T09:17:12.528281+0000","last_became_active":"2023-12-22T09:16:57.642742+0000","last_became_peered":"2023-12-22T09:16:57.642742+0000","last_unstale":"2023-12-22T09:17:12.528281+0000","last_undegraded":"2023-12-22T09:17:12.528281+0000","last_fullsized":"2023-12-22T09:17:12.528281+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:42.697488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.784437+0000","last_change":"2023-12-22T09:17:12.535531+0000","last_active":"2023-12-22T09:17:13.784437+0000","last_peered":"2023-12-22T09:17:13.784437+0000","last_clean":"2023-12-22T09:17:13.784437+0000","last_became_active":"2023-12-22T09:17:12.535243+0000","last_became_peered":"2023-12-22T09:17:12.535243+0000","last_unstale":"2023-12-22T09:17:13.784437+0000","last_undegraded":"2023-12-22T09:17:13.784437+0000","last_fullsized":"2023-12-22T09:17:13.784437+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:04.343307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"63'4","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.546908+0000","last_change":"2023-12-22T09:17:12.029107+0000","last_active":"2023-12-22T09:17:12.546908+0000","last_peered":"2023-12-22T09:17:12.546908+0000","last_clean":"2023-12-22T09:17:12.546908+0000","last_became_active":"2023-12-22T09:17:12.028772+0000","last_became_peered":"2023-12-22T09:17:12.028772+0000","last_unstale":"2023-12-22T09:17:12.546908+0000","last_undegraded":"2023-12-22T09:17:12.546908+0000","last_fullsized":"2023-12-22T09:17:12.546908+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:27.752298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.528127+0000","last_change":"2023-12-22T09:16:58.124625+0000","last_active":"2023-12-22T09:17:12.528127+0000","last_peered":"2023-12-22T09:17:12.528127+0000","last_clean":"2023-12-22T09:17:12.528127+0000","last_became_active":"2023-12-22T09:16:58.124353+0000","last_became_peered":"2023-12-22T09:16:58.124353+0000","last_unstale":"2023-12-22T09:17:12.528127+0000","last_undegraded":"2023-12-22T09:17:12.528127+0000","last_fullsized":"2023-12-22T09:17:12.528127+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:30:35.111753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.525401+0000","last_change":"2023-12-22T09:16:57.655128+0000","last_active":"2023-12-22T09:17:12.525401+0000","last_peered":"2023-12-22T09:17:12.525401+0000","last_clean":"2023-12-22T09:17:12.525401+0000","last_became_active":"2023-12-22T09:16:57.654793+0000","last_became_peered":"2023-12-22T09:16:57.654793+0000","last_unstale":"2023-12-22T09:17:12.525401+0000","last_undegraded":"2023-12-22T09:17:12.525401+0000","last_fullsized":"2023-12-22T09:17:12.525401+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:38.806721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.655210+0000","last_change":"2023-12-22T09:17:12.524624+0000","last_active":"2023-12-22T09:17:13.655210+0000","last_peered":"2023-12-22T09:17:13.655210+0000","last_clean":"2023-12-22T09:17:13.655210+0000","last_became_active":"2023-12-22T09:17:12.524258+0000","last_became_peered":"2023-12-22T09:17:12.524258+0000","last_unstale":"2023-12-22T09:17:13.655210+0000","last_undegraded":"2023-12-22T09:17:13.655210+0000","last_fullsized":"2023-12-22T09:17:13.655210+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:15.051168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.541013+0000","last_change":"2023-12-22T09:17:12.049173+0000","last_active":"2023-12-22T09:17:12.541013+0000","last_peered":"2023-12-22T09:17:12.541013+0000","last_clean":"2023-12-22T09:17:12.541013+0000","last_became_active":"2023-12-22T09:17:12.048864+0000","last_became_peered":"2023-12-22T09:17:12.048864+0000","last_unstale":"2023-12-22T09:17:12.541013+0000","last_undegraded":"2023-12-22T09:17:12.541013+0000","last_fullsized":"2023-12-22T09:17:12.541013+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:03.329046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530735+0000","last_change":"2023-12-22T09:16:58.153226+0000","last_active":"2023-12-22T09:17:12.530735+0000","last_peered":"2023-12-22T09:17:12.530735+0000","last_clean":"2023-12-22T09:17:12.530735+0000","last_became_active":"2023-12-22T09:16:58.151970+0000","last_became_peered":"2023-12-22T09:16:58.151970+0000","last_unstale":"2023-12-22T09:17:12.530735+0000","last_undegraded":"2023-12-22T09:17:12.530735+0000","last_fullsized":"2023-12-22T09:17:12.530735+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.522035+0000","last_change":"2023-12-22T09:16:57.635854+0000","last_active":"2023-12-22T09:17:12.522035+0000","last_peered":"2023-12-22T09:17:12.522035+0000","last_clean":"2023-12-22T09:17:12.522035+0000","last_became_active":"2023-12-22T09:16:57.635365+0000","last_became_peered":"2023-12-22T09:16:57.635365+0000","last_unstale":"2023-12-22T09:17:12.522035+0000","last_undegraded":"2023-12-22T09:17:12.522035+0000","last_fullsized":"2023-12-22T09:17:12.522035+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:55.506978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.789409+0000","last_change":"2023-12-22T09:17:12.541470+0000","last_active":"2023-12-22T09:17:13.789409+0000","last_peered":"2023-12-22T09:17:13.789409+0000","last_clean":"2023-12-22T09:17:13.789409+0000","last_became_active":"2023-12-22T09:17:12.539038+0000","last_became_peered":"2023-12-22T09:17:12.539038+0000","last_unstale":"2023-12-22T09:17:13.789409+0000","last_undegraded":"2023-12-22T09:17:13.789409+0000","last_fullsized":"2023-12-22T09:17:13.789409+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:10:16.447879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514793+0000","last_change":"2023-12-22T09:17:12.041343+0000","last_active":"2023-12-22T09:17:12.514793+0000","last_peered":"2023-12-22T09:17:12.514793+0000","last_clean":"2023-12-22T09:17:12.514793+0000","last_became_active":"2023-12-22T09:17:12.040893+0000","last_became_peered":"2023-12-22T09:17:12.040893+0000","last_unstale":"2023-12-22T09:17:12.514793+0000","last_undegraded":"2023-12-22T09:17:12.514793+0000","last_fullsized":"2023-12-22T09:17:12.514793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:42.368968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511317+0000","last_change":"2023-12-22T09:16:58.111968+0000","last_active":"2023-12-22T09:17:12.511317+0000","last_peered":"2023-12-22T09:17:12.511317+0000","last_clean":"2023-12-22T09:17:12.511317+0000","last_became_active":"2023-12-22T09:16:58.111712+0000","last_became_peered":"2023-12-22T09:16:58.111712+0000","last_unstale":"2023-12-22T09:17:12.511317+0000","last_undegraded":"2023-12-22T09:17:12.511317+0000","last_fullsized":"2023-12-22T09:17:12.511317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:31:26.301820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510900+0000","last_change":"2023-12-22T09:16:57.646140+0000","last_active":"2023-12-22T09:17:12.510900+0000","last_peered":"2023-12-22T09:17:12.510900+0000","last_clean":"2023-12-22T09:17:12.510900+0000","last_became_active":"2023-12-22T09:16:57.645839+0000","last_became_peered":"2023-12-22T09:16:57.645839+0000","last_unstale":"2023-12-22T09:17:12.510900+0000","last_undegraded":"2023-12-22T09:17:12.510900+0000","last_fullsized":"2023-12-22T09:17:12.510900+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:15.308735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519978+0000","last_change":"2023-12-22T09:17:12.538499+0000","last_active":"2023-12-22T09:17:13.519978+0000","last_peered":"2023-12-22T09:17:13.519978+0000","last_clean":"2023-12-22T09:17:13.519978+0000","last_became_active":"2023-12-22T09:17:12.537198+0000","last_became_peered":"2023-12-22T09:17:12.537198+0000","last_unstale":"2023-12-22T09:17:13.519978+0000","last_undegraded":"2023-12-22T09:17:13.519978+0000","last_fullsized":"2023-12-22T09:17:13.519978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:33:56.242812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511233+0000","last_change":"2023-12-22T09:17:12.042593+0000","last_active":"2023-12-22T09:17:12.511233+0000","last_peered":"2023-12-22T09:17:12.511233+0000","last_clean":"2023-12-22T09:17:12.511233+0000","last_became_active":"2023-12-22T09:17:12.042025+0000","last_became_peered":"2023-12-22T09:17:12.042025+0000","last_unstale":"2023-12-22T09:17:12.511233+0000","last_undegraded":"2023-12-22T09:17:12.511233+0000","last_fullsized":"2023-12-22T09:17:12.511233+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:23.589301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.500631+0000","last_change":"2023-12-22T09:16:58.148277+0000","last_active":"2023-12-22T09:17:12.500631+0000","last_peered":"2023-12-22T09:17:12.500631+0000","last_clean":"2023-12-22T09:17:12.500631+0000","last_became_active":"2023-12-22T09:16:58.147042+0000","last_became_peered":"2023-12-22T09:16:58.147042+0000","last_unstale":"2023-12-22T09:17:12.500631+0000","last_undegraded":"2023-12-22T09:17:12.500631+0000","last_fullsized":"2023-12-22T09:17:12.500631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:39.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510989+0000","last_change":"2023-12-22T09:16:57.641319+0000","last_active":"2023-12-22T09:17:12.510989+0000","last_peered":"2023-12-22T09:17:12.510989+0000","last_clean":"2023-12-22T09:17:12.510989+0000","last_became_active":"2023-12-22T09:16:57.641031+0000","last_became_peered":"2023-12-22T09:16:57.641031+0000","last_unstale":"2023-12-22T09:17:12.510989+0000","last_undegraded":"2023-12-22T09:17:12.510989+0000","last_fullsized":"2023-12-22T09:17:12.510989+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:10.350226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654739+0000","last_change":"2023-12-22T09:17:12.538075+0000","last_active":"2023-12-22T09:17:13.654739+0000","last_peered":"2023-12-22T09:17:13.654739+0000","last_clean":"2023-12-22T09:17:13.654739+0000","last_became_active":"2023-12-22T09:17:12.537810+0000","last_became_peered":"2023-12-22T09:17:12.537810+0000","last_unstale":"2023-12-22T09:17:13.654739+0000","last_undegraded":"2023-12-22T09:17:13.654739+0000","last_fullsized":"2023-12-22T09:17:13.654739+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:56.342160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.540158+0000","last_change":"2023-12-22T09:17:12.048461+0000","last_active":"2023-12-22T09:17:12.540158+0000","last_peered":"2023-12-22T09:17:12.540158+0000","last_clean":"2023-12-22T09:17:12.540158+0000","last_became_active":"2023-12-22T09:17:12.047895+0000","last_became_peered":"2023-12-22T09:17:12.047895+0000","last_unstale":"2023-12-22T09:17:12.540158+0000","last_undegraded":"2023-12-22T09:17:12.540158+0000","last_fullsized":"2023-12-22T09:17:12.540158+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:29.709741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506322+0000","last_change":"2023-12-22T09:16:58.130875+0000","last_active":"2023-12-22T09:17:12.506322+0000","last_peered":"2023-12-22T09:17:12.506322+0000","last_clean":"2023-12-22T09:17:12.506322+0000","last_became_active":"2023-12-22T09:16:58.130606+0000","last_became_peered":"2023-12-22T09:16:58.130606+0000","last_unstale":"2023-12-22T09:17:12.506322+0000","last_undegraded":"2023-12-22T09:17:12.506322+0000","last_fullsized":"2023-12-22T09:17:12.506322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:30.649529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508857+0000","last_change":"2023-12-22T09:16:57.642097+0000","last_active":"2023-12-22T09:17:12.508857+0000","last_peered":"2023-12-22T09:17:12.508857+0000","last_clean":"2023-12-22T09:17:12.508857+0000","last_became_active":"2023-12-22T09:16:57.641830+0000","last_became_peered":"2023-12-22T09:16:57.641830+0000","last_unstale":"2023-12-22T09:17:12.508857+0000","last_undegraded":"2023-12-22T09:17:12.508857+0000","last_fullsized":"2023-12-22T09:17:12.508857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:37:23.822669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.655149+0000","last_change":"2023-12-22T09:17:12.540055+0000","last_active":"2023-12-22T09:17:13.655149+0000","last_peered":"2023-12-22T09:17:13.655149+0000","last_clean":"2023-12-22T09:17:13.655149+0000","last_became_active":"2023-12-22T09:17:12.538538+0000","last_became_peered":"2023-12-22T09:17:12.538538+0000","last_unstale":"2023-12-22T09:17:13.655149+0000","last_undegraded":"2023-12-22T09:17:13.655149+0000","last_fullsized":"2023-12-22T09:17:13.655149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:32.197707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.535927+0000","last_change":"2023-12-22T09:17:12.039872+0000","last_active":"2023-12-22T09:17:12.535927+0000","last_peered":"2023-12-22T09:17:12.535927+0000","last_clean":"2023-12-22T09:17:12.535927+0000","last_became_active":"2023-12-22T09:17:12.039547+0000","last_became_peered":"2023-12-22T09:17:12.039547+0000","last_unstale":"2023-12-22T09:17:12.535927+0000","last_undegraded":"2023-12-22T09:17:12.535927+0000","last_fullsized":"2023-12-22T09:17:12.535927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:57:47.077419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510813+0000","last_change":"2023-12-22T09:16:58.147991+0000","last_active":"2023-12-22T09:17:12.510813+0000","last_peered":"2023-12-22T09:17:12.510813+0000","last_clean":"2023-12-22T09:17:12.510813+0000","last_became_active":"2023-12-22T09:16:58.147595+0000","last_became_peered":"2023-12-22T09:16:58.147595+0000","last_unstale":"2023-12-22T09:17:12.510813+0000","last_undegraded":"2023-12-22T09:17:12.510813+0000","last_fullsized":"2023-12-22T09:17:12.510813+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:14.136005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510671+0000","last_change":"2023-12-22T09:16:57.647073+0000","last_active":"2023-12-22T09:17:12.510671+0000","last_peered":"2023-12-22T09:17:12.510671+0000","last_clean":"2023-12-22T09:17:12.510671+0000","last_became_active":"2023-12-22T09:16:57.646655+0000","last_became_peered":"2023-12-22T09:16:57.646655+0000","last_unstale":"2023-12-22T09:17:12.510671+0000","last_undegraded":"2023-12-22T09:17:12.510671+0000","last_fullsized":"2023-12-22T09:17:12.510671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:52.036721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.513231+0000","last_change":"2023-12-22T09:17:12.518504+0000","last_active":"2023-12-22T09:17:13.513231+0000","last_peered":"2023-12-22T09:17:13.513231+0000","last_clean":"2023-12-22T09:17:13.513231+0000","last_became_active":"2023-12-22T09:17:12.516641+0000","last_became_peered":"2023-12-22T09:17:12.516641+0000","last_unstale":"2023-12-22T09:17:13.513231+0000","last_undegraded":"2023-12-22T09:17:13.513231+0000","last_fullsized":"2023-12-22T09:17:13.513231+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:03:21.031760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"63'3","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.536686+0000","last_change":"2023-12-22T09:17:12.042844+0000","last_active":"2023-12-22T09:17:12.536686+0000","last_peered":"2023-12-22T09:17:12.536686+0000","last_clean":"2023-12-22T09:17:12.536686+0000","last_became_active":"2023-12-22T09:17:12.042579+0000","last_became_peered":"2023-12-22T09:17:12.042579+0000","last_unstale":"2023-12-22T09:17:12.536686+0000","last_undegraded":"2023-12-22T09:17:12.536686+0000","last_fullsized":"2023-12-22T09:17:12.536686+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:28.077725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501712+0000","last_change":"2023-12-22T09:16:58.112827+0000","last_active":"2023-12-22T09:17:12.501712+0000","last_peered":"2023-12-22T09:17:12.501712+0000","last_clean":"2023-12-22T09:17:12.501712+0000","last_became_active":"2023-12-22T09:16:58.112533+0000","last_became_peered":"2023-12-22T09:16:58.112533+0000","last_unstale":"2023-12-22T09:17:12.501712+0000","last_undegraded":"2023-12-22T09:17:12.501712+0000","last_fullsized":"2023-12-22T09:17:12.501712+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:38.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530940+0000","last_change":"2023-12-22T09:16:57.653443+0000","last_active":"2023-12-22T09:17:12.530940+0000","last_peered":"2023-12-22T09:17:12.530940+0000","last_clean":"2023-12-22T09:17:12.530940+0000","last_became_active":"2023-12-22T09:16:57.653141+0000","last_became_peered":"2023-12-22T09:16:57.653141+0000","last_unstale":"2023-12-22T09:17:12.530940+0000","last_undegraded":"2023-12-22T09:17:12.530940+0000","last_fullsized":"2023-12-22T09:17:12.530940+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.785009+0000","last_change":"2023-12-22T09:17:12.519197+0000","last_active":"2023-12-22T09:17:13.785009+0000","last_peered":"2023-12-22T09:17:13.785009+0000","last_clean":"2023-12-22T09:17:13.785009+0000","last_became_active":"2023-12-22T09:17:12.518938+0000","last_became_peered":"2023-12-22T09:17:12.518938+0000","last_unstale":"2023-12-22T09:17:13.785009+0000","last_undegraded":"2023-12-22T09:17:13.785009+0000","last_fullsized":"2023-12-22T09:17:13.785009+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:51.675128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"63'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.552653+0000","last_change":"2023-12-22T09:17:12.045401+0000","last_active":"2023-12-22T09:17:12.552653+0000","last_peered":"2023-12-22T09:17:12.552653+0000","last_clean":"2023-12-22T09:17:12.552653+0000","last_became_active":"2023-12-22T09:17:12.044219+0000","last_became_peered":"2023-12-22T09:17:12.044219+0000","last_unstale":"2023-12-22T09:17:12.552653+0000","last_undegraded":"2023-12-22T09:17:12.552653+0000","last_fullsized":"2023-12-22T09:17:12.552653+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:44.256814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511748+0000","last_change":"2023-12-22T09:16:58.138339+0000","last_active":"2023-12-22T09:17:12.511748+0000","last_peered":"2023-12-22T09:17:12.511748+0000","last_clean":"2023-12-22T09:17:12.511748+0000","last_became_active":"2023-12-22T09:16:58.137859+0000","last_became_peered":"2023-12-22T09:16:58.137859+0000","last_unstale":"2023-12-22T09:17:12.511748+0000","last_undegraded":"2023-12-22T09:17:12.511748+0000","last_fullsized":"2023-12-22T09:17:12.511748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:20.962415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.532026+0000","last_change":"2023-12-22T09:16:57.655164+0000","last_active":"2023-12-22T09:17:12.532026+0000","last_peered":"2023-12-22T09:17:12.532026+0000","last_clean":"2023-12-22T09:17:12.532026+0000","last_became_active":"2023-12-22T09:16:57.654845+0000","last_became_peered":"2023-12-22T09:16:57.654845+0000","last_unstale":"2023-12-22T09:17:12.532026+0000","last_undegraded":"2023-12-22T09:17:12.532026+0000","last_fullsized":"2023-12-22T09:17:12.532026+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:48.446401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654348+0000","last_change":"2023-12-22T09:17:12.533123+0000","last_active":"2023-12-22T09:17:13.654348+0000","last_peered":"2023-12-22T09:17:13.654348+0000","last_clean":"2023-12-22T09:17:13.654348+0000","last_became_active":"2023-12-22T09:17:12.532863+0000","last_became_peered":"2023-12-22T09:17:12.532863+0000","last_unstale":"2023-12-22T09:17:13.654348+0000","last_undegraded":"2023-12-22T09:17:13.654348+0000","last_fullsized":"2023-12-22T09:17:13.654348+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:19.705765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530622+0000","last_change":"2023-12-22T09:17:12.051582+0000","last_active":"2023-12-22T09:17:12.530622+0000","last_peered":"2023-12-22T09:17:12.530622+0000","last_clean":"2023-12-22T09:17:12.530622+0000","last_became_active":"2023-12-22T09:17:12.051335+0000","last_became_peered":"2023-12-22T09:17:12.051335+0000","last_unstale":"2023-12-22T09:17:12.530622+0000","last_undegraded":"2023-12-22T09:17:12.530622+0000","last_fullsized":"2023-12-22T09:17:12.530622+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:44.261501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509885+0000","last_change":"2023-12-22T09:16:58.140359+0000","last_active":"2023-12-22T09:17:12.509885+0000","last_peered":"2023-12-22T09:17:12.509885+0000","last_clean":"2023-12-22T09:17:12.509885+0000","last_became_active":"2023-12-22T09:16:58.140013+0000","last_became_peered":"2023-12-22T09:16:58.140013+0000","last_unstale":"2023-12-22T09:17:12.509885+0000","last_undegraded":"2023-12-22T09:17:12.509885+0000","last_fullsized":"2023-12-22T09:17:12.509885+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:10:45.503921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.524534+0000","last_change":"2023-12-22T09:16:57.649245+0000","last_active":"2023-12-22T09:17:12.524534+0000","last_peered":"2023-12-22T09:17:12.524534+0000","last_clean":"2023-12-22T09:17:12.524534+0000","last_became_active":"2023-12-22T09:16:57.648941+0000","last_became_peered":"2023-12-22T09:16:57.648941+0000","last_unstale":"2023-12-22T09:17:12.524534+0000","last_undegraded":"2023-12-22T09:17:12.524534+0000","last_fullsized":"2023-12-22T09:17:12.524534+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:41:54.745043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786500+0000","last_change":"2023-12-22T09:17:12.541809+0000","last_active":"2023-12-22T09:17:13.786500+0000","last_peered":"2023-12-22T09:17:13.786500+0000","last_clean":"2023-12-22T09:17:13.786500+0000","last_became_active":"2023-12-22T09:17:12.541337+0000","last_became_peered":"2023-12-22T09:17:12.541337+0000","last_unstale":"2023-12-22T09:17:13.786500+0000","last_undegraded":"2023-12-22T09:17:13.786500+0000","last_fullsized":"2023-12-22T09:17:13.786500+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:13:32.197707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.518282+0000","last_change":"2023-12-22T09:17:12.044813+0000","last_active":"2023-12-22T09:17:12.518282+0000","last_peered":"2023-12-22T09:17:12.518282+0000","last_clean":"2023-12-22T09:17:12.518282+0000","last_became_active":"2023-12-22T09:17:12.044493+0000","last_became_peered":"2023-12-22T09:17:12.044493+0000","last_unstale":"2023-12-22T09:17:12.518282+0000","last_undegraded":"2023-12-22T09:17:12.518282+0000","last_fullsized":"2023-12-22T09:17:12.518282+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:49:30.159981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531860+0000","last_change":"2023-12-22T09:16:58.136583+0000","last_active":"2023-12-22T09:17:12.531860+0000","last_peered":"2023-12-22T09:17:12.531860+0000","last_clean":"2023-12-22T09:17:12.531860+0000","last_became_active":"2023-12-22T09:16:58.136313+0000","last_became_peered":"2023-12-22T09:16:58.136313+0000","last_unstale":"2023-12-22T09:17:12.531860+0000","last_undegraded":"2023-12-22T09:17:12.531860+0000","last_fullsized":"2023-12-22T09:17:12.531860+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:55:04.972480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"59'9","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501925+0000","last_change":"2023-12-22T09:16:57.656118+0000","last_active":"2023-12-22T09:17:12.501925+0000","last_peered":"2023-12-22T09:17:12.501925+0000","last_clean":"2023-12-22T09:17:12.501925+0000","last_became_active":"2023-12-22T09:16:57.655712+0000","last_became_peered":"2023-12-22T09:16:57.655712+0000","last_unstale":"2023-12-22T09:17:12.501925+0000","last_undegraded":"2023-12-22T09:17:12.501925+0000","last_fullsized":"2023-12-22T09:17:12.501925+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3059,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519856+0000","last_change":"2023-12-22T09:17:12.541565+0000","last_active":"2023-12-22T09:17:13.519856+0000","last_peered":"2023-12-22T09:17:13.519856+0000","last_clean":"2023-12-22T09:17:13.519856+0000","last_became_active":"2023-12-22T09:17:12.540916+0000","last_became_peered":"2023-12-22T09:17:12.540916+0000","last_unstale":"2023-12-22T09:17:13.519856+0000","last_undegraded":"2023-12-22T09:17:13.519856+0000","last_fullsized":"2023-12-22T09:17:13.519856+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:25:48.901354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.517343+0000","last_change":"2023-12-22T09:17:12.033057+0000","last_active":"2023-12-22T09:17:12.517343+0000","last_peered":"2023-12-22T09:17:12.517343+0000","last_clean":"2023-12-22T09:17:12.517343+0000","last_became_active":"2023-12-22T09:17:12.031614+0000","last_became_peered":"2023-12-22T09:17:12.031614+0000","last_unstale":"2023-12-22T09:17:12.517343+0000","last_undegraded":"2023-12-22T09:17:12.517343+0000","last_fullsized":"2023-12-22T09:17:12.517343+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:43:07.491118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523277+0000","last_change":"2023-12-22T09:16:58.146066+0000","last_active":"2023-12-22T09:17:12.523277+0000","last_peered":"2023-12-22T09:17:12.523277+0000","last_clean":"2023-12-22T09:17:12.523277+0000","last_became_active":"2023-12-22T09:16:58.145703+0000","last_became_peered":"2023-12-22T09:16:58.145703+0000","last_unstale":"2023-12-22T09:17:12.523277+0000","last_undegraded":"2023-12-22T09:17:12.523277+0000","last_fullsized":"2023-12-22T09:17:12.523277+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:02.557319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530402+0000","last_change":"2023-12-22T09:16:57.649967+0000","last_active":"2023-12-22T09:17:12.530402+0000","last_peered":"2023-12-22T09:17:12.530402+0000","last_clean":"2023-12-22T09:17:12.530402+0000","last_became_active":"2023-12-22T09:16:57.649500+0000","last_became_peered":"2023-12-22T09:16:57.649500+0000","last_unstale":"2023-12-22T09:17:12.530402+0000","last_undegraded":"2023-12-22T09:17:12.530402+0000","last_fullsized":"2023-12-22T09:17:12.530402+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520037+0000","last_change":"2023-12-22T09:17:12.524836+0000","last_active":"2023-12-22T09:17:13.520037+0000","last_peered":"2023-12-22T09:17:13.520037+0000","last_clean":"2023-12-22T09:17:13.520037+0000","last_became_active":"2023-12-22T09:17:12.524505+0000","last_became_peered":"2023-12-22T09:17:12.524505+0000","last_unstale":"2023-12-22T09:17:13.520037+0000","last_undegraded":"2023-12-22T09:17:13.520037+0000","last_fullsized":"2023-12-22T09:17:13.520037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:11:58.590168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"63'8","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.545045+0000","last_change":"2023-12-22T09:17:12.033674+0000","last_active":"2023-12-22T09:17:12.545045+0000","last_peered":"2023-12-22T09:17:12.545045+0000","last_clean":"2023-12-22T09:17:12.545045+0000","last_became_active":"2023-12-22T09:17:12.033414+0000","last_became_peered":"2023-12-22T09:17:12.033414+0000","last_unstale":"2023-12-22T09:17:12.545045+0000","last_undegraded":"2023-12-22T09:17:12.545045+0000","last_fullsized":"2023-12-22T09:17:12.545045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511945+0000","last_change":"2023-12-22T09:16:58.134889+0000","last_active":"2023-12-22T09:17:12.511945+0000","last_peered":"2023-12-22T09:17:12.511945+0000","last_clean":"2023-12-22T09:17:12.511945+0000","last_became_active":"2023-12-22T09:16:58.134552+0000","last_became_peered":"2023-12-22T09:16:58.134552+0000","last_unstale":"2023-12-22T09:17:12.511945+0000","last_undegraded":"2023-12-22T09:17:12.511945+0000","last_fullsized":"2023-12-22T09:17:12.511945+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514020+0000","last_change":"2023-12-22T09:16:57.651390+0000","last_active":"2023-12-22T09:17:12.514020+0000","last_peered":"2023-12-22T09:17:12.514020+0000","last_clean":"2023-12-22T09:17:12.514020+0000","last_became_active":"2023-12-22T09:16:57.650566+0000","last_became_peered":"2023-12-22T09:16:57.650566+0000","last_unstale":"2023-12-22T09:17:12.514020+0000","last_undegraded":"2023-12-22T09:17:12.514020+0000","last_fullsized":"2023-12-22T09:17:12.514020+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:53.090112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.787882+0000","last_change":"2023-12-22T09:17:12.527859+0000","last_active":"2023-12-22T09:17:13.787882+0000","last_peered":"2023-12-22T09:17:13.787882+0000","last_clean":"2023-12-22T09:17:13.787882+0000","last_became_active":"2023-12-22T09:17:12.527492+0000","last_became_peered":"2023-12-22T09:17:12.527492+0000","last_unstale":"2023-12-22T09:17:13.787882+0000","last_undegraded":"2023-12-22T09:17:13.787882+0000","last_fullsized":"2023-12-22T09:17:13.787882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:53:47.049867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.542091+0000","last_change":"2023-12-22T09:17:12.051972+0000","last_active":"2023-12-22T09:17:12.542091+0000","last_peered":"2023-12-22T09:17:12.542091+0000","last_clean":"2023-12-22T09:17:12.542091+0000","last_became_active":"2023-12-22T09:17:12.051625+0000","last_became_peered":"2023-12-22T09:17:12.051625+0000","last_unstale":"2023-12-22T09:17:12.542091+0000","last_undegraded":"2023-12-22T09:17:12.542091+0000","last_fullsized":"2023-12-22T09:17:12.542091+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:56:30.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506577+0000","last_change":"2023-12-22T09:16:58.127084+0000","last_active":"2023-12-22T09:17:12.506577+0000","last_peered":"2023-12-22T09:17:12.506577+0000","last_clean":"2023-12-22T09:17:12.506577+0000","last_became_active":"2023-12-22T09:16:58.126598+0000","last_became_peered":"2023-12-22T09:16:58.126598+0000","last_unstale":"2023-12-22T09:17:12.506577+0000","last_undegraded":"2023-12-22T09:17:12.506577+0000","last_fullsized":"2023-12-22T09:17:12.506577+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:34:57.174680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523748+0000","last_change":"2023-12-22T09:16:57.643354+0000","last_active":"2023-12-22T09:17:12.523748+0000","last_peered":"2023-12-22T09:17:12.523748+0000","last_clean":"2023-12-22T09:17:12.523748+0000","last_became_active":"2023-12-22T09:16:57.643102+0000","last_became_peered":"2023-12-22T09:16:57.643102+0000","last_unstale":"2023-12-22T09:17:12.523748+0000","last_undegraded":"2023-12-22T09:17:12.523748+0000","last_fullsized":"2023-12-22T09:17:12.523748+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519260+0000","last_change":"2023-12-22T09:17:12.526768+0000","last_active":"2023-12-22T09:17:13.519260+0000","last_peered":"2023-12-22T09:17:13.519260+0000","last_clean":"2023-12-22T09:17:13.519260+0000","last_became_active":"2023-12-22T09:17:12.526405+0000","last_became_peered":"2023-12-22T09:17:12.526405+0000","last_unstale":"2023-12-22T09:17:13.519260+0000","last_undegraded":"2023-12-22T09:17:13.519260+0000","last_fullsized":"2023-12-22T09:17:13.519260+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:14:28.665216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.525171+0000","last_change":"2023-12-22T09:17:12.049210+0000","last_active":"2023-12-22T09:17:12.525171+0000","last_peered":"2023-12-22T09:17:12.525171+0000","last_clean":"2023-12-22T09:17:12.525171+0000","last_became_active":"2023-12-22T09:17:12.048873+0000","last_became_peered":"2023-12-22T09:17:12.048873+0000","last_unstale":"2023-12-22T09:17:12.525171+0000","last_undegraded":"2023-12-22T09:17:12.525171+0000","last_fullsized":"2023-12-22T09:17:12.525171+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:53.836251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.503160+0000","last_change":"2023-12-22T09:16:58.146073+0000","last_active":"2023-12-22T09:17:12.503160+0000","last_peered":"2023-12-22T09:17:12.503160+0000","last_clean":"2023-12-22T09:17:12.503160+0000","last_became_active":"2023-12-22T09:16:58.145780+0000","last_became_peered":"2023-12-22T09:16:58.145780+0000","last_unstale":"2023-12-22T09:17:12.503160+0000","last_undegraded":"2023-12-22T09:17:12.503160+0000","last_fullsized":"2023-12-22T09:17:12.503160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:07:56.524005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":24,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523398+0000","last_change":"2023-12-22T09:16:57.651320+0000","last_active":"2023-12-22T09:17:12.523398+0000","last_peered":"2023-12-22T09:17:12.523398+0000","last_clean":"2023-12-22T09:17:12.523398+0000","last_became_active":"2023-12-22T09:16:57.651060+0000","last_became_peered":"2023-12-22T09:16:57.651060+0000","last_unstale":"2023-12-22T09:17:12.523398+0000","last_undegraded":"2023-12-22T09:17:12.523398+0000","last_fullsized":"2023-12-22T09:17:12.523398+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:19:59.812662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672849+0000","last_change":"2023-12-22T09:17:12.528567+0000","last_active":"2023-12-22T09:17:13.672849+0000","last_peered":"2023-12-22T09:17:13.672849+0000","last_clean":"2023-12-22T09:17:13.672849+0000","last_became_active":"2023-12-22T09:17:12.528002+0000","last_became_peered":"2023-12-22T09:17:12.528002+0000","last_unstale":"2023-12-22T09:17:13.672849+0000","last_undegraded":"2023-12-22T09:17:13.672849+0000","last_fullsized":"2023-12-22T09:17:13.672849+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:51.036971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.541699+0000","last_change":"2023-12-22T09:17:12.033505+0000","last_active":"2023-12-22T09:17:12.541699+0000","last_peered":"2023-12-22T09:17:12.541699+0000","last_clean":"2023-12-22T09:17:12.541699+0000","last_became_active":"2023-12-22T09:17:12.033215+0000","last_became_peered":"2023-12-22T09:17:12.033215+0000","last_unstale":"2023-12-22T09:17:12.541699+0000","last_undegraded":"2023-12-22T09:17:12.541699+0000","last_fullsized":"2023-12-22T09:17:12.541699+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:12:56.005441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.526085+0000","last_change":"2023-12-22T09:16:58.148310+0000","last_active":"2023-12-22T09:17:12.526085+0000","last_peered":"2023-12-22T09:17:12.526085+0000","last_clean":"2023-12-22T09:17:12.526085+0000","last_became_active":"2023-12-22T09:16:58.147993+0000","last_became_peered":"2023-12-22T09:16:58.147993+0000","last_unstale":"2023-12-22T09:17:12.526085+0000","last_undegraded":"2023-12-22T09:17:12.526085+0000","last_fullsized":"2023-12-22T09:17:12.526085+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.516449+0000","last_change":"2023-12-22T09:16:57.654251+0000","last_active":"2023-12-22T09:17:12.516449+0000","last_peered":"2023-12-22T09:17:12.516449+0000","last_clean":"2023-12-22T09:17:12.516449+0000","last_became_active":"2023-12-22T09:16:57.653954+0000","last_became_peered":"2023-12-22T09:16:57.653954+0000","last_unstale":"2023-12-22T09:17:12.516449+0000","last_undegraded":"2023-12-22T09:17:12.516449+0000","last_fullsized":"2023-12-22T09:17:12.516449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512606+0000","last_change":"2023-12-22T09:17:12.530578+0000","last_active":"2023-12-22T09:17:13.512606+0000","last_peered":"2023-12-22T09:17:13.512606+0000","last_clean":"2023-12-22T09:17:13.512606+0000","last_became_active":"2023-12-22T09:17:12.530253+0000","last_became_peered":"2023-12-22T09:17:12.530253+0000","last_unstale":"2023-12-22T09:17:13.512606+0000","last_undegraded":"2023-12-22T09:17:13.512606+0000","last_fullsized":"2023-12-22T09:17:13.512606+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:35:40.208972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.501023+0000","last_change":"2023-12-22T09:17:12.044418+0000","last_active":"2023-12-22T09:17:12.501023+0000","last_peered":"2023-12-22T09:17:12.501023+0000","last_clean":"2023-12-22T09:17:12.501023+0000","last_became_active":"2023-12-22T09:17:12.041736+0000","last_became_peered":"2023-12-22T09:17:12.041736+0000","last_unstale":"2023-12-22T09:17:12.501023+0000","last_undegraded":"2023-12-22T09:17:12.501023+0000","last_fullsized":"2023-12-22T09:17:12.501023+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:34:22.106083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514253+0000","last_change":"2023-12-22T09:16:58.152892+0000","last_active":"2023-12-22T09:17:12.514253+0000","last_peered":"2023-12-22T09:17:12.514253+0000","last_clean":"2023-12-22T09:17:12.514253+0000","last_became_active":"2023-12-22T09:16:58.152538+0000","last_became_peered":"2023-12-22T09:16:58.152538+0000","last_unstale":"2023-12-22T09:17:12.514253+0000","last_undegraded":"2023-12-22T09:17:12.514253+0000","last_fullsized":"2023-12-22T09:17:12.514253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T21:12:00.336692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.523612+0000","last_change":"2023-12-22T09:16:57.659614+0000","last_active":"2023-12-22T09:17:12.523612+0000","last_peered":"2023-12-22T09:17:12.523612+0000","last_clean":"2023-12-22T09:17:12.523612+0000","last_became_active":"2023-12-22T09:16:57.659211+0000","last_became_peered":"2023-12-22T09:16:57.659211+0000","last_unstale":"2023-12-22T09:17:12.523612+0000","last_undegraded":"2023-12-22T09:17:12.523612+0000","last_fullsized":"2023-12-22T09:17:12.523612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:13.351291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.512450+0000","last_change":"2023-12-22T09:17:12.530610+0000","last_active":"2023-12-22T09:17:13.512450+0000","last_peered":"2023-12-22T09:17:13.512450+0000","last_clean":"2023-12-22T09:17:13.512450+0000","last_became_active":"2023-12-22T09:17:12.530321+0000","last_became_peered":"2023-12-22T09:17:12.530321+0000","last_unstale":"2023-12-22T09:17:13.512450+0000","last_undegraded":"2023-12-22T09:17:13.512450+0000","last_fullsized":"2023-12-22T09:17:13.512450+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:05:07.882503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.543725+0000","last_change":"2023-12-22T09:17:12.053568+0000","last_active":"2023-12-22T09:17:12.543725+0000","last_peered":"2023-12-22T09:17:12.543725+0000","last_clean":"2023-12-22T09:17:12.543725+0000","last_became_active":"2023-12-22T09:17:12.053300+0000","last_became_peered":"2023-12-22T09:17:12.053300+0000","last_unstale":"2023-12-22T09:17:12.543725+0000","last_undegraded":"2023-12-22T09:17:12.543725+0000","last_fullsized":"2023-12-22T09:17:12.543725+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:27.519985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.531709+0000","last_change":"2023-12-22T09:16:58.144680+0000","last_active":"2023-12-22T09:17:12.531709+0000","last_peered":"2023-12-22T09:17:12.531709+0000","last_clean":"2023-12-22T09:17:12.531709+0000","last_became_active":"2023-12-22T09:16:58.144401+0000","last_became_peered":"2023-12-22T09:16:58.144401+0000","last_unstale":"2023-12-22T09:17:12.531709+0000","last_undegraded":"2023-12-22T09:17:12.531709+0000","last_fullsized":"2023-12-22T09:17:12.531709+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:44:43.213252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.524628+0000","last_change":"2023-12-22T09:16:57.651659+0000","last_active":"2023-12-22T09:17:12.524628+0000","last_peered":"2023-12-22T09:17:12.524628+0000","last_clean":"2023-12-22T09:17:12.524628+0000","last_became_active":"2023-12-22T09:16:57.650353+0000","last_became_peered":"2023-12-22T09:16:57.650353+0000","last_unstale":"2023-12-22T09:17:12.524628+0000","last_undegraded":"2023-12-22T09:17:12.524628+0000","last_fullsized":"2023-12-22T09:17:12.524628+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:15.191139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.672043+0000","last_change":"2023-12-22T09:17:12.532001+0000","last_active":"2023-12-22T09:17:13.672043+0000","last_peered":"2023-12-22T09:17:13.672043+0000","last_clean":"2023-12-22T09:17:13.672043+0000","last_became_active":"2023-12-22T09:17:12.531752+0000","last_became_peered":"2023-12-22T09:17:12.531752+0000","last_unstale":"2023-12-22T09:17:13.672043+0000","last_undegraded":"2023-12-22T09:17:13.672043+0000","last_fullsized":"2023-12-22T09:17:13.672043+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:57.709662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.543808+0000","last_change":"2023-12-22T09:17:12.046797+0000","last_active":"2023-12-22T09:17:12.543808+0000","last_peered":"2023-12-22T09:17:12.543808+0000","last_clean":"2023-12-22T09:17:12.543808+0000","last_became_active":"2023-12-22T09:17:12.046525+0000","last_became_peered":"2023-12-22T09:17:12.046525+0000","last_unstale":"2023-12-22T09:17:12.543808+0000","last_undegraded":"2023-12-22T09:17:12.543808+0000","last_fullsized":"2023-12-22T09:17:12.543808+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:47.502516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509106+0000","last_change":"2023-12-22T09:16:58.139368+0000","last_active":"2023-12-22T09:17:12.509106+0000","last_peered":"2023-12-22T09:17:12.509106+0000","last_clean":"2023-12-22T09:17:12.509106+0000","last_became_active":"2023-12-22T09:16:58.134697+0000","last_became_peered":"2023-12-22T09:16:58.134697+0000","last_unstale":"2023-12-22T09:17:12.509106+0000","last_undegraded":"2023-12-22T09:17:12.509106+0000","last_fullsized":"2023-12-22T09:17:12.509106+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:40.957191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511659+0000","last_change":"2023-12-22T09:16:57.659460+0000","last_active":"2023-12-22T09:17:12.511659+0000","last_peered":"2023-12-22T09:17:12.511659+0000","last_clean":"2023-12-22T09:17:12.511659+0000","last_became_active":"2023-12-22T09:16:57.659124+0000","last_became_peered":"2023-12-22T09:16:57.659124+0000","last_unstale":"2023-12-22T09:17:12.511659+0000","last_undegraded":"2023-12-22T09:17:12.511659+0000","last_fullsized":"2023-12-22T09:17:12.511659+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:56:00.331386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.656111+0000","last_change":"2023-12-22T09:17:12.544913+0000","last_active":"2023-12-22T09:17:13.656111+0000","last_peered":"2023-12-22T09:17:13.656111+0000","last_clean":"2023-12-22T09:17:13.656111+0000","last_became_active":"2023-12-22T09:17:12.544666+0000","last_became_peered":"2023-12-22T09:17:12.544666+0000","last_unstale":"2023-12-22T09:17:13.656111+0000","last_undegraded":"2023-12-22T09:17:13.656111+0000","last_fullsized":"2023-12-22T09:17:13.656111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:00.648890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508653+0000","last_change":"2023-12-22T09:17:12.026554+0000","last_active":"2023-12-22T09:17:12.508653+0000","last_peered":"2023-12-22T09:17:12.508653+0000","last_clean":"2023-12-22T09:17:12.508653+0000","last_became_active":"2023-12-22T09:17:12.026169+0000","last_became_peered":"2023-12-22T09:17:12.026169+0000","last_unstale":"2023-12-22T09:17:12.508653+0000","last_undegraded":"2023-12-22T09:17:12.508653+0000","last_fullsized":"2023-12-22T09:17:12.508653+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:22:18.487717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.513517+0000","last_change":"2023-12-22T09:16:58.122054+0000","last_active":"2023-12-22T09:17:12.513517+0000","last_peered":"2023-12-22T09:17:12.513517+0000","last_clean":"2023-12-22T09:17:12.513517+0000","last_became_active":"2023-12-22T09:16:58.121132+0000","last_became_peered":"2023-12-22T09:16:58.121132+0000","last_unstale":"2023-12-22T09:17:12.513517+0000","last_undegraded":"2023-12-22T09:17:12.513517+0000","last_fullsized":"2023-12-22T09:17:12.513517+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:00:22.352032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.513127+0000","last_change":"2023-12-22T09:16:57.643365+0000","last_active":"2023-12-22T09:17:12.513127+0000","last_peered":"2023-12-22T09:17:12.513127+0000","last_clean":"2023-12-22T09:17:12.513127+0000","last_became_active":"2023-12-22T09:16:57.642191+0000","last_became_peered":"2023-12-22T09:16:57.642191+0000","last_unstale":"2023-12-22T09:17:12.513127+0000","last_undegraded":"2023-12-22T09:17:12.513127+0000","last_fullsized":"2023-12-22T09:17:12.513127+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:42.294395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.520118+0000","last_change":"2023-12-22T09:17:12.533494+0000","last_active":"2023-12-22T09:17:13.520118+0000","last_peered":"2023-12-22T09:17:13.520118+0000","last_clean":"2023-12-22T09:17:13.520118+0000","last_became_active":"2023-12-22T09:17:12.532982+0000","last_became_peered":"2023-12-22T09:17:12.532982+0000","last_unstale":"2023-12-22T09:17:13.520118+0000","last_undegraded":"2023-12-22T09:17:13.520118+0000","last_fullsized":"2023-12-22T09:17:13.520118+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:31.400736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509800+0000","last_change":"2023-12-22T09:17:12.028752+0000","last_active":"2023-12-22T09:17:12.509800+0000","last_peered":"2023-12-22T09:17:12.509800+0000","last_clean":"2023-12-22T09:17:12.509800+0000","last_became_active":"2023-12-22T09:17:12.024880+0000","last_became_peered":"2023-12-22T09:17:12.024880+0000","last_unstale":"2023-12-22T09:17:12.509800+0000","last_undegraded":"2023-12-22T09:17:12.509800+0000","last_fullsized":"2023-12-22T09:17:12.509800+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:18.691505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.512171+0000","last_change":"2023-12-22T09:16:58.139882+0000","last_active":"2023-12-22T09:17:12.512171+0000","last_peered":"2023-12-22T09:17:12.512171+0000","last_clean":"2023-12-22T09:17:12.512171+0000","last_became_active":"2023-12-22T09:16:58.139602+0000","last_became_peered":"2023-12-22T09:16:58.139602+0000","last_unstale":"2023-12-22T09:17:12.512171+0000","last_undegraded":"2023-12-22T09:17:12.512171+0000","last_fullsized":"2023-12-22T09:17:12.512171+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514161+0000","last_change":"2023-12-22T09:16:57.651581+0000","last_active":"2023-12-22T09:17:12.514161+0000","last_peered":"2023-12-22T09:17:12.514161+0000","last_clean":"2023-12-22T09:17:12.514161+0000","last_became_active":"2023-12-22T09:16:57.651050+0000","last_became_peered":"2023-12-22T09:16:57.651050+0000","last_unstale":"2023-12-22T09:17:12.514161+0000","last_undegraded":"2023-12-22T09:17:12.514161+0000","last_fullsized":"2023-12-22T09:17:12.514161+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:32.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654707+0000","last_change":"2023-12-22T09:17:12.533788+0000","last_active":"2023-12-22T09:17:13.654707+0000","last_peered":"2023-12-22T09:17:13.654707+0000","last_clean":"2023-12-22T09:17:13.654707+0000","last_became_active":"2023-12-22T09:17:12.533557+0000","last_became_peered":"2023-12-22T09:17:12.533557+0000","last_unstale":"2023-12-22T09:17:13.654707+0000","last_undegraded":"2023-12-22T09:17:13.654707+0000","last_fullsized":"2023-12-22T09:17:13.654707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:52:31.473473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530636+0000","last_change":"2023-12-22T09:17:12.045811+0000","last_active":"2023-12-22T09:17:12.530636+0000","last_peered":"2023-12-22T09:17:12.530636+0000","last_clean":"2023-12-22T09:17:12.530636+0000","last_became_active":"2023-12-22T09:17:12.045487+0000","last_became_peered":"2023-12-22T09:17:12.045487+0000","last_unstale":"2023-12-22T09:17:12.530636+0000","last_undegraded":"2023-12-22T09:17:12.530636+0000","last_fullsized":"2023-12-22T09:17:12.530636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:24.280048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506960+0000","last_change":"2023-12-22T09:16:58.127943+0000","last_active":"2023-12-22T09:17:12.506960+0000","last_peered":"2023-12-22T09:17:12.506960+0000","last_clean":"2023-12-22T09:17:12.506960+0000","last_became_active":"2023-12-22T09:16:58.127679+0000","last_became_peered":"2023-12-22T09:16:58.127679+0000","last_unstale":"2023-12-22T09:17:12.506960+0000","last_undegraded":"2023-12-22T09:17:12.506960+0000","last_fullsized":"2023-12-22T09:17:12.506960+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:34.212746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.514933+0000","last_change":"2023-12-22T09:16:57.643620+0000","last_active":"2023-12-22T09:17:12.514933+0000","last_peered":"2023-12-22T09:17:12.514933+0000","last_clean":"2023-12-22T09:17:12.514933+0000","last_became_active":"2023-12-22T09:16:57.643322+0000","last_became_peered":"2023-12-22T09:16:57.643322+0000","last_unstale":"2023-12-22T09:17:12.514933+0000","last_undegraded":"2023-12-22T09:17:12.514933+0000","last_fullsized":"2023-12-22T09:17:12.514933+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:53:13.807363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786525+0000","last_change":"2023-12-22T09:17:12.537393+0000","last_active":"2023-12-22T09:17:13.786525+0000","last_peered":"2023-12-22T09:17:13.786525+0000","last_clean":"2023-12-22T09:17:13.786525+0000","last_became_active":"2023-12-22T09:17:12.537068+0000","last_became_peered":"2023-12-22T09:17:12.537068+0000","last_unstale":"2023-12-22T09:17:13.786525+0000","last_undegraded":"2023-12-22T09:17:13.786525+0000","last_fullsized":"2023-12-22T09:17:13.786525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:42.821653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.524227+0000","last_change":"2023-12-22T09:17:12.050090+0000","last_active":"2023-12-22T09:17:12.524227+0000","last_peered":"2023-12-22T09:17:12.524227+0000","last_clean":"2023-12-22T09:17:12.524227+0000","last_became_active":"2023-12-22T09:17:12.049825+0000","last_became_peered":"2023-12-22T09:17:12.049825+0000","last_unstale":"2023-12-22T09:17:12.524227+0000","last_undegraded":"2023-12-22T09:17:12.524227+0000","last_fullsized":"2023-12-22T09:17:12.524227+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:03:50.660868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.521873+0000","last_change":"2023-12-22T09:16:58.147612+0000","last_active":"2023-12-22T09:17:12.521873+0000","last_peered":"2023-12-22T09:17:12.521873+0000","last_clean":"2023-12-22T09:17:12.521873+0000","last_became_active":"2023-12-22T09:16:58.147333+0000","last_became_peered":"2023-12-22T09:16:58.147333+0000","last_unstale":"2023-12-22T09:17:12.521873+0000","last_undegraded":"2023-12-22T09:17:12.521873+0000","last_fullsized":"2023-12-22T09:17:12.521873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:55.463677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":30,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.522232+0000","last_change":"2023-12-22T09:17:11.042027+0000","last_active":"2023-12-22T09:17:12.522232+0000","last_peered":"2023-12-22T09:17:12.522232+0000","last_clean":"2023-12-22T09:17:12.522232+0000","last_became_active":"2023-12-22T09:17:11.038601+0000","last_became_peered":"2023-12-22T09:17:11.038601+0000","last_unstale":"2023-12-22T09:17:12.522232+0000","last_undegraded":"2023-12-22T09:17:12.522232+0000","last_fullsized":"2023-12-22T09:17:12.522232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:48.928040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.654978+0000","last_change":"2023-12-22T09:17:12.533590+0000","last_active":"2023-12-22T09:17:13.654978+0000","last_peered":"2023-12-22T09:17:13.654978+0000","last_clean":"2023-12-22T09:17:13.654978+0000","last_became_active":"2023-12-22T09:17:12.533150+0000","last_became_peered":"2023-12-22T09:17:12.533150+0000","last_unstale":"2023-12-22T09:17:13.654978+0000","last_undegraded":"2023-12-22T09:17:13.654978+0000","last_fullsized":"2023-12-22T09:17:13.654978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:46:40.356945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.525921+0000","last_change":"2023-12-22T09:17:12.056793+0000","last_active":"2023-12-22T09:17:12.525921+0000","last_peered":"2023-12-22T09:17:12.525921+0000","last_clean":"2023-12-22T09:17:12.525921+0000","last_became_active":"2023-12-22T09:17:12.056485+0000","last_became_peered":"2023-12-22T09:17:12.056485+0000","last_unstale":"2023-12-22T09:17:12.525921+0000","last_undegraded":"2023-12-22T09:17:12.525921+0000","last_fullsized":"2023-12-22T09:17:12.525921+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:10:15.433618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.520080+0000","last_change":"2023-12-22T09:16:58.122982+0000","last_active":"2023-12-22T09:17:12.520080+0000","last_peered":"2023-12-22T09:17:12.520080+0000","last_clean":"2023-12-22T09:17:12.520080+0000","last_became_active":"2023-12-22T09:16:58.122683+0000","last_became_peered":"2023-12-22T09:16:58.122683+0000","last_unstale":"2023-12-22T09:17:12.520080+0000","last_undegraded":"2023-12-22T09:17:12.520080+0000","last_fullsized":"2023-12-22T09:17:12.520080+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:03:37.012223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.518891+0000","last_change":"2023-12-22T09:16:57.652367+0000","last_active":"2023-12-22T09:17:12.518891+0000","last_peered":"2023-12-22T09:17:12.518891+0000","last_clean":"2023-12-22T09:17:12.518891+0000","last_became_active":"2023-12-22T09:16:57.651997+0000","last_became_peered":"2023-12-22T09:16:57.651997+0000","last_unstale":"2023-12-22T09:17:12.518891+0000","last_undegraded":"2023-12-22T09:17:12.518891+0000","last_fullsized":"2023-12-22T09:17:12.518891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786227+0000","last_change":"2023-12-22T09:17:12.540652+0000","last_active":"2023-12-22T09:17:13.786227+0000","last_peered":"2023-12-22T09:17:13.786227+0000","last_clean":"2023-12-22T09:17:13.786227+0000","last_became_active":"2023-12-22T09:17:12.540378+0000","last_became_peered":"2023-12-22T09:17:12.540378+0000","last_unstale":"2023-12-22T09:17:13.786227+0000","last_undegraded":"2023-12-22T09:17:13.786227+0000","last_fullsized":"2023-12-22T09:17:13.786227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:08.734786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.533334+0000","last_change":"2023-12-22T09:17:12.045827+0000","last_active":"2023-12-22T09:17:12.533334+0000","last_peered":"2023-12-22T09:17:12.533334+0000","last_clean":"2023-12-22T09:17:12.533334+0000","last_became_active":"2023-12-22T09:17:12.045562+0000","last_became_peered":"2023-12-22T09:17:12.045562+0000","last_unstale":"2023-12-22T09:17:12.533334+0000","last_undegraded":"2023-12-22T09:17:12.533334+0000","last_fullsized":"2023-12-22T09:17:12.533334+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:00.845862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.518595+0000","last_change":"2023-12-22T09:16:58.134298+0000","last_active":"2023-12-22T09:17:12.518595+0000","last_peered":"2023-12-22T09:17:12.518595+0000","last_clean":"2023-12-22T09:17:12.518595+0000","last_became_active":"2023-12-22T09:16:58.134027+0000","last_became_peered":"2023-12-22T09:16:58.134027+0000","last_unstale":"2023-12-22T09:17:12.518595+0000","last_undegraded":"2023-12-22T09:17:12.518595+0000","last_fullsized":"2023-12-22T09:17:12.518595+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:19:31.688365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.517237+0000","last_change":"2023-12-22T09:16:57.651565+0000","last_active":"2023-12-22T09:17:12.517237+0000","last_peered":"2023-12-22T09:17:12.517237+0000","last_clean":"2023-12-22T09:17:12.517237+0000","last_became_active":"2023-12-22T09:16:57.651295+0000","last_became_peered":"2023-12-22T09:16:57.651295+0000","last_unstale":"2023-12-22T09:17:12.517237+0000","last_undegraded":"2023-12-22T09:17:12.517237+0000","last_fullsized":"2023-12-22T09:17:12.517237+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:54:18.179171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.516601+0000","last_change":"2023-12-22T09:17:12.523916+0000","last_active":"2023-12-22T09:17:13.516601+0000","last_peered":"2023-12-22T09:17:13.516601+0000","last_clean":"2023-12-22T09:17:13.516601+0000","last_became_active":"2023-12-22T09:17:12.519420+0000","last_became_peered":"2023-12-22T09:17:12.519420+0000","last_unstale":"2023-12-22T09:17:13.516601+0000","last_undegraded":"2023-12-22T09:17:13.516601+0000","last_fullsized":"2023-12-22T09:17:13.516601+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:27:28.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.527996+0000","last_change":"2023-12-22T09:17:12.045851+0000","last_active":"2023-12-22T09:17:12.527996+0000","last_peered":"2023-12-22T09:17:12.527996+0000","last_clean":"2023-12-22T09:17:12.527996+0000","last_became_active":"2023-12-22T09:17:12.045148+0000","last_became_peered":"2023-12-22T09:17:12.045148+0000","last_unstale":"2023-12-22T09:17:12.527996+0000","last_undegraded":"2023-12-22T09:17:12.527996+0000","last_fullsized":"2023-12-22T09:17:12.527996+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:28:17.921536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509202+0000","last_change":"2023-12-22T09:16:58.142640+0000","last_active":"2023-12-22T09:17:12.509202+0000","last_peered":"2023-12-22T09:17:12.509202+0000","last_clean":"2023-12-22T09:17:12.509202+0000","last_became_active":"2023-12-22T09:16:58.142334+0000","last_became_peered":"2023-12-22T09:16:58.142334+0000","last_unstale":"2023-12-22T09:17:12.509202+0000","last_undegraded":"2023-12-22T09:17:12.509202+0000","last_fullsized":"2023-12-22T09:17:12.509202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:35:36.019628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.502123+0000","last_change":"2023-12-22T09:16:57.655954+0000","last_active":"2023-12-22T09:17:12.502123+0000","last_peered":"2023-12-22T09:17:12.502123+0000","last_clean":"2023-12-22T09:17:12.502123+0000","last_became_active":"2023-12-22T09:16:57.655335+0000","last_became_peered":"2023-12-22T09:16:57.655335+0000","last_unstale":"2023-12-22T09:17:12.502123+0000","last_undegraded":"2023-12-22T09:17:12.502123+0000","last_fullsized":"2023-12-22T09:17:12.502123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:56:13.676719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.785992+0000","last_change":"2023-12-22T09:17:12.542507+0000","last_active":"2023-12-22T09:17:13.785992+0000","last_peered":"2023-12-22T09:17:13.785992+0000","last_clean":"2023-12-22T09:17:13.785992+0000","last_became_active":"2023-12-22T09:17:12.542174+0000","last_became_peered":"2023-12-22T09:17:12.542174+0000","last_unstale":"2023-12-22T09:17:13.785992+0000","last_undegraded":"2023-12-22T09:17:13.785992+0000","last_fullsized":"2023-12-22T09:17:13.785992+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:01:17.585593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509527+0000","last_change":"2023-12-22T09:17:12.034651+0000","last_active":"2023-12-22T09:17:12.509527+0000","last_peered":"2023-12-22T09:17:12.509527+0000","last_clean":"2023-12-22T09:17:12.509527+0000","last_became_active":"2023-12-22T09:17:12.034345+0000","last_became_peered":"2023-12-22T09:17:12.034345+0000","last_unstale":"2023-12-22T09:17:12.509527+0000","last_undegraded":"2023-12-22T09:17:12.509527+0000","last_fullsized":"2023-12-22T09:17:12.509527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:57:00.962453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510462+0000","last_change":"2023-12-22T09:16:58.121917+0000","last_active":"2023-12-22T09:17:12.510462+0000","last_peered":"2023-12-22T09:17:12.510462+0000","last_clean":"2023-12-22T09:17:12.510462+0000","last_became_active":"2023-12-22T09:16:58.118511+0000","last_became_peered":"2023-12-22T09:16:58.118511+0000","last_unstale":"2023-12-22T09:17:12.510462+0000","last_undegraded":"2023-12-22T09:17:12.510462+0000","last_fullsized":"2023-12-22T09:17:12.510462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:33:40.126107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.530416+0000","last_change":"2023-12-22T09:16:57.647202+0000","last_active":"2023-12-22T09:17:12.530416+0000","last_peered":"2023-12-22T09:17:12.530416+0000","last_clean":"2023-12-22T09:17:12.530416+0000","last_became_active":"2023-12-22T09:16:57.646930+0000","last_became_peered":"2023-12-22T09:16:57.646930+0000","last_unstale":"2023-12-22T09:17:12.530416+0000","last_undegraded":"2023-12-22T09:17:12.530416+0000","last_fullsized":"2023-12-22T09:17:12.530416+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:40.073052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.786282+0000","last_change":"2023-12-22T09:17:12.541669+0000","last_active":"2023-12-22T09:17:13.786282+0000","last_peered":"2023-12-22T09:17:13.786282+0000","last_clean":"2023-12-22T09:17:13.786282+0000","last_became_active":"2023-12-22T09:17:12.541434+0000","last_became_peered":"2023-12-22T09:17:12.541434+0000","last_unstale":"2023-12-22T09:17:13.786282+0000","last_undegraded":"2023-12-22T09:17:13.786282+0000","last_fullsized":"2023-12-22T09:17:13.786282+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:43.383228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.500227+0000","last_change":"2023-12-22T09:17:12.041706+0000","last_active":"2023-12-22T09:17:12.500227+0000","last_peered":"2023-12-22T09:17:12.500227+0000","last_clean":"2023-12-22T09:17:12.500227+0000","last_became_active":"2023-12-22T09:17:12.041413+0000","last_became_peered":"2023-12-22T09:17:12.041413+0000","last_unstale":"2023-12-22T09:17:12.500227+0000","last_undegraded":"2023-12-22T09:17:12.500227+0000","last_fullsized":"2023-12-22T09:17:12.500227+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:44.983134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.528209+0000","last_change":"2023-12-22T09:16:58.139737+0000","last_active":"2023-12-22T09:17:12.528209+0000","last_peered":"2023-12-22T09:17:12.528209+0000","last_clean":"2023-12-22T09:17:12.528209+0000","last_became_active":"2023-12-22T09:16:58.139455+0000","last_became_peered":"2023-12-22T09:16:58.139455+0000","last_unstale":"2023-12-22T09:17:12.528209+0000","last_undegraded":"2023-12-22T09:17:12.528209+0000","last_fullsized":"2023-12-22T09:17:12.528209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:21.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.511076+0000","last_change":"2023-12-22T09:16:57.640845+0000","last_active":"2023-12-22T09:17:12.511076+0000","last_peered":"2023-12-22T09:17:12.511076+0000","last_clean":"2023-12-22T09:17:12.511076+0000","last_became_active":"2023-12-22T09:16:57.640523+0000","last_became_peered":"2023-12-22T09:16:57.640523+0000","last_unstale":"2023-12-22T09:17:12.511076+0000","last_undegraded":"2023-12-22T09:17:12.511076+0000","last_fullsized":"2023-12-22T09:17:12.511076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:11.216158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519019+0000","last_change":"2023-12-22T09:17:12.534422+0000","last_active":"2023-12-22T09:17:13.519019+0000","last_peered":"2023-12-22T09:17:13.519019+0000","last_clean":"2023-12-22T09:17:13.519019+0000","last_became_active":"2023-12-22T09:17:12.534170+0000","last_became_peered":"2023-12-22T09:17:12.534170+0000","last_unstale":"2023-12-22T09:17:13.519019+0000","last_undegraded":"2023-12-22T09:17:13.519019+0000","last_fullsized":"2023-12-22T09:17:13.519019+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:14:37.881358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.506696+0000","last_change":"2023-12-22T09:17:12.041999+0000","last_active":"2023-12-22T09:17:12.506696+0000","last_peered":"2023-12-22T09:17:12.506696+0000","last_clean":"2023-12-22T09:17:12.506696+0000","last_became_active":"2023-12-22T09:17:12.041632+0000","last_became_peered":"2023-12-22T09:17:12.041632+0000","last_unstale":"2023-12-22T09:17:12.506696+0000","last_undegraded":"2023-12-22T09:17:12.506696+0000","last_fullsized":"2023-12-22T09:17:12.506696+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:24.728438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.502590+0000","last_change":"2023-12-22T09:16:58.136215+0000","last_active":"2023-12-22T09:17:12.502590+0000","last_peered":"2023-12-22T09:17:12.502590+0000","last_clean":"2023-12-22T09:17:12.502590+0000","last_became_active":"2023-12-22T09:16:58.135936+0000","last_became_peered":"2023-12-22T09:16:58.135936+0000","last_unstale":"2023-12-22T09:17:12.502590+0000","last_undegraded":"2023-12-22T09:17:12.502590+0000","last_fullsized":"2023-12-22T09:17:12.502590+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:43.311422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.508952+0000","last_change":"2023-12-22T09:16:57.641987+0000","last_active":"2023-12-22T09:17:12.508952+0000","last_peered":"2023-12-22T09:17:12.508952+0000","last_clean":"2023-12-22T09:17:12.508952+0000","last_became_active":"2023-12-22T09:16:57.641712+0000","last_became_peered":"2023-12-22T09:16:57.641712+0000","last_unstale":"2023-12-22T09:17:12.508952+0000","last_undegraded":"2023-12-22T09:17:12.508952+0000","last_fullsized":"2023-12-22T09:17:12.508952+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:33.101510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.519359+0000","last_change":"2023-12-22T09:17:12.537866+0000","last_active":"2023-12-22T09:17:13.519359+0000","last_peered":"2023-12-22T09:17:13.519359+0000","last_clean":"2023-12-22T09:17:13.519359+0000","last_became_active":"2023-12-22T09:17:12.537136+0000","last_became_peered":"2023-12-22T09:17:12.537136+0000","last_unstale":"2023-12-22T09:17:13.519359+0000","last_undegraded":"2023-12-22T09:17:13.519359+0000","last_fullsized":"2023-12-22T09:17:13.519359+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:14.639137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.516654+0000","last_change":"2023-12-22T09:17:12.031115+0000","last_active":"2023-12-22T09:17:12.516654+0000","last_peered":"2023-12-22T09:17:12.516654+0000","last_clean":"2023-12-22T09:17:12.516654+0000","last_became_active":"2023-12-22T09:17:12.030513+0000","last_became_peered":"2023-12-22T09:17:12.030513+0000","last_unstale":"2023-12-22T09:17:12.516654+0000","last_undegraded":"2023-12-22T09:17:12.516654+0000","last_fullsized":"2023-12-22T09:17:12.516654+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:15.941299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.516678+0000","last_change":"2023-12-22T09:16:58.150323+0000","last_active":"2023-12-22T09:17:12.516678+0000","last_peered":"2023-12-22T09:17:12.516678+0000","last_clean":"2023-12-22T09:17:12.516678+0000","last_became_active":"2023-12-22T09:16:58.150063+0000","last_became_peered":"2023-12-22T09:16:58.150063+0000","last_unstale":"2023-12-22T09:17:12.516678+0000","last_undegraded":"2023-12-22T09:17:12.516678+0000","last_fullsized":"2023-12-22T09:17:12.516678+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:25.054982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.500501+0000","last_change":"2023-12-22T09:16:57.643219+0000","last_active":"2023-12-22T09:17:12.500501+0000","last_peered":"2023-12-22T09:17:12.500501+0000","last_clean":"2023-12-22T09:17:12.500501+0000","last_became_active":"2023-12-22T09:16:57.642986+0000","last_became_peered":"2023-12-22T09:16:57.642986+0000","last_unstale":"2023-12-22T09:17:12.500501+0000","last_undegraded":"2023-12-22T09:17:12.500501+0000","last_fullsized":"2023-12-22T09:17:12.500501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:01.540292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-22T09:17:13.517474+0000","last_change":"2023-12-22T09:17:12.536234+0000","last_active":"2023-12-22T09:17:13.517474+0000","last_peered":"2023-12-22T09:17:13.517474+0000","last_clean":"2023-12-22T09:17:13.517474+0000","last_became_active":"2023-12-22T09:17:12.535964+0000","last_became_peered":"2023-12-22T09:17:12.535964+0000","last_unstale":"2023-12-22T09:17:13.517474+0000","last_undegraded":"2023-12-22T09:17:13.517474+0000","last_fullsized":"2023-12-22T09:17:13.517474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:11.997050+0000","last_clean_scrub_stamp":"2023-12-22T09:17:11.997050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:13.049502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.510821+0000","last_change":"2023-12-22T09:17:12.028656+0000","last_active":"2023-12-22T09:17:12.510821+0000","last_peered":"2023-12-22T09:17:12.510821+0000","last_clean":"2023-12-22T09:17:12.510821+0000","last_became_active":"2023-12-22T09:17:12.028097+0000","last_became_peered":"2023-12-22T09:17:12.028097+0000","last_unstale":"2023-12-22T09:17:12.510821+0000","last_undegraded":"2023-12-22T09:17:12.510821+0000","last_fullsized":"2023-12-22T09:17:12.510821+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:17:10.982789+0000","last_clean_scrub_stamp":"2023-12-22T09:17:10.982789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:33:46.996428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.507919+0000","last_change":"2023-12-22T09:16:58.125951+0000","last_active":"2023-12-22T09:17:12.507919+0000","last_peered":"2023-12-22T09:17:12.507919+0000","last_clean":"2023-12-22T09:17:12.507919+0000","last_became_active":"2023-12-22T09:16:58.125435+0000","last_became_peered":"2023-12-22T09:16:58.125435+0000","last_unstale":"2023-12-22T09:17:12.507919+0000","last_undegraded":"2023-12-22T09:17:12.507919+0000","last_fullsized":"2023-12-22T09:17:12.507919+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:57.598810+0000","last_clean_scrub_stamp":"2023-12-22T09:16:57.598810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:30:10.376413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.509882+0000","last_change":"2023-12-22T09:16:57.639438+0000","last_active":"2023-12-22T09:17:12.509882+0000","last_peered":"2023-12-22T09:17:12.509882+0000","last_clean":"2023-12-22T09:17:12.509882+0000","last_became_active":"2023-12-22T09:16:57.639148+0000","last_became_peered":"2023-12-22T09:16:57.639148+0000","last_unstale":"2023-12-22T09:17:12.509882+0000","last_undegraded":"2023-12-22T09:17:12.509882+0000","last_fullsized":"2023-12-22T09:17:12.509882+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:16:56.581783+0000","last_clean_scrub_stamp":"2023-12-22T09:16:56.581783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:36.593161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-22T09:17:12.527491+0000","last_change":"2023-12-22T09:14:18.675126+0000","last_active":"2023-12-22T09:17:12.527491+0000","last_peered":"2023-12-22T09:17:12.527491+0000","last_clean":"2023-12-22T09:17:12.527491+0000","last_became_active":"2023-12-22T09:14:18.672655+0000","last_became_peered":"2023-12-22T09:14:18.672655+0000","last_unstale":"2023-12-22T09:17:12.527491+0000","last_undegraded":"2023-12-22T09:17:12.527491+0000","last_fullsized":"2023-12-22T09:17:12.527491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T09:14:17.057519+0000","last_clean_scrub_stamp":"2023-12-22T09:14:17.057519+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:16.166184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3857,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1384448,"data_stored":949457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.173,"15min":1.1870000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.1060000000000001,"15min":1.129},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.409,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.95999999999999996}]},{"osd":1,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1910000000000001,"15min":1.1990000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.006,"5min":1.2769999999999999,"15min":1.3220000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.339,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.0580000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1539999999999999,"15min":1.1739999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.3799999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.3759999999999999,"15min":1.4059999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":1.365}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.24,"15min":1.256},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.427,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.109},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3600000000000001,"15min":1.3720000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.79600000000000004}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.268,"15min":1.2809999999999999},"min":{"1min":0.81399999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7090000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":1.038,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.6319999999999999,"5min":2.8119999999999998,"15min":2.8119999999999998},"last":1.0229999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.458,"15min":1.427},"min":{"1min":0.91400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":8.1620000000000008,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":1.508},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.476,"15min":1.504},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.6220000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.5649999999999999,"15min":1.5740000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.554,"15min":1.581},"min":{"1min":1.127,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.655,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.1930000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":359889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.1100000000000001,"15min":1.1319999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.085,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4810000000000001,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":1.111}]},{"osd":1,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1459999999999999,"15min":1.1659999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.978,"15min":1.978},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.204,"15min":1.2190000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5189999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.2130000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.661,"5min":1.915,"15min":1.915},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.268,"15min":1.282},"min":{"1min":0.74099999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.194}]},{"osd":3,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4950000000000001,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3580000000000001,"15min":1.3740000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.736,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.29}]},{"osd":4,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.494,"15min":1.52},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8380000000000001,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.5549999999999999,"15min":1.585},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.722,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.5329999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.5760000000000001,"15min":1.6060000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.74,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.732},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.671,"15min":1.6970000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.952,"5min":3.3399999999999999,"15min":3.3399999999999999},"last":1.583}]},{"osd":7,"last update":"Fri Dec 22 09:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.6379999999999999,"15min":1.6619999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.859,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.6240000000000001,"15min":1.637},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":2.0459999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3380000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":778240,"data_stored":358347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":0.97099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3240000000000001,"5min":1.677,"15min":1.677},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0389999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.4650000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.92800000000000005}]},{"osd":1,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.107,"15min":1.1180000000000001},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.48,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.24,"15min":1.26},"min":{"1min":0.73499999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.802,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.381}]},{"osd":2,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2230000000000001,"15min":1.2390000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5449999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.159,"15min":1.169},"min":{"1min":0.748,"5min":0.629,"15min":0.629},"max":{"1min":1.4419999999999999,"5min":1.762,"15min":1.762},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.256,"15min":1.264},"min":{"1min":0.88,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5640000000000001,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.284},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.284,"15min":1.306},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.8089999999999999,"5min":2.431,"15min":2.431},"last":1.228}]},{"osd":4,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.304,"15min":1.3120000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5629999999999999,"5min":1.889,"15min":1.889},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4870000000000001,"15min":1.5},"min":{"1min":0.874,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.4890000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4099999999999999,"15min":1.4299999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.982,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.53},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4179999999999999,"15min":1.4359999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7889999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.7629999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.464,"15min":1.48},"min":{"1min":0.97499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.8540000000000001,"5min":3.298,"15min":3.298},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.504,"15min":1.5249999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.0899999999999999,"5min":2.589,"15min":2.589},"last":1.877}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":363018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3320000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.292},{"interface":"front","average":{"1min":1.083,"5min":1.115,"15min":1.121},"min":{"1min":0.70399999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5409999999999999,"5min":2.25,"15min":2.25},"last":1.016}]},{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.113,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.345,"5min":1.782,"15min":1.782},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.038,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.425,"5min":1.494,"15min":1.494},"last":1.1080000000000001}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4890000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.2130000000000001,"15min":1.224},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7749999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.2490000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.1319999999999999,"15min":1.149},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.542,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.508},{"interface":"front","average":{"1min":1.161,"5min":1.2929999999999999,"15min":1.3149999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.4690000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.6060000000000001}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3320000000000001,"15min":1.3520000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.909,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.139},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.268,"15min":1.286},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.679,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.1950000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.367,"15min":1.399},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4950000000000001,"5min":2.052,"15min":2.052},"last":1.546},{"interface":"front","average":{"1min":1.355,"5min":1.5069999999999999,"15min":1.5329999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.4079999999999999,"15min":1.4350000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.7470000000000001,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.375},{"interface":"front","average":{"1min":1.339,"5min":1.512,"15min":1.5409999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.629,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.655}]}]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":774144,"data_stored":358873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.86499999999999999,"15min":0.875},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":1.1479999999999999,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.88500000000000001,"15min":0.89700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.627,"5min":1.716,"15min":1.716},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4430000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.04,"15min":1.05},"min":{"1min":0.65500000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.028}]},{"osd":2,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.093,"15min":1.105},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1719999999999999,"15min":1.1899999999999999},"min":{"1min":0.66700000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4019999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.26}]},{"osd":4,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.244,"15min":1.25},"min":{"1min":0.90900000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.722,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.115},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.3680000000000001,"15min":1.3859999999999999},"min":{"1min":0.92200000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.571,"5min":2.508,"15min":2.508},"last":1.2969999999999999}]},{"osd":5,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":2.0030000000000001,"15min":2.1219999999999999},"min":{"1min":0.86299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6519999999999999,"5min":24.245999999999999,"15min":24.245999999999999},"last":1.647},{"interface":"front","average":{"1min":1.258,"5min":2.254,"15min":2.4199999999999999},"min":{"1min":0.89500000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.6739999999999999,"5min":32.527999999999999,"15min":32.527999999999999},"last":1.5229999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":2.423,"15min":2.6219999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.752,"5min":33.103999999999999,"15min":33.103999999999999},"last":1.468},{"interface":"front","average":{"1min":1.3460000000000001,"5min":2.1970000000000001,"15min":2.339},"min":{"1min":0.98999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.722,"5min":27.181999999999999,"15min":27.181999999999999},"last":1.5880000000000001}]},{"osd":7,"last update":"Fri Dec 22 09:16:22 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":2,"15min":2.121},"min":{"1min":1.016,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5069999999999999,"5min":22.715,"15min":22.715},"last":1.633},{"interface":"front","average":{"1min":1.3260000000000001,"5min":2.3860000000000001,"15min":2.5619999999999998},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.643,"5min":30.108000000000001,"15min":30.108000000000001},"last":1.663}]}]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":782336,"data_stored":359033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.85599999999999998,"15min":0.88},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.395,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.95699999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.381,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.98399999999999999,"15min":1.0069999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.357,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.98899999999999999,"15min":1.002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.5489999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.75}]},{"osd":3,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0049999999999999,"15min":1.016},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5289999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.173,"15min":1.1910000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6279999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.96099999999999997}]},{"osd":4,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.377,"15min":1.4179999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6160000000000001,"5min":2.802,"15min":2.802},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.276,"5min":1.4139999999999999,"15min":1.4370000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.758,"5min":2.46,"15min":2.46},"last":1.093}]},{"osd":5,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2889999999999999,"15min":1.323},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.595,"5min":3.327,"15min":3.327},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.371,"15min":1.399},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.4279999999999999,"15min":1.452},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.9950000000000001,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.429},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.369,"15min":1.3999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.554,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":1.542}]},{"osd":7,"last update":"Fri Dec 22 09:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.4870000000000001,"15min":1.516},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.823,"5min":2.867,"15min":2.867},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4670000000000001,"15min":1.4950000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.724,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":1.4830000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":362226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.879,"15min":0.90700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.262,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3260000000000001,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.90600000000000003,"15min":0.92800000000000005},"min":{"1min":0.443,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.218,"5min":1.504,"15min":1.504},"last":0.874},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.103,"15min":1.143},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.282,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":1.0409999999999999,"15min":1.0700000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.54,"5min":2.5640000000000001,"15min":2.5640000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.266,"15min":1.3069999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4430000000000001,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.222,"15min":1.2430000000000001},"min":{"1min":0.68799999999999994,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4330000000000001,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.3129999999999999,"15min":1.3500000000000001},"min":{"1min":0.77200000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6599999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.4019999999999999,"15min":1.4299999999999999},"min":{"1min":0.85599999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.1720000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.214,"5min":1.534,"15min":1.5880000000000001},"min":{"1min":0.71199999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.649,"5min":4.524,"15min":4.524},"last":0.86199999999999999}]},{"osd":6,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.5349999999999999,"15min":1.581},"min":{"1min":0.80900000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.8180000000000001,"5min":4.4189999999999996,"15min":4.4189999999999996},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3879999999999999,"15min":1.4139999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.881,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":0.90100000000000002}]},{"osd":7,"last update":"Fri Dec 22 09:16:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.474,"15min":1.5089999999999999},"min":{"1min":0.79800000000000004,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.29,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.998},{"interface":"front","average":{"1min":1.319,"5min":1.52,"15min":1.554},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.766,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.80400000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":948659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.997,"15min":1.0229999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2689999999999999,"5min":1.548,"15min":1.548},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.98099999999999998,"15min":1.0129999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.242,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.1930000000000001,"15min":1.238},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6120000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.0900000000000001,"15min":1.1319999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3939999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.1799999999999999,"15min":1.1990000000000001},"min":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.601,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.093,"5min":1.357,"15min":1.401},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":3.589,"15min":3.589},"last":1.129}]},{"osd":5,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.2010000000000001,"15min":1.2150000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5920000000000001,"5min":1.748,"15min":1.748},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.72599999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.49,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.048}]},{"osd":6,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.268,"15min":1.282},"min":{"1min":0.77200000000000002,"5min":0.748,"15min":0.748},"max":{"1min":1.611,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.155},{"interface":"front","average":{"1min":1.155,"5min":1.3069999999999999,"15min":1.333},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5189999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Dec 22 09:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.365,"15min":1.3879999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8109999999999999,"5min":2.157,"15min":2.157},"last":1.103},{"interface":"front","average":{"1min":1.22,"5min":1.419,"15min":1.452},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6439999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.84699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T09:17:22.477 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T09:17:22.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-22T09:17:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.729+0000 7f73c96ec640 1 Processor -- start 2023-12-22T09:17:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.729+0000 7f73c96ec640 1 -- start start 2023-12-22T09:17:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.730+0000 7f73c96ec640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f73c40c6150 0x7f73c40c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.730+0000 7f73c96ec640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c40c4560 con 0x7f73c406ca00 2023-12-22T09:17:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.730+0000 7f73c96ec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c4154720 con 0x7f73c40c7640 2023-12-22T09:17:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.730+0000 7f73c96ec640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c40c4f90 con 0x7f73c40c6150 2023-12-22T09:17:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.731+0000 7f73c2ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f73c40c6150 0x7f73c40c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.731+0000 7f73c37fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f73c406ca00 0x7f73c406b8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40658/0 (socket says 172.21.15.106:40658) 2023-12-22T09:17:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.731+0000 7f73c2ffd640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f73c40c6150 0x7f73c40c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39096/0 (socket says 172.21.15.106:39096) 2023-12-22T09:17:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.731+0000 7f73c37fe640 1 -- 172.21.15.106:0/3692890528 learned_addr learned my addr 172.21.15.106:0/3692890528 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.731+0000 7f73c2ffd640 1 -- 172.21.15.106:0/3692890528 >> v1:172.21.15.132:6789/0 conn(0x7f73c40c7640 legacy=0x7f73c406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.731+0000 7f73c2ffd640 1 -- 172.21.15.106:0/3692890528 >> v1:172.21.15.106:6789/0 conn(0x7f73c406ca00 legacy=0x7f73c406b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.731+0000 7f73c2ffd640 1 -- 172.21.15.106:0/3692890528 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4154c50 con 0x7f73c40c6150 2023-12-22T09:17:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.731+0000 7f73c1ffb640 1 -- 172.21.15.106:0/3692890528 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107133765 0 0) 0x7f73c40c4560 con 0x7f73c406ca00 2023-12-22T09:17:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.732+0000 7f73c2ffd640 1 --2- 172.21.15.106:0/3692890528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c40c6150 0x7f73c40c6530 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009d90 tx=0x7f73b402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af71018f8a79a321 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c1ffb640 1 -- 172.21.15.106:0/3692890528 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b402cb40 con 0x7f73c40c6150 2023-12-22T09:17:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c1ffb640 1 -- 172.21.15.106:0/3692890528 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b402cca0 con 0x7f73c40c6150 2023-12-22T09:17:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c1ffb640 1 -- 172.21.15.106:0/3692890528 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4034660 con 0x7f73c40c6150 2023-12-22T09:17:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c96ec640 1 -- 172.21.15.106:0/3692890528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c40c6150 msgr2=0x7f73c40c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c96ec640 1 --2- 172.21.15.106:0/3692890528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c40c6150 0x7f73c40c6530 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009d90 tx=0x7f73b402bd90 comp rx=0 tx=0).stop 2023-12-22T09:17:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c96ec640 1 -- 172.21.15.106:0/3692890528 shutdown_connections 2023-12-22T09:17:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c96ec640 1 --2- 172.21.15.106:0/3692890528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c40c6150 0x7f73c40c6530 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c96ec640 1 -- 172.21.15.106:0/3692890528 >> 172.21.15.106:0/3692890528 conn(0x7f73c40ab330 msgr2=0x7f73c40ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c96ec640 1 -- 172.21.15.106:0/3692890528 shutdown_connections 2023-12-22T09:17:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.733+0000 7f73c96ec640 1 -- 172.21.15.106:0/3692890528 wait complete. 2023-12-22T09:17:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.735+0000 7f73c96ec640 1 Processor -- start 2023-12-22T09:17:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.735+0000 7f73c96ec640 1 -- start start 2023-12-22T09:17:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.736+0000 7f73c96ec640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c406ca00 0x7f73c41474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.736+0000 7f73c96ec640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73c40c6150 0x7f73c414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.736+0000 7f73c96ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c40c7640 0x7f73c414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.736+0000 7f73c96ec640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c414ba30 con 0x7f73c406ca00 2023-12-22T09:17:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.736+0000 7f73c96ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c414e730 con 0x7f73c40c7640 2023-12-22T09:17:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.736+0000 7f73c96ec640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c41e9a00 con 0x7f73c40c6150 2023-12-22T09:17:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.736+0000 7f73c2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c406ca00 0x7f73c41474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.736+0000 7f73c2ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c406ca00 0x7f73c41474e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39108/0 (socket says 172.21.15.106:39108) 2023-12-22T09:17:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.736+0000 7f73c2ffd640 1 -- 172.21.15.106:0/4141997388 learned_addr learned my addr 172.21.15.106:0/4141997388 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73c37fe640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c40c7640 0x7f73c414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73c2ffd640 1 -- 172.21.15.106:0/4141997388 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73c40c6150 msgr2=0x7f73c414daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73c27fc640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73c40c6150 0x7f73c414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73c2ffd640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73c40c6150 0x7f73c414daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73c2ffd640 1 -- 172.21.15.106:0/4141997388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c40c7640 msgr2=0x7f73c414e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73c2ffd640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c40c7640 0x7f73c414e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73c2ffd640 1 -- 172.21.15.106:0/4141997388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b4009a70 con 0x7f73c406ca00 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73c37fe640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c40c7640 0x7f73c414e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73c2ffd640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c406ca00 0x7f73c41474e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009d90 tx=0x7f73b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73bb7fe640 1 -- 172.21.15.106:0/4141997388 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b403e610 con 0x7f73c406ca00 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.737+0000 7f73bb7fe640 1 -- 172.21.15.106:0/4141997388 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b403e770 con 0x7f73c406ca00 2023-12-22T09:17:22.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.738+0000 7f73bb7fe640 1 -- 172.21.15.106:0/4141997388 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b403eb20 con 0x7f73c406ca00 2023-12-22T09:17:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.738+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c41e9ce0 con 0x7f73c406ca00 2023-12-22T09:17:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.738+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c40c69a0 con 0x7f73c406ca00 2023-12-22T09:17:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.739+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c41e9840 con 0x7f73c406ca00 2023-12-22T09:17:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.740+0000 7f73bb7fe640 1 -- 172.21.15.106:0/4141997388 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f73b403b050 con 0x7f73c406ca00 2023-12-22T09:17:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.741+0000 7f73bb7fe640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f73a406a430 0x7f73a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.741+0000 7f73bb7fe640 1 -- 172.21.15.106:0/4141997388 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f73b40ab880 con 0x7f73c406ca00 2023-12-22T09:17:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.741+0000 7f73c27fc640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f73a406a430 0x7f73a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.742+0000 7f73c27fc640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f73a406a430 0x7f73a406c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f73c414b890 tx=0x7f73ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:22.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:22.745+0000 7f73bb7fe640 1 -- 172.21.15.106:0/4141997388 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f73b4076b10 con 0x7f73c406ca00 2023-12-22T09:17:23.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.009+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f73c414ea10 con 0x7f73c406ca00 2023-12-22T09:17:23.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.015+0000 7f73bb7fe640 1 -- 172.21.15.106:0/4141997388 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v17) v1 ==== 185+0+0 (secure 0 0 0) 0x7f73b40390e0 con 0x7f73c406ca00 2023-12-22T09:17:23.017 INFO:teuthology.orchestra.run.smithi106.stderr:updated caps for client.1 2023-12-22T09:17:23.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f73a406a430 msgr2=0x7f73a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f73a406a430 0x7f73a406c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f73c414b890 tx=0x7f73ac008040 comp rx=0 tx=0).stop 2023-12-22T09:17:23.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c406ca00 msgr2=0x7f73c41474e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c406ca00 0x7f73c41474e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009d90 tx=0x7f73b4004a40 comp rx=0 tx=0).stop 2023-12-22T09:17:23.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 shutdown_connections 2023-12-22T09:17:23.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f73a406a430 0x7f73a406c8f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c40c7640 0x7f73c414e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f73c40c6150 0x7f73c414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 --2- 172.21.15.106:0/4141997388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73c406ca00 0x7f73c41474e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 >> 172.21.15.106:0/4141997388 conn(0x7f73c40ab330 msgr2=0x7f73c40c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:23.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 shutdown_connections 2023-12-22T09:17:23.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.018+0000 7f73c96ec640 1 -- 172.21.15.106:0/4141997388 wait complete. 2023-12-22T09:17:23.037 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:17:23.037 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:17:23.098 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:17:23.099 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:17:23.149 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T09:17:23.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.362+0000 7f70c4c5f640 1 Processor -- start 2023-12-22T09:17:23.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.362+0000 7f70c4c5f640 1 -- start start 2023-12-22T09:17:23.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.363+0000 7f70c4c5f640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f70c0069e60 0x7f70c01551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.363+0000 7f70c4c5f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70c015c070 0x7f70c0155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.363+0000 7f70c4c5f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f70c0070480 0x7f70c00bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.363+0000 7f70c4c5f640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c015c5e0 con 0x7f70c0069e60 2023-12-22T09:17:23.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.363+0000 7f70c4c5f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c006fe60 con 0x7f70c0070480 2023-12-22T09:17:23.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.363+0000 7f70c4c5f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c0070140 con 0x7f70c015c070 2023-12-22T09:17:23.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.363+0000 7f70be59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f70c0069e60 0x7f70c01551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.364+0000 7f70be59c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f70c0069e60 0x7f70c01551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39124/0 (socket says 172.21.15.106:39124) 2023-12-22T09:17:23.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.364+0000 7f70be59c640 1 -- 172.21.15.106:0/2786542735 learned_addr learned my addr 172.21.15.106:0/2786542735 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:23.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.364+0000 7f70be59c640 1 -- 172.21.15.106:0/2786542735 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70c015c070 msgr2=0x7f70c0155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:23.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.364+0000 7f70be59c640 1 --2- 172.21.15.106:0/2786542735 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70c015c070 0x7f70c0155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.364+0000 7f70be59c640 1 -- 172.21.15.106:0/2786542735 >> v2:172.21.15.132:3300/0 conn(0x7f70c0070480 msgr2=0x7f70c00bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:23.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.364+0000 7f70be59c640 1 --2- 172.21.15.106:0/2786542735 >> v2:172.21.15.132:3300/0 conn(0x7f70c0070480 0x7f70c00bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.364+0000 7f70be59c640 1 -- 172.21.15.106:0/2786542735 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c00c1440 con 0x7f70c0069e60 2023-12-22T09:17:23.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.365+0000 7f70be59c640 1 --2- 172.21.15.106:0/2786542735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0069e60 0x7f70c01551f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f70c0070910 tx=0x7f70b002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6483241829a4d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:23.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.365+0000 7f70bdd9b640 1 -- 172.21.15.106:0/2786542735 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0004230 con 0x7f70c0069e60 2023-12-22T09:17:23.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.365+0000 7f70bdd9b640 1 -- 172.21.15.106:0/2786542735 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b0004390 con 0x7f70c0069e60 2023-12-22T09:17:23.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.365+0000 7f70bdd9b640 1 -- 172.21.15.106:0/2786542735 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0003810 con 0x7f70c0069e60 2023-12-22T09:17:23.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.366+0000 7f70c4c5f640 1 -- 172.21.15.106:0/2786542735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0069e60 msgr2=0x7f70c01551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.366+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/2786542735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0069e60 0x7f70c01551f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f70c0070910 tx=0x7f70b002b8f0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.366+0000 7f70c4c5f640 1 -- 172.21.15.106:0/2786542735 shutdown_connections 2023-12-22T09:17:23.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.366+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/2786542735 >> v2:172.21.15.132:3300/0 conn(0x7f70c0070480 0x7f70c00bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.366+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/2786542735 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70c015c070 0x7f70c0155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.366+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/2786542735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0069e60 0x7f70c01551f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.366+0000 7f70c4c5f640 1 -- 172.21.15.106:0/2786542735 >> 172.21.15.106:0/2786542735 conn(0x7f70c00c5360 msgr2=0x7f70c00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.366+0000 7f70c4c5f640 1 -- 172.21.15.106:0/2786542735 shutdown_connections 2023-12-22T09:17:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.366+0000 7f70c4c5f640 1 -- 172.21.15.106:0/2786542735 wait complete. 2023-12-22T09:17:23.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.368+0000 7f70c4c5f640 1 Processor -- start 2023-12-22T09:17:23.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.368+0000 7f70c4c5f640 1 -- start start 2023-12-22T09:17:23.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70c4c5f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70c0069e60 0x7f70c01f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70c4c5f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0070480 0x7f70c00c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70c4c5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70c015c070 0x7f70c01edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70c4c5f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c01e2f80 con 0x7f70c0070480 2023-12-22T09:17:23.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70c4c5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c01ed800 con 0x7f70c015c070 2023-12-22T09:17:23.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70c4c5f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c01f1cc0 con 0x7f70c0069e60 2023-12-22T09:17:23.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70b7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0070480 0x7f70c00c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70b7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0070480 0x7f70c00c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39132/0 (socket says 172.21.15.106:39132) 2023-12-22T09:17:23.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70b7fff640 1 -- 172.21.15.106:0/1719418946 learned_addr learned my addr 172.21.15.106:0/1719418946 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:23.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.369+0000 7f70be59c640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70c0069e60 0x7f70c01f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70bed9d640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70c015c070 0x7f70c01edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70b7fff640 1 -- 172.21.15.106:0/1719418946 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70c0069e60 msgr2=0x7f70c01f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70b7fff640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70c0069e60 0x7f70c01f1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70b7fff640 1 -- 172.21.15.106:0/1719418946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70c015c070 msgr2=0x7f70c01edf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70b7fff640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70c015c070 0x7f70c01edf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70b7fff640 1 -- 172.21.15.106:0/1719418946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0009460 con 0x7f70c0070480 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70b7fff640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0070480 0x7f70c00c41f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f70a800b4a0 tx=0x7f70a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70b6ffd640 1 -- 172.21.15.106:0/1719418946 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8010610 con 0x7f70c0070480 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70b6ffd640 1 -- 172.21.15.106:0/1719418946 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8010770 con 0x7f70c0070480 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70b6ffd640 1 -- 172.21.15.106:0/1719418946 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8010b20 con 0x7f70c0070480 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.370+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c01eda80 con 0x7f70c0070480 2023-12-22T09:17:23.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.371+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c01e4300 con 0x7f70c0070480 2023-12-22T09:17:23.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.372+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c01edc10 con 0x7f70c0070480 2023-12-22T09:17:23.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.373+0000 7f70b6ffd640 1 -- 172.21.15.106:0/1719418946 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f70a8010c80 con 0x7f70c0070480 2023-12-22T09:17:23.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.373+0000 7f70b6ffd640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f70a006a460 0x7f70a006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.374+0000 7f70b6ffd640 1 -- 172.21.15.106:0/1719418946 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f70a8088900 con 0x7f70c0070480 2023-12-22T09:17:23.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.374+0000 7f70be59c640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f70a006a460 0x7f70a006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.374+0000 7f70be59c640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f70a006a460 0x7f70a006c920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f70b0035000 tx=0x7f70b0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:23.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.378+0000 7f70b6ffd640 1 -- 172.21.15.106:0/1719418946 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70a8053a70 con 0x7f70c0070480 2023-12-22T09:17:23.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.570+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70c00c16f0 con 0x7f70c0070480 2023-12-22T09:17:23.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.573+0000 7f70b6ffd640 1 -- 172.21.15.106:0/1719418946 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+20206 (secure 0 0 0) 0x7f70a8014090 con 0x7f70c0070480 2023-12-22T09:17:23.574 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-12-22T09:17:23.574 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":64,"fsid":"c9422aac-a1e3-428b-87d0-2dbf321c6b46","created":"2023-12-22T09:14:03.865923+0000","modified":"2023-12-22T09:17:13.496319+0000","last_up_change":"2023-12-22T09:14:15.981333+0000","last_in_change":"2023-12-22T09:14:07.322286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T09:14:16.764498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-22T09:16:55.972567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-22T09:16:57.103965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-22T09:17:10.934795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-22T09:17:11.491287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cfdeeba0-d07e-4bf9-bba1-2a8275dccf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":88650},{"type":"v1","addr":"172.21.15.106:6801","nonce":88650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":88650},{"type":"v1","addr":"172.21.15.106:6803","nonce":88650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":88650},{"type":"v1","addr":"172.21.15.106:6807","nonce":88650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":88650},{"type":"v1","addr":"172.21.15.106:6805","nonce":88650}]},"public_addr":"172.21.15.106:6801/88650","cluster_addr":"172.21.15.106:6803/88650","heartbeat_back_addr":"172.21.15.106:6807/88650","heartbeat_front_addr":"172.21.15.106:6805/88650","state":["exists","up"]},{"osd":1,"uuid":"7c87401d-2d1c-4ab0-a241-1a265ec971ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":88652},{"type":"v1","addr":"172.21.15.106:6809","nonce":88652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":88652},{"type":"v1","addr":"172.21.15.106:6811","nonce":88652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":88652},{"type":"v1","addr":"172.21.15.106:6815","nonce":88652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":88652},{"type":"v1","addr":"172.21.15.106:6813","nonce":88652}]},"public_addr":"172.21.15.106:6809/88652","cluster_addr":"172.21.15.106:6811/88652","heartbeat_back_addr":"172.21.15.106:6815/88652","heartbeat_front_addr":"172.21.15.106:6813/88652","state":["exists","up"]},{"osd":2,"uuid":"f437f571-c91a-4169-8911-7468d972e39c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":88655},{"type":"v1","addr":"172.21.15.106:6817","nonce":88655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":88655},{"type":"v1","addr":"172.21.15.106:6819","nonce":88655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6825","nonce":88655},{"type":"v1","addr":"172.21.15.106:6827","nonce":88655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6821","nonce":88655},{"type":"v1","addr":"172.21.15.106:6823","nonce":88655}]},"public_addr":"172.21.15.106:6817/88655","cluster_addr":"172.21.15.106:6819/88655","heartbeat_back_addr":"172.21.15.106:6827/88655","heartbeat_front_addr":"172.21.15.106:6823/88655","state":["exists","up"]},{"osd":3,"uuid":"4946e22f-789e-4326-a11b-f6e65f518dfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":88666},{"type":"v1","addr":"172.21.15.106:6822","nonce":88666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":88666},{"type":"v1","addr":"172.21.15.106:6826","nonce":88666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":88666},{"type":"v1","addr":"172.21.15.106:6831","nonce":88666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":88666},{"type":"v1","addr":"172.21.15.106:6829","nonce":88666}]},"public_addr":"172.21.15.106:6822/88666","cluster_addr":"172.21.15.106:6826/88666","heartbeat_back_addr":"172.21.15.106:6831/88666","heartbeat_front_addr":"172.21.15.106:6829/88666","state":["exists","up"]},{"osd":4,"uuid":"8649cca0-8591-4ed5-bbaa-0e5209d8a53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":89139},{"type":"v1","addr":"172.21.15.132:6819","nonce":89139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":89139},{"type":"v1","addr":"172.21.15.132:6823","nonce":89139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":89139},{"type":"v1","addr":"172.21.15.132:6829","nonce":89139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":89139},{"type":"v1","addr":"172.21.15.132:6827","nonce":89139}]},"public_addr":"172.21.15.132:6819/89139","cluster_addr":"172.21.15.132:6823/89139","heartbeat_back_addr":"172.21.15.132:6829/89139","heartbeat_front_addr":"172.21.15.132:6827/89139","state":["exists","up"]},{"osd":5,"uuid":"52e2de6d-f709-4a50-9e16-f2f621898e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":89137},{"type":"v1","addr":"172.21.15.132:6801","nonce":89137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":89137},{"type":"v1","addr":"172.21.15.132:6803","nonce":89137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":89137},{"type":"v1","addr":"172.21.15.132:6807","nonce":89137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":89137},{"type":"v1","addr":"172.21.15.132:6805","nonce":89137}]},"public_addr":"172.21.15.132:6801/89137","cluster_addr":"172.21.15.132:6803/89137","heartbeat_back_addr":"172.21.15.132:6807/89137","heartbeat_front_addr":"172.21.15.132:6805/89137","state":["exists","up"]},{"osd":6,"uuid":"71c167ac-2694-4ce4-babf-7c899e6945f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":89138},{"type":"v1","addr":"172.21.15.132:6809","nonce":89138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":89138},{"type":"v1","addr":"172.21.15.132:6811","nonce":89138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":89138},{"type":"v1","addr":"172.21.15.132:6815","nonce":89138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":89138},{"type":"v1","addr":"172.21.15.132:6813","nonce":89138}]},"public_addr":"172.21.15.132:6809/89138","cluster_addr":"172.21.15.132:6811/89138","heartbeat_back_addr":"172.21.15.132:6815/89138","heartbeat_front_addr":"172.21.15.132:6813/89138","state":["exists","up"]},{"osd":7,"uuid":"8a8e873b-9dc5-4e8a-ba64-c7fc14baef98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":89142},{"type":"v1","addr":"172.21.15.132:6818","nonce":89142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":89142},{"type":"v1","addr":"172.21.15.132:6822","nonce":89142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":89142},{"type":"v1","addr":"172.21.15.132:6831","nonce":89142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":89142},{"type":"v1","addr":"172.21.15.132:6826","nonce":89142}]},"public_addr":"172.21.15.132:6818/89142","cluster_addr":"172.21.15.132:6822/89142","heartbeat_back_addr":"172.21.15.132:6831/89142","heartbeat_front_addr":"172.21.15.132:6826/89142","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.684344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.384009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.640753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.726649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.702975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.824250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.944873+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T09:14:12.247802+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.34","mappings":[{"from":7,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.575+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f70a006a460 msgr2=0x7f70a006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.575+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f70a006a460 0x7f70a006c920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f70b0035000 tx=0x7f70b0008030 comp rx=0 tx=0).stop 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.575+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0070480 msgr2=0x7f70c00c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.575+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0070480 0x7f70c00c41f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f70a800b4a0 tx=0x7f70a800b960 comp rx=0 tx=0).stop 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.576+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 shutdown_connections 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.576+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f70a006a460 0x7f70a006c920 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.576+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70c015c070 0x7f70c01edf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.576+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70c0070480 0x7f70c00c41f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.576+0000 7f70c4c5f640 1 --2- 172.21.15.106:0/1719418946 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70c0069e60 0x7f70c01f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.576+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 >> 172.21.15.106:0/1719418946 conn(0x7f70c00c5360 msgr2=0x7f70c0152210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.576+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 shutdown_connections 2023-12-22T09:17:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.576+0000 7f70c4c5f640 1 -- 172.21.15.106:0/1719418946 wait complete. 2023-12-22T09:17:23.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T09:14:16.764498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T09:16:55.972567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T09:16:57.103965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-22T09:17:10.934795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-22T09:17:11.491287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T09:17:23.597 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T09:17:23.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.804+0000 7f07e628b640 1 Processor -- start 2023-12-22T09:17:23.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.804+0000 7f07e628b640 1 -- start start 2023-12-22T09:17:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.805+0000 7f07e628b640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f07e00aa290 0x7f07e00c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.805+0000 7f07e628b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07e00c0790 0x7f07e00c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07e628b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e00c1c40 con 0x7f07e00c2550 2023-12-22T09:17:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07e628b640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00706c0 con 0x7f07e00aa290 2023-12-22T09:17:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07e628b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00708b0 con 0x7f07e00c0790 2023-12-22T09:17:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07dffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f07e00aa290 0x7f07e00c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07dffff640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f07e00aa290 0x7f07e00c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39138/0 (socket says 172.21.15.106:39138) 2023-12-22T09:17:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07dffff640 1 -- 172.21.15.106:0/2835102401 learned_addr learned my addr 172.21.15.106:0/2835102401 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07d7fff640 1 --2- 172.21.15.106:0/2835102401 >> v2:172.21.15.132:3300/0 conn(0x7f07e00c0790 0x7f07e00c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07dffff640 1 -- 172.21.15.106:0/2835102401 >> v2:172.21.15.132:3300/0 conn(0x7f07e00c0790 msgr2=0x7f07e00c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07dffff640 1 --2- 172.21.15.106:0/2835102401 >> v2:172.21.15.132:3300/0 conn(0x7f07e00c0790 0x7f07e00c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07dffff640 1 -- 172.21.15.106:0/2835102401 >> v1:172.21.15.132:6789/0 conn(0x7f07e00c2550 legacy=0x7f07e01543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.806+0000 7f07dffff640 1 -- 172.21.15.106:0/2835102401 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0070b50 con 0x7f07e00aa290 2023-12-22T09:17:23.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.807+0000 7f07dffff640 1 --2- 172.21.15.106:0/2835102401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 0x7f07e00c1700 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f07e01519f0 tx=0x7f07d002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9ef1773982b79a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.808+0000 7f07df7fe640 1 -- 172.21.15.106:0/2835102401 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00317e0 con 0x7f07e00aa290 2023-12-22T09:17:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.808+0000 7f07df7fe640 1 -- 172.21.15.106:0/2835102401 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0031940 con 0x7f07e00aa290 2023-12-22T09:17:23.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.808+0000 7f07df7fe640 1 -- 172.21.15.106:0/2835102401 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0031cd0 con 0x7f07e00aa290 2023-12-22T09:17:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.808+0000 7f07e628b640 1 -- 172.21.15.106:0/2835102401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 msgr2=0x7f07e00c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.808+0000 7f07e628b640 1 --2- 172.21.15.106:0/2835102401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 0x7f07e00c1700 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f07e01519f0 tx=0x7f07d002b880 comp rx=0 tx=0).stop 2023-12-22T09:17:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.808+0000 7f07e628b640 1 -- 172.21.15.106:0/2835102401 shutdown_connections 2023-12-22T09:17:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.808+0000 7f07e628b640 1 --2- 172.21.15.106:0/2835102401 >> v2:172.21.15.132:3300/0 conn(0x7f07e00c0790 0x7f07e00c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.808+0000 7f07e628b640 1 --2- 172.21.15.106:0/2835102401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 0x7f07e00c1700 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.808+0000 7f07e628b640 1 -- 172.21.15.106:0/2835102401 >> 172.21.15.106:0/2835102401 conn(0x7f07e0069dd0 msgr2=0x7f07e006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.809+0000 7f07e628b640 1 -- 172.21.15.106:0/2835102401 shutdown_connections 2023-12-22T09:17:23.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.809+0000 7f07e628b640 1 -- 172.21.15.106:0/2835102401 wait complete. 2023-12-22T09:17:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.811+0000 7f07e628b640 1 Processor -- start 2023-12-22T09:17:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.811+0000 7f07e628b640 1 -- start start 2023-12-22T09:17:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.812+0000 7f07e628b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 0x7f07e0153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.812+0000 7f07e628b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e00c0790 0x7f07e013ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.812+0000 7f07e628b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e00c2550 0x7f07e013f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.812+0000 7f07e628b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01e8d70 con 0x7f07e00aa290 2023-12-22T09:17:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.812+0000 7f07e628b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0155340 con 0x7f07e00c2550 2023-12-22T09:17:23.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.812+0000 7f07e628b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e011e860 con 0x7f07e00c0790 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.812+0000 7f07dffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 0x7f07e0153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.812+0000 7f07dffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 0x7f07e0153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39150/0 (socket says 172.21.15.106:39150) 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.812+0000 7f07dffff640 1 -- 172.21.15.106:0/3403853462 learned_addr learned my addr 172.21.15.106:0/3403853462 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07e4828640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e00c2550 0x7f07e013f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07d7fff640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e00c0790 0x7f07e013ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07dffff640 1 -- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e00c0790 msgr2=0x7f07e013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07dffff640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e00c0790 0x7f07e013ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07dffff640 1 -- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e00c2550 msgr2=0x7f07e013f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07dffff640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e00c2550 0x7f07e013f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07dffff640 1 -- 172.21.15.106:0/3403853462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00094d0 con 0x7f07e00aa290 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07d7fff640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e00c0790 0x7f07e013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07e4828640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e00c2550 0x7f07e013f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.813+0000 7f07dffff640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 0x7f07e0153470 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f07d002b8c0 tx=0x7f07d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:23.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.816+0000 7f07dd7fa640 1 -- 172.21.15.106:0/3403853462 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00329c0 con 0x7f07e00aa290 2023-12-22T09:17:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.816+0000 7f07dd7fa640 1 -- 172.21.15.106:0/3403853462 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0032b40 con 0x7f07e00aa290 2023-12-22T09:17:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.816+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e01ec690 con 0x7f07e00aa290 2023-12-22T09:17:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.816+0000 7f07dd7fa640 1 -- 172.21.15.106:0/3403853462 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00453f0 con 0x7f07e00aa290 2023-12-22T09:17:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.816+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e01ecc50 con 0x7f07e00aa290 2023-12-22T09:17:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.817+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e0073f10 con 0x7f07e00aa290 2023-12-22T09:17:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.818+0000 7f07dd7fa640 1 -- 172.21.15.106:0/3403853462 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f07d004d3f0 con 0x7f07e00aa290 2023-12-22T09:17:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.819+0000 7f07dd7fa640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f07c406a430 0x7f07c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.819+0000 7f07dd7fa640 1 -- 172.21.15.106:0/3403853462 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f07d00aad50 con 0x7f07e00aa290 2023-12-22T09:17:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.819+0000 7f07d7fff640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f07c406a430 0x7f07c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.820+0000 7f07d7fff640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f07c406a430 0x7f07c406c8f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f07e014d440 tx=0x7f07c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:23.823+0000 7f07dd7fa640 1 -- 172.21.15.106:0/3403853462 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f07d0075ed0 con 0x7f07e00aa290 2023-12-22T09:17:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.012+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07e00c0500 con 0x7f07e00aa290 2023-12-22T09:17:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.013+0000 7f07dd7fa640 1 -- 172.21.15.106:0/3403853462 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07d00794f0 con 0x7f07e00aa290 2023-12-22T09:17:24.013 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-12-22T09:17:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f07c406a430 msgr2=0x7f07c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f07c406a430 0x7f07c406c8f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f07e014d440 tx=0x7f07c8008040 comp rx=0 tx=0).stop 2023-12-22T09:17:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 msgr2=0x7f07e0153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 0x7f07e0153470 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f07d002b8c0 tx=0x7f07d00046c0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 shutdown_connections 2023-12-22T09:17:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f07c406a430 0x7f07c406c8f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07e00c2550 0x7f07e013f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07e00c0790 0x7f07e013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 --2- 172.21.15.106:0/3403853462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07e00aa290 0x7f07e0153470 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.015+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 >> 172.21.15.106:0/3403853462 conn(0x7f07e0069dd0 msgr2=0x7f07e01510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.016+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 shutdown_connections 2023-12-22T09:17:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.016+0000 7f07e628b640 1 -- 172.21.15.106:0/3403853462 wait complete. 2023-12-22T09:17:24.035 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T09:17:24.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.249+0000 7f85473b9640 1 Processor -- start 2023-12-22T09:17:24.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.249+0000 7f85473b9640 1 -- start start 2023-12-22T09:17:24.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.251+0000 7f85473b9640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f854006ca20 0x7f854006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.251+0000 7f85473b9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 0x7f854006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.251+0000 7f85473b9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85400bcc70 con 0x7f8540151400 2023-12-22T09:17:24.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.251+0000 7f85473b9640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85401517e0 con 0x7f854006ca20 2023-12-22T09:17:24.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.251+0000 7f85473b9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85400c4c90 con 0x7f85400c7620 2023-12-22T09:17:24.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.251+0000 7f8544954640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f854006ca20 0x7f854006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.251+0000 7f8545155640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8540151400 0x7f85400c6130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40668/0 (socket says 172.21.15.106:40668) 2023-12-22T09:17:24.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.251+0000 7f8545155640 1 -- 172.21.15.106:0/2066875322 learned_addr learned my addr 172.21.15.106:0/2066875322 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:24.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.251+0000 7f8545956640 1 --2- 172.21.15.106:0/2066875322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 0x7f854006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.252+0000 7f8544954640 1 -- 172.21.15.106:0/2066875322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 msgr2=0x7f854006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:24.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.252+0000 7f8544954640 1 --2- 172.21.15.106:0/2066875322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 0x7f854006b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.252+0000 7f8544954640 1 -- 172.21.15.106:0/2066875322 >> v1:172.21.15.106:6789/0 conn(0x7f8540151400 legacy=0x7f85400c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.252+0000 7f8544954640 1 -- 172.21.15.106:0/2066875322 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400c42d0 con 0x7f854006ca20 2023-12-22T09:17:24.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.252+0000 7f8537fff640 1 -- 172.21.15.106:0/2066875322 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819639254 0 0) 0x7f85400bcc70 con 0x7f8540151400 2023-12-22T09:17:24.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.253+0000 7f8544954640 1 --2- 172.21.15.106:0/2066875322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f854006ca20 0x7f854006b1e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f85300097a0 tx=0x7f853002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b347d6b215a3ea8a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:24.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.253+0000 7f8537fff640 1 -- 172.21.15.106:0/2066875322 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853002f050 con 0x7f854006ca20 2023-12-22T09:17:24.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.253+0000 7f8537fff640 1 -- 172.21.15.106:0/2066875322 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8530031700 con 0x7f854006ca20 2023-12-22T09:17:24.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.253+0000 7f8537fff640 1 -- 172.21.15.106:0/2066875322 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530031a90 con 0x7f854006ca20 2023-12-22T09:17:24.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.254+0000 7f85473b9640 1 -- 172.21.15.106:0/2066875322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f854006ca20 msgr2=0x7f854006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.254+0000 7f85473b9640 1 --2- 172.21.15.106:0/2066875322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f854006ca20 0x7f854006b1e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f85300097a0 tx=0x7f853002b7a0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.254+0000 7f85473b9640 1 -- 172.21.15.106:0/2066875322 shutdown_connections 2023-12-22T09:17:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.254+0000 7f85473b9640 1 --2- 172.21.15.106:0/2066875322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 0x7f854006b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.254+0000 7f85473b9640 1 --2- 172.21.15.106:0/2066875322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f854006ca20 0x7f854006b1e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.254+0000 7f85473b9640 1 -- 172.21.15.106:0/2066875322 >> 172.21.15.106:0/2066875322 conn(0x7f85400ab310 msgr2=0x7f85400ab6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.254+0000 7f85473b9640 1 -- 172.21.15.106:0/2066875322 shutdown_connections 2023-12-22T09:17:24.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.254+0000 7f85473b9640 1 -- 172.21.15.106:0/2066875322 wait complete. 2023-12-22T09:17:24.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.256+0000 7f85473b9640 1 Processor -- start 2023-12-22T09:17:24.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.256+0000 7f85473b9640 1 -- start start 2023-12-22T09:17:24.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f85473b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f854006ca20 0x7f85401e97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f85473b9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 0x7f85400aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f85473b9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540151400 0x7f85400c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f85473b9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401ec680 con 0x7f8540151400 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f85473b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85400c1ac0 con 0x7f854006ca20 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f85473b9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85401e8d90 con 0x7f85400c7620 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f8545956640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540151400 0x7f85400c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f8545956640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540151400 0x7f85400c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39162/0 (socket says 172.21.15.106:39162) 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f8545956640 1 -- 172.21.15.106:0/2899010761 learned_addr learned my addr 172.21.15.106:0/2899010761 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f8544954640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 0x7f85400aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.257+0000 7f8545155640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f854006ca20 0x7f85401e97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f8545956640 1 -- 172.21.15.106:0/2899010761 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 msgr2=0x7f85400aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f8545956640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 0x7f85400aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f8545956640 1 -- 172.21.15.106:0/2899010761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f854006ca20 msgr2=0x7f85401e97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f8545956640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f854006ca20 0x7f85401e97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f8545956640 1 -- 172.21.15.106:0/2899010761 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530009400 con 0x7f8540151400 2023-12-22T09:17:24.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f8545956640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540151400 0x7f85400c1e70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8538007e40 tx=0x7f853800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:24.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f8535ffb640 1 -- 172.21.15.106:0/2899010761 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538014620 con 0x7f8540151400 2023-12-22T09:17:24.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f8535ffb640 1 -- 172.21.15.106:0/2899010761 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85380147a0 con 0x7f8540151400 2023-12-22T09:17:24.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85401e9ce0 con 0x7f8540151400 2023-12-22T09:17:24.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f8535ffb640 1 -- 172.21.15.106:0/2899010761 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538014b50 con 0x7f8540151400 2023-12-22T09:17:24.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.258+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401ec3a0 con 0x7f8540151400 2023-12-22T09:17:24.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.260+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85400c4740 con 0x7f8540151400 2023-12-22T09:17:24.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.260+0000 7f8535ffb640 1 -- 172.21.15.106:0/2899010761 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8538014cb0 con 0x7f8540151400 2023-12-22T09:17:24.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.261+0000 7f8535ffb640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f852406a430 0x7f852406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.261+0000 7f8535ffb640 1 -- 172.21.15.106:0/2899010761 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f85380897f0 con 0x7f8540151400 2023-12-22T09:17:24.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.262+0000 7f8545155640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f852406a430 0x7f852406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.263 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.262+0000 7f8545155640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f852406a430 0x7f852406c8f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f853c000f60 tx=0x7f853c007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:24.267 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.266+0000 7f8535ffb640 1 -- 172.21.15.106:0/2899010761 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f85400c4740 con 0x7f8540151400 2023-12-22T09:17:24.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.455+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85400c4740 con 0x7f8540151400 2023-12-22T09:17:24.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.456+0000 7f8535ffb640 1 -- 172.21.15.106:0/2899010761 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85400c4740 con 0x7f8540151400 2023-12-22T09:17:24.456 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:17:24.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f852406a430 msgr2=0x7f852406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f852406a430 0x7f852406c8f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f853c000f60 tx=0x7f853c007b50 comp rx=0 tx=0).stop 2023-12-22T09:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540151400 msgr2=0x7f85400c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540151400 0x7f85400c1e70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8538007e40 tx=0x7f853800e4b0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 shutdown_connections 2023-12-22T09:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f852406a430 0x7f852406c8f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8540151400 0x7f85400c1e70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f85400c7620 0x7f85400aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 --2- 172.21.15.106:0/2899010761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f854006ca20 0x7f85401e97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 >> 172.21.15.106:0/2899010761 conn(0x7f85400ab310 msgr2=0x7f854014bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 shutdown_connections 2023-12-22T09:17:24.460 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.458+0000 7f85473b9640 1 -- 172.21.15.106:0/2899010761 wait complete. 2023-12-22T09:17:24.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T09:17:24.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.691+0000 7ff2ea8cc640 1 Processor -- start 2023-12-22T09:17:24.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.692+0000 7ff2ea8cc640 1 -- start start 2023-12-22T09:17:24.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.693+0000 7ff2ea8cc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e40c1e00 0x7ff2e413ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.693+0000 7ff2ea8cc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e41572b0 con 0x7ff2e4153cc0 2023-12-22T09:17:24.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.693+0000 7ff2ea8cc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e40bfb00 con 0x7ff2e406cd10 2023-12-22T09:17:24.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.693+0000 7ff2ea8cc640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4154240 con 0x7ff2e40c1e00 2023-12-22T09:17:24.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.693+0000 7ff2e90c9640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff2e4153cc0 0x7ff2e4157740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40670/0 (socket says 172.21.15.106:40670) 2023-12-22T09:17:24.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.693+0000 7ff2e90c9640 1 -- 172.21.15.106:0/4214633718 learned_addr learned my addr 172.21.15.106:0/4214633718 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:24.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e98ca640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e40c1e00 0x7ff2e413ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742874042 0 0) 0x7ff2e41572b0 con 0x7ff2e4153cc0 2023-12-22T09:17:24.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d0003520 con 0x7ff2e4153cc0 2023-12-22T09:17:24.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223514014 0 0) 0x7ff2d0003520 con 0x7ff2e4153cc0 2023-12-22T09:17:24.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e40c1e00 msgr2=0x7ff2e413ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:24.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e40c1e00 0x7ff2e413ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 >> v1:172.21.15.132:6789/0 conn(0x7ff2e406cd10 legacy=0x7ff2e415e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4154520 con 0x7ff2e4153cc0 2023-12-22T09:17:24.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7ff2d8001670 con 0x7ff2e4153cc0 2023-12-22T09:17:24.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 >> v1:172.21.15.106:6789/0 conn(0x7ff2e4153cc0 legacy=0x7ff2e4157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2d0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d00047c0 0x7ff2d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e40c1e00 0x7ff2d0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4154240 con 0x7ff2d00039a0 2023-12-22T09:17:24.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d000bb10 con 0x7ff2d00047c0 2023-12-22T09:17:24.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.694+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d000bcd0 con 0x7ff2e40c1e00 2023-12-22T09:17:24.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.695+0000 7ff2e98ca640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2d0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.695+0000 7ff2e90c9640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d00047c0 0x7ff2d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.695+0000 7ff2e98ca640 1 -- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e40c1e00 msgr2=0x7ff2d0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:24.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.695+0000 7ff2e98ca640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e40c1e00 0x7ff2d0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.695+0000 7ff2e98ca640 1 -- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d00047c0 msgr2=0x7ff2d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:24.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.695+0000 7ff2e98ca640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d00047c0 0x7ff2d0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.695+0000 7ff2e98ca640 1 -- 172.21.15.106:0/4214633718 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d0003520 con 0x7ff2d00039a0 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.696+0000 7ff2e98ca640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2d0003dc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009ac0 tx=0x7ff2d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b2854c81d3721a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.696+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e002c710 con 0x7ff2d00039a0 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.696+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e002c870 con 0x7ff2d00039a0 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.696+0000 7ff2e88c8640 1 -- 172.21.15.106:0/4214633718 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e002cc00 con 0x7ff2d00039a0 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.697+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/4214633718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 msgr2=0x7ff2d0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.697+0000 7ff2ea8cc640 1 --2- 172.21.15.106:0/4214633718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2d0003dc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009ac0 tx=0x7ff2d00057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.697+0000 7ff2ea0cb640 1 -- 172.21.15.106:0/4214633718 reap_dead start 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.697+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/4214633718 shutdown_connections 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.697+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/4214633718 >> 172.21.15.106:0/4214633718 conn(0x7ff2e4069bf0 msgr2=0x7ff2e4069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.697+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/4214633718 shutdown_connections 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.697+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/4214633718 wait complete. 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.699+0000 7ff2ea8cc640 1 Processor -- start 2023-12-22T09:17:24.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.699+0000 7ff2ea8cc640 1 -- start start 2023-12-22T09:17:24.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2ea8cc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2e41379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2ea8cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e4156f60 0x7ff2e41ec5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2ea8cc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e41ecb30 0x7ff2e41de5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2ea8cc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4153620 con 0x7ff2d00039a0 2023-12-22T09:17:24.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2ea8cc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e41ec160 con 0x7ff2e4156f60 2023-12-22T09:17:24.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2ea8cc640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4153b10 con 0x7ff2e41ecb30 2023-12-22T09:17:24.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2e98ca640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2e41379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2e98ca640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2e41379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39184/0 (socket says 172.21.15.106:39184) 2023-12-22T09:17:24.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2e98ca640 1 -- 172.21.15.106:0/2864218464 learned_addr learned my addr 172.21.15.106:0/2864218464 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:24.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2e98ca640 1 -- 172.21.15.106:0/2864218464 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e41ecb30 msgr2=0x7ff2e41de5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2e98ca640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e41ecb30 0x7ff2e41de5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2e98ca640 1 -- 172.21.15.106:0/2864218464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e4156f60 msgr2=0x7ff2e41ec5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2e98ca640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e4156f60 0x7ff2e41ec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.700+0000 7ff2e98ca640 1 -- 172.21.15.106:0/2864218464 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4136eb0 con 0x7ff2d00039a0 2023-12-22T09:17:24.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.701+0000 7ff2e98ca640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2e41379e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009be0 tx=0x7ff2e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:24.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.701+0000 7ff2d67fc640 1 -- 172.21.15.106:0/2864218464 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0003610 con 0x7ff2d00039a0 2023-12-22T09:17:24.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.701+0000 7ff2d67fc640 1 -- 172.21.15.106:0/2864218464 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0003770 con 0x7ff2d00039a0 2023-12-22T09:17:24.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.701+0000 7ff2d67fc640 1 -- 172.21.15.106:0/2864218464 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0003b00 con 0x7ff2d00039a0 2023-12-22T09:17:24.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.701+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e4153830 con 0x7ff2d00039a0 2023-12-22T09:17:24.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.701+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e4151f40 con 0x7ff2d00039a0 2023-12-22T09:17:24.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.702+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e404e8d0 con 0x7ff2d00039a0 2023-12-22T09:17:24.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.703+0000 7ff2d67fc640 1 -- 172.21.15.106:0/2864218464 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff2e003b070 con 0x7ff2d00039a0 2023-12-22T09:17:24.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.704+0000 7ff2d67fc640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff2c806a460 0x7ff2c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:24.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.704+0000 7ff2d67fc640 1 -- 172.21.15.106:0/2864218464 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7ff2e00aa560 con 0x7ff2d00039a0 2023-12-22T09:17:24.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.704+0000 7ff2e90c9640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff2c806a460 0x7ff2c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:24.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.705+0000 7ff2e90c9640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff2c806a460 0x7ff2c806c920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4134e30 tx=0x7ff2d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:24.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.708+0000 7ff2d67fc640 1 -- 172.21.15.106:0/2864218464 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff2e0075790 con 0x7ff2d00039a0 2023-12-22T09:17:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.901+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2e4154ab0 con 0x7ff2d00039a0 2023-12-22T09:17:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.902+0000 7ff2d67fc640 1 -- 172.21.15.106:0/2864218464 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2e0078db0 con 0x7ff2d00039a0 2023-12-22T09:17:24.903 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:17:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.904+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff2c806a460 msgr2=0x7ff2c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.904+0000 7ff2ea8cc640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff2c806a460 0x7ff2c806c920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4134e30 tx=0x7ff2d8009040 comp rx=0 tx=0).stop 2023-12-22T09:17:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.904+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 msgr2=0x7ff2e41379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.904+0000 7ff2ea8cc640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2e41379e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009be0 tx=0x7ff2e0004730 comp rx=0 tx=0).stop 2023-12-22T09:17:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.904+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 shutdown_connections 2023-12-22T09:17:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.904+0000 7ff2ea8cc640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7ff2c806a460 0x7ff2c806c920 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.904+0000 7ff2ea8cc640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2e41ecb30 0x7ff2e41de5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.904+0000 7ff2ea8cc640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e4156f60 0x7ff2e41ec5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.904+0000 7ff2ea8cc640 1 --2- 172.21.15.106:0/2864218464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d00039a0 0x7ff2e41379e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.905+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 >> 172.21.15.106:0/2864218464 conn(0x7ff2e4069bf0 msgr2=0x7ff2e413ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.905+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 shutdown_connections 2023-12-22T09:17:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:24.905+0000 7ff2ea8cc640 1 -- 172.21.15.106:0/2864218464 wait complete. 2023-12-22T09:17:24.923 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-22T09:17:25.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.136+0000 7f6c3ef53640 1 Processor -- start 2023-12-22T09:17:25.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.136+0000 7f6c3ef53640 1 -- start start 2023-12-22T09:17:25.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.138+0000 7f6c3ef53640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c38154a50 0x7f6c380c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.138+0000 7f6c3ef53640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c381545c0 con 0x7f6c380c0dd0 2023-12-22T09:17:25.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.138+0000 7f6c3ef53640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c380c1a60 con 0x7f6c3814a850 2023-12-22T09:17:25.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.138+0000 7f6c3ef53640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380a8460 con 0x7f6c38154a50 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.138+0000 7f6c3e752640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6c380c0dd0 0x7f6c380c55f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40686/0 (socket says 172.21.15.106:40686) 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.138+0000 7f6c3e752640 1 -- 172.21.15.106:0/3444411815 learned_addr learned my addr 172.21.15.106:0/3444411815 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.138+0000 7f6c3d750640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c38154a50 0x7f6c380c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.138+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448983504 0 0) 0x7f6c381545c0 con 0x7f6c380c0dd0 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.138+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c24005730 con 0x7f6c380c0dd0 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2624768057 0 0) 0x7f6c24005730 con 0x7f6c380c0dd0 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c38154a50 msgr2=0x7f6c380c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c38154a50 0x7f6c380c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 >> v1:172.21.15.132:6789/0 conn(0x7f6c3814a850 legacy=0x7f6c3806fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38151280 con 0x7f6c380c0dd0 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f6c300019f0 con 0x7f6c380c0dd0 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 >> v1:172.21.15.106:6789/0 conn(0x7f6c380c0dd0 legacy=0x7f6c380c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c38154a50 0x7f6c24005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c240060f0 0x7f6c240069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c24006f10 0x7f6c24007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2400ff90 con 0x7f6c240060f0 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c24010100 con 0x7f6c24006f10 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240102c0 con 0x7f6c38154a50 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.139+0000 7f6c3d750640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c240060f0 0x7f6c240069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.140+0000 7f6c3e752640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c24006f10 0x7f6c24007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.140+0000 7f6c3df51640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c38154a50 0x7f6c24005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.140+0000 7f6c3d750640 1 -- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c38154a50 msgr2=0x7f6c24005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.140+0000 7f6c3d750640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c38154a50 0x7f6c24005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.140+0000 7f6c3d750640 1 -- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c24006f10 msgr2=0x7f6c24007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.140+0000 7f6c3d750640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c24006f10 0x7f6c24007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.140+0000 7f6c3d750640 1 -- 172.21.15.106:0/3444411815 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c24005730 con 0x7f6c240060f0 2023-12-22T09:17:25.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.141+0000 7f6c3d750640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c240060f0 0x7f6c240069d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009a90 tx=0x7f6c24007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56dc4431d2cd240 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:25.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.141+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2802c680 con 0x7f6c240060f0 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.141+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2802c7e0 con 0x7f6c240060f0 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.141+0000 7f6c3cf4f640 1 -- 172.21.15.106:0/3444411815 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2802cb70 con 0x7f6c240060f0 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.142+0000 7f6c3ef53640 1 -- 172.21.15.106:0/3444411815 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c240060f0 msgr2=0x7f6c240069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.142+0000 7f6c3ef53640 1 --2- 172.21.15.106:0/3444411815 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c240060f0 0x7f6c240069d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009a90 tx=0x7f6c24007a00 comp rx=0 tx=0).stop 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.142+0000 7f6c3e752640 1 -- 172.21.15.106:0/3444411815 reap_dead start 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.142+0000 7f6c3ef53640 1 -- 172.21.15.106:0/3444411815 shutdown_connections 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.142+0000 7f6c3ef53640 1 -- 172.21.15.106:0/3444411815 >> 172.21.15.106:0/3444411815 conn(0x7f6c38069bf0 msgr2=0x7f6c38069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.142+0000 7f6c3ef53640 1 -- 172.21.15.106:0/3444411815 shutdown_connections 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.142+0000 7f6c3ef53640 1 -- 172.21.15.106:0/3444411815 wait complete. 2023-12-22T09:17:25.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.144+0000 7f6c3ef53640 1 Processor -- start 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.144+0000 7f6c3ef53640 1 -- start start 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3ef53640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240060f0 0x7f6c381e8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3ef53640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c3813ec70 0x7f6c380c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3ef53640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c380c4a30 0x7f6c38151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3ef53640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3814f9c0 con 0x7f6c3813ec70 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3ef53640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c38150540 con 0x7f6c380c4a30 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3ef53640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c38153a90 con 0x7f6c240060f0 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3d750640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c3813ec70 0x7f6c380c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3d750640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c3813ec70 0x7f6c380c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39188/0 (socket says 172.21.15.106:39188) 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3d750640 1 -- 172.21.15.106:0/430810154 learned_addr learned my addr 172.21.15.106:0/430810154 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3df51640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240060f0 0x7f6c381e8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3e752640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c380c4a30 0x7f6c38151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3d750640 1 -- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240060f0 msgr2=0x7f6c381e8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3d750640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240060f0 0x7f6c381e8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3d750640 1 -- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c380c4a30 msgr2=0x7f6c38151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3d750640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c380c4a30 0x7f6c38151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.145+0000 7f6c3d750640 1 -- 172.21.15.106:0/430810154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3814fba0 con 0x7f6c3813ec70 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.146+0000 7f6c3df51640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240060f0 0x7f6c381e8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.146+0000 7f6c3e752640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c380c4a30 0x7f6c38151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.146+0000 7f6c3d750640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c3813ec70 0x7f6c380c44f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009bb0 tx=0x7f6c28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.146+0000 7f6c2e7fc640 1 -- 172.21.15.106:0/430810154 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2802dea0 con 0x7f6c3813ec70 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.146+0000 7f6c2e7fc640 1 -- 172.21.15.106:0/430810154 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c28003810 con 0x7f6c3813ec70 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.146+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3814fe80 con 0x7f6c3813ec70 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.146+0000 7f6c2e7fc640 1 -- 172.21.15.106:0/430810154 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28003ba0 con 0x7f6c3813ec70 2023-12-22T09:17:25.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.146+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3814e8d0 con 0x7f6c3813ec70 2023-12-22T09:17:25.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.148+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c38150680 con 0x7f6c3813ec70 2023-12-22T09:17:25.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.149+0000 7f6c2e7fc640 1 -- 172.21.15.106:0/430810154 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c28003d00 con 0x7f6c3813ec70 2023-12-22T09:17:25.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.150+0000 7f6c2e7fc640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c1c06a430 0x7f6c1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.151+0000 7f6c2e7fc640 1 -- 172.21.15.106:0/430810154 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f6c280aad10 con 0x7f6c3813ec70 2023-12-22T09:17:25.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.151+0000 7f6c3df51640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c1c06a430 0x7f6c1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.151+0000 7f6c3df51640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c1c06a430 0x7f6c1c06c8f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6c340016b0 tx=0x7f6c34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:25.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.155+0000 7f6c2e7fc640 1 -- 172.21.15.106:0/430810154 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6c38150680 con 0x7f6c3813ec70 2023-12-22T09:17:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.346+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c38150680 con 0x7f6c3813ec70 2023-12-22T09:17:25.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.347+0000 7f6c2e7fc640 1 -- 172.21.15.106:0/430810154 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v64) v1 ==== 105+0+11 (secure 0 0 0) 0x7f6c38150680 con 0x7f6c3813ec70 2023-12-22T09:17:25.348 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-12-22T09:17:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c1c06a430 msgr2=0x7f6c1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c1c06a430 0x7f6c1c06c8f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6c340016b0 tx=0x7f6c34009040 comp rx=0 tx=0).stop 2023-12-22T09:17:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c3813ec70 msgr2=0x7f6c380c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c3813ec70 0x7f6c380c44f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009bb0 tx=0x7f6c28004730 comp rx=0 tx=0).stop 2023-12-22T09:17:25.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 shutdown_connections 2023-12-22T09:17:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f6c1c06a430 0x7f6c1c06c8f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c380c4a30 0x7f6c38151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c3813ec70 0x7f6c380c44f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 --2- 172.21.15.106:0/430810154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c240060f0 0x7f6c381e8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 >> 172.21.15.106:0/430810154 conn(0x7f6c38069bf0 msgr2=0x7f6c38143710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.349+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 shutdown_connections 2023-12-22T09:17:25.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.350+0000 7f6c3ef53640 1 -- 172.21.15.106:0/430810154 wait complete. 2023-12-22T09:17:25.367 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-22T09:17:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.572+0000 7f8e611c4640 1 Processor -- start 2023-12-22T09:17:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.573+0000 7f8e611c4640 1 -- start start 2023-12-22T09:17:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.574+0000 7f8e611c4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8e5c0c6150 0x7f8e5c0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.574+0000 7f8e611c4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c0c4560 con 0x7f8e5c06ca00 2023-12-22T09:17:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.574+0000 7f8e611c4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c154720 con 0x7f8e5c0c7640 2023-12-22T09:17:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.574+0000 7f8e611c4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c0c4f90 con 0x7f8e5c0c6150 2023-12-22T09:17:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.574+0000 7f8e5b59e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8e5c06ca00 0x7f8e5c06b8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40700/0 (socket says 172.21.15.106:40700) 2023-12-22T09:17:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.575+0000 7f8e5b59e640 1 -- 172.21.15.106:0/3189730217 learned_addr learned my addr 172.21.15.106:0/3189730217 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.575+0000 7f8e5ad9d640 1 --2- 172.21.15.106:0/3189730217 >> v2:172.21.15.132:3300/0 conn(0x7f8e5c0c6150 0x7f8e5c0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.575+0000 7f8e59d9b640 1 -- 172.21.15.106:0/3189730217 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438440245 0 0) 0x7f8e5c0c4560 con 0x7f8e5c06ca00 2023-12-22T09:17:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.575+0000 7f8e59d9b640 1 -- 172.21.15.106:0/3189730217 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e48003520 con 0x7f8e5c06ca00 2023-12-22T09:17:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.575+0000 7f8e5ad9d640 1 -- 172.21.15.106:0/3189730217 >> v1:172.21.15.132:6789/0 conn(0x7f8e5c0c7640 legacy=0x7f8e5c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.575+0000 7f8e59d9b640 1 -- 172.21.15.106:0/3189730217 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3939826256 0 0) 0x7f8e48003520 con 0x7f8e5c06ca00 2023-12-22T09:17:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.575+0000 7f8e5ad9d640 1 -- 172.21.15.106:0/3189730217 >> v1:172.21.15.106:6789/0 conn(0x7f8e5c06ca00 legacy=0x7f8e5c06b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.575+0000 7f8e5ad9d640 1 -- 172.21.15.106:0/3189730217 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c154c50 con 0x7f8e5c0c6150 2023-12-22T09:17:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.577+0000 7f8e5ad9d640 1 --2- 172.21.15.106:0/3189730217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e5c0c6150 0x7f8e5c0c6530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8e440097a0 tx=0x7f8e4402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68763522af5f40d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.577+0000 7f8e59d9b640 1 -- 172.21.15.106:0/3189730217 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54001670 con 0x7f8e5c0c6150 2023-12-22T09:17:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.577+0000 7f8e59d9b640 1 -- 172.21.15.106:0/3189730217 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4402e050 con 0x7f8e5c0c6150 2023-12-22T09:17:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.577+0000 7f8e59d9b640 1 -- 172.21.15.106:0/3189730217 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44030710 con 0x7f8e5c0c6150 2023-12-22T09:17:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.578+0000 7f8e611c4640 1 -- 172.21.15.106:0/3189730217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e5c0c6150 msgr2=0x7f8e5c0c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.578+0000 7f8e611c4640 1 --2- 172.21.15.106:0/3189730217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e5c0c6150 0x7f8e5c0c6530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8e440097a0 tx=0x7f8e4402b710 comp rx=0 tx=0).stop 2023-12-22T09:17:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.578+0000 7f8e611c4640 1 -- 172.21.15.106:0/3189730217 shutdown_connections 2023-12-22T09:17:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.578+0000 7f8e611c4640 1 --2- 172.21.15.106:0/3189730217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e5c0c6150 0x7f8e5c0c6530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.578+0000 7f8e611c4640 1 -- 172.21.15.106:0/3189730217 >> 172.21.15.106:0/3189730217 conn(0x7f8e5c0ab330 msgr2=0x7f8e5c0ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.578+0000 7f8e611c4640 1 -- 172.21.15.106:0/3189730217 shutdown_connections 2023-12-22T09:17:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.578+0000 7f8e611c4640 1 -- 172.21.15.106:0/3189730217 wait complete. 2023-12-22T09:17:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.580+0000 7f8e611c4640 1 Processor -- start 2023-12-22T09:17:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.580+0000 7f8e611c4640 1 -- start start 2023-12-22T09:17:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e611c4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c06ca00 0x7f8e5c1ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e611c4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e5c0c6150 0x7f8e5c1ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e611c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e5c0c7640 0x7f8e5c1ec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e611c4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1ec610 con 0x7f8e5c06ca00 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e611c4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1ea730 con 0x7f8e5c0c7640 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e611c4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1ed3c0 con 0x7f8e5c0c6150 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e5ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c06ca00 0x7f8e5c1ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e5ad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c06ca00 0x7f8e5c1ecaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39190/0 (socket says 172.21.15.106:39190) 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e5ad9d640 1 -- 172.21.15.106:0/154271769 learned_addr learned my addr 172.21.15.106:0/154271769 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e5ad9d640 1 -- 172.21.15.106:0/154271769 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e5c0c6150 msgr2=0x7f8e5c1ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e5ad9d640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e5c0c6150 0x7f8e5c1ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e5ad9d640 1 -- 172.21.15.106:0/154271769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e5c0c7640 msgr2=0x7f8e5c1ec0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e5ad9d640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e5c0c7640 0x7f8e5c1ec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.581+0000 7f8e5ad9d640 1 -- 172.21.15.106:0/154271769 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e44009400 con 0x7f8e5c06ca00 2023-12-22T09:17:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.582+0000 7f8e5ad9d640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c06ca00 0x7f8e5c1ecaa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000c00 tx=0x7f8e440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.582+0000 7f8e537fe640 1 -- 172.21.15.106:0/154271769 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e440044c0 con 0x7f8e5c06ca00 2023-12-22T09:17:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.582+0000 7f8e537fe640 1 -- 172.21.15.106:0/154271769 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44030510 con 0x7f8e5c06ca00 2023-12-22T09:17:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.582+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c1ed6a0 con 0x7f8e5c06ca00 2023-12-22T09:17:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.582+0000 7f8e537fe640 1 -- 172.21.15.106:0/154271769 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e440308c0 con 0x7f8e5c06ca00 2023-12-22T09:17:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.582+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c0c34a0 con 0x7f8e5c06ca00 2023-12-22T09:17:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.583+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c0c12b0 con 0x7f8e5c06ca00 2023-12-22T09:17:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.584+0000 7f8e537fe640 1 -- 172.21.15.106:0/154271769 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8e44039070 con 0x7f8e5c06ca00 2023-12-22T09:17:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.585+0000 7f8e537fe640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8e3c06a430 0x7f8e3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.586+0000 7f8e537fe640 1 -- 172.21.15.106:0/154271769 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f8e440aa650 con 0x7f8e5c06ca00 2023-12-22T09:17:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.586+0000 7f8e5a59c640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8e3c06a430 0x7f8e3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.586+0000 7f8e5a59c640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8e3c06a430 0x7f8e3c06c8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0012e0 tx=0x7f8e4c007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.590+0000 7f8e537fe640 1 -- 172.21.15.106:0/154271769 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8e5c0c12b0 con 0x7f8e5c06ca00 2023-12-22T09:17:25.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.780+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f8e5c0c12b0 con 0x7f8e5c06ca00 2023-12-22T09:17:25.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.781+0000 7f8e537fe640 1 -- 172.21.15.106:0/154271769 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v64) v1 ==== 101+0+11 (secure 0 0 0) 0x7f8e440757c0 con 0x7f8e5c06ca00 2023-12-22T09:17:25.787 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-12-22T09:17:25.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8e3c06a430 msgr2=0x7f8e3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8e3c06a430 0x7f8e3c06c8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0012e0 tx=0x7f8e4c007d30 comp rx=0 tx=0).stop 2023-12-22T09:17:25.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c06ca00 msgr2=0x7f8e5c1ecaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:25.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c06ca00 0x7f8e5c1ecaa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000c00 tx=0x7f8e440046c0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 shutdown_connections 2023-12-22T09:17:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f8e3c06a430 0x7f8e3c06c8f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e5c0c7640 0x7f8e5c1ec0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e5c0c6150 0x7f8e5c1ebb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 --2- 172.21.15.106:0/154271769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c06ca00 0x7f8e5c1ecaa0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 >> 172.21.15.106:0/154271769 conn(0x7f8e5c0ab330 msgr2=0x7f8e5c0c6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 shutdown_connections 2023-12-22T09:17:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:25.784+0000 7f8e611c4640 1 -- 172.21.15.106:0/154271769 wait complete. 2023-12-22T09:17:25.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T09:17:26.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.010+0000 7f881013c640 1 Processor -- start 2023-12-22T09:17:26.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.010+0000 7f881013c640 1 -- start start 2023-12-22T09:17:26.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.011+0000 7f881013c640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88081551c0 0x7f8808069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.011+0000 7f881013c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880806c510 con 0x7f880814f370 2023-12-22T09:17:26.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.012+0000 7f881013c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880806c1e0 con 0x7f880806a130 2023-12-22T09:17:26.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.012+0000 7f881013c640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8808071a30 con 0x7f88081551c0 2023-12-22T09:17:26.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.012+0000 7f880d6d7640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88081551c0 0x7f8808069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.012+0000 7f880ded8640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f880814f370 0x7f8808071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40704/0 (socket says 172.21.15.106:40704) 2023-12-22T09:17:26.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.012+0000 7f880ded8640 1 -- 172.21.15.106:0/2325580391 learned_addr learned my addr 172.21.15.106:0/2325580391 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:26.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.012+0000 7f880d6d7640 1 -- 172.21.15.106:0/2325580391 >> v1:172.21.15.132:6789/0 conn(0x7f880806a130 legacy=0x7f880806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:26.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.012+0000 7f880d6d7640 1 -- 172.21.15.106:0/2325580391 >> v1:172.21.15.106:6789/0 conn(0x7f880814f370 legacy=0x7f8808071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.012+0000 7f880d6d7640 1 -- 172.21.15.106:0/2325580391 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808071d10 con 0x7f88081551c0 2023-12-22T09:17:26.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.013+0000 7f880d6d7640 1 --2- 172.21.15.106:0/2325580391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 0x7f8808069bf0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097a0 tx=0x7f87f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d4af6f4742204b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:26.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.014+0000 7f880ced6640 1 -- 172.21.15.106:0/2325580391 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8031830 con 0x7f88081551c0 2023-12-22T09:17:26.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.014+0000 7f880ced6640 1 -- 172.21.15.106:0/2325580391 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8031990 con 0x7f88081551c0 2023-12-22T09:17:26.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.014+0000 7f880ced6640 1 -- 172.21.15.106:0/2325580391 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8031d20 con 0x7f88081551c0 2023-12-22T09:17:26.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.014+0000 7f881013c640 1 -- 172.21.15.106:0/2325580391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 msgr2=0x7f8808069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.014+0000 7f881013c640 1 --2- 172.21.15.106:0/2325580391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 0x7f8808069bf0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097a0 tx=0x7f87f802b8d0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.014+0000 7f881013c640 1 -- 172.21.15.106:0/2325580391 shutdown_connections 2023-12-22T09:17:26.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.014+0000 7f881013c640 1 --2- 172.21.15.106:0/2325580391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 0x7f8808069bf0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.014+0000 7f881013c640 1 -- 172.21.15.106:0/2325580391 >> 172.21.15.106:0/2325580391 conn(0x7f88080c1db0 msgr2=0x7f88080c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:26.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.014+0000 7f881013c640 1 -- 172.21.15.106:0/2325580391 shutdown_connections 2023-12-22T09:17:26.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.015+0000 7f881013c640 1 -- 172.21.15.106:0/2325580391 wait complete. 2023-12-22T09:17:26.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.016+0000 7f881013c640 1 Processor -- start 2023-12-22T09:17:26.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.016+0000 7f881013c640 1 -- start start 2023-12-22T09:17:26.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.017+0000 7f881013c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f880806a130 0x7f88081dc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.017+0000 7f881013c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f880814f370 0x7f88081ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.017+0000 7f881013c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 0x7f880814e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.017+0000 7f881013c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88081dc690 con 0x7f88081551c0 2023-12-22T09:17:26.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.017+0000 7f881013c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88081db060 con 0x7f880806a130 2023-12-22T09:17:26.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.017+0000 7f881013c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88081ed990 con 0x7f880814f370 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.017+0000 7f880e6d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 0x7f880814e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.017+0000 7f880e6d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 0x7f880814e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39200/0 (socket says 172.21.15.106:39200) 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.017+0000 7f880e6d9640 1 -- 172.21.15.106:0/2835425326 learned_addr learned my addr 172.21.15.106:0/2835425326 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f880ded8640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f880806a130 0x7f88081dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f880d6d7640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f880814f370 0x7f88081ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f880e6d9640 1 -- 172.21.15.106:0/2835425326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f880814f370 msgr2=0x7f88081ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f880e6d9640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f880814f370 0x7f88081ed450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f880e6d9640 1 -- 172.21.15.106:0/2835425326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f880806a130 msgr2=0x7f88081dc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f880e6d9640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f880806a130 0x7f88081dc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f880e6d9640 1 -- 172.21.15.106:0/2835425326 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8009400 con 0x7f88081551c0 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f880ded8640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f880806a130 0x7f88081dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f880e6d9640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 0x7f880814e280 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f880000b970 tx=0x7f880000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:26.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f87fe7fc640 1 -- 172.21.15.106:0/2835425326 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880000cb40 con 0x7f88081551c0 2023-12-22T09:17:26.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f87fe7fc640 1 -- 172.21.15.106:0/2835425326 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880000cca0 con 0x7f88081551c0 2023-12-22T09:17:26.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.018+0000 7f87fe7fc640 1 -- 172.21.15.106:0/2835425326 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800014680 con 0x7f88081551c0 2023-12-22T09:17:26.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.019+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88081e98b0 con 0x7f88081551c0 2023-12-22T09:17:26.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.019+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88080aa0a0 con 0x7f88081551c0 2023-12-22T09:17:26.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.020+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88081e9a40 con 0x7f88081551c0 2023-12-22T09:17:26.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.020+0000 7f87fe7fc640 1 -- 172.21.15.106:0/2835425326 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f880001d3b0 con 0x7f88081551c0 2023-12-22T09:17:26.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.022+0000 7f87fe7fc640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87ec06a430 0x7f87ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.022+0000 7f87fe7fc640 1 -- 172.21.15.106:0/2835425326 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f8800088c60 con 0x7f88081551c0 2023-12-22T09:17:26.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.022+0000 7f880ded8640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87ec06a430 0x7f87ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.023+0000 7f880ded8640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87ec06a430 0x7f87ec06c8f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8804004980 tx=0x7f8804009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:26.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.027+0000 7f87fe7fc640 1 -- 172.21.15.106:0/2835425326 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8800053d30 con 0x7f88081551c0 2023-12-22T09:17:26.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.213+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8808073f10 con 0x7f88081551c0 2023-12-22T09:17:26.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.214+0000 7f87fe7fc640 1 -- 172.21.15.106:0/2835425326 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8800057350 con 0x7f88081551c0 2023-12-22T09:17:26.215 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-12-22T09:17:26.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87ec06a430 msgr2=0x7f87ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87ec06a430 0x7f87ec06c8f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8804004980 tx=0x7f8804009040 comp rx=0 tx=0).stop 2023-12-22T09:17:26.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 msgr2=0x7f880814e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 0x7f880814e280 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f880000b970 tx=0x7f880000be30 comp rx=0 tx=0).stop 2023-12-22T09:17:26.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 shutdown_connections 2023-12-22T09:17:26.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f87ec06a430 0x7f87ec06c8f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88081551c0 0x7f880814e280 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f880814f370 0x7f88081ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 --2- 172.21.15.106:0/2835425326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f880806a130 0x7f88081dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.216+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 >> 172.21.15.106:0/2835425326 conn(0x7f88080c1db0 msgr2=0x7f88080c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:26.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.217+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 shutdown_connections 2023-12-22T09:17:26.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.217+0000 7f881013c640 1 -- 172.21.15.106:0/2835425326 wait complete. 2023-12-22T09:17:26.233 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T09:17:26.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:26.234 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T09:17:26.348 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-22T09:17:26.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:26.348 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T09:17:26.402 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:17:26.402 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:17:26.450 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054304,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498832k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-22T09:17:26.450 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T09:17:26.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.669+0000 7fd5c4830640 1 Processor -- start 2023-12-22T09:17:26.671 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.670+0000 7fd5c4830640 1 -- start start 2023-12-22T09:17:26.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.671+0000 7fd5c4830640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd5c0150a80 0x7fd5c0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.671+0000 7fd5c4830640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00bfce0 con 0x7fd5c0071ea0 2023-12-22T09:17:26.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.671+0000 7fd5c4830640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00bffc0 con 0x7fd5c0069e60 2023-12-22T09:17:26.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.671+0000 7fd5c4830640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c00c0960 con 0x7fd5c0150a80 2023-12-22T09:17:26.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.671+0000 7fd5bed9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd5c0071ea0 0x7fd5c015b400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40710/0 (socket says 172.21.15.106:40710) 2023-12-22T09:17:26.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bed9d640 1 -- 172.21.15.106:0/2353353589 learned_addr learned my addr 172.21.15.106:0/2353353589 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:26.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bdd9b640 1 --2- 172.21.15.106:0/2353353589 >> v2:172.21.15.132:3300/0 conn(0x7fd5c0150a80 0x7fd5c0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674640305 0 0) 0x7fd5c00bfce0 con 0x7fd5c0071ea0 2023-12-22T09:17:26.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a8003520 con 0x7fd5c0071ea0 2023-12-22T09:17:26.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3681369538 0 0) 0x7fd5a8003520 con 0x7fd5c0071ea0 2023-12-22T09:17:26.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 >> v2:172.21.15.132:3300/0 conn(0x7fd5c0150a80 msgr2=0x7fd5c0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:26.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 --2- 172.21.15.106:0/2353353589 >> v2:172.21.15.132:3300/0 conn(0x7fd5c0150a80 0x7fd5c0151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 >> v1:172.21.15.132:6789/0 conn(0x7fd5c0069e60 legacy=0x7fd5c014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00c02a0 con 0x7fd5c0071ea0 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fd5b80019f0 con 0x7fd5c0071ea0 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 >> v1:172.21.15.106:6789/0 conn(0x7fd5c0071ea0 legacy=0x7fd5c015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.672+0000 7fd5bd59a640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5a8003970 0x7fd5a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bd59a640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5a80047c0 0x7fd5a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bd59a640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5a80052a0 0x7fd5a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00c0960 con 0x7fd5a80052a0 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a800c170 con 0x7fd5a8003970 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a800c330 con 0x7fd5a80047c0 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bed9d640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5a80052a0 0x7fd5a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5be59c640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5a8003970 0x7fd5a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bed9d640 1 -- 172.21.15.106:0/2353353589 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5a80047c0 msgr2=0x7fd5a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bed9d640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5a80047c0 0x7fd5a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bed9d640 1 -- 172.21.15.106:0/2353353589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5a8003970 msgr2=0x7fd5a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:26.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bed9d640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5a8003970 0x7fd5a8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.673+0000 7fd5bed9d640 1 -- 172.21.15.106:0/2353353589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8003520 con 0x7fd5a80052a0 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.674+0000 7fd5bed9d640 1 -- 172.21.15.106:0/2353353589 reap_dead start 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.674+0000 7fd5bed9d640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5a80052a0 0x7fd5a800b980 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800a800 tx=0x7fd5a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e5fda1d345ec49 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.674+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80072d0 con 0x7fd5a80052a0 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.675+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b802f070 con 0x7fd5a80052a0 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.675+0000 7fd5bd59a640 1 -- 172.21.15.106:0/2353353589 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8007690 con 0x7fd5a80052a0 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.675+0000 7fd5c4830640 1 -- 172.21.15.106:0/2353353589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5a80052a0 msgr2=0x7fd5a800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.675+0000 7fd5c4830640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5a80052a0 0x7fd5a800b980 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800a800 tx=0x7fd5a80057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.675+0000 7fd5c4830640 1 -- 172.21.15.106:0/2353353589 shutdown_connections 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.675+0000 7fd5c4830640 1 --2- 172.21.15.106:0/2353353589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5a80052a0 0x7fd5a800b980 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.675+0000 7fd5c4830640 1 -- 172.21.15.106:0/2353353589 >> 172.21.15.106:0/2353353589 conn(0x7fd5c00c5360 msgr2=0x7fd5c00c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.675+0000 7fd5c4830640 1 -- 172.21.15.106:0/2353353589 shutdown_connections 2023-12-22T09:17:26.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.675+0000 7fd5c4830640 1 -- 172.21.15.106:0/2353353589 wait complete. 2023-12-22T09:17:26.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.677+0000 7fd5c4830640 1 Processor -- start 2023-12-22T09:17:26.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.677+0000 7fd5c4830640 1 -- start start 2023-12-22T09:17:26.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.678+0000 7fd5c4830640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5a80052a0 0x7fd5c013bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.678+0000 7fd5c4830640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c013c4f0 0x7fd5c0154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.678+0000 7fd5c4830640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5c0154740 0x7fd5c01ec210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.678+0000 7fd5c4830640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c013c970 con 0x7fd5c0154740 2023-12-22T09:17:26.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.678+0000 7fd5c4830640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0147b70 con 0x7fd5c013c4f0 2023-12-22T09:17:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.678+0000 7fd5c4830640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0145550 con 0x7fd5a80052a0 2023-12-22T09:17:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5c0154740 0x7fd5c01ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bed9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5c0154740 0x7fd5c01ec210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39220/0 (socket says 172.21.15.106:39220) 2023-12-22T09:17:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bed9d640 1 -- 172.21.15.106:0/2741710190 learned_addr learned my addr 172.21.15.106:0/2741710190 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bdd9b640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c013c4f0 0x7fd5c0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5be59c640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5a80052a0 0x7fd5c013bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bed9d640 1 -- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5a80052a0 msgr2=0x7fd5c013bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bed9d640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5a80052a0 0x7fd5c013bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bed9d640 1 -- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c013c4f0 msgr2=0x7fd5c0154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bed9d640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c013c4f0 0x7fd5c0154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bed9d640 1 -- 172.21.15.106:0/2741710190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0144f40 con 0x7fd5c0154740 2023-12-22T09:17:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bdd9b640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c013c4f0 0x7fd5c0154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5be59c640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5a80052a0 0x7fd5c013bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.679+0000 7fd5bed9d640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5c0154740 0x7fd5c01ec210 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800a8f0 tx=0x7fd5b8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.680+0000 7fd5aeffd640 1 -- 172.21.15.106:0/2741710190 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80019f0 con 0x7fd5c0154740 2023-12-22T09:17:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.680+0000 7fd5aeffd640 1 -- 172.21.15.106:0/2741710190 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b802ce90 con 0x7fd5c0154740 2023-12-22T09:17:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.680+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c0154bc0 con 0x7fd5c0154740 2023-12-22T09:17:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.680+0000 7fd5aeffd640 1 -- 172.21.15.106:0/2741710190 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80070d0 con 0x7fd5c0154740 2023-12-22T09:17:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.680+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c01451e0 con 0x7fd5c0154740 2023-12-22T09:17:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.681+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c01453a0 con 0x7fd5c0154740 2023-12-22T09:17:26.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.682+0000 7fd5aeffd640 1 -- 172.21.15.106:0/2741710190 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd5b8031030 con 0x7fd5c0154740 2023-12-22T09:17:26.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.683+0000 7fd5aeffd640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd5a006a430 0x7fd5a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:26.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.683+0000 7fd5aeffd640 1 -- 172.21.15.106:0/2741710190 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fd5b80a9d00 con 0x7fd5c0154740 2023-12-22T09:17:26.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.683+0000 7fd5be59c640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd5a006a430 0x7fd5a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.684+0000 7fd5be59c640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd5a006a430 0x7fd5a006c8f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0007fd0 tx=0x7fd5b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:26.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.688+0000 7fd5aeffd640 1 -- 172.21.15.106:0/2741710190 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd5b8074dd0 con 0x7fd5c0154740 2023-12-22T09:17:26.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.919+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd5c01453a0 con 0x7fd5c0154740 2023-12-22T09:17:26.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.920+0000 7fd5aeffd640 1 -- 172.21.15.106:0/2741710190 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd5b80430b0 con 0x7fd5c0154740 2023-12-22T09:17:26.921 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T09:17:26.921 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-22T09:17:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd5a006a430 msgr2=0x7fd5a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd5a006a430 0x7fd5a006c8f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0007fd0 tx=0x7fd5b0009040 comp rx=0 tx=0).stop 2023-12-22T09:17:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5c0154740 msgr2=0x7fd5c01ec210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5c0154740 0x7fd5c01ec210 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800a8f0 tx=0x7fd5b8001d80 comp rx=0 tx=0).stop 2023-12-22T09:17:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 shutdown_connections 2023-12-22T09:17:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fd5a006a430 0x7fd5a006c8f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5c0154740 0x7fd5c01ec210 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c013c4f0 0x7fd5c0154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 --2- 172.21.15.106:0/2741710190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5a80052a0 0x7fd5c013bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:26.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 >> 172.21.15.106:0/2741710190 conn(0x7fd5c00c5360 msgr2=0x7fd5c00be670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:26.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 shutdown_connections 2023-12-22T09:17:26.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:26.923+0000 7fd5c4830640 1 -- 172.21.15.106:0/2741710190 wait complete. 2023-12-22T09:17:26.943 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-22T09:17:26.943 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T09:17:26.943 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-22T09:17:26.943 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T09:17:26.943 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T09:17:26.943 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-22T09:17:26.943 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T09:17:26.943 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T09:17:26.943 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:17:26.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:26.944 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-22T09:17:27.005 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T09:17:27.005 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T09:17:27.005 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T09:17:27.005 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:27.005 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-22T09:17:27.005 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42188sec preferred_lft 42188sec 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-22T09:17:27.006 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 9e:b3:3a:4a:07:97 brd ff:ff:ff:ff:ff:ff 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::fc76:1aff:fe8a:2e61/64 scope link 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 9e:b3:3a:4a:07:97 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::9cb3:3aff:fe4a:797/64 scope link 2023-12-22T09:17:27.007 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-22T09:17:27.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:27.008 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T09:17:27.097 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-22T09:17:27.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:27.101 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-22T09:17:27.155 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-22T09:17:27.156 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T09:17:27.156 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T09:17:27.156 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T09:17:27.156 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T09:17:27.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:27.156 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-22T09:17:27.156 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-22T09:17:27.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T09:17:27.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T09:17:27.157 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T09:17:27.157 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-22T09:17:27.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:27.338 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-22T09:17:27.388 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T09:17:27.388 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:17:27.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:27.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-22T09:17:27.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:17:27.482 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T09:17:27.537 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T09:17:27.537 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T09:17:27.537 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:17:27.585 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T09:17:27.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:27.586 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-12-22T09:17:27.719 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-12-22T09:17:27.720 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-12-22T09:17:27.720 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:17:27.740 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-12-22T09:17:27.741 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-12-22T09:17:27.741 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:17:27.741 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:17:27.741 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:17:27.766 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-12-22T09:17:27.766 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-12-22T09:17:27.766 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2023-12-22T09:17:27.767 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.132:3300,172.21.15.132:3301" 2023-12-22T09:17:27.767 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T09:17:27.767 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790" 2023-12-22T09:17:27.767 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.132:6789,172.21.15.132:6790:/ 2023-12-22T09:17:27.767 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=c9422aac-a1e3-428b-87d0-2dbf321c6b46" will pass to kernel 2023-12-22T09:17:27.768 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T09:17:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2023-12-22T09:17:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T09:17:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T09:17:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T09:17:27.772 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T09:17:27.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:27.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T09:17:27.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T09:17:27.854 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T09:17:27.926 INFO:teuthology.orchestra.run.smithi132.stdout:client4967 2023-12-22T09:17:27.927 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-22T09:17:27.927 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T09:17:27.982 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-12-22T09:17:28.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.211+0000 7fa5d62df640 1 Processor -- start 2023-12-22T09:17:28.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.212+0000 7fa5d62df640 1 -- start start 2023-12-22T09:17:28.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.213+0000 7fa5d62df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5d00c6150 0x7fa5d00c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.213+0000 7fa5d62df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5d00c7640 0x7fa5d006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.213+0000 7fa5d62df640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00c4560 con 0x7fa5d006ca00 2023-12-22T09:17:28.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.213+0000 7fa5d62df640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00c4f90 con 0x7fa5d00c7640 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.213+0000 7fa5d62df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0154720 con 0x7fa5d00c6150 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.213+0000 7fa5d487c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa5d006ca00 0x7fa5d006b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40726/0 (socket says 172.21.15.106:40726) 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.213+0000 7fa5d487c640 1 -- 172.21.15.106:0/3414446916 learned_addr learned my addr 172.21.15.106:0/3414446916 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5cffff640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5d00c6150 0x7fa5d00c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5cf7fe640 1 --2- 172.21.15.106:0/3414446916 >> v2:172.21.15.132:3300/0 conn(0x7fa5d00c7640 0x7fa5d006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996069167 0 0) 0x7fa5d00c4560 con 0x7fa5d006ca00 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5bc003520 con 0x7fa5d006ca00 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4110838757 0 0) 0x7fa5bc003520 con 0x7fa5d006ca00 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5d00c6150 msgr2=0x7fa5d00c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5d00c6150 0x7fa5d00c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 >> v2:172.21.15.132:3300/0 conn(0x7fa5d00c7640 msgr2=0x7fa5d006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 --2- 172.21.15.106:0/3414446916 >> v2:172.21.15.132:3300/0 conn(0x7fa5d00c7640 0x7fa5d006b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0154c50 con 0x7fa5d006ca00 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7fa5c8001670 con 0x7fa5d006ca00 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.214+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 >> v1:172.21.15.106:6789/0 conn(0x7fa5d006ca00 legacy=0x7fa5d006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5ceffd640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5d00c6150 0x7fa5bc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5ceffd640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5bc003f40 0x7fa5bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5ceffd640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5bc004d00 0x7fa5bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0154720 con 0x7fa5bc004d00 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc00bb10 con 0x7fa5bc003f40 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc00bca0 con 0x7fa5d00c6150 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5d487c640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5bc004d00 0x7fa5bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5cf7fe640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5bc003f40 0x7fa5bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5d487c640 1 -- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5d00c6150 msgr2=0x7fa5bc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:28.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5d487c640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5d00c6150 0x7fa5bc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5d487c640 1 -- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5bc003f40 msgr2=0x7fa5bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:28.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5d487c640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5bc003f40 0x7fa5bc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.215+0000 7fa5d487c640 1 -- 172.21.15.106:0/3414446916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc003520 con 0x7fa5bc004d00 2023-12-22T09:17:28.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.216+0000 7fa5d487c640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5bc004d00 0x7fa5bc005180 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800c110 tx=0x7fa5bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6882e1db2f6a0dc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:28.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8005ad0 con 0x7fa5bc004d00 2023-12-22T09:17:28.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8005c50 con 0x7fa5bc004d00 2023-12-22T09:17:28.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5ceffd640 1 -- 172.21.15.106:0/3414446916 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c802c830 con 0x7fa5bc004d00 2023-12-22T09:17:28.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5d62df640 1 -- 172.21.15.106:0/3414446916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5bc004d00 msgr2=0x7fa5bc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5d62df640 1 --2- 172.21.15.106:0/3414446916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5bc004d00 0x7fa5bc005180 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800c110 tx=0x7fa5bc0057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5d487c640 1 -- 172.21.15.106:0/3414446916 reap_dead start 2023-12-22T09:17:28.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5d62df640 1 -- 172.21.15.106:0/3414446916 shutdown_connections 2023-12-22T09:17:28.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5d62df640 1 -- 172.21.15.106:0/3414446916 >> 172.21.15.106:0/3414446916 conn(0x7fa5d00ab330 msgr2=0x7fa5d00ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:28.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5d62df640 1 -- 172.21.15.106:0/3414446916 shutdown_connections 2023-12-22T09:17:28.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.217+0000 7fa5d62df640 1 -- 172.21.15.106:0/3414446916 wait complete. 2023-12-22T09:17:28.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.219+0000 7fa5d62df640 1 Processor -- start 2023-12-22T09:17:28.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.219+0000 7fa5d62df640 1 -- start start 2023-12-22T09:17:28.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.220+0000 7fa5d62df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5bc004d00 0x7fa5d00c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.220+0000 7fa5d62df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5d0147ce0 0x7fa5d01e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.220+0000 7fa5d62df640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d0148230 0x7fa5d00aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.220+0000 7fa5d62df640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d01e8c70 con 0x7fa5d0148230 2023-12-22T09:17:28.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.220+0000 7fa5d62df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d01e91d0 con 0x7fa5d0147ce0 2023-12-22T09:17:28.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.220+0000 7fa5d62df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00c2d70 con 0x7fa5bc004d00 2023-12-22T09:17:28.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5d487c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d0148230 0x7fa5d00aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5d487c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d0148230 0x7fa5d00aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39236/0 (socket says 172.21.15.106:39236) 2023-12-22T09:17:28.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5d487c640 1 -- 172.21.15.106:0/1606184025 learned_addr learned my addr 172.21.15.106:0/1606184025 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5cffff640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5bc004d00 0x7fa5d00c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5cf7fe640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5d0147ce0 0x7fa5d01e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5d487c640 1 -- 172.21.15.106:0/1606184025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5bc004d00 msgr2=0x7fa5d00c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5d487c640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5bc004d00 0x7fa5d00c2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5d487c640 1 -- 172.21.15.106:0/1606184025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5d0147ce0 msgr2=0x7fa5d01e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5d487c640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5d0147ce0 0x7fa5d01e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5d487c640 1 -- 172.21.15.106:0/1606184025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d01e9ba0 con 0x7fa5d0148230 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5cf7fe640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5d0147ce0 0x7fa5d01e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.221+0000 7fa5d487c640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d0148230 0x7fa5d00aa4d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa5c802c4a0 tx=0x7fa5c80019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.222+0000 7fa5ccff9640 1 -- 172.21.15.106:0/1606184025 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c803c040 con 0x7fa5d0148230 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.222+0000 7fa5ccff9640 1 -- 172.21.15.106:0/1606184025 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c802cc40 con 0x7fa5d0148230 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.222+0000 7fa5ccff9640 1 -- 172.21.15.106:0/1606184025 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8001b80 con 0x7fa5d0148230 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.222+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d01ecbf0 con 0x7fa5d0148230 2023-12-22T09:17:28.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.222+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d01e8e60 con 0x7fa5d0148230 2023-12-22T09:17:28.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.223+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d01e9380 con 0x7fa5d0148230 2023-12-22T09:17:28.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.224+0000 7fa5ccff9640 1 -- 172.21.15.106:0/1606184025 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5c8032070 con 0x7fa5d0148230 2023-12-22T09:17:28.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.225+0000 7fa5ccff9640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa5b006a460 0x7fa5b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.225+0000 7fa5ccff9640 1 -- 172.21.15.106:0/1606184025 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fa5c80a9ee0 con 0x7fa5d0148230 2023-12-22T09:17:28.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.225+0000 7fa5cffff640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa5b006a460 0x7fa5b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.226+0000 7fa5cffff640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa5b006a460 0x7fa5b006c920 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0004b30 tx=0x7fa5c000d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:28.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.229+0000 7fa5ccff9640 1 -- 172.21.15.106:0/1606184025 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5d01e9380 con 0x7fa5d0148230 2023-12-22T09:17:28.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.486+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7fa5d01e9380 con 0x7fa5d0148230 2023-12-22T09:17:28.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.492+0000 7fa5ccff9640 1 -- 172.21.15.106:0/1606184025 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v18) v1 ==== 291+0+0 (secure 0 0 0) 0x7fa5d01e9380 con 0x7fa5d0148230 2023-12-22T09:17:28.493 INFO:teuthology.orchestra.run.smithi106.stderr:added key for client.testuser 2023-12-22T09:17:28.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.494+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa5b006a460 msgr2=0x7fa5b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.494+0000 7fa5d62df640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa5b006a460 0x7fa5b006c920 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0004b30 tx=0x7fa5c000d040 comp rx=0 tx=0).stop 2023-12-22T09:17:28.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.494+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d0148230 msgr2=0x7fa5d00aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.494+0000 7fa5d62df640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d0148230 0x7fa5d00aa4d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa5c802c4a0 tx=0x7fa5c80019a0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.495+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 shutdown_connections 2023-12-22T09:17:28.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.495+0000 7fa5d62df640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7fa5b006a460 0x7fa5b006c920 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.495+0000 7fa5d62df640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d0148230 0x7fa5d00aa4d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.495+0000 7fa5d62df640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5d0147ce0 0x7fa5d01e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.495+0000 7fa5d62df640 1 --2- 172.21.15.106:0/1606184025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5bc004d00 0x7fa5d00c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.495+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 >> 172.21.15.106:0/1606184025 conn(0x7fa5d00ab330 msgr2=0x7fa5d00c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:28.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.495+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 shutdown_connections 2023-12-22T09:17:28.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.495+0000 7fa5d62df640 1 -- 172.21.15.106:0/1606184025 wait complete. 2023-12-22T09:17:28.515 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-22T09:17:28.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.716+0000 7f42f3838640 1 Processor -- start 2023-12-22T09:17:28.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.716+0000 7f42f3838640 1 -- start start 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.717+0000 7f42f3838640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42ec069e60 0x7f42ec14a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.717+0000 7f42f3838640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42ec150a80 0x7f42ec14abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.717+0000 7f42f3838640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec0bfce0 con 0x7f42ec071ea0 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.717+0000 7f42f3838640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec0c0960 con 0x7f42ec069e60 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.717+0000 7f42f3838640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec06aba0 con 0x7f42ec150a80 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42f1dd5640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f42ec071ea0 0x7f42ec151f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40740/0 (socket says 172.21.15.106:40740) 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42f1dd5640 1 -- 172.21.15.106:0/1339307249 learned_addr learned my addr 172.21.15.106:0/1339307249 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522412635 0 0) 0x7f42ec0bfce0 con 0x7f42ec071ea0 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42f15d4640 1 --2- 172.21.15.106:0/1339307249 >> v2:172.21.15.132:3300/0 conn(0x7f42ec069e60 0x7f42ec14a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d8003520 con 0x7f42ec071ea0 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42f0dd3640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42ec150a80 0x7f42ec14abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645399620 0 0) 0x7f42d8003520 con 0x7f42ec071ea0 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42ec150a80 msgr2=0x7f42ec14abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42ec150a80 0x7f42ec14abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 >> v2:172.21.15.132:3300/0 conn(0x7f42ec069e60 msgr2=0x7f42ec14a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 --2- 172.21.15.106:0/1339307249 >> v2:172.21.15.132:3300/0 conn(0x7f42ec069e60 0x7f42ec14a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec0bffc0 con 0x7f42ec071ea0 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1728288147 0 0) 0x7f42e40019f0 con 0x7f42ec071ea0 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42f15d4640 1 --2- 172.21.15.106:0/1339307249 >> v2:172.21.15.132:3300/0 conn(0x7f42ec069e60 0x7f42ec14a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 >> v1:172.21.15.106:6789/0 conn(0x7f42ec071ea0 legacy=0x7f42ec151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42ec150a80 0x7f42d80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d8004020 0x7f42d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c0960 con 0x7f42d8004d00 2023-12-22T09:17:28.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec06aba0 con 0x7f42d8004020 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.718+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d800de50 con 0x7f42ec150a80 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.719+0000 7f42f1dd5640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.719+0000 7f42f15d4640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42ec150a80 0x7f42d80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.719+0000 7f42f0dd3640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d8004020 0x7f42d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.719+0000 7f42f1dd5640 1 -- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42ec150a80 msgr2=0x7f42d80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.719+0000 7f42f1dd5640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42ec150a80 0x7f42d80039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.719+0000 7f42f1dd5640 1 -- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d8004020 msgr2=0x7f42d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.719+0000 7f42f1dd5640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d8004020 0x7f42d80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.719+0000 7f42f1dd5640 1 -- 172.21.15.106:0/1339307249 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8003520 con 0x7f42d8004d00 2023-12-22T09:17:28.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.720+0000 7f42f1dd5640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f42e400a760 tx=0x7f42d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41ec77bb0fc91bc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:28.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.720+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4034630 con 0x7f42d8004d00 2023-12-22T09:17:28.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.720+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e402f070 con 0x7f42d8004d00 2023-12-22T09:17:28.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.720+0000 7f42e3fff640 1 -- 172.21.15.106:0/1339307249 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4034a50 con 0x7f42d8004d00 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.721+0000 7f42f3838640 1 -- 172.21.15.106:0/1339307249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8004d00 msgr2=0x7f42d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.721+0000 7f42f3838640 1 --2- 172.21.15.106:0/1339307249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f42e400a760 tx=0x7f42d80057f0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.721+0000 7f42f1dd5640 1 -- 172.21.15.106:0/1339307249 reap_dead start 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.721+0000 7f42f3838640 1 -- 172.21.15.106:0/1339307249 shutdown_connections 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.721+0000 7f42f3838640 1 -- 172.21.15.106:0/1339307249 >> 172.21.15.106:0/1339307249 conn(0x7f42ec0c5360 msgr2=0x7f42ec0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.721+0000 7f42f3838640 1 -- 172.21.15.106:0/1339307249 shutdown_connections 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.721+0000 7f42f3838640 1 -- 172.21.15.106:0/1339307249 wait complete. 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.723+0000 7f42f3838640 1 Processor -- start 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.723+0000 7f42f3838640 1 -- start start 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f3838640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42d8004d00 0x7f42ec1deba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f3838640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42ec0c4420 0x7f42ec142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f3838640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42ec143210 0x7f42ec1ec870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f3838640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec148830 con 0x7f42ec143210 2023-12-22T09:17:28.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f3838640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec143690 con 0x7f42ec0c4420 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f3838640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec1494e0 con 0x7f42d8004d00 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f1dd5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42ec143210 0x7f42ec1ec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f1dd5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42ec143210 0x7f42ec1ec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39260/0 (socket says 172.21.15.106:39260) 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f1dd5640 1 -- 172.21.15.106:0/515861029 learned_addr learned my addr 172.21.15.106:0/515861029 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f0dd3640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42ec0c4420 0x7f42ec142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f1dd5640 1 -- 172.21.15.106:0/515861029 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42d8004d00 msgr2=0x7f42ec1deba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f15d4640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42d8004d00 0x7f42ec1deba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f1dd5640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42d8004d00 0x7f42ec1deba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f1dd5640 1 -- 172.21.15.106:0/515861029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42ec0c4420 msgr2=0x7f42ec142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f1dd5640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42ec0c4420 0x7f42ec142cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f1dd5640 1 -- 172.21.15.106:0/515861029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec148b40 con 0x7f42ec143210 2023-12-22T09:17:28.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.724+0000 7f42f0dd3640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42ec0c4420 0x7f42ec142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T09:17:28.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.725+0000 7f42f1dd5640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42ec143210 0x7f42ec1ec870 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f42e400a760 tx=0x7f42e4001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:28.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.725+0000 7f42e1ffb640 1 -- 172.21.15.106:0/515861029 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4040480 con 0x7f42ec143210 2023-12-22T09:17:28.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.725+0000 7f42e1ffb640 1 -- 172.21.15.106:0/515861029 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e40405e0 con 0x7f42ec143210 2023-12-22T09:17:28.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.725+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec148e20 con 0x7f42ec143210 2023-12-22T09:17:28.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.725+0000 7f42e1ffb640 1 -- 172.21.15.106:0/515861029 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4040950 con 0x7f42ec143210 2023-12-22T09:17:28.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.725+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec0c4f00 con 0x7f42ec143210 2023-12-22T09:17:28.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.726+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec1ec590 con 0x7f42ec143210 2023-12-22T09:17:28.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.727+0000 7f42e1ffb640 1 -- 172.21.15.106:0/515861029 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f42e4031030 con 0x7f42ec143210 2023-12-22T09:17:28.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.728+0000 7f42e1ffb640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42d006a430 0x7f42d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T09:17:28.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.728+0000 7f42e1ffb640 1 -- 172.21.15.106:0/515861029 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f42e40aab50 con 0x7f42ec143210 2023-12-22T09:17:28.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.728+0000 7f42f15d4640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42d006a430 0x7f42d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T09:17:28.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.729+0000 7f42f15d4640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42d006a430 0x7f42d006c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42e800e920 tx=0x7f42e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T09:17:28.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.732+0000 7f42e1ffb640 1 -- 172.21.15.106:0/515861029 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f42ec1ec590 con 0x7f42ec143210 2023-12-22T09:17:28.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.993+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f42ec1ec590 con 0x7f42ec143210 2023-12-22T09:17:28.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.993+0000 7f42e1ffb640 1 -- 172.21.15.106:0/515861029 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+245 (secure 0 0 0) 0x7f42ec1ec590 con 0x7f42ec143210 2023-12-22T09:17:28.994 INFO:teuthology.orchestra.run.smithi106.stdout:[client.testuser] 2023-12-22T09:17:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAoVIVlrPYZHRAAffGWAB/yza0RRo4wrYGlaA== 2023-12-22T09:17:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-22T09:17:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-12-22T09:17:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-22T09:17:28.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42d006a430 msgr2=0x7f42d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42d006a430 0x7f42d006c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42e800e920 tx=0x7f42e8008040 comp rx=0 tx=0).stop 2023-12-22T09:17:28.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42ec143210 msgr2=0x7f42ec1ec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T09:17:28.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42ec143210 0x7f42ec1ec870 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f42e400a760 tx=0x7f42e4001cb0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 shutdown_connections 2023-12-22T09:17:28.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:6832/88400,v1:172.21.15.106:6833/88400] conn(0x7f42d006a430 0x7f42d006c8f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42ec143210 0x7f42ec1ec870 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42ec0c4420 0x7f42ec142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 --2- 172.21.15.106:0/515861029 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42d8004d00 0x7f42ec1deba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T09:17:28.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 >> 172.21.15.106:0/515861029 conn(0x7f42ec0c5360 msgr2=0x7f42ec144380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T09:17:28.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 shutdown_connections 2023-12-22T09:17:28.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-12-22T09:17:28.996+0000 7f42f3838640 1 -- 172.21.15.106:0/515861029 wait complete. 2023-12-22T09:17:29.016 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2023-12-22T09:17:29.070 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.fDqdLY0eFm 2023-12-22T09:17:29.071 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-12-22T09:17:29.071 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/tmp/tmp.fDqdLY0eFm 2023-12-22T09:17:29.084 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 309, in copy_and_close shutil.copyfileobj(src, fdst) File "/usr/lib/python3.8/shutil.py", line 202, in copyfileobj fsrc_read = fsrc.read AttributeError: 'RemoteProcess' object has no attribute 'read' 2023-12-22T09:17:51.174 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:17:51.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:18:21.351 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:18:21.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:18:51.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:18:51.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:19:21.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:19:21.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:19:52.127 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:19:52.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:20:22.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:20:22.296 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:20:52.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:20:52.461 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:21:22.637 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:21:22.647 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:21:52.860 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:21:52.870 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:22:22.999 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:22:23.009 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:22:53.188 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:22:53.198 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:23:23.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:23:23.354 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:23:53.499 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:23:53.509 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:24:23.656 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:24:23.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:24:53.793 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:24:53.803 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:25:23.940 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:25:23.950 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:25:54.079 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:25:54.089 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:26:24.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:26:24.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:26:54.412 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:26:54.422 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:27:24.668 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:27:24.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:27:54.817 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:27:54.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:28:25.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:28:25.100 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:28:55.244 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:28:55.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:29:25.393 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:29:25.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:29:55.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:29:55.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:30:25.781 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:30:25.791 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:30:55.953 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:30:55.993 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:31:26.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:31:26.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:31:56.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:31:56.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:32:26.781 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:32:26.791 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:32:56.941 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:32:56.951 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:33:27.075 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:33:27.085 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:33:57.308 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:33:57.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:34:27.473 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:34:27.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:34:57.640 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:34:57.651 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:35:27.800 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:35:27.810 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:35:57.948 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:35:57.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:36:28.104 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:36:28.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:36:58.327 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:36:58.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:37:28.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:37:28.477 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:37:58.606 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:37:58.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:38:28.846 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:38:28.857 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:38:58.983 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:38:58.992 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:39:29.192 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:39:29.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:39:59.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:39:59.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:40:29.583 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:40:29.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:40:59.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:40:59.731 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:41:29.878 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:41:29.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:42:00.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:42:00.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:42:30.180 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:42:30.190 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:43:00.335 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:43:00.345 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:43:30.482 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:43:30.492 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:44:00.622 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:44:00.632 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:44:30.771 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:44:30.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:45:00.914 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:45:00.926 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:45:31.068 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:45:31.078 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:46:01.241 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:46:01.251 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:46:31.473 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:46:31.483 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:47:01.612 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:47:01.622 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:47:31.778 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:47:31.788 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:48:01.920 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:48:01.932 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:48:32.072 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:48:32.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:49:02.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:49:02.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:49:32.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:49:32.465 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:50:02.632 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:50:02.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:50:32.817 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:50:32.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:51:02.996 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:51:03.006 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:51:33.218 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:51:33.228 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:52:03.537 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:52:03.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:52:33.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:52:33.693 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:53:03.832 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:53:03.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:53:33.968 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:53:33.978 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:54:04.115 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:54:04.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:54:34.284 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:54:34.294 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:55:04.415 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:55:04.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:55:34.720 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:55:34.730 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:56:04.868 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:56:04.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:56:35.009 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:56:35.019 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:57:05.161 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:57:05.171 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:57:35.299 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:57:35.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:58:05.446 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:58:05.456 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:58:35.698 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:58:35.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:59:05.853 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:59:05.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:59:36.103 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T09:59:36.113 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:00:06.257 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:00:06.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:00:36.521 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:00:36.531 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:01:06.697 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:01:06.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:01:36.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:01:36.850 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:02:06.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:02:06.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:02:37.145 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:02:37.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:07.319 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:07.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:37.461 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:37.471 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:04:07.613 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:04:07.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:04:37.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:04:37.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:05:08.212 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:05:08.223 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:05:38.340 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:05:38.350 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:06:08.527 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:06:08.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:06:38.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:06:38.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:07:08.816 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:07:08.826 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:07:38.976 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:07:38.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:08:09.151 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:08:09.161 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:08:39.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:08:39.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:09:09.724 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:09:09.734 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:09:39.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:09:39.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:10:10.051 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:10:10.061 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:10:40.225 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:10:40.234 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:11:10.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:11:10.380 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:11:40.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:11:40.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:12:10.664 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:12:10.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:12:40.837 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:12:40.848 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:13:10.975 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:13:10.985 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:13:41.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:13:41.122 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:14:11.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:14:11.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:14:41.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:14:41.410 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:15:11.537 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:15:11.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:15:41.693 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:15:41.703 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:16:11.831 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:16:11.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:16:41.989 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:16:41.999 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:17:12.188 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:17:12.198 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:17:42.528 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:17:42.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:18:12.669 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:18:12.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:18:42.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:18:42.850 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:19:12.988 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:19:12.998 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:19:43.161 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:19:43.172 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:20:13.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:20:13.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:20:43.523 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:20:43.533 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:21:13.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:21:13.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:21:43.949 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:21:43.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:22:14.103 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:22:14.113 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:22:44.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:22:44.265 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:23:14.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:23:14.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:23:44.560 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:23:44.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:24:14.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:24:14.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:24:44.864 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:24:44.875 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:25:15.028 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:25:15.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:25:45.200 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:25:45.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:26:15.347 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:26:15.357 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:26:45.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:26:45.531 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:27:15.698 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:27:15.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:27:45.862 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:27:45.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:28:16.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:28:16.028 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:28:46.156 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:28:46.167 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:29:16.320 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:29:16.330 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:29:46.461 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:29:46.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:30:16.639 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:30:16.649 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:30:46.785 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:30:46.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:31:16.933 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:31:16.943 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:31:47.074 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:31:47.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:32:17.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:32:17.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:32:47.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:32:47.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:33:17.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:33:17.745 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:33:48.090 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:33:48.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:34:18.248 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:34:18.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:34:48.395 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:34:48.406 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:35:18.567 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:35:18.577 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:35:48.706 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:35:48.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:36:18.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:36:18.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:36:49.074 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:36:49.085 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:37:19.288 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:37:19.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:37:49.501 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:37:49.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:38:19.691 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:38:19.701 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:38:49.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:38:49.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:39:20.050 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:39:20.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:39:50.215 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:39:50.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:40:20.412 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:40:20.422 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:40:50.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:40:50.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:41:20.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:41:20.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:41:51.069 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:41:51.078 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:42:21.232 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:42:21.242 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:42:51.421 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:42:51.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:43:21.618 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:43:21.628 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:43:51.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:43:51.851 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:44:22.054 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:44:22.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:44:52.293 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:44:52.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:45:22.507 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:45:22.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:45:52.838 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:45:52.848 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:46:22.970 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:46:22.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:46:53.198 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:46:53.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:47:23.334 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:47:23.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:47:53.497 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:47:53.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:48:23.886 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:48:23.897 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:48:54.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:48:54.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:49:24.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:49:24.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:49:54.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:49:54.488 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:50:24.690 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:50:24.700 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:50:54.896 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:50:54.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:51:25.093 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:51:25.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:51:55.310 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:51:55.323 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:52:25.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:52:25.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:52:55.760 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:52:55.770 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:53:25.973 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:53:25.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:53:56.238 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:53:56.248 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:54:26.375 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:54:26.386 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:54:56.564 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:54:56.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:55:26.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:55:26.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:55:57.128 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:55:57.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:56:27.284 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:56:27.294 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:56:57.448 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:56:57.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:57:27.658 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:57:27.668 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:57:57.881 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:57:57.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:58:28.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:58:28.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:58:58.267 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:58:58.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:59:28.415 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:59:28.425 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:59:58.638 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:59:58.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:00:29.010 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:00:29.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:00:59.224 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:00:59.234 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:01:29.369 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:01:29.379 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:01:59.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:01:59.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:02:29.733 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:02:29.744 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:03:00.090 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:03:00.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:03:30.396 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:03:30.406 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:04:00.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:04:00.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:04:30.763 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:04:30.782 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:05:00.969 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:05:00.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:05:31.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:05:31.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:06:01.340 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:06:01.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:06:31.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:06:31.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:07:01.692 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:07:01.703 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:07:31.915 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:07:31.925 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:08:02.145 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:08:02.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:08:32.334 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:08:32.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:09:02.556 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:09:02.566 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:09:32.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:09:32.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:10:02.934 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:10:02.944 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:10:33.168 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:10:33.178 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:11:03.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:11:03.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:11:33.710 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:11:33.720 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:12:03.850 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:12:03.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:12:34.064 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:12:34.074 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:13:04.264 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:13:04.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:13:34.551 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:13:34.561 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:14:04.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:14:04.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:14:34.877 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:14:34.887 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:15:05.137 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:15:05.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:15:35.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:15:35.371 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:16:05.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:16:05.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:16:35.689 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:16:35.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:17:05.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:17:05.916 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:17:36.118 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:17:36.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:18:06.316 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:18:06.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:18:36.505 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:18:36.515 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:19:06.718 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:19:06.729 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:19:36.933 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:19:36.943 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:20:07.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:20:07.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:20:37.302 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:20:37.312 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:21:07.507 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:21:07.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:21:37.704 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:21:37.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:22:07.901 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:22:07.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:22:38.189 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:22:38.199 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:23:08.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:23:08.339 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:23:38.534 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:23:38.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:24:08.747 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:24:08.757 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:24:38.964 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:24:38.974 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:25:09.123 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:25:09.134 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:25:39.321 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:25:39.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:26:09.543 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:26:09.553 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:26:39.724 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:26:39.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:27:09.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:27:09.955 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:27:40.134 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:27:40.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:28:10.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:28:10.375 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:28:40.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:28:40.591 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:29:10.787 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:29:10.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:29:40.979 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:29:40.989 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:30:11.134 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:30:11.144 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:30:41.365 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:30:41.376 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:31:11.512 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:31:11.523 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:31:41.761 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:31:41.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:32:11.933 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:32:11.943 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:32:42.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:32:42.123 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:33:12.303 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:33:12.313 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:33:42.480 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:33:42.490 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:34:12.669 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:34:12.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:34:42.898 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:34:42.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:35:13.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:35:13.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:35:43.209 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:35:43.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:36:13.379 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:36:13.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:36:43.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:36:43.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:37:13.799 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:37:13.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:37:43.997 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:37:44.007 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:38:14.237 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:38:14.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:38:44.434 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:38:44.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:39:14.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:39:14.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:39:44.793 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:39:44.803 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:40:14.955 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:40:14.965 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:40:45.191 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:40:45.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:41:15.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:41:15.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:41:45.529 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:41:45.539 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:42:15.701 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:42:15.712 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:42:45.900 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:42:45.910 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:43:16.088 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:43:16.098 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:43:46.310 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:43:46.321 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:44:16.531 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:44:16.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:44:46.678 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:44:46.688 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:45:16.879 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:45:16.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:45:47.038 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:45:47.048 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:46:17.327 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:46:17.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:46:47.524 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:46:47.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:47:17.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:47:17.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:47:47.819 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:47:47.830 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:48:18.065 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:48:18.076 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:48:48.263 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:48:48.273 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:49:18.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:49:18.429 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:49:48.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:49:48.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:50:18.881 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:50:18.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:50:49.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:50:49.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:51:19.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:51:19.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:51:49.468 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:51:49.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:52:19.671 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:52:19.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:52:49.854 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:52:49.864 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:53:20.069 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:53:20.080 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:53:50.273 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:53:50.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:54:20.503 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:54:20.513 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:54:50.717 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:54:50.727 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:55:20.947 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:55:20.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:55:51.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:55:51.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:56:21.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:56:21.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:56:51.546 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:56:51.556 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:57:21.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:57:21.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:57:51.948 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:57:51.958 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:58:22.171 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:58:22.181 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:58:52.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:58:52.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:59:22.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:59:22.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:59:52.728 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T11:59:52.738 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:00:22.925 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:00:22.935 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:00:53.114 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:00:53.124 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:01:23.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:01:23.296 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:01:53.491 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:01:53.502 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:02:23.689 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:02:23.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:02:53.885 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:02:53.895 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:03:24.107 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:03:24.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:03:54.297 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:03:54.307 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:04:24.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:04:24.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:04:54.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:04:54.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:05:24.920 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:05:24.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:05:55.076 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:05:55.087 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:06:25.313 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:06:25.323 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:06:55.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:06:55.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:07:25.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:07:25.752 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:07:55.932 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:07:55.943 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:08:26.155 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:08:26.164 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:08:56.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:08:56.370 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:09:26.559 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:09:26.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:09:56.773 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:09:56.783 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:10:26.920 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:10:26.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:10:57.069 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:10:57.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:11:27.258 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:11:27.268 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:11:57.439 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:11:57.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:12:27.652 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:12:27.663 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:12:57.833 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:12:57.844 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:13:28.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:13:28.014 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:13:58.260 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:13:58.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:14:28.457 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:14:28.466 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:14:58.875 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:14:58.885 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:15:29.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:15:29.032 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:15:59.220 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:15:59.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:16:29.376 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:16:29.386 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:16:59.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:16:59.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:17:29.740 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:17:29.750 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:17:59.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:17:59.958 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:18:30.175 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:18:30.186 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:19:00.347 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:19:00.358 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:19:30.527 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:19:30.537 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:20:00.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:20:00.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:20:30.952 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:20:30.961 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:21:01.142 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:21:01.152 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:21:31.372 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:21:31.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:22:01.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:22:01.563 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:22:31.776 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:22:31.786 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:23:01.932 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:23:01.942 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:23:32.120 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:23:32.131 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:24:02.318 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:24:02.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:24:32.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:24:32.558 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:25:02.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:25:02.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:25:32.959 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:25:32.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:26:03.173 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:26:03.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:26:33.411 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:26:33.421 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:27:03.601 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:27:03.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:27:33.822 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:27:33.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:28:04.028 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:28:04.038 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:28:34.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:28:34.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:29:04.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:29:04.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:29:34.653 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:29:34.663 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:30:05.092 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:30:05.101 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:30:35.238 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:30:35.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:31:05.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:31:05.454 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:31:35.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:31:35.693 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:32:05.913 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:32:05.923 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:32:36.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:32:36.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:33:06.252 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:33:06.262 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:33:36.465 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:33:36.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:34:06.646 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:34:06.656 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:34:36.827 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:34:36.838 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:35:07.221 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:35:07.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:35:37.377 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:35:37.387 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:36:07.546 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:36:07.557 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:36:37.745 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:36:37.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:37:07.894 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:37:07.904 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:37:38.106 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:37:38.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:38:08.320 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:38:08.330 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:38:38.535 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:38:38.544 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:39:08.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:39:08.782 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:39:38.929 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:39:38.939 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:40:09.135 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:40:09.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:40:39.374 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:40:39.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:41:09.589 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:41:09.599 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:41:39.741 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:41:39.752 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:42:09.956 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:42:09.966 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:42:40.162 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:42:40.172 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:43:10.367 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:43:10.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:43:40.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:43:40.597 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:44:10.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:44:10.811 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:44:41.008 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:44:41.018 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:45:11.321 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:45:11.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:45:41.509 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:45:41.520 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:46:11.740 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:46:11.750 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:46:41.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:46:41.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:47:12.101 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:47:12.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:47:42.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:47:42.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:48:12.502 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:48:12.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:48:42.657 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:48:42.667 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:49:12.819 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:49:12.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:49:43.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:49:43.035 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:50:13.231 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:50:13.242 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:50:43.412 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:50:43.421 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:51:13.660 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:51:13.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:51:43.891 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:51:43.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:52:14.097 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:52:14.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:52:44.244 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:52:44.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:53:14.465 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:53:14.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:53:44.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:53:44.672 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:54:14.833 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:54:14.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:54:44.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:54:44.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:55:15.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:55:15.188 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:55:45.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:55:45.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:56:15.530 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:56:15.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:56:45.753 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:56:45.763 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:57:15.957 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:57:15.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:57:46.187 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:57:46.197 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:58:16.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:58:16.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:58:46.556 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:58:46.566 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:59:16.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:59:16.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:59:46.951 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T12:59:46.962 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:00:17.098 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:00:17.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:00:47.236 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:00:47.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:01:17.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:01:17.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:01:47.635 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:01:47.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:02:17.802 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:02:17.812 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:02:48.014 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:02:48.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:03:18.219 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:03:18.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:03:48.410 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:03:48.421 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:04:18.582 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:04:18.592 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:04:48.870 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:04:48.881 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:05:19.075 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:05:19.085 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:05:49.288 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:05:49.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:06:19.514 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:06:19.525 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:06:49.749 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:06:49.759 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:07:19.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:07:19.973 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:07:50.168 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:07:50.178 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:08:20.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:08:20.374 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:08:50.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:08:50.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:09:20.766 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:09:20.776 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:09:51.073 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:09:51.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:10:21.229 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:10:21.240 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:10:51.376 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:10:51.386 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:11:21.524 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:11:21.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:11:51.702 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:11:51.712 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:12:21.924 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:12:21.933 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:12:52.143 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:12:52.153 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:13:22.276 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:13:22.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:13:52.438 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:13:52.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:14:22.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:14:22.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:14:52.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:14:52.776 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:15:22.931 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:15:22.941 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:15:53.137 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:15:53.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:16:23.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:16:23.353 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:16:53.590 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:16:53.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:17:23.780 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:17:23.790 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:17:53.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:17:53.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:18:24.201 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:18:24.211 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:18:54.351 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:18:54.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:19:24.564 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:19:24.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:19:54.736 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:19:54.746 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:20:24.910 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:20:24.921 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:20:55.139 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:20:55.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:21:25.369 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:21:25.379 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:21:55.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:21:55.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:22:25.747 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:22:25.758 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:22:55.961 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:22:55.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:23:26.217 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:23:26.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:23:56.390 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:23:56.400 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:24:26.612 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:24:26.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:24:56.768 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:24:56.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:25:26.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:25:27.006 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:25:57.206 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:25:57.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:26:27.446 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:26:27.456 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:26:57.669 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:26:57.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:27:27.818 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:27:27.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:27:58.055 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:27:58.065 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:28:28.237 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:28:28.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:28:58.461 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:28:58.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:29:28.612 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:29:28.622 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:29:58.763 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:29:58.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:30:28.978 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:30:28.996 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:30:59.153 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:30:59.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:31:29.366 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:31:29.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:31:59.606 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:31:59.617 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:32:29.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:32:29.765 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:32:59.891 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:32:59.901 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:33:30.123 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:33:30.134 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:34:00.337 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:34:00.347 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:34:30.483 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:34:30.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:35:00.675 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:35:00.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:35:30.881 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:35:30.890 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:36:01.104 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:36:01.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:36:31.302 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:36:31.312 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:37:01.484 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:37:01.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:37:31.688 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:37:31.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:38:01.912 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:38:01.922 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:38:32.159 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:38:32.169 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:39:02.316 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:39:02.326 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:39:32.495 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:39:32.505 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:40:02.649 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:40:02.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:40:32.834 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:40:32.844 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:41:03.039 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:41:03.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:41:33.300 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:41:33.310 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:42:03.493 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:42:03.503 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:42:33.656 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:42:33.667 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:43:03.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:43:03.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:43:34.110 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:43:34.120 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:44:04.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:44:04.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:44:34.480 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:44:34.490 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:45:04.686 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:45:04.696 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:45:34.901 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:45:34.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:46:05.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:46:05.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:46:35.369 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:46:35.378 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:47:05.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:47:05.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:47:35.720 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:47:35.731 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:48:05.895 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:48:05.905 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:48:36.125 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:48:36.135 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:49:06.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:49:06.339 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:49:36.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:49:36.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:50:06.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:50:06.749 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:50:36.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:50:36.894 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:51:07.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:51:07.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:51:37.321 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:51:37.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:52:07.518 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:52:07.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:52:37.791 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:52:37.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:53:07.979 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:53:07.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:53:38.192 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:53:38.203 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:54:08.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:54:08.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:54:38.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:54:38.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:55:08.832 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:55:08.842 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:55:39.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:55:39.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:56:09.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:56:09.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:56:39.434 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:56:39.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:57:09.656 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:57:09.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:57:39.828 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:57:39.839 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:58:10.030 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:58:10.040 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:58:40.225 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:58:40.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:59:10.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:59:10.464 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:59:40.655 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T13:59:40.665 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:00:10.819 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:00:10.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:00:41.067 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:00:41.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:01:11.271 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:01:11.281 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:01:41.435 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:01:41.445 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:02:11.673 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:02:11.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:02:41.879 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:02:41.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:03:12.069 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:03:12.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:03:42.318 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:03:42.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:04:12.674 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:04:12.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:04:42.808 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:04:42.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:05:12.970 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:05:12.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:05:43.184 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:05:43.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:06:13.380 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:06:13.390 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:06:43.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:06:43.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:07:13.792 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:07:13.803 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:07:43.988 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:07:43.998 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:08:14.219 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:08:14.228 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:08:44.465 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:08:44.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:09:14.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:09:14.673 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:09:44.876 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:09:44.886 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:10:15.056 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:10:15.066 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:10:45.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:10:45.306 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:11:15.517 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:11:15.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:11:45.680 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:11:45.690 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:12:15.860 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:12:15.870 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:12:46.075 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:12:46.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:13:16.280 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:13:16.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:13:46.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:13:46.470 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:14:16.634 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:14:16.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:14:46.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:14:46.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:15:16.988 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:15:16.998 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:15:47.152 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:15:47.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:16:17.334 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:16:17.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:16:47.531 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:16:47.540 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:17:17.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:17:17.765 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:17:47.959 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:17:47.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:18:18.173 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:18:18.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:18:48.312 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:18:48.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:19:18.543 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:19:18.553 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:19:48.764 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:19:48.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:20:18.919 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:20:18.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:20:49.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:20:49.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:21:19.330 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:21:19.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:21:49.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:21:49.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:22:19.748 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:22:19.759 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:22:49.956 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:22:49.966 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:23:20.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:23:20.173 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:23:50.375 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:23:50.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:24:20.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:24:20.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:24:50.747 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:24:50.757 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:25:20.918 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:25:20.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:25:51.142 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:25:51.152 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:26:21.358 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:26:21.368 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:26:51.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:26:51.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:27:21.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:27:21.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:27:51.899 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:27:51.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:28:22.097 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:28:22.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:28:52.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:28:52.296 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:29:22.493 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:29:22.503 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:29:52.665 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:29:52.675 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:30:22.842 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:30:22.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:30:53.052 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:30:53.062 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:31:23.266 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:31:23.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:31:53.406 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:31:53.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:32:23.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:32:23.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:32:53.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:32:53.835 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:33:24.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:33:24.072 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:33:54.300 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:33:54.312 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:34:24.448 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:34:24.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:34:54.586 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:34:54.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:35:24.809 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:35:24.819 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:35:55.038 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:35:55.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:36:25.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:36:25.253 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:36:55.473 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:36:55.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:37:25.713 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:37:25.723 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:37:55.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:37:55.944 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:38:26.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:38:26.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:38:56.278 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:38:56.288 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:39:26.500 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:39:26.511 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:39:56.723 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:39:56.734 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:40:26.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:40:26.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:40:57.147 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:40:57.157 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:41:27.340 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:41:27.351 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:41:57.496 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:41:57.505 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:42:27.723 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:42:27.733 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:42:57.891 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:42:57.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:43:28.120 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:43:28.129 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:43:58.283 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:43:58.293 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:44:28.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:44:28.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:44:58.711 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:44:58.722 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:45:28.883 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:45:28.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:45:59.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:45:59.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:46:29.277 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:46:29.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:46:59.508 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:46:59.518 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:47:29.713 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:47:29.723 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:47:59.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:47:59.953 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:48:30.098 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:48:30.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:49:00.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:49:00.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:49:30.567 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:49:30.577 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:50:00.815 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:50:00.824 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:50:30.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:50:31.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:51:01.192 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:51:01.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:51:31.357 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:51:31.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:52:01.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:52:01.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:52:31.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:52:31.851 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:53:02.022 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:53:02.032 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:53:32.209 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:53:32.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:54:02.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:54:02.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:54:32.570 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:54:32.579 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:55:02.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:55:02.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:55:32.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:55:32.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:56:03.119 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:56:03.129 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:56:33.332 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:56:33.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:57:03.471 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:57:03.481 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:57:33.676 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:57:33.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:58:03.898 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:58:03.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:58:34.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:58:34.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:59:04.276 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:59:04.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:59:34.471 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T14:59:34.481 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:00:04.633 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:00:04.642 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:00:34.873 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:00:34.887 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:01:05.012 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:01:05.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:01:35.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:01:35.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:02:05.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:02:05.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:02:35.631 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:02:35.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:03:05.837 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:03:05.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:03:36.009 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:03:36.019 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:04:06.230 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:04:06.240 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:04:36.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:04:36.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:05:06.640 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:05:06.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:05:36.803 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:05:36.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:06:07.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:06:07.028 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:06:37.206 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:06:37.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:07:07.420 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:07:07.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:07:37.600 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:07:37.614 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:08:07.823 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:08:07.833 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:08:37.985 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:08:37.995 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:09:08.123 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:09:08.133 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:09:38.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:09:38.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:10:08.513 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:10:08.523 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:10:38.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:10:38.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:11:08.907 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:11:08.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:11:39.085 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:11:39.095 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:12:09.332 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:12:09.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:12:39.496 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:12:39.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:13:09.736 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:13:09.746 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:13:40.191 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:13:40.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:14:10.354 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:14:10.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:14:40.569 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:14:40.579 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:15:10.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:15:10.750 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:15:40.938 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:15:40.948 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:16:11.147 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:16:11.157 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:16:41.293 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:16:41.304 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:17:11.539 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:17:11.549 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:17:41.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:17:41.745 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:18:11.948 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:18:11.958 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:18:42.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:18:42.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:19:12.346 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:19:12.356 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:19:42.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:19:42.554 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:20:12.758 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:20:12.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:20:42.980 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:20:42.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:21:13.203 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:21:13.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:21:43.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:21:43.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:22:13.582 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:22:13.592 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:22:43.822 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:22:43.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:23:14.044 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:23:14.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:23:44.240 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:23:44.251 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:24:14.395 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:24:14.404 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:24:44.612 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:24:44.622 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:25:14.811 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:25:14.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:25:44.979 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:25:44.988 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:26:15.148 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:26:15.158 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:26:45.379 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:26:45.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:27:15.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:27:15.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:27:45.807 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:27:45.817 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:28:15.972 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:28:15.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:28:46.135 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:28:46.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:29:16.383 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:29:16.394 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:29:46.589 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:29:46.599 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:30:16.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:30:16.815 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:30:47.016 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:30:47.026 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:31:17.170 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:31:17.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:31:47.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:31:47.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:32:17.591 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:32:17.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:32:47.812 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:32:47.824 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:33:18.026 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:33:18.037 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:33:48.232 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:33:48.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:34:18.378 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:34:18.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:34:48.573 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:34:48.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:35:18.798 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:35:18.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:35:48.953 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:35:48.964 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:36:19.141 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:36:19.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:36:49.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:36:49.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:37:19.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:37:19.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:37:49.774 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:37:49.785 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:38:20.013 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:38:20.023 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:38:50.151 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:38:50.161 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:39:20.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:39:20.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:39:50.462 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:39:50.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:40:20.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:40:20.693 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:40:50.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:40:50.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:41:21.104 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:41:21.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:41:51.266 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:41:51.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:42:21.440 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:42:21.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:42:51.686 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:42:51.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:43:21.974 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:43:21.985 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:43:52.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:43:52.141 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:44:22.330 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:44:22.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:44:52.549 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:44:52.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:45:22.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:45:22.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:45:52.959 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:45:52.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:46:23.164 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:46:23.174 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:46:53.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:46:53.321 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:47:23.456 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:47:23.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:47:53.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:47:53.674 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:48:23.993 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:48:24.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:48:54.149 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:48:54.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:49:24.287 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:49:24.296 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:49:54.460 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:49:54.470 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:50:24.692 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:50:24.703 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:50:54.915 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:50:54.925 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:51:25.096 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:51:25.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:51:55.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:51:55.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:52:25.537 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:52:25.548 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:52:55.741 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:52:55.751 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:53:25.936 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:53:25.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:53:56.142 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:53:56.152 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:54:26.281 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:54:26.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:54:56.470 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:54:56.480 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:55:26.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:55:26.628 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:55:56.815 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:55:56.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:56:27.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:56:27.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:56:57.216 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:56:57.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:57:27.432 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:57:27.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:57:57.611 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:57:57.621 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:58:27.791 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:58:27.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:58:58.007 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:58:58.017 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:59:28.244 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:59:28.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:59:58.416 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T15:59:58.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:00:28.630 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:00:28.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:00:58.766 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:00:58.776 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:01:28.957 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:01:28.967 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:01:59.188 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:01:59.198 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:02:29.400 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:02:29.410 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:02:59.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:02:59.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:03:29.902 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:03:29.912 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:04:00.047 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:04:00.058 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:04:30.282 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:04:30.292 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:05:00.513 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:05:00.523 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:05:30.710 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:05:30.721 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:06:00.895 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:06:00.905 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:06:31.118 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:06:31.129 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:07:01.303 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:07:01.314 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:07:31.543 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:07:31.554 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:08:01.757 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:08:01.768 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:08:31.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:08:31.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:09:02.097 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:09:02.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:09:32.328 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:09:32.339 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:10:02.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:10:02.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:10:32.688 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:10:32.698 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:11:02.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:11:02.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:11:33.083 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:11:33.093 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:12:03.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:12:03.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:12:33.435 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:12:33.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:13:03.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:13:03.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:13:33.871 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:13:33.881 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:14:04.046 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:14:04.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:14:34.235 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:14:34.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:15:04.408 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:15:04.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:15:34.625 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:15:34.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:16:04.848 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:16:04.858 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:16:35.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:16:35.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:17:05.268 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:17:05.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:17:35.488 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:17:35.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:18:05.761 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:18:05.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:18:35.967 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:18:35.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:19:06.181 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:19:06.191 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:19:36.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:19:36.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:20:06.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:20:06.552 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:20:36.740 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:20:36.751 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:21:06.969 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:21:06.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:21:37.174 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:21:37.185 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:22:07.380 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:22:07.390 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:22:37.577 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:22:37.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:23:07.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:23:07.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:23:38.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:23:38.032 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:24:08.261 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:24:08.272 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:24:38.432 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:24:38.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:25:08.653 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:25:08.664 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:25:38.875 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:25:38.885 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:26:09.065 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:26:09.074 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:26:39.312 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:26:39.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:27:09.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:27:09.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:27:39.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:27:39.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:28:10.019 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:28:10.030 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:28:40.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:28:40.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:29:10.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:29:10.374 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:29:40.577 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:29:40.587 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:30:10.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:30:10.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:30:40.998 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:30:41.008 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:31:11.244 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:31:11.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:31:41.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:31:41.469 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:32:11.646 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:32:11.656 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:32:41.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:32:41.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:33:12.031 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:33:12.041 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:33:42.178 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:33:42.188 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:34:12.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:34:12.346 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:34:42.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:34:42.549 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:35:12.761 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:35:12.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:35:42.959 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:35:42.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:36:13.197 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:36:13.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:36:43.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:36:43.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:37:13.582 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:37:13.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:37:43.806 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:37:43.817 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:38:14.001 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:38:14.012 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:38:44.240 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:38:44.250 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:39:14.396 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:39:14.407 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:39:44.594 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:39:44.603 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:40:14.816 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:40:14.826 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:40:45.012 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:40:45.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:41:15.234 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:41:15.244 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:41:45.381 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:41:45.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:42:15.569 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:42:15.580 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:42:45.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:42:45.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:43:15.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:43:15.941 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:43:46.077 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:43:46.087 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:44:16.358 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:44:16.369 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:44:46.554 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:44:46.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:45:16.768 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:45:16.776 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:45:47.015 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:45:47.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:46:17.153 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:46:17.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:46:47.309 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:46:47.319 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:47:17.481 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:47:17.491 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:47:47.669 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:47:47.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:48:17.860 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:48:17.871 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:48:48.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:48:48.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:49:18.218 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:49:18.228 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:49:48.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:49:48.477 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:50:18.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:50:18.673 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:50:48.893 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:50:48.903 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:51:19.054 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:51:19.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:51:49.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:51:49.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:52:19.476 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:52:19.487 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:52:49.724 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:52:49.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:53:19.922 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:53:19.932 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:53:50.058 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:53:50.068 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:54:20.256 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:54:20.266 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:54:50.469 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:54:50.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:55:20.606 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:55:20.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:55:50.838 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:55:50.848 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:56:21.045 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:56:21.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:56:51.241 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:56:51.251 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:57:21.460 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:57:21.470 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:57:51.667 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:57:51.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:58:21.914 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:58:21.927 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:58:52.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:58:52.142 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:59:22.326 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:59:22.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:59:52.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T16:59:52.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:00:22.761 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:00:22.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:00:52.975 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:00:52.985 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:01:23.218 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:01:23.229 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:01:53.380 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:01:53.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:02:23.625 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:02:23.638 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:02:53.805 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:02:53.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:03:23.968 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:03:23.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:03:54.196 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:03:54.215 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:04:24.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:04:24.396 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:04:54.608 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:04:54.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:05:24.815 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:05:24.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:05:55.003 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:05:55.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:06:25.233 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:06:25.244 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:06:55.433 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:06:55.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:07:25.655 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:07:25.664 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:07:55.920 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:07:55.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:08:26.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:08:26.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:08:56.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:08:56.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:09:26.381 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:09:26.390 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:09:56.528 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:09:56.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:10:26.751 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:10:26.761 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:10:56.973 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:10:56.982 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:11:27.205 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:11:27.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:11:57.409 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:11:57.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:12:27.565 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:12:27.574 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:12:57.947 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:12:57.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:13:28.085 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:13:28.094 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:13:58.299 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:13:58.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:14:28.503 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:14:28.513 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:14:58.725 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:14:58.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:15:28.922 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:15:28.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:15:59.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:15:59.154 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:16:29.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:16:29.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:16:59.522 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:16:59.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:17:29.759 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:17:29.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:17:59.972 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:17:59.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:18:30.201 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:18:30.211 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:19:00.357 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:19:00.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:19:30.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:19:30.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:20:00.641 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:20:00.651 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:20:30.865 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:20:30.874 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:21:01.094 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:21:01.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:21:31.310 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:21:31.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:22:01.514 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:22:01.525 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:22:31.703 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:22:31.713 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:23:01.898 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:23:01.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:23:32.088 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:23:32.098 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:24:02.251 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:24:02.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:24:32.464 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:24:32.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:25:02.635 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:25:02.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:25:32.799 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:25:32.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:26:02.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:26:02.949 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:26:33.160 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:26:33.170 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:27:03.381 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:27:03.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:27:33.528 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:27:33.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:28:03.758 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:28:03.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:28:33.906 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:28:33.916 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:29:04.108 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:29:04.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:29:34.315 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:29:34.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:30:04.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:30:04.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:30:34.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:30:34.745 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:31:04.924 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:31:04.935 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:31:35.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:31:35.131 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:32:05.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:32:05.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:32:35.556 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:32:35.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:33:05.753 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:33:05.763 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:33:35.899 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:33:35.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:34:06.105 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:34:06.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:34:36.321 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:34:36.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:35:06.535 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:35:06.544 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:35:36.755 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:35:36.766 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:36:07.002 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:36:07.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:36:37.197 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:36:37.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:37:07.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:37:07.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:37:37.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:37:37.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:38:07.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:38:07.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:38:37.944 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:38:37.954 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:39:08.115 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:39:08.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:39:38.314 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:39:38.323 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:40:08.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:40:08.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:40:38.718 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:40:38.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:41:08.885 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:41:08.896 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:41:39.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:41:39.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:42:09.303 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:42:09.314 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:42:39.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:42:39.632 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:43:09.791 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:43:09.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:43:40.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:43:40.016 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:44:10.210 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:44:10.220 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:44:40.415 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:44:40.424 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:45:10.602 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:45:10.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:45:40.808 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:45:40.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:46:10.955 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:46:10.965 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:46:41.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:46:41.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:47:11.281 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:47:11.292 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:47:41.443 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:47:41.454 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:48:11.659 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:48:11.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:48:41.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:48:41.915 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:49:12.061 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:49:12.072 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:49:42.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:49:42.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:50:12.398 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:50:12.408 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:50:42.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:50:42.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:51:12.820 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:51:12.830 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:51:42.996 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:51:43.006 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:52:13.191 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:52:13.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:52:43.349 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:52:43.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:53:13.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:53:13.520 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:53:43.718 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:53:43.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:54:13.966 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:54:13.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:54:44.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:54:44.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:55:14.276 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:55:14.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:55:44.465 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:55:44.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:56:14.697 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:56:14.707 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:56:44.895 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:56:44.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:57:15.142 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:57:15.152 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:57:45.340 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:57:45.350 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:58:15.554 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:58:15.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:58:45.759 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:58:45.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:59:15.958 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:59:15.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:59:46.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T17:59:46.141 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:00:16.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:00:16.345 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:00:46.577 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:00:46.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:01:16.798 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:01:16.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:01:47.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:01:47.014 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:02:17.268 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:02:17.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:02:47.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:02:47.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:03:17.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:03:17.573 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:03:47.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:03:47.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:04:17.989 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:04:17.999 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:04:48.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:04:48.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:05:18.357 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:05:18.368 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:05:48.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:05:48.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:06:18.703 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:06:18.713 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:06:48.891 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:06:48.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:07:19.046 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:07:19.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:07:49.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:07:49.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:08:19.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:08:19.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:08:49.678 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:08:49.688 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:09:19.860 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:09:19.870 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:09:50.022 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:09:50.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:10:20.236 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:10:20.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:10:50.465 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:10:50.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:11:20.704 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:11:20.714 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:11:50.901 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:11:50.912 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:12:21.097 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:12:21.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:12:51.319 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:12:51.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:13:21.534 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:13:21.544 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:13:51.723 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:13:51.733 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:14:21.912 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:14:21.922 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:14:52.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:14:52.143 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:15:22.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:15:22.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:15:52.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:15:52.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:16:22.708 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:16:22.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:16:52.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:16:52.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:17:23.044 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:17:23.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:17:53.178 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:17:53.189 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:18:23.413 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:18:23.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:18:53.560 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:18:53.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:19:23.788 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:19:23.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:19:53.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:19:54.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:20:24.234 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:20:24.244 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:20:54.414 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:20:54.424 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:21:24.629 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:21:24.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:21:54.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:21:54.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:22:25.097 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:22:25.107 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:22:55.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:22:55.321 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:23:25.458 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:23:25.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:23:55.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:23:55.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:24:25.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:24:25.811 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:24:56.033 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:24:56.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:25:26.221 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:25:26.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:25:56.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:25:56.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:26:26.631 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:26:26.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:26:56.952 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:26:56.963 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:27:27.169 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:27:27.179 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:27:57.321 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:27:57.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:28:27.496 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:28:27.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:28:57.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:28:57.744 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:29:27.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:29:27.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:29:58.117 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:29:58.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:30:28.322 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:30:28.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:30:58.521 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:30:58.531 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:31:28.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:31:28.746 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:31:58.974 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:31:58.987 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:32:29.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:32:29.222 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:32:59.357 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:32:59.371 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:33:29.603 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:33:29.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:33:59.750 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:33:59.760 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:34:29.955 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:34:29.965 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:35:00.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:35:00.153 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:35:30.366 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:35:30.376 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:36:00.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:36:00.572 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:36:30.711 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:36:30.721 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:37:00.914 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:37:00.924 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:37:31.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:37:31.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:38:01.291 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:38:01.302 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:38:31.522 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:38:31.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:39:01.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:39:01.738 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:39:31.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:39:31.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:40:02.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:40:02.131 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:40:32.261 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:40:32.271 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:41:02.474 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:41:02.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:41:32.628 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:41:32.638 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:42:02.832 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:42:02.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:42:32.975 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:42:32.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:43:03.154 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:43:03.164 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:43:33.393 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:43:33.403 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:44:03.633 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:44:03.644 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:44:33.798 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:44:33.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:45:04.027 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:45:04.037 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:45:34.233 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:45:34.242 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:46:04.446 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:46:04.455 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:46:34.679 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:46:34.690 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:47:04.831 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:47:04.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:47:35.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:47:35.082 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:48:05.269 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:48:05.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:48:35.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:48:35.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:49:05.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:49:05.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:49:35.942 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:49:35.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:50:06.182 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:50:06.191 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:50:36.353 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:50:36.365 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:51:06.594 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:51:06.605 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:51:36.773 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:51:36.785 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:52:06.962 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:52:06.974 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:52:37.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:52:37.188 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:53:07.407 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:53:07.417 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:53:37.622 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:53:37.631 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:54:07.814 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:54:07.824 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:54:37.951 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:54:37.962 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:55:08.166 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:55:08.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:55:38.380 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:55:38.390 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:56:08.593 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:56:08.605 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:56:38.860 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:56:38.871 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:57:09.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:57:09.101 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:57:39.279 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:57:39.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:58:09.452 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:58:09.463 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:58:39.652 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:58:39.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:59:09.901 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:59:09.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:59:40.048 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T18:59:40.057 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:00:10.254 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:00:10.265 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:00:40.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:00:40.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:01:10.598 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:01:10.610 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:01:40.812 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:01:40.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:02:10.984 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:02:10.993 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:02:41.216 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:02:41.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:03:11.403 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:03:11.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:03:41.584 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:03:41.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:04:11.807 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:04:11.817 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:04:42.011 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:04:42.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:05:12.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:05:12.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:05:42.372 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:05:42.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:06:12.585 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:06:12.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:06:42.745 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:06:42.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:07:12.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:07:12.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:07:43.085 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:07:43.096 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:08:13.211 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:08:13.221 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:08:43.437 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:08:43.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:09:13.642 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:09:13.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:09:43.856 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:09:43.869 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:10:14.003 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:10:14.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:10:44.225 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:10:44.235 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:11:14.438 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:11:14.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:11:44.660 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:11:44.671 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:12:14.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:12:14.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:12:45.037 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:12:45.047 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:13:15.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:13:15.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:13:45.407 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:13:45.417 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:14:15.583 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:14:15.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:14:45.792 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:14:45.803 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:15:15.981 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:15:15.991 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:15:46.204 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:15:46.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:16:16.358 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:16:16.368 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:16:46.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:16:46.591 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:17:16.719 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:17:16.729 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:17:46.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:17:46.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:18:17.140 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:18:17.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:18:47.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:18:47.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:19:17.554 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:19:17.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:19:47.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:19:47.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:20:17.983 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:20:17.993 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:20:48.166 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:20:48.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:21:18.396 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:21:18.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:21:48.542 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:21:48.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:22:18.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:22:18.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:22:48.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:22:48.953 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:23:19.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:23:19.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:23:49.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:23:49.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:24:19.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:24:19.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:24:49.809 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:24:49.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:25:20.015 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:25:20.025 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:25:50.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:25:50.189 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:26:20.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:26:20.562 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:26:50.741 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:26:50.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:27:20.946 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:27:20.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:27:51.152 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:27:51.162 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:28:21.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:28:21.346 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:28:51.509 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:28:51.520 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:29:21.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:29:21.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:29:51.937 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:29:51.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:30:22.135 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:30:22.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:30:52.340 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:30:52.349 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:31:22.494 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:31:22.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:31:52.733 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:31:52.743 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:32:22.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:32:22.881 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:32:53.095 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:32:53.105 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:33:23.234 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:33:23.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:33:53.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:33:53.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:34:23.644 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:34:23.655 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:34:53.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:34:53.850 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:35:24.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:35:24.072 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:35:54.233 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:35:54.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:36:24.456 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:36:24.466 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:36:54.593 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:36:54.603 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:37:24.898 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:37:24.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:37:55.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:37:55.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:38:25.268 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:38:25.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:38:55.507 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:38:55.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:39:25.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:39:25.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:39:55.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:39:55.954 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:40:26.165 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:40:26.174 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:40:56.377 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:40:56.387 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:41:26.692 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:41:26.702 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:41:56.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:41:56.850 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:42:26.998 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:42:27.008 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:42:57.191 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:42:57.200 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:43:27.355 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:43:27.369 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:43:57.519 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:43:57.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:44:27.773 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:44:27.784 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:44:57.954 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:44:57.964 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:45:28.142 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:45:28.153 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:45:58.357 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:45:58.369 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:46:28.612 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:46:28.622 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:46:58.765 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:46:58.775 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:47:28.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:47:28.973 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:47:59.107 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:47:59.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:48:29.275 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:48:29.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:48:59.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:48:59.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:49:29.753 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:49:29.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:49:59.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:49:59.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:50:30.128 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:50:30.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:51:00.335 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:51:00.345 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:51:30.542 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:51:30.552 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:52:00.736 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:52:00.746 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:52:30.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:52:30.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:53:01.166 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:53:01.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:53:31.380 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:53:31.390 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:54:01.611 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:54:01.621 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:54:31.771 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:54:31.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:55:01.972 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:55:01.985 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:55:32.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:55:32.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:56:02.314 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:56:02.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:56:32.469 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:56:32.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:57:02.698 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:57:02.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:57:32.848 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:57:32.859 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:58:02.986 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:58:02.996 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:58:33.168 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:58:33.178 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:59:03.348 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:59:03.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:59:33.528 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T19:59:33.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:00:03.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:00:03.753 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:00:33.975 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:00:33.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:01:04.338 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:01:04.349 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:01:34.494 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:01:34.505 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:02:04.659 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:02:04.671 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:02:34.803 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:02:34.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:03:05.027 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:03:05.038 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:03:35.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:03:35.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:04:05.464 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:04:05.489 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:04:35.651 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:04:35.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:05:05.874 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:05:05.884 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:05:36.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:05:36.074 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:06:06.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:06:06.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:06:36.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:06:36.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:07:06.756 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:07:06.766 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:07:36.900 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:07:36.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:08:07.106 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:08:07.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:08:37.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:08:37.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:09:07.492 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:09:07.502 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:09:37.715 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:09:37.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:10:07.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:10:07.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:10:38.076 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:10:38.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:11:08.280 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:11:08.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:11:38.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:11:38.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:12:08.653 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:12:08.663 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:12:38.805 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:12:38.815 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:13:09.002 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:13:09.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:13:39.224 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:13:39.233 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:14:09.488 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:14:09.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:14:39.677 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:14:39.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:15:09.814 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:15:09.824 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:15:39.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:15:40.007 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:16:10.209 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:16:10.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:16:40.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:16:40.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:17:10.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:17:10.574 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:17:40.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:17:40.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:18:11.039 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:18:11.050 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:18:41.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:18:41.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:19:11.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:19:11.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:19:41.639 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:19:41.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:20:11.836 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:20:11.846 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:20:41.982 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:20:41.992 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:21:12.140 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:21:12.150 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:21:42.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:21:42.297 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:22:12.432 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:22:12.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:22:42.639 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:22:42.651 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:23:12.794 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:23:12.804 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:23:42.975 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:23:42.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:24:13.165 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:24:13.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:24:43.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:24:43.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:25:13.449 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:25:13.460 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:25:43.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:25:43.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:26:13.810 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:26:13.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:26:44.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:26:44.035 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:27:14.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:27:14.174 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:27:44.369 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:27:44.379 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:28:14.575 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:28:14.586 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:28:44.780 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:28:44.791 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:29:15.003 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:29:15.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:29:45.174 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:29:45.185 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:30:15.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:30:15.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:30:45.593 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:30:45.604 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:31:15.749 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:31:15.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:31:45.904 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:31:45.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:32:16.043 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:32:16.053 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:32:46.181 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:32:46.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:33:16.388 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:33:16.399 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:33:46.543 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:33:46.553 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:34:16.746 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:34:16.756 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:34:46.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:34:46.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:35:17.156 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:35:17.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:35:47.332 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:35:47.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:36:17.537 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:36:17.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:36:47.709 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:36:47.719 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:37:17.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:37:17.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:37:48.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:37:48.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:38:18.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:38:18.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:38:48.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:38:48.408 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:39:18.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:39:18.614 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:39:48.785 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:39:48.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:40:18.964 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:40:18.974 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:40:49.187 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:40:49.197 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:41:19.375 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:41:19.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:41:49.564 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:41:49.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:42:19.780 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:42:19.791 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:42:49.973 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:42:49.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:43:20.165 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:43:20.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:43:50.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:43:50.394 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:44:20.513 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:44:20.525 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:44:50.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:44:50.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:45:20.994 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:45:21.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:45:51.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:45:51.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:46:21.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:46:21.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:46:51.567 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:46:51.577 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:47:21.764 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:47:21.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:47:51.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:47:52.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:48:22.192 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:48:22.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:48:52.381 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:48:52.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:49:22.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:49:22.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:49:52.794 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:49:52.803 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:50:22.967 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:50:22.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:50:53.139 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:50:53.148 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:51:23.345 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:51:23.356 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:51:53.551 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:51:53.561 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:52:23.759 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:52:23.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:52:53.972 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:52:53.982 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:53:24.186 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:53:24.196 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:53:54.327 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:53:54.336 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:54:24.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:54:24.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:54:54.706 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:54:54.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:55:24.936 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:55:24.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:55:55.074 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:55:55.084 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:56:25.238 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:56:25.248 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:56:55.377 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:56:55.388 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:57:25.609 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:57:25.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:57:55.814 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:57:55.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T20:58:04.291 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-12-22T20:58:04.292 DEBUG:teuthology.task.console_log:Killing console logger for smithi106 2023-12-22T20:58:04.292 DEBUG:teuthology.task.console_log:Killing console logger for smithi132 2023-12-22T20:58:04.292 DEBUG:teuthology.exit:Finished running handlers